2026-02-12T03:42:46.356 INFO:root:teuthology version: 0.0.1.dev31+g5f66ecfb3 2026-02-12T03:42:46.372 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T03:42:46.451 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/yuriw-2026-02-11_20:27:55-rados-wip-yuri3-testing-2026-02-09-1550-tentacle-distro-default-trial/45766 branch: wip-yuri3-testing-2026-02-09-1550-tentacle description: rados/verify/{centos_latest ceph clusters/fixed-4 d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/{bluestore/{alloc$/{btree} base mem$/{normal-2} onode-segment$/{512K} write$/{v2/{compr$/{yes$/{zstd}} v2}}}} rados read-affinity/balance tasks/rados_api_tests validater/valgrind} email: null first_in_suite: false flavor: default job_id: '45766' kernel: branch: distro kdb: true sha1: distro last_in_suite: false machine_type: trial name: yuriw-2026-02-11_20:27:55-rados-wip-yuri3-testing-2026-02-09-1550-tentacle-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuri3-testing-2026-02-09-1550-tentacle ceph: conf: client: debug monc: 20 debug ms: 1 debug objecter: 20 debug rados: 20 rados replica read policy: balance global: mon client directed command retry: 5 mon election default strategy: 3 ms bind msgr2: false ms inject socket failures: 5000 ms type: async osd heartbeat grace: 160 osd op thread timeout: 150 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osd crush smoke test: false mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub interval: 300 mon warn on pool no app: false paxos service trim min: 10 osd: bdev async discard: true bdev enable discard: true bluestore allocator: btree bluestore block size: 96636764160 bluestore compression algorithm: zstd bluestore compression mode: aggressive bluestore fsck on mount: true bluestore onode segment size: 512K bluestore write v2: true bluestore zero block detection: true crush location: root=default host=host-$id debug bluefs: 1 debug bluestore: 1 debug monc: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd class default list: '*' osd class load list: '*' osd client watch timeout: 240 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd fast shutdown: false osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd mclock skip benchmark: true osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd shutdown pgref assert: true osd_mclock_skip_benchmark: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - reached quota - overall HEALTH_ - \(CACHE_POOL_NO_HIT_SET\) - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(SLOW_OPS\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(OBJECT_MISPLACED\) - slow request - overall HEALTH_ - \(PG_ - \(MON_DOWN\) - \(SLOW_OPS\) - slow request - OSD bench result - OSD_DOWN mon_bind_msgr2: false sha1: 1279775fef08a9169052c6dd6a10581353958aac stop-daemons-timeout: 1200 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes osd: - --tool=memcheck ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: debuginfo: true flavor: default sha1: 1279775fef08a9169052c6dd6a10581353958aac thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri3-testing-2026-02-09-1550-tentacle sha1: 1279775fef08a9169052c6dd6a10581353958aac owner: scheduled_yuriw@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - osd.0 - osd.4 - osd.8 - osd.12 - - mon.b - osd.1 - osd.5 - osd.9 - osd.13 - - mon.c - osd.2 - osd.6 - osd.10 - osd.14 - - mgr.x - osd.3 - osd.7 - osd.11 - osd.15 - client.0 seed: 4009 sha1: 1279775fef08a9169052c6dd6a10581353958aac sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri3-testing-2026-02-09-1550-tentacle suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_1279775fef08a9169052c6dd6a10581353958aac/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 1279775fef08a9169052c6dd6a10581353958aac targets: trial091.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLgUfVVo9sP7RVf5FrYm/RRiYSgEP4u6f2YjsPczL/voAxcN0Ki/NliLSPXX4uOEn3mJzKKLuACooNvbhRd4rVU= trial098.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH/ZGNxGm4YVb5NKwcPoCfFuMQD5Uzd3a38gWjg4pdALOpieHEk1t6PFqRS30hITPgL7gShmdVuOpeoF/1SRJ2w= trial111.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA1l48SOmf1PdrNOMICCcHGTZhexXRe/LPTckaIJGJzsHjjgweQ0HaCe59rLxJCgtEjP8zOIBa2Ax/ha2ypcP4s= trial154.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGeW/kQYhKmapBRxoUDFP7L7B90We5Dkac4dnhUkXEOtzMV1uzfc+vIV3ekGf43ekJHr+R3Zq9LYZl2W6W8n5bw= tasks: - install: null - ceph: null - workunit: clients: client.0: - rados/test.sh env: ALLOW_TIMEOUTS: '1' timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - '-- Don''t run this test on tiny clusters if py_len(yaml.roles) < 4 then reject() end ' teuthology_branch: reimage-ssh-down teuthology_sha1: 5f66ecfb34c0370410e78b3ee641753d19da653b timestamp: 2026-02-11_20:27:55 tube: trial user: yuriw verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.2161924 2026-02-12T03:42:46.451 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_1279775fef08a9169052c6dd6a10581353958aac/qa; will attempt to use it 2026-02-12T03:42:46.451 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_1279775fef08a9169052c6dd6a10581353958aac/qa/tasks 2026-02-12T03:42:46.451 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-12T03:42:46.453 INFO:teuthology.task.internal:Checking packages... 2026-02-12T03:42:46.453 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1279775fef08a9169052c6dd6a10581353958aac' 2026-02-12T03:42:46.453 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-12T03:42:46.453 INFO:teuthology.packaging:ref: None 2026-02-12T03:42:46.453 INFO:teuthology.packaging:tag: None 2026-02-12T03:42:46.453 INFO:teuthology.packaging:branch: wip-yuri3-testing-2026-02-09-1550-tentacle 2026-02-12T03:42:46.453 INFO:teuthology.packaging:sha1: 1279775fef08a9169052c6dd6a10581353958aac 2026-02-12T03:42:46.453 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuri3-testing-2026-02-09-1550-tentacle 2026-02-12T03:42:46.583 INFO:teuthology.task.internal:Found packages for ceph version 20.2.0-626.g1279775f 2026-02-12T03:42:46.584 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-12T03:42:46.596 INFO:teuthology.task.internal:no buildpackages task found 2026-02-12T03:42:46.596 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-12T03:42:46.609 INFO:teuthology.task.internal:Saving configuration 2026-02-12T03:42:46.624 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-12T03:42:46.636 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-12T03:42:46.716 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial091.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-11_20:27:55-rados-wip-yuri3-testing-2026-02-09-1550-tentacle-distro-default-trial/45766', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 03:39:24.966109', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLgUfVVo9sP7RVf5FrYm/RRiYSgEP4u6f2YjsPczL/voAxcN0Ki/NliLSPXX4uOEn3mJzKKLuACooNvbhRd4rVU='} 2026-02-12T03:42:46.771 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial098.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-11_20:27:55-rados-wip-yuri3-testing-2026-02-09-1550-tentacle-distro-default-trial/45766', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 03:39:24.967070', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH/ZGNxGm4YVb5NKwcPoCfFuMQD5Uzd3a38gWjg4pdALOpieHEk1t6PFqRS30hITPgL7gShmdVuOpeoF/1SRJ2w='} 2026-02-12T03:42:46.827 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial111.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-11_20:27:55-rados-wip-yuri3-testing-2026-02-09-1550-tentacle-distro-default-trial/45766', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 03:39:24.967405', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA1l48SOmf1PdrNOMICCcHGTZhexXRe/LPTckaIJGJzsHjjgweQ0HaCe59rLxJCgtEjP8zOIBa2Ax/ha2ypcP4s='} 2026-02-12T03:42:46.882 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial154.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-11_20:27:55-rados-wip-yuri3-testing-2026-02-09-1550-tentacle-distro-default-trial/45766', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 03:39:24.966712', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGeW/kQYhKmapBRxoUDFP7L7B90We5Dkac4dnhUkXEOtzMV1uzfc+vIV3ekGf43ekJHr+R3Zq9LYZl2W6W8n5bw='} 2026-02-12T03:42:46.882 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-12T03:42:46.893 INFO:teuthology.task.internal:roles: ubuntu@trial091.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'] 2026-02-12T03:42:46.893 INFO:teuthology.task.internal:roles: ubuntu@trial098.front.sepia.ceph.com - ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'] 2026-02-12T03:42:46.893 INFO:teuthology.task.internal:roles: ubuntu@trial111.front.sepia.ceph.com - ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'] 2026-02-12T03:42:46.893 INFO:teuthology.task.internal:roles: ubuntu@trial154.front.sepia.ceph.com - ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0'] 2026-02-12T03:42:46.893 INFO:teuthology.run_tasks:Running task console_log... 2026-02-12T03:42:47.139 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa988cf39c0>, signals=[15]) 2026-02-12T03:42:47.139 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-12T03:42:47.150 INFO:teuthology.task.internal:Opening connections... 2026-02-12T03:42:47.150 DEBUG:teuthology.task.internal:connecting to ubuntu@trial091.front.sepia.ceph.com 2026-02-12T03:42:47.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T03:42:47.213 DEBUG:teuthology.task.internal:connecting to ubuntu@trial098.front.sepia.ceph.com 2026-02-12T03:42:47.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T03:42:47.275 DEBUG:teuthology.task.internal:connecting to ubuntu@trial111.front.sepia.ceph.com 2026-02-12T03:42:47.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T03:42:47.333 DEBUG:teuthology.task.internal:connecting to ubuntu@trial154.front.sepia.ceph.com 2026-02-12T03:42:47.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T03:42:47.393 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-12T03:42:47.406 DEBUG:teuthology.orchestra.run.trial091:> uname -m 2026-02-12T03:42:47.421 INFO:teuthology.orchestra.run.trial091.stdout:x86_64 2026-02-12T03:42:47.421 DEBUG:teuthology.orchestra.run.trial091:> cat /etc/os-release 2026-02-12T03:42:47.476 INFO:teuthology.orchestra.run.trial091.stdout:NAME="CentOS Stream" 2026-02-12T03:42:47.476 INFO:teuthology.orchestra.run.trial091.stdout:VERSION="9" 2026-02-12T03:42:47.476 INFO:teuthology.orchestra.run.trial091.stdout:ID="centos" 2026-02-12T03:42:47.476 INFO:teuthology.orchestra.run.trial091.stdout:ID_LIKE="rhel fedora" 2026-02-12T03:42:47.476 INFO:teuthology.orchestra.run.trial091.stdout:VERSION_ID="9" 2026-02-12T03:42:47.476 INFO:teuthology.orchestra.run.trial091.stdout:PLATFORM_ID="platform:el9" 2026-02-12T03:42:47.476 INFO:teuthology.orchestra.run.trial091.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T03:42:47.476 INFO:teuthology.orchestra.run.trial091.stdout:ANSI_COLOR="0;31" 2026-02-12T03:42:47.476 INFO:teuthology.orchestra.run.trial091.stdout:LOGO="fedora-logo-icon" 2026-02-12T03:42:47.476 INFO:teuthology.orchestra.run.trial091.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T03:42:47.476 INFO:teuthology.orchestra.run.trial091.stdout:HOME_URL="https://centos.org/" 2026-02-12T03:42:47.476 INFO:teuthology.orchestra.run.trial091.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T03:42:47.476 INFO:teuthology.orchestra.run.trial091.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T03:42:47.476 INFO:teuthology.orchestra.run.trial091.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T03:42:47.477 INFO:teuthology.lock.ops:Updating trial091.front.sepia.ceph.com on lock server 2026-02-12T03:42:47.546 DEBUG:teuthology.orchestra.run.trial098:> uname -m 2026-02-12T03:42:47.561 INFO:teuthology.orchestra.run.trial098.stdout:x86_64 2026-02-12T03:42:47.561 DEBUG:teuthology.orchestra.run.trial098:> cat /etc/os-release 2026-02-12T03:42:47.618 INFO:teuthology.orchestra.run.trial098.stdout:NAME="CentOS Stream" 2026-02-12T03:42:47.618 INFO:teuthology.orchestra.run.trial098.stdout:VERSION="9" 2026-02-12T03:42:47.618 INFO:teuthology.orchestra.run.trial098.stdout:ID="centos" 2026-02-12T03:42:47.618 INFO:teuthology.orchestra.run.trial098.stdout:ID_LIKE="rhel fedora" 2026-02-12T03:42:47.618 INFO:teuthology.orchestra.run.trial098.stdout:VERSION_ID="9" 2026-02-12T03:42:47.618 INFO:teuthology.orchestra.run.trial098.stdout:PLATFORM_ID="platform:el9" 2026-02-12T03:42:47.618 INFO:teuthology.orchestra.run.trial098.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T03:42:47.618 INFO:teuthology.orchestra.run.trial098.stdout:ANSI_COLOR="0;31" 2026-02-12T03:42:47.618 INFO:teuthology.orchestra.run.trial098.stdout:LOGO="fedora-logo-icon" 2026-02-12T03:42:47.618 INFO:teuthology.orchestra.run.trial098.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T03:42:47.618 INFO:teuthology.orchestra.run.trial098.stdout:HOME_URL="https://centos.org/" 2026-02-12T03:42:47.618 INFO:teuthology.orchestra.run.trial098.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T03:42:47.618 INFO:teuthology.orchestra.run.trial098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T03:42:47.619 INFO:teuthology.orchestra.run.trial098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T03:42:47.619 INFO:teuthology.lock.ops:Updating trial098.front.sepia.ceph.com on lock server 2026-02-12T03:42:47.697 DEBUG:teuthology.orchestra.run.trial111:> uname -m 2026-02-12T03:42:47.712 INFO:teuthology.orchestra.run.trial111.stdout:x86_64 2026-02-12T03:42:47.712 DEBUG:teuthology.orchestra.run.trial111:> cat /etc/os-release 2026-02-12T03:42:47.767 INFO:teuthology.orchestra.run.trial111.stdout:NAME="CentOS Stream" 2026-02-12T03:42:47.768 INFO:teuthology.orchestra.run.trial111.stdout:VERSION="9" 2026-02-12T03:42:47.768 INFO:teuthology.orchestra.run.trial111.stdout:ID="centos" 2026-02-12T03:42:47.768 INFO:teuthology.orchestra.run.trial111.stdout:ID_LIKE="rhel fedora" 2026-02-12T03:42:47.768 INFO:teuthology.orchestra.run.trial111.stdout:VERSION_ID="9" 2026-02-12T03:42:47.768 INFO:teuthology.orchestra.run.trial111.stdout:PLATFORM_ID="platform:el9" 2026-02-12T03:42:47.768 INFO:teuthology.orchestra.run.trial111.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T03:42:47.768 INFO:teuthology.orchestra.run.trial111.stdout:ANSI_COLOR="0;31" 2026-02-12T03:42:47.768 INFO:teuthology.orchestra.run.trial111.stdout:LOGO="fedora-logo-icon" 2026-02-12T03:42:47.768 INFO:teuthology.orchestra.run.trial111.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T03:42:47.768 INFO:teuthology.orchestra.run.trial111.stdout:HOME_URL="https://centos.org/" 2026-02-12T03:42:47.768 INFO:teuthology.orchestra.run.trial111.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T03:42:47.768 INFO:teuthology.orchestra.run.trial111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T03:42:47.768 INFO:teuthology.orchestra.run.trial111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T03:42:47.769 INFO:teuthology.lock.ops:Updating trial111.front.sepia.ceph.com on lock server 2026-02-12T03:42:47.853 DEBUG:teuthology.orchestra.run.trial154:> uname -m 2026-02-12T03:42:47.868 INFO:teuthology.orchestra.run.trial154.stdout:x86_64 2026-02-12T03:42:47.868 DEBUG:teuthology.orchestra.run.trial154:> cat /etc/os-release 2026-02-12T03:42:47.924 INFO:teuthology.orchestra.run.trial154.stdout:NAME="CentOS Stream" 2026-02-12T03:42:47.924 INFO:teuthology.orchestra.run.trial154.stdout:VERSION="9" 2026-02-12T03:42:47.924 INFO:teuthology.orchestra.run.trial154.stdout:ID="centos" 2026-02-12T03:42:47.924 INFO:teuthology.orchestra.run.trial154.stdout:ID_LIKE="rhel fedora" 2026-02-12T03:42:47.924 INFO:teuthology.orchestra.run.trial154.stdout:VERSION_ID="9" 2026-02-12T03:42:47.924 INFO:teuthology.orchestra.run.trial154.stdout:PLATFORM_ID="platform:el9" 2026-02-12T03:42:47.924 INFO:teuthology.orchestra.run.trial154.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T03:42:47.924 INFO:teuthology.orchestra.run.trial154.stdout:ANSI_COLOR="0;31" 2026-02-12T03:42:47.925 INFO:teuthology.orchestra.run.trial154.stdout:LOGO="fedora-logo-icon" 2026-02-12T03:42:47.925 INFO:teuthology.orchestra.run.trial154.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T03:42:47.925 INFO:teuthology.orchestra.run.trial154.stdout:HOME_URL="https://centos.org/" 2026-02-12T03:42:47.925 INFO:teuthology.orchestra.run.trial154.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T03:42:47.925 INFO:teuthology.orchestra.run.trial154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T03:42:47.925 INFO:teuthology.orchestra.run.trial154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T03:42:47.925 INFO:teuthology.lock.ops:Updating trial154.front.sepia.ceph.com on lock server 2026-02-12T03:42:48.010 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-12T03:42:48.023 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-12T03:42:48.035 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-12T03:42:48.035 DEBUG:teuthology.orchestra.run.trial091:> test '!' -e /home/ubuntu/cephtest 2026-02-12T03:42:48.036 DEBUG:teuthology.orchestra.run.trial098:> test '!' -e /home/ubuntu/cephtest 2026-02-12T03:42:48.038 DEBUG:teuthology.orchestra.run.trial111:> test '!' -e /home/ubuntu/cephtest 2026-02-12T03:42:48.040 DEBUG:teuthology.orchestra.run.trial154:> test '!' -e /home/ubuntu/cephtest 2026-02-12T03:42:48.054 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-12T03:42:48.066 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-12T03:42:48.066 DEBUG:teuthology.orchestra.run.trial091:> test -z $(ls -A /var/lib/ceph) 2026-02-12T03:42:48.091 DEBUG:teuthology.orchestra.run.trial098:> test -z $(ls -A /var/lib/ceph) 2026-02-12T03:42:48.093 DEBUG:teuthology.orchestra.run.trial111:> test -z $(ls -A /var/lib/ceph) 2026-02-12T03:42:48.095 DEBUG:teuthology.orchestra.run.trial154:> test -z $(ls -A /var/lib/ceph) 2026-02-12T03:42:48.112 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-12T03:42:48.390 INFO:teuthology.run_tasks:Running task kernel... 2026-02-12T03:42:48.409 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-12T03:42:48.409 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'mon.b': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'mon.c': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-12T03:42:48.410 DEBUG:teuthology.orchestra.run.trial091:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T03:42:48.410 DEBUG:teuthology.orchestra.run.trial098:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T03:42:48.410 DEBUG:teuthology.orchestra.run.trial111:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T03:42:48.410 DEBUG:teuthology.orchestra.run.trial154:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T03:42:48.425 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T03:42:48.425 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T03:42:48.425 DEBUG:teuthology.orchestra.run.trial098:> uname -r 2026-02-12T03:42:48.425 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T03:42:48.425 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T03:42:48.425 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T03:42:48.426 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T03:42:48.426 DEBUG:teuthology.orchestra.run.trial091:> uname -r 2026-02-12T03:42:48.480 INFO:teuthology.orchestra.run.trial091.stdout:5.14.0-645.el9.x86_64 2026-02-12T03:42:48.480 INFO:teuthology.task.kernel:Running kernel on trial091: 5.14.0-645.el9.x86_64 2026-02-12T03:42:48.481 DEBUG:teuthology.orchestra.run.trial091:> sudo yum install -y kernel 2026-02-12T03:42:48.481 INFO:teuthology.orchestra.run.trial111.stdout:5.14.0-645.el9.x86_64 2026-02-12T03:42:48.481 INFO:teuthology.orchestra.run.trial154.stdout:5.14.0-645.el9.x86_64 2026-02-12T03:42:48.481 INFO:teuthology.task.kernel:Running kernel on trial111: 5.14.0-645.el9.x86_64 2026-02-12T03:42:48.481 DEBUG:teuthology.orchestra.run.trial111:> sudo yum install -y kernel 2026-02-12T03:42:48.481 INFO:teuthology.task.kernel:Running kernel on trial154: 5.14.0-645.el9.x86_64 2026-02-12T03:42:48.481 DEBUG:teuthology.orchestra.run.trial154:> sudo yum install -y kernel 2026-02-12T03:42:48.482 INFO:teuthology.orchestra.run.trial098.stdout:5.14.0-645.el9.x86_64 2026-02-12T03:42:48.482 INFO:teuthology.task.kernel:Running kernel on trial098: 5.14.0-645.el9.x86_64 2026-02-12T03:42:48.482 DEBUG:teuthology.orchestra.run.trial098:> sudo yum install -y kernel 2026-02-12T03:42:49.554 INFO:teuthology.orchestra.run.trial098.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-12T03:42:49.713 INFO:teuthology.orchestra.run.trial111.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.9 MB 00:00 2026-02-12T03:42:52.474 INFO:teuthology.orchestra.run.trial154.stdout:CentOS Stream 9 - BaseOS 2.4 MB/s | 8.9 MB 00:03 2026-02-12T03:42:52.659 INFO:teuthology.orchestra.run.trial091.stdout:CentOS Stream 9 - BaseOS 2.3 MB/s | 8.9 MB 00:03 2026-02-12T03:42:52.946 INFO:teuthology.orchestra.run.trial111.stdout:CentOS Stream 9 - AppStream 9.9 MB/s | 27 MB 00:02 2026-02-12T03:42:55.010 INFO:teuthology.orchestra.run.trial098.stdout:CentOS Stream 9 - AppStream 5.4 MB/s | 27 MB 00:04 2026-02-12T03:42:55.978 INFO:teuthology.orchestra.run.trial154.stdout:CentOS Stream 9 - AppStream 9.0 MB/s | 27 MB 00:02 2026-02-12T03:42:56.426 INFO:teuthology.orchestra.run.trial091.stdout:CentOS Stream 9 - AppStream 8.3 MB/s | 27 MB 00:03 2026-02-12T03:42:58.425 INFO:teuthology.orchestra.run.trial111.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 7.8 MB 00:03 2026-02-12T03:42:59.264 INFO:teuthology.orchestra.run.trial154.stdout:CentOS Stream 9 - CRB 8.4 MB/s | 7.8 MB 00:00 2026-02-12T03:42:59.999 INFO:teuthology.orchestra.run.trial111.stdout:CentOS Stream 9 - Extras packages 23 kB/s | 20 kB 00:00 2026-02-12T03:43:00.076 INFO:teuthology.orchestra.run.trial154.stdout:CentOS Stream 9 - Extras packages 190 kB/s | 20 kB 00:00 2026-02-12T03:43:00.322 INFO:teuthology.orchestra.run.trial098.stdout:CentOS Stream 9 - CRB 2.7 MB/s | 7.8 MB 00:02 2026-02-12T03:43:00.467 INFO:teuthology.orchestra.run.trial111.stdout:Extra Packages for Enterprise Linux 52 MB/s | 20 MB 00:00 2026-02-12T03:43:01.268 INFO:teuthology.orchestra.run.trial154.stdout:Extra Packages for Enterprise Linux 18 MB/s | 20 MB 00:01 2026-02-12T03:43:01.887 INFO:teuthology.orchestra.run.trial098.stdout:CentOS Stream 9 - Extras packages 24 kB/s | 20 kB 00:00 2026-02-12T03:43:02.498 INFO:teuthology.orchestra.run.trial098.stdout:Extra Packages for Enterprise Linux 38 MB/s | 20 MB 00:00 2026-02-12T03:43:03.644 INFO:teuthology.orchestra.run.trial111.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-12T03:43:04.505 INFO:teuthology.orchestra.run.trial154.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-12T03:43:04.708 INFO:teuthology.orchestra.run.trial111.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-12T03:43:04.728 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:43:04.729 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:43:04.729 INFO:teuthology.orchestra.run.trial111.stdout: Package Architecture Version Repository Size 2026-02-12T03:43:04.729 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:43:04.729 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T03:43:04.730 INFO:teuthology.orchestra.run.trial111.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-12T03:43:04.730 INFO:teuthology.orchestra.run.trial111.stdout:Installing dependencies: 2026-02-12T03:43:04.730 INFO:teuthology.orchestra.run.trial111.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-12T03:43:04.730 INFO:teuthology.orchestra.run.trial111.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-12T03:43:04.730 INFO:teuthology.orchestra.run.trial111.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-12T03:43:04.730 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:43:04.730 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T03:43:04.730 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:43:04.730 INFO:teuthology.orchestra.run.trial111.stdout:Install 4 Packages 2026-02-12T03:43:04.730 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:43:04.730 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 88 M 2026-02-12T03:43:04.731 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 135 M 2026-02-12T03:43:04.731 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T03:43:05.569 INFO:teuthology.orchestra.run.trial154.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-12T03:43:05.589 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:43:05.591 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:43:05.591 INFO:teuthology.orchestra.run.trial154.stdout: Package Architecture Version Repository Size 2026-02-12T03:43:05.591 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:43:05.591 INFO:teuthology.orchestra.run.trial154.stdout:Installing: 2026-02-12T03:43:05.591 INFO:teuthology.orchestra.run.trial154.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-12T03:43:05.591 INFO:teuthology.orchestra.run.trial154.stdout:Installing dependencies: 2026-02-12T03:43:05.592 INFO:teuthology.orchestra.run.trial154.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-12T03:43:05.592 INFO:teuthology.orchestra.run.trial154.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-12T03:43:05.592 INFO:teuthology.orchestra.run.trial154.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-12T03:43:05.592 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:43:05.592 INFO:teuthology.orchestra.run.trial154.stdout:Transaction Summary 2026-02-12T03:43:05.592 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:43:05.592 INFO:teuthology.orchestra.run.trial154.stdout:Install 4 Packages 2026-02-12T03:43:05.592 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:43:05.592 INFO:teuthology.orchestra.run.trial154.stdout:Total download size: 88 M 2026-02-12T03:43:05.592 INFO:teuthology.orchestra.run.trial154.stdout:Installed size: 135 M 2026-02-12T03:43:05.593 INFO:teuthology.orchestra.run.trial154.stdout:Downloading Packages: 2026-02-12T03:43:05.689 INFO:teuthology.orchestra.run.trial111.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 1.0 MB/s | 768 kB 00:00 2026-02-12T03:43:05.758 INFO:teuthology.orchestra.run.trial098.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-12T03:43:06.819 INFO:teuthology.orchestra.run.trial098.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-12T03:43:06.839 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:43:06.840 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:43:06.840 INFO:teuthology.orchestra.run.trial098.stdout: Package Architecture Version Repository Size 2026-02-12T03:43:06.840 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:43:06.840 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-12T03:43:06.840 INFO:teuthology.orchestra.run.trial098.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-12T03:43:06.840 INFO:teuthology.orchestra.run.trial098.stdout:Installing dependencies: 2026-02-12T03:43:06.840 INFO:teuthology.orchestra.run.trial098.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-12T03:43:06.840 INFO:teuthology.orchestra.run.trial098.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-12T03:43:06.840 INFO:teuthology.orchestra.run.trial098.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-12T03:43:06.841 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:43:06.841 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-12T03:43:06.841 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:43:06.841 INFO:teuthology.orchestra.run.trial098.stdout:Install 4 Packages 2026-02-12T03:43:06.841 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:43:06.841 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 88 M 2026-02-12T03:43:06.841 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 135 M 2026-02-12T03:43:06.841 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-12T03:43:06.889 INFO:teuthology.orchestra.run.trial111.stdout:(2/4): kernel-core-5.14.0-677.el9.x86_64.rpm 8.9 MB/s | 17 MB 00:01 2026-02-12T03:43:06.896 INFO:teuthology.orchestra.run.trial154.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 631 kB/s | 768 kB 00:01 2026-02-12T03:43:07.273 INFO:teuthology.orchestra.run.trial098.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 5.8 MB/s | 768 kB 00:00 2026-02-12T03:43:07.418 INFO:teuthology.orchestra.run.trial098.stdout:(2/4): kernel-core-5.14.0-677.el9.x86_64.rpm 62 MB/s | 17 MB 00:00 2026-02-12T03:43:07.544 INFO:teuthology.orchestra.run.trial091.stdout:CentOS Stream 9 - CRB 910 kB/s | 7.8 MB 00:08 2026-02-12T03:43:07.569 INFO:teuthology.orchestra.run.trial098.stdout:(3/4): kernel-modules-core-5.14.0-677.el9.x86_6 104 MB/s | 31 MB 00:00 2026-02-12T03:43:07.820 INFO:teuthology.orchestra.run.trial111.stdout:(3/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 14 MB/s | 40 MB 00:02 2026-02-12T03:43:07.873 INFO:teuthology.orchestra.run.trial098.stdout:(4/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 54 MB/s | 40 MB 00:00 2026-02-12T03:43:07.873 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:43:07.874 INFO:teuthology.orchestra.run.trial098.stdout:Total 85 MB/s | 88 MB 00:01 2026-02-12T03:43:08.063 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-12T03:43:08.105 INFO:teuthology.orchestra.run.trial111.stdout:(4/4): kernel-modules-core-5.14.0-677.el9.x86_6 13 MB/s | 31 MB 00:02 2026-02-12T03:43:08.105 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:43:08.105 INFO:teuthology.orchestra.run.trial111.stdout:Total 26 MB/s | 88 MB 00:03 2026-02-12T03:43:08.265 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-12T03:43:08.265 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-12T03:43:08.297 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T03:43:08.506 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T03:43:08.506 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T03:43:08.609 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-12T03:43:08.610 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-12T03:43:08.852 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T03:43:08.852 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T03:43:09.300 INFO:teuthology.orchestra.run.trial091.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 20 kB 00:01 2026-02-12T03:43:09.700 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-12T03:43:09.944 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T03:43:09.985 INFO:teuthology.orchestra.run.trial098.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-12T03:43:10.005 INFO:teuthology.orchestra.run.trial098.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T03:43:10.146 INFO:teuthology.orchestra.run.trial091.stdout:Extra Packages for Enterprise Linux 26 MB/s | 20 MB 00:00 2026-02-12T03:43:10.229 INFO:teuthology.orchestra.run.trial111.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-12T03:43:10.248 INFO:teuthology.orchestra.run.trial111.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T03:43:11.778 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T03:43:11.808 INFO:teuthology.orchestra.run.trial098.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T03:43:12.009 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T03:43:12.038 INFO:teuthology.orchestra.run.trial111.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T03:43:13.309 INFO:teuthology.orchestra.run.trial091.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-12T03:43:14.378 INFO:teuthology.orchestra.run.trial091.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-12T03:43:14.397 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:43:14.398 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:43:14.399 INFO:teuthology.orchestra.run.trial091.stdout: Package Architecture Version Repository Size 2026-02-12T03:43:14.399 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:43:14.399 INFO:teuthology.orchestra.run.trial091.stdout:Installing: 2026-02-12T03:43:14.399 INFO:teuthology.orchestra.run.trial091.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-12T03:43:14.399 INFO:teuthology.orchestra.run.trial091.stdout:Installing dependencies: 2026-02-12T03:43:14.399 INFO:teuthology.orchestra.run.trial091.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-12T03:43:14.399 INFO:teuthology.orchestra.run.trial091.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-12T03:43:14.399 INFO:teuthology.orchestra.run.trial091.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-12T03:43:14.399 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:43:14.399 INFO:teuthology.orchestra.run.trial091.stdout:Transaction Summary 2026-02-12T03:43:14.399 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:43:14.400 INFO:teuthology.orchestra.run.trial091.stdout:Install 4 Packages 2026-02-12T03:43:14.400 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:43:14.400 INFO:teuthology.orchestra.run.trial091.stdout:Total download size: 88 M 2026-02-12T03:43:14.400 INFO:teuthology.orchestra.run.trial091.stdout:Installed size: 135 M 2026-02-12T03:43:14.400 INFO:teuthology.orchestra.run.trial091.stdout:Downloading Packages: 2026-02-12T03:43:14.711 INFO:teuthology.orchestra.run.trial091.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 11 MB/s | 768 kB 00:00 2026-02-12T03:43:14.830 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T03:43:14.837 INFO:teuthology.orchestra.run.trial098.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T03:43:14.849 INFO:teuthology.orchestra.run.trial091.stdout:(2/4): kernel-core-5.14.0-677.el9.x86_64.rpm 82 MB/s | 17 MB 00:00 2026-02-12T03:43:15.205 INFO:teuthology.orchestra.run.trial091.stdout:(3/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 70 MB/s | 40 MB 00:00 2026-02-12T03:43:15.263 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T03:43:15.269 INFO:teuthology.orchestra.run.trial111.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T03:43:15.652 INFO:teuthology.orchestra.run.trial091.stdout:(4/4): kernel-modules-core-5.14.0-677.el9.x86_6 33 MB/s | 31 MB 00:00 2026-02-12T03:43:15.652 INFO:teuthology.orchestra.run.trial091.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:43:15.652 INFO:teuthology.orchestra.run.trial091.stdout:Total 70 MB/s | 88 MB 00:01 2026-02-12T03:43:15.843 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction check 2026-02-12T03:43:16.048 INFO:teuthology.orchestra.run.trial091.stdout:Transaction check succeeded. 2026-02-12T03:43:16.048 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction test 2026-02-12T03:43:16.289 INFO:teuthology.orchestra.run.trial154.stdout:(2/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 3.7 MB/s | 40 MB 00:10 2026-02-12T03:43:16.395 INFO:teuthology.orchestra.run.trial091.stdout:Transaction test succeeded. 2026-02-12T03:43:16.395 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction 2026-02-12T03:43:17.490 INFO:teuthology.orchestra.run.trial091.stdout: Preparing : 1/1 2026-02-12T03:43:17.624 INFO:teuthology.orchestra.run.trial154.stdout:(3/4): kernel-modules-core-5.14.0-677.el9.x86_6 2.9 MB/s | 31 MB 00:10 2026-02-12T03:43:17.645 INFO:teuthology.orchestra.run.trial154.stdout:(4/4): kernel-core-5.14.0-677.el9.x86_64.rpm 1.4 MB/s | 17 MB 00:11 2026-02-12T03:43:17.647 INFO:teuthology.orchestra.run.trial154.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:43:17.647 INFO:teuthology.orchestra.run.trial154.stdout:Total 7.3 MB/s | 88 MB 00:12 2026-02-12T03:43:17.777 INFO:teuthology.orchestra.run.trial091.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-12T03:43:17.796 INFO:teuthology.orchestra.run.trial091.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T03:43:17.838 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction check 2026-02-12T03:43:17.875 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T03:43:18.042 INFO:teuthology.orchestra.run.trial154.stdout:Transaction check succeeded. 2026-02-12T03:43:18.042 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction test 2026-02-12T03:43:18.303 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T03:43:18.390 INFO:teuthology.orchestra.run.trial154.stdout:Transaction test succeeded. 2026-02-12T03:43:18.391 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction 2026-02-12T03:43:19.531 INFO:teuthology.orchestra.run.trial154.stdout: Preparing : 1/1 2026-02-12T03:43:19.565 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T03:43:19.593 INFO:teuthology.orchestra.run.trial091.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T03:43:19.835 INFO:teuthology.orchestra.run.trial154.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-12T03:43:19.854 INFO:teuthology.orchestra.run.trial154.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T03:43:21.640 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T03:43:21.669 INFO:teuthology.orchestra.run.trial154.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T03:43:22.680 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T03:43:22.686 INFO:teuthology.orchestra.run.trial091.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T03:43:24.755 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T03:43:24.761 INFO:teuthology.orchestra.run.trial154.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T03:43:25.781 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T03:43:27.860 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T03:43:48.501 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T03:43:48.523 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-12T03:43:48.625 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T03:43:48.647 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-12T03:43:48.694 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T03:43:48.694 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-12T03:43:48.694 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T03:43:48.694 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T03:43:48.711 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T03:43:48.711 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-12T03:43:48.712 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T03:43:48.712 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T03:43:48.747 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T03:43:48.747 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:43:48.747 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-12T03:43:48.747 INFO:teuthology.orchestra.run.trial098.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-12T03:43:48.748 INFO:teuthology.orchestra.run.trial098.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-12T03:43:48.748 INFO:teuthology.orchestra.run.trial098.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-12T03:43:48.748 INFO:teuthology.orchestra.run.trial098.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-12T03:43:48.748 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:43:48.748 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:43:48.763 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T03:43:48.763 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:43:48.764 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T03:43:48.764 INFO:teuthology.orchestra.run.trial111.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-12T03:43:48.764 INFO:teuthology.orchestra.run.trial111.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-12T03:43:48.764 INFO:teuthology.orchestra.run.trial111.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-12T03:43:48.764 INFO:teuthology.orchestra.run.trial111.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-12T03:43:48.764 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:43:48.764 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:43:48.806 DEBUG:teuthology.orchestra.run.trial098:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T03:43:48.822 DEBUG:teuthology.orchestra.run.trial111:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T03:43:48.847 INFO:teuthology.orchestra.run.trial111.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T03:43:48.849 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T03:43:48.849 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-12T03:43:48.849 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T03:43:48.849 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T03:43:48.849 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2026-02-12T03:43:48.849 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial111.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T03:43:48.850 DEBUG:teuthology.orchestra.run.trial111:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T03:43:48.871 INFO:teuthology.orchestra.run.trial098.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T03:43:48.872 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T03:43:48.872 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-12T03:43:48.872 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T03:43:48.872 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T03:43:48.872 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-12T03:43:48.873 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial098.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T03:43:48.873 DEBUG:teuthology.orchestra.run.trial098:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T03:43:48.914 INFO:teuthology.orchestra.run.trial111.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T03:43:48.916 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T03:43:48.916 DEBUG:teuthology.orchestra.run.trial111:> sudo rpm -qi grub2-tools 2026-02-12T03:43:48.935 INFO:teuthology.orchestra.run.trial098.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T03:43:48.936 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T03:43:48.936 DEBUG:teuthology.orchestra.run.trial098:> sudo rpm -qi grub2-tools 2026-02-12T03:43:48.984 INFO:teuthology.orchestra.run.trial111.stdout:Name : grub2-tools 2026-02-12T03:43:48.984 INFO:teuthology.orchestra.run.trial111.stdout:Epoch : 1 2026-02-12T03:43:48.984 INFO:teuthology.orchestra.run.trial111.stdout:Version : 2.06 2026-02-12T03:43:48.984 INFO:teuthology.orchestra.run.trial111.stdout:Release : 118.el9 2026-02-12T03:43:48.984 INFO:teuthology.orchestra.run.trial111.stdout:Architecture: x86_64 2026-02-12T03:43:48.984 INFO:teuthology.orchestra.run.trial111.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-12T03:43:48.985 INFO:teuthology.orchestra.run.trial111.stdout:Group : Unspecified 2026-02-12T03:43:48.985 INFO:teuthology.orchestra.run.trial111.stdout:Size : 8393909 2026-02-12T03:43:48.985 INFO:teuthology.orchestra.run.trial111.stdout:License : GPLv3+ 2026-02-12T03:43:48.985 INFO:teuthology.orchestra.run.trial111.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-12T03:43:48.985 INFO:teuthology.orchestra.run.trial111.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-12T03:43:48.985 INFO:teuthology.orchestra.run.trial111.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-12T03:43:48.985 INFO:teuthology.orchestra.run.trial111.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-12T03:43:48.985 INFO:teuthology.orchestra.run.trial111.stdout:Packager : builder@centos.org 2026-02-12T03:43:48.985 INFO:teuthology.orchestra.run.trial111.stdout:Vendor : CentOS 2026-02-12T03:43:48.985 INFO:teuthology.orchestra.run.trial111.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T03:43:48.985 INFO:teuthology.orchestra.run.trial111.stdout:Summary : Support tools for GRUB. 2026-02-12T03:43:48.985 INFO:teuthology.orchestra.run.trial111.stdout:Description : 2026-02-12T03:43:48.986 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:43:48.986 INFO:teuthology.orchestra.run.trial111.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T03:43:48.986 INFO:teuthology.orchestra.run.trial111.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T03:43:48.986 INFO:teuthology.orchestra.run.trial111.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T03:43:48.986 INFO:teuthology.orchestra.run.trial111.stdout:hardware devices. 2026-02-12T03:43:48.986 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:43:48.986 INFO:teuthology.orchestra.run.trial111.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T03:43:48.987 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T03:43:48.987 INFO:teuthology.task.kernel:Updating grub on trial111 to boot 5.14.0-677.el9.x86_64 2026-02-12T03:43:48.987 DEBUG:teuthology.orchestra.run.trial111:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T03:43:49.005 INFO:teuthology.orchestra.run.trial098.stdout:Name : grub2-tools 2026-02-12T03:43:49.005 INFO:teuthology.orchestra.run.trial098.stdout:Epoch : 1 2026-02-12T03:43:49.006 INFO:teuthology.orchestra.run.trial098.stdout:Version : 2.06 2026-02-12T03:43:49.006 INFO:teuthology.orchestra.run.trial098.stdout:Release : 118.el9 2026-02-12T03:43:49.006 INFO:teuthology.orchestra.run.trial098.stdout:Architecture: x86_64 2026-02-12T03:43:49.006 INFO:teuthology.orchestra.run.trial098.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-12T03:43:49.006 INFO:teuthology.orchestra.run.trial098.stdout:Group : Unspecified 2026-02-12T03:43:49.006 INFO:teuthology.orchestra.run.trial098.stdout:Size : 8393909 2026-02-12T03:43:49.006 INFO:teuthology.orchestra.run.trial098.stdout:License : GPLv3+ 2026-02-12T03:43:49.006 INFO:teuthology.orchestra.run.trial098.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-12T03:43:49.006 INFO:teuthology.orchestra.run.trial098.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-12T03:43:49.006 INFO:teuthology.orchestra.run.trial098.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-12T03:43:49.006 INFO:teuthology.orchestra.run.trial098.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-12T03:43:49.007 INFO:teuthology.orchestra.run.trial098.stdout:Packager : builder@centos.org 2026-02-12T03:43:49.007 INFO:teuthology.orchestra.run.trial098.stdout:Vendor : CentOS 2026-02-12T03:43:49.007 INFO:teuthology.orchestra.run.trial098.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T03:43:49.007 INFO:teuthology.orchestra.run.trial098.stdout:Summary : Support tools for GRUB. 2026-02-12T03:43:49.007 INFO:teuthology.orchestra.run.trial098.stdout:Description : 2026-02-12T03:43:49.007 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:43:49.007 INFO:teuthology.orchestra.run.trial098.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T03:43:49.007 INFO:teuthology.orchestra.run.trial098.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T03:43:49.007 INFO:teuthology.orchestra.run.trial098.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T03:43:49.007 INFO:teuthology.orchestra.run.trial098.stdout:hardware devices. 2026-02-12T03:43:49.007 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:43:49.007 INFO:teuthology.orchestra.run.trial098.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T03:43:49.008 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T03:43:49.009 INFO:teuthology.task.kernel:Updating grub on trial098 to boot 5.14.0-677.el9.x86_64 2026-02-12T03:43:49.009 DEBUG:teuthology.orchestra.run.trial098:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T03:43:49.050 INFO:teuthology.orchestra.run.trial111.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-12T03:43:49.052 DEBUG:teuthology.orchestra.run.trial111:> sudo command -v grubby && echo yes || echo no 2026-02-12T03:43:49.071 INFO:teuthology.orchestra.run.trial098.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-12T03:43:49.073 DEBUG:teuthology.orchestra.run.trial098:> sudo command -v grubby && echo yes || echo no 2026-02-12T03:43:49.114 INFO:teuthology.orchestra.run.trial111.stdout:/sbin/grubby 2026-02-12T03:43:49.116 INFO:teuthology.orchestra.run.trial111.stdout:yes 2026-02-12T03:43:49.116 DEBUG:teuthology.orchestra.run.trial111:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-12T03:43:49.139 INFO:teuthology.orchestra.run.trial098.stdout:/sbin/grubby 2026-02-12T03:43:49.140 INFO:teuthology.orchestra.run.trial098.stdout:yes 2026-02-12T03:43:49.141 DEBUG:teuthology.orchestra.run.trial098:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-12T03:43:49.180 INFO:teuthology.orchestra.run.trial111.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-12T03:43:49.181 DEBUG:teuthology.orchestra.run.trial111:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-12T03:43:49.207 INFO:teuthology.orchestra.run.trial098.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-12T03:43:49.208 DEBUG:teuthology.orchestra.run.trial098:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-12T03:43:49.256 DEBUG:teuthology.orchestra.run.trial111:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T03:43:49.280 DEBUG:teuthology.orchestra.run.trial098:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T03:43:49.464 INFO:teuthology.orchestra.run.trial111.stderr:Generating grub configuration file ... 2026-02-12T03:43:49.488 INFO:teuthology.orchestra.run.trial098.stderr:Generating grub configuration file ... 2026-02-12T03:43:49.527 INFO:teuthology.orchestra.run.trial111.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-12T03:43:49.533 INFO:teuthology.orchestra.run.trial111.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-12T03:43:49.552 INFO:teuthology.orchestra.run.trial098.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-12T03:43:49.558 INFO:teuthology.orchestra.run.trial098.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-12T03:43:49.783 INFO:teuthology.orchestra.run.trial111.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-12T03:43:49.790 INFO:teuthology.orchestra.run.trial111.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-12T03:43:49.809 INFO:teuthology.orchestra.run.trial098.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-12T03:43:49.815 INFO:teuthology.orchestra.run.trial098.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-12T03:43:49.821 INFO:teuthology.orchestra.run.trial111.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-12T03:43:49.828 INFO:teuthology.orchestra.run.trial111.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-12T03:43:49.847 INFO:teuthology.orchestra.run.trial098.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-12T03:43:49.850 INFO:teuthology.orchestra.run.trial111.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-12T03:43:49.854 INFO:teuthology.orchestra.run.trial098.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-12T03:43:49.857 INFO:teuthology.orchestra.run.trial111.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-12T03:43:49.877 INFO:teuthology.orchestra.run.trial098.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-12T03:43:49.884 INFO:teuthology.orchestra.run.trial098.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-12T03:43:49.941 INFO:teuthology.orchestra.run.trial111.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T03:43:49.949 INFO:teuthology.orchestra.run.trial111.stderr:done 2026-02-12T03:43:49.951 DEBUG:teuthology.orchestra.run.trial111:> test -d /sys/firmware/efi 2026-02-12T03:43:49.966 INFO:teuthology.orchestra.run.trial098.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T03:43:49.967 DEBUG:teuthology.orchestra.run.trial111:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T03:43:49.974 INFO:teuthology.orchestra.run.trial098.stderr:done 2026-02-12T03:43:49.976 DEBUG:teuthology.orchestra.run.trial098:> test -d /sys/firmware/efi 2026-02-12T03:43:49.992 DEBUG:teuthology.orchestra.run.trial098:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T03:43:50.031 INFO:teuthology.orchestra.run.trial111.stdout:/boot/efi/EFI/BOOT 2026-02-12T03:43:50.032 INFO:teuthology.orchestra.run.trial111.stdout:/boot/efi/EFI/centos 2026-02-12T03:43:50.033 DEBUG:teuthology.orchestra.run.trial111:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T03:43:50.058 INFO:teuthology.orchestra.run.trial098.stdout:/boot/efi/EFI/BOOT 2026-02-12T03:43:50.059 INFO:teuthology.orchestra.run.trial098.stdout:/boot/efi/EFI/centos 2026-02-12T03:43:50.060 DEBUG:teuthology.orchestra.run.trial098:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T03:43:50.098 INFO:teuthology.orchestra.run.trial111.stdout:no 2026-02-12T03:43:50.098 DEBUG:teuthology.orchestra.run.trial111:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-12T03:43:50.126 INFO:teuthology.orchestra.run.trial098.stdout:no 2026-02-12T03:43:50.127 DEBUG:teuthology.orchestra.run.trial098:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-12T03:43:50.162 INFO:teuthology.orchestra.run.trial111.stdout:yes 2026-02-12T03:43:50.163 DEBUG:teuthology.orchestra.run.trial111:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-12T03:43:50.191 INFO:teuthology.orchestra.run.trial098.stdout:yes 2026-02-12T03:43:50.191 DEBUG:teuthology.orchestra.run.trial098:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-12T03:43:50.227 DEBUG:teuthology.orchestra.run.trial111:> sudo shutdown -r now 2026-02-12T03:43:50.257 DEBUG:teuthology.orchestra.run.trial098:> sudo shutdown -r now 2026-02-12T03:43:50.330 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2026-02-12T03:43:56.217 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T03:43:56.238 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-12T03:43:56.410 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T03:43:56.410 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-12T03:43:56.410 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T03:43:56.410 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T03:43:56.463 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T03:43:56.463 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:43:56.463 INFO:teuthology.orchestra.run.trial091.stdout:Installed: 2026-02-12T03:43:56.463 INFO:teuthology.orchestra.run.trial091.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-12T03:43:56.463 INFO:teuthology.orchestra.run.trial091.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-12T03:43:56.463 INFO:teuthology.orchestra.run.trial091.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-12T03:43:56.463 INFO:teuthology.orchestra.run.trial091.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-12T03:43:56.463 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:43:56.463 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:43:56.522 DEBUG:teuthology.orchestra.run.trial091:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T03:43:56.549 INFO:teuthology.orchestra.run.trial091.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T03:43:56.550 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T03:43:56.550 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-12T03:43:56.550 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T03:43:56.550 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T03:43:56.551 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-12T03:43:56.551 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial091.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T03:43:56.551 DEBUG:teuthology.orchestra.run.trial091:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T03:43:56.614 INFO:teuthology.orchestra.run.trial091.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T03:43:56.614 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T03:43:56.615 DEBUG:teuthology.orchestra.run.trial091:> sudo rpm -qi grub2-tools 2026-02-12T03:43:56.682 INFO:teuthology.orchestra.run.trial091.stdout:Name : grub2-tools 2026-02-12T03:43:56.682 INFO:teuthology.orchestra.run.trial091.stdout:Epoch : 1 2026-02-12T03:43:56.683 INFO:teuthology.orchestra.run.trial091.stdout:Version : 2.06 2026-02-12T03:43:56.683 INFO:teuthology.orchestra.run.trial091.stdout:Release : 118.el9 2026-02-12T03:43:56.683 INFO:teuthology.orchestra.run.trial091.stdout:Architecture: x86_64 2026-02-12T03:43:56.683 INFO:teuthology.orchestra.run.trial091.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-12T03:43:56.683 INFO:teuthology.orchestra.run.trial091.stdout:Group : Unspecified 2026-02-12T03:43:56.683 INFO:teuthology.orchestra.run.trial091.stdout:Size : 8393909 2026-02-12T03:43:56.683 INFO:teuthology.orchestra.run.trial091.stdout:License : GPLv3+ 2026-02-12T03:43:56.683 INFO:teuthology.orchestra.run.trial091.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-12T03:43:56.683 INFO:teuthology.orchestra.run.trial091.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-12T03:43:56.683 INFO:teuthology.orchestra.run.trial091.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-12T03:43:56.683 INFO:teuthology.orchestra.run.trial091.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-12T03:43:56.683 INFO:teuthology.orchestra.run.trial091.stdout:Packager : builder@centos.org 2026-02-12T03:43:56.683 INFO:teuthology.orchestra.run.trial091.stdout:Vendor : CentOS 2026-02-12T03:43:56.683 INFO:teuthology.orchestra.run.trial091.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T03:43:56.683 INFO:teuthology.orchestra.run.trial091.stdout:Summary : Support tools for GRUB. 2026-02-12T03:43:56.683 INFO:teuthology.orchestra.run.trial091.stdout:Description : 2026-02-12T03:43:56.683 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:43:56.683 INFO:teuthology.orchestra.run.trial091.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T03:43:56.683 INFO:teuthology.orchestra.run.trial091.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T03:43:56.683 INFO:teuthology.orchestra.run.trial091.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T03:43:56.684 INFO:teuthology.orchestra.run.trial091.stdout:hardware devices. 2026-02-12T03:43:56.684 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:43:56.684 INFO:teuthology.orchestra.run.trial091.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T03:43:56.684 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T03:43:56.684 INFO:teuthology.task.kernel:Updating grub on trial091 to boot 5.14.0-677.el9.x86_64 2026-02-12T03:43:56.684 DEBUG:teuthology.orchestra.run.trial091:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T03:43:56.746 INFO:teuthology.orchestra.run.trial091.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-12T03:43:56.747 DEBUG:teuthology.orchestra.run.trial091:> sudo command -v grubby && echo yes || echo no 2026-02-12T03:43:56.812 INFO:teuthology.orchestra.run.trial091.stdout:/sbin/grubby 2026-02-12T03:43:56.814 INFO:teuthology.orchestra.run.trial091.stdout:yes 2026-02-12T03:43:56.814 DEBUG:teuthology.orchestra.run.trial091:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-12T03:43:56.877 INFO:teuthology.orchestra.run.trial091.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-12T03:43:56.879 DEBUG:teuthology.orchestra.run.trial091:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-12T03:43:56.952 DEBUG:teuthology.orchestra.run.trial091:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T03:43:57.160 INFO:teuthology.orchestra.run.trial091.stderr:Generating grub configuration file ... 2026-02-12T03:43:57.224 INFO:teuthology.orchestra.run.trial091.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-12T03:43:57.230 INFO:teuthology.orchestra.run.trial091.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-12T03:43:57.478 INFO:teuthology.orchestra.run.trial091.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-12T03:43:57.485 INFO:teuthology.orchestra.run.trial091.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-12T03:43:57.516 INFO:teuthology.orchestra.run.trial091.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-12T03:43:57.523 INFO:teuthology.orchestra.run.trial091.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-12T03:43:57.546 INFO:teuthology.orchestra.run.trial091.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-12T03:43:57.552 INFO:teuthology.orchestra.run.trial091.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-12T03:43:57.634 INFO:teuthology.orchestra.run.trial091.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T03:43:57.643 INFO:teuthology.orchestra.run.trial091.stderr:done 2026-02-12T03:43:57.645 DEBUG:teuthology.orchestra.run.trial091:> test -d /sys/firmware/efi 2026-02-12T03:43:57.662 DEBUG:teuthology.orchestra.run.trial091:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T03:43:57.726 INFO:teuthology.orchestra.run.trial091.stdout:/boot/efi/EFI/BOOT 2026-02-12T03:43:57.727 INFO:teuthology.orchestra.run.trial091.stdout:/boot/efi/EFI/centos 2026-02-12T03:43:57.728 DEBUG:teuthology.orchestra.run.trial091:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T03:43:57.792 INFO:teuthology.orchestra.run.trial091.stdout:no 2026-02-12T03:43:57.792 DEBUG:teuthology.orchestra.run.trial091:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-12T03:43:57.858 INFO:teuthology.orchestra.run.trial091.stdout:yes 2026-02-12T03:43:57.858 DEBUG:teuthology.orchestra.run.trial091:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-12T03:43:57.922 DEBUG:teuthology.orchestra.run.trial091:> sudo shutdown -r now 2026-02-12T03:43:57.995 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2026-02-12T03:43:58.336 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T03:43:58.357 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-12T03:43:58.421 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T03:43:58.421 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-12T03:43:58.421 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T03:43:58.421 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T03:43:58.474 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T03:43:58.474 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:43:58.474 INFO:teuthology.orchestra.run.trial154.stdout:Installed: 2026-02-12T03:43:58.474 INFO:teuthology.orchestra.run.trial154.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-12T03:43:58.474 INFO:teuthology.orchestra.run.trial154.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-12T03:43:58.474 INFO:teuthology.orchestra.run.trial154.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-12T03:43:58.474 INFO:teuthology.orchestra.run.trial154.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-12T03:43:58.474 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:43:58.475 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:43:58.534 DEBUG:teuthology.orchestra.run.trial154:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T03:43:58.560 INFO:teuthology.orchestra.run.trial154.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T03:43:58.561 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T03:43:58.561 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-12T03:43:58.561 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T03:43:58.561 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T03:43:58.561 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2026-02-12T03:43:58.561 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial154.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T03:43:58.562 DEBUG:teuthology.orchestra.run.trial154:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T03:43:58.623 INFO:teuthology.orchestra.run.trial154.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T03:43:58.625 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T03:43:58.625 DEBUG:teuthology.orchestra.run.trial154:> sudo rpm -qi grub2-tools 2026-02-12T03:43:58.692 INFO:teuthology.orchestra.run.trial154.stdout:Name : grub2-tools 2026-02-12T03:43:58.692 INFO:teuthology.orchestra.run.trial154.stdout:Epoch : 1 2026-02-12T03:43:58.693 INFO:teuthology.orchestra.run.trial154.stdout:Version : 2.06 2026-02-12T03:43:58.693 INFO:teuthology.orchestra.run.trial154.stdout:Release : 118.el9 2026-02-12T03:43:58.693 INFO:teuthology.orchestra.run.trial154.stdout:Architecture: x86_64 2026-02-12T03:43:58.693 INFO:teuthology.orchestra.run.trial154.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-12T03:43:58.693 INFO:teuthology.orchestra.run.trial154.stdout:Group : Unspecified 2026-02-12T03:43:58.693 INFO:teuthology.orchestra.run.trial154.stdout:Size : 8393909 2026-02-12T03:43:58.693 INFO:teuthology.orchestra.run.trial154.stdout:License : GPLv3+ 2026-02-12T03:43:58.693 INFO:teuthology.orchestra.run.trial154.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-12T03:43:58.693 INFO:teuthology.orchestra.run.trial154.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-12T03:43:58.693 INFO:teuthology.orchestra.run.trial154.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-12T03:43:58.694 INFO:teuthology.orchestra.run.trial154.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-12T03:43:58.694 INFO:teuthology.orchestra.run.trial154.stdout:Packager : builder@centos.org 2026-02-12T03:43:58.694 INFO:teuthology.orchestra.run.trial154.stdout:Vendor : CentOS 2026-02-12T03:43:58.694 INFO:teuthology.orchestra.run.trial154.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T03:43:58.694 INFO:teuthology.orchestra.run.trial154.stdout:Summary : Support tools for GRUB. 2026-02-12T03:43:58.694 INFO:teuthology.orchestra.run.trial154.stdout:Description : 2026-02-12T03:43:58.694 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:43:58.694 INFO:teuthology.orchestra.run.trial154.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T03:43:58.694 INFO:teuthology.orchestra.run.trial154.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T03:43:58.694 INFO:teuthology.orchestra.run.trial154.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T03:43:58.694 INFO:teuthology.orchestra.run.trial154.stdout:hardware devices. 2026-02-12T03:43:58.694 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:43:58.695 INFO:teuthology.orchestra.run.trial154.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T03:43:58.696 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T03:43:58.696 INFO:teuthology.task.kernel:Updating grub on trial154 to boot 5.14.0-677.el9.x86_64 2026-02-12T03:43:58.696 DEBUG:teuthology.orchestra.run.trial154:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T03:43:58.758 INFO:teuthology.orchestra.run.trial154.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-12T03:43:58.760 DEBUG:teuthology.orchestra.run.trial154:> sudo command -v grubby && echo yes || echo no 2026-02-12T03:43:58.823 INFO:teuthology.orchestra.run.trial154.stdout:/sbin/grubby 2026-02-12T03:43:58.824 INFO:teuthology.orchestra.run.trial154.stdout:yes 2026-02-12T03:43:58.825 DEBUG:teuthology.orchestra.run.trial154:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-12T03:43:58.888 INFO:teuthology.orchestra.run.trial154.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-12T03:43:58.889 DEBUG:teuthology.orchestra.run.trial154:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-12T03:43:58.965 DEBUG:teuthology.orchestra.run.trial154:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T03:43:59.169 INFO:teuthology.orchestra.run.trial154.stderr:Generating grub configuration file ... 2026-02-12T03:43:59.232 INFO:teuthology.orchestra.run.trial154.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-12T03:43:59.238 INFO:teuthology.orchestra.run.trial154.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-12T03:43:59.485 INFO:teuthology.orchestra.run.trial154.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-12T03:43:59.491 INFO:teuthology.orchestra.run.trial154.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-12T03:43:59.523 INFO:teuthology.orchestra.run.trial154.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-12T03:43:59.530 INFO:teuthology.orchestra.run.trial154.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-12T03:43:59.553 INFO:teuthology.orchestra.run.trial154.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-12T03:43:59.560 INFO:teuthology.orchestra.run.trial154.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-12T03:43:59.642 INFO:teuthology.orchestra.run.trial154.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T03:43:59.649 INFO:teuthology.orchestra.run.trial154.stderr:done 2026-02-12T03:43:59.651 DEBUG:teuthology.orchestra.run.trial154:> test -d /sys/firmware/efi 2026-02-12T03:43:59.668 DEBUG:teuthology.orchestra.run.trial154:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T03:43:59.732 INFO:teuthology.orchestra.run.trial154.stdout:/boot/efi/EFI/BOOT 2026-02-12T03:43:59.732 INFO:teuthology.orchestra.run.trial154.stdout:/boot/efi/EFI/centos 2026-02-12T03:43:59.734 DEBUG:teuthology.orchestra.run.trial154:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T03:43:59.800 INFO:teuthology.orchestra.run.trial154.stdout:no 2026-02-12T03:43:59.801 DEBUG:teuthology.orchestra.run.trial154:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-12T03:43:59.865 INFO:teuthology.orchestra.run.trial154.stdout:yes 2026-02-12T03:43:59.865 DEBUG:teuthology.orchestra.run.trial154:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-12T03:43:59.929 DEBUG:teuthology.orchestra.run.trial154:> sudo shutdown -r now 2026-02-12T03:44:00.004 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2026-02-12T03:44:20.286 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2026-02-12T03:44:20.286 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T03:44:20.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T03:44:20.299 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-12T03:44:20.300 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial098.front.sepia.ceph.com' 2026-02-12T03:44:20.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T03:44:27.972 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T03:44:27.972 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial091.front.sepia.ceph.com' 2026-02-12T03:44:27.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T03:44:29.975 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2026-02-12T03:44:29.975 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T03:44:29.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T03:45:20.290 DEBUG:teuthology.orchestra.remote:timed out 2026-02-12T03:45:20.302 DEBUG:teuthology.orchestra.remote:timed out 2026-02-12T03:45:27.983 DEBUG:teuthology.orchestra.remote:timed out 2026-02-12T03:45:29.293 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T03:45:29.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T03:45:29.302 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial098.front.sepia.ceph.com' 2026-02-12T03:45:29.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T03:45:29.433 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T03:45:29.526 DEBUG:teuthology.orchestra.run.trial098:> true 2026-02-12T03:45:29.591 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T03:45:29.591 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-677.el9.x86_64"... 2026-02-12T03:45:29.591 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T03:45:29.646 INFO:teuthology.orchestra.run.trial111.stdout:5.14.0-677.el9.x86_64 2026-02-12T03:45:29.647 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-677.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T03:45:29.647 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-12T03:45:29.647 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T03:45:29.679 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial098.front.sepia.ceph.com' 2026-02-12T03:45:29.679 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-677.el9.x86_64"... 2026-02-12T03:45:29.679 DEBUG:teuthology.orchestra.run.trial098:> uname -r 2026-02-12T03:45:29.734 INFO:teuthology.orchestra.run.trial098.stdout:5.14.0-677.el9.x86_64 2026-02-12T03:45:29.735 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-677.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T03:45:29.735 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-12T03:45:29.735 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T03:45:29.978 DEBUG:teuthology.orchestra.remote:timed out 2026-02-12T03:45:30.648 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2026-02-12T03:45:30.648 DEBUG:teuthology.orchestra.run.trial111:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-12T03:45:30.677 INFO:teuthology.orchestra.run.trial111.stdout:ttyS1 2026-02-12T03:45:30.698 DEBUG:teuthology.parallel:result is None 2026-02-12T03:45:30.736 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2026-02-12T03:45:30.737 DEBUG:teuthology.orchestra.run.trial098:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-12T03:45:30.766 INFO:teuthology.orchestra.run.trial098.stdout:ttyS1 2026-02-12T03:45:30.789 DEBUG:teuthology.parallel:result is None 2026-02-12T03:45:36.984 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial091.front.sepia.ceph.com' 2026-02-12T03:45:36.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T03:45:37.121 DEBUG:teuthology.orchestra.run.trial091:> true 2026-02-12T03:45:37.280 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial091.front.sepia.ceph.com' 2026-02-12T03:45:37.280 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T03:45:37.280 DEBUG:teuthology.orchestra.run.trial091:> uname -r 2026-02-12T03:45:37.336 INFO:teuthology.orchestra.run.trial091.stdout:5.14.0-677.el9.x86_64 2026-02-12T03:45:37.336 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-677.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T03:45:37.336 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-12T03:45:37.337 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T03:45:38.337 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-12T03:45:38.338 DEBUG:teuthology.orchestra.run.trial091:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-12T03:45:38.367 INFO:teuthology.orchestra.run.trial091.stdout:ttyS1 2026-02-12T03:45:38.390 DEBUG:teuthology.parallel:result is None 2026-02-12T03:45:38.979 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T03:45:38.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T03:45:39.069 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T03:45:39.223 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T03:45:39.223 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-677.el9.x86_64"... 2026-02-12T03:45:39.224 DEBUG:teuthology.orchestra.run.trial154:> uname -r 2026-02-12T03:45:39.279 INFO:teuthology.orchestra.run.trial154.stdout:5.14.0-677.el9.x86_64 2026-02-12T03:45:39.279 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-677.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T03:45:39.280 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-12T03:45:39.280 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T03:45:40.280 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2026-02-12T03:45:40.280 DEBUG:teuthology.orchestra.run.trial154:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-12T03:45:40.310 INFO:teuthology.orchestra.run.trial154.stdout:ttyS1 2026-02-12T03:45:40.330 DEBUG:teuthology.parallel:result is None 2026-02-12T03:45:40.330 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-12T03:45:40.342 INFO:teuthology.task.internal:Creating test directory... 2026-02-12T03:45:40.342 DEBUG:teuthology.orchestra.run.trial091:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-12T03:45:40.344 DEBUG:teuthology.orchestra.run.trial098:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-12T03:45:40.346 DEBUG:teuthology.orchestra.run.trial111:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-12T03:45:40.348 DEBUG:teuthology.orchestra.run.trial154:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-12T03:45:40.387 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-12T03:45:40.398 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-12T03:45:40.411 INFO:teuthology.task.internal:Creating archive directory... 2026-02-12T03:45:40.412 DEBUG:teuthology.orchestra.run.trial091:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-12T03:45:40.414 DEBUG:teuthology.orchestra.run.trial098:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-12T03:45:40.417 DEBUG:teuthology.orchestra.run.trial111:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-12T03:45:40.419 DEBUG:teuthology.orchestra.run.trial154:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-12T03:45:40.453 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-12T03:45:40.465 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-12T03:45:40.465 DEBUG:teuthology.orchestra.run.trial091:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-12T03:45:40.470 DEBUG:teuthology.orchestra.run.trial098:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-12T03:45:40.473 DEBUG:teuthology.orchestra.run.trial111:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-12T03:45:40.476 DEBUG:teuthology.orchestra.run.trial154:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-12T03:45:40.493 INFO:teuthology.orchestra.run.trial091.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T03:45:40.495 INFO:teuthology.orchestra.run.trial098.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T03:45:40.498 INFO:teuthology.orchestra.run.trial111.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T03:45:40.502 INFO:teuthology.orchestra.run.trial091.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T03:45:40.504 INFO:teuthology.orchestra.run.trial098.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T03:45:40.507 INFO:teuthology.orchestra.run.trial111.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T03:45:40.509 INFO:teuthology.orchestra.run.trial154.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T03:45:40.517 INFO:teuthology.orchestra.run.trial154.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T03:45:40.519 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-12T03:45:40.531 INFO:teuthology.task.internal:Configuring sudo... 2026-02-12T03:45:40.531 DEBUG:teuthology.orchestra.run.trial091:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-12T03:45:40.546 DEBUG:teuthology.orchestra.run.trial098:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-12T03:45:40.549 DEBUG:teuthology.orchestra.run.trial111:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-12T03:45:40.551 DEBUG:teuthology.orchestra.run.trial154:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-12T03:45:40.583 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-12T03:45:40.599 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-12T03:45:40.599 DEBUG:teuthology.orchestra.run.trial091:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-12T03:45:40.612 DEBUG:teuthology.orchestra.run.trial098:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-12T03:45:40.615 DEBUG:teuthology.orchestra.run.trial111:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-12T03:45:40.617 DEBUG:teuthology.orchestra.run.trial154:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-12T03:45:40.639 DEBUG:teuthology.orchestra.run.trial091:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T03:45:40.784 DEBUG:teuthology.orchestra.run.trial091:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T03:45:40.810 DEBUG:teuthology.orchestra.run.trial091:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T03:45:40.958 DEBUG:teuthology.orchestra.run.trial091:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T03:45:40.982 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-12T03:45:40.982 DEBUG:teuthology.orchestra.run.trial091:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-12T03:45:41.048 DEBUG:teuthology.orchestra.run.trial098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T03:45:41.162 DEBUG:teuthology.orchestra.run.trial098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T03:45:41.187 DEBUG:teuthology.orchestra.run.trial098:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T03:45:41.330 DEBUG:teuthology.orchestra.run.trial098:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T03:45:41.356 DEBUG:teuthology.orchestra.run.trial098:> set -ex 2026-02-12T03:45:41.356 DEBUG:teuthology.orchestra.run.trial098:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-12T03:45:41.419 DEBUG:teuthology.orchestra.run.trial111:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T03:45:41.533 DEBUG:teuthology.orchestra.run.trial111:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T03:45:41.557 DEBUG:teuthology.orchestra.run.trial111:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T03:45:41.706 DEBUG:teuthology.orchestra.run.trial111:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T03:45:41.730 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-12T03:45:41.730 DEBUG:teuthology.orchestra.run.trial111:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-12T03:45:41.794 DEBUG:teuthology.orchestra.run.trial154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T03:45:41.899 DEBUG:teuthology.orchestra.run.trial154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T03:45:41.923 DEBUG:teuthology.orchestra.run.trial154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T03:45:42.063 DEBUG:teuthology.orchestra.run.trial154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T03:45:42.088 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-12T03:45:42.088 DEBUG:teuthology.orchestra.run.trial154:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-12T03:45:42.151 DEBUG:teuthology.orchestra.run.trial091:> sudo service rsyslog restart 2026-02-12T03:45:42.153 DEBUG:teuthology.orchestra.run.trial098:> sudo service rsyslog restart 2026-02-12T03:45:42.156 DEBUG:teuthology.orchestra.run.trial111:> sudo service rsyslog restart 2026-02-12T03:45:42.159 DEBUG:teuthology.orchestra.run.trial154:> sudo service rsyslog restart 2026-02-12T03:45:42.180 INFO:teuthology.orchestra.run.trial091.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T03:45:42.182 INFO:teuthology.orchestra.run.trial098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T03:45:42.185 INFO:teuthology.orchestra.run.trial111.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T03:45:42.218 INFO:teuthology.orchestra.run.trial154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T03:45:42.704 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-12T03:45:42.716 INFO:teuthology.task.internal:Starting timer... 2026-02-12T03:45:42.716 INFO:teuthology.run_tasks:Running task pcp... 2026-02-12T03:45:42.737 INFO:teuthology.run_tasks:Running task selinux... 2026-02-12T03:45:42.755 DEBUG:teuthology.orchestra.run.trial091:> sudo service auditd rotate 2026-02-12T03:45:42.785 INFO:teuthology.orchestra.run.trial091.stdout:Rotating logs: 2026-02-12T03:45:42.787 DEBUG:teuthology.orchestra.run.trial098:> sudo service auditd rotate 2026-02-12T03:45:42.817 INFO:teuthology.orchestra.run.trial098.stdout:Rotating logs: 2026-02-12T03:45:42.819 DEBUG:teuthology.orchestra.run.trial111:> sudo service auditd rotate 2026-02-12T03:45:42.848 INFO:teuthology.orchestra.run.trial111.stdout:Rotating logs: 2026-02-12T03:45:42.850 DEBUG:teuthology.orchestra.run.trial154:> sudo service auditd rotate 2026-02-12T03:45:42.878 INFO:teuthology.orchestra.run.trial154.stdout:Rotating logs: 2026-02-12T03:45:42.880 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-12T03:45:42.881 DEBUG:teuthology.orchestra.run.trial091:> /usr/sbin/getenforce 2026-02-12T03:45:42.898 INFO:teuthology.orchestra.run.trial091.stdout:Permissive 2026-02-12T03:45:42.899 DEBUG:teuthology.orchestra.run.trial098:> /usr/sbin/getenforce 2026-02-12T03:45:42.916 INFO:teuthology.orchestra.run.trial098.stdout:Permissive 2026-02-12T03:45:42.917 DEBUG:teuthology.orchestra.run.trial111:> /usr/sbin/getenforce 2026-02-12T03:45:42.933 INFO:teuthology.orchestra.run.trial111.stdout:Permissive 2026-02-12T03:45:42.933 DEBUG:teuthology.orchestra.run.trial154:> /usr/sbin/getenforce 2026-02-12T03:45:42.950 INFO:teuthology.orchestra.run.trial154.stdout:Permissive 2026-02-12T03:45:42.950 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial091.front.sepia.ceph.com': 'permissive', 'ubuntu@trial098.front.sepia.ceph.com': 'permissive', 'ubuntu@trial111.front.sepia.ceph.com': 'permissive', 'ubuntu@trial154.front.sepia.ceph.com': 'permissive'} 2026-02-12T03:45:42.950 DEBUG:teuthology.orchestra.run.trial091:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-12T03:45:42.977 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T03:45:42.977 DEBUG:teuthology.orchestra.run.trial098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-12T03:45:43.002 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T03:45:43.003 DEBUG:teuthology.orchestra.run.trial111:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-12T03:45:43.029 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T03:45:43.029 DEBUG:teuthology.orchestra.run.trial154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-12T03:45:43.056 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T03:45:43.057 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-12T03:45:43.057 DEBUG:teuthology.orchestra.run.trial091:> sudo /usr/sbin/setenforce permissive 2026-02-12T03:45:43.082 DEBUG:teuthology.orchestra.run.trial098:> sudo /usr/sbin/setenforce permissive 2026-02-12T03:45:43.106 DEBUG:teuthology.orchestra.run.trial111:> sudo /usr/sbin/setenforce permissive 2026-02-12T03:45:43.132 DEBUG:teuthology.orchestra.run.trial154:> sudo /usr/sbin/setenforce permissive 2026-02-12T03:45:43.157 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-12T03:45:43.172 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-12T03:45:43.184 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-12T03:45:43.185 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial091.front.sepia.ceph.com,trial098.front.sepia.ceph.com,trial111.front.sepia.ceph.com,trial154.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-12T03:47:00.302 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial091.front.sepia.ceph.com'), Remote(name='ubuntu@trial098.front.sepia.ceph.com'), Remote(name='ubuntu@trial111.front.sepia.ceph.com'), Remote(name='ubuntu@trial154.front.sepia.ceph.com')] 2026-02-12T03:47:00.304 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial091.front.sepia.ceph.com' 2026-02-12T03:47:00.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial091.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T03:47:00.416 DEBUG:teuthology.orchestra.run.trial091:> true 2026-02-12T03:47:00.493 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial091.front.sepia.ceph.com' 2026-02-12T03:47:00.493 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial098.front.sepia.ceph.com' 2026-02-12T03:47:00.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T03:47:00.587 DEBUG:teuthology.orchestra.run.trial098:> true 2026-02-12T03:47:00.661 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial098.front.sepia.ceph.com' 2026-02-12T03:47:00.661 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T03:47:00.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T03:47:00.755 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T03:47:00.831 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T03:47:00.832 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T03:47:00.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T03:47:00.922 DEBUG:teuthology.orchestra.run.trial154:> true 2026-02-12T03:47:01.006 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial154.front.sepia.ceph.com' 2026-02-12T03:47:01.006 INFO:teuthology.run_tasks:Running task clock... 2026-02-12T03:47:01.020 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-12T03:47:01.020 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-12T03:47:01.020 DEBUG:teuthology.orchestra.run.trial091:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T03:47:01.023 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-12T03:47:01.023 DEBUG:teuthology.orchestra.run.trial098:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T03:47:01.025 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-12T03:47:01.025 DEBUG:teuthology.orchestra.run.trial111:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T03:47:01.028 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-12T03:47:01.028 DEBUG:teuthology.orchestra.run.trial154:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T03:47:01.048 INFO:teuthology.orchestra.run.trial091.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-12T03:47:01.051 INFO:teuthology.orchestra.run.trial098.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-12T03:47:01.054 INFO:teuthology.orchestra.run.trial111.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-12T03:47:01.060 INFO:teuthology.orchestra.run.trial091.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-12T03:47:01.062 INFO:teuthology.orchestra.run.trial098.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-12T03:47:01.065 INFO:teuthology.orchestra.run.trial111.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-12T03:47:01.072 INFO:teuthology.orchestra.run.trial154.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-12T03:47:01.081 INFO:teuthology.orchestra.run.trial091.stderr:sudo: ntpd: command not found 2026-02-12T03:47:01.082 INFO:teuthology.orchestra.run.trial098.stderr:sudo: ntpd: command not found 2026-02-12T03:47:01.083 INFO:teuthology.orchestra.run.trial154.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-12T03:47:01.087 INFO:teuthology.orchestra.run.trial111.stderr:sudo: ntpd: command not found 2026-02-12T03:47:01.090 INFO:teuthology.orchestra.run.trial091.stdout:506 Cannot talk to daemon 2026-02-12T03:47:01.092 INFO:teuthology.orchestra.run.trial098.stdout:506 Cannot talk to daemon 2026-02-12T03:47:01.097 INFO:teuthology.orchestra.run.trial111.stdout:506 Cannot talk to daemon 2026-02-12T03:47:01.102 INFO:teuthology.orchestra.run.trial091.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-12T03:47:01.102 INFO:teuthology.orchestra.run.trial154.stderr:sudo: ntpd: command not found 2026-02-12T03:47:01.103 INFO:teuthology.orchestra.run.trial098.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-12T03:47:01.109 INFO:teuthology.orchestra.run.trial111.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-12T03:47:01.111 INFO:teuthology.orchestra.run.trial154.stdout:506 Cannot talk to daemon 2026-02-12T03:47:01.113 INFO:teuthology.orchestra.run.trial091.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-12T03:47:01.115 INFO:teuthology.orchestra.run.trial098.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-12T03:47:01.121 INFO:teuthology.orchestra.run.trial111.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-12T03:47:01.122 INFO:teuthology.orchestra.run.trial154.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-12T03:47:01.133 INFO:teuthology.orchestra.run.trial154.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-12T03:47:01.159 INFO:teuthology.orchestra.run.trial091.stderr:bash: line 1: ntpq: command not found 2026-02-12T03:47:01.161 INFO:teuthology.orchestra.run.trial091.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T03:47:01.161 INFO:teuthology.orchestra.run.trial091.stdout:=============================================================================== 2026-02-12T03:47:01.165 INFO:teuthology.orchestra.run.trial111.stderr:bash: line 1: ntpq: command not found 2026-02-12T03:47:01.167 INFO:teuthology.orchestra.run.trial111.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T03:47:01.167 INFO:teuthology.orchestra.run.trial111.stdout:=============================================================================== 2026-02-12T03:47:01.169 INFO:teuthology.orchestra.run.trial098.stderr:bash: line 1: ntpq: command not found 2026-02-12T03:47:01.170 INFO:teuthology.orchestra.run.trial098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T03:47:01.170 INFO:teuthology.orchestra.run.trial098.stdout:=============================================================================== 2026-02-12T03:47:01.178 INFO:teuthology.orchestra.run.trial154.stderr:bash: line 1: ntpq: command not found 2026-02-12T03:47:01.180 INFO:teuthology.orchestra.run.trial154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T03:47:01.180 INFO:teuthology.orchestra.run.trial154.stdout:=============================================================================== 2026-02-12T03:47:01.181 INFO:teuthology.run_tasks:Running task install... 2026-02-12T03:47:01.194 DEBUG:teuthology.task.install:project ceph 2026-02-12T03:47:01.195 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '1279775fef08a9169052c6dd6a10581353958aac'}} 2026-02-12T03:47:01.195 DEBUG:teuthology.task.install:config {'debuginfo': True, 'flavor': 'default', 'sha1': '1279775fef08a9169052c6dd6a10581353958aac'} 2026-02-12T03:47:01.195 INFO:teuthology.task.install:Using flavor: default 2026-02-12T03:47:01.204 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2026-02-12T03:47:01.204 INFO:teuthology.task.install:extra packages: [] 2026-02-12T03:47:01.204 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1279775fef08a9169052c6dd6a10581353958aac', 'tag': None, 'wait_for_package': False} 2026-02-12T03:47:01.205 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1279775fef08a9169052c6dd6a10581353958aac 2026-02-12T03:47:01.208 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1279775fef08a9169052c6dd6a10581353958aac', 'tag': None, 'wait_for_package': False} 2026-02-12T03:47:01.208 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1279775fef08a9169052c6dd6a10581353958aac 2026-02-12T03:47:01.210 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1279775fef08a9169052c6dd6a10581353958aac', 'tag': None, 'wait_for_package': False} 2026-02-12T03:47:01.210 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1279775fef08a9169052c6dd6a10581353958aac 2026-02-12T03:47:01.211 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1279775fef08a9169052c6dd6a10581353958aac', 'tag': None, 'wait_for_package': False} 2026-02-12T03:47:01.212 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1279775fef08a9169052c6dd6a10581353958aac 2026-02-12T03:47:01.495 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-09-1550-tentacle/1279775fef08a9169052c6dd6a10581353958aac/centos/9/flavors/default/ 2026-02-12T03:47:01.495 INFO:teuthology.task.install.rpm:Package version is 20.2.0-626.g1279775f 2026-02-12T03:47:01.497 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-09-1550-tentacle/1279775fef08a9169052c6dd6a10581353958aac/centos/9/flavors/default/ 2026-02-12T03:47:01.497 INFO:teuthology.task.install.rpm:Package version is 20.2.0-626.g1279775f 2026-02-12T03:47:01.498 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-09-1550-tentacle/1279775fef08a9169052c6dd6a10581353958aac/centos/9/flavors/default/ 2026-02-12T03:47:01.498 INFO:teuthology.task.install.rpm:Package version is 20.2.0-626.g1279775f 2026-02-12T03:47:01.502 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-09-1550-tentacle/1279775fef08a9169052c6dd6a10581353958aac/centos/9/flavors/default/ 2026-02-12T03:47:01.503 INFO:teuthology.task.install.rpm:Package version is 20.2.0-626.g1279775f 2026-02-12T03:47:01.723 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-09-1550-tentacle/1279775fef08a9169052c6dd6a10581353958aac/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-09-1550-tentacle/1279775fef08a9169052c6dd6a10581353958aac/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-09-1550-tentacle/1279775fef08a9169052c6dd6a10581353958aac/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-12T03:47:01.723 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-12T03:47:01.723 DEBUG:teuthology.orchestra.run.trial154:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-12T03:47:01.733 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-09-1550-tentacle/1279775fef08a9169052c6dd6a10581353958aac/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-09-1550-tentacle/1279775fef08a9169052c6dd6a10581353958aac/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-09-1550-tentacle/1279775fef08a9169052c6dd6a10581353958aac/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-12T03:47:01.734 DEBUG:teuthology.orchestra.run.trial098:> set -ex 2026-02-12T03:47:01.734 DEBUG:teuthology.orchestra.run.trial098:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-12T03:47:01.735 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-09-1550-tentacle/1279775fef08a9169052c6dd6a10581353958aac/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-09-1550-tentacle/1279775fef08a9169052c6dd6a10581353958aac/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-09-1550-tentacle/1279775fef08a9169052c6dd6a10581353958aac/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-12T03:47:01.735 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-12T03:47:01.735 DEBUG:teuthology.orchestra.run.trial111:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-12T03:47:01.748 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-09-1550-tentacle/1279775fef08a9169052c6dd6a10581353958aac/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-09-1550-tentacle/1279775fef08a9169052c6dd6a10581353958aac/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2026-02-09-1550-tentacle/1279775fef08a9169052c6dd6a10581353958aac/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-12T03:47:01.749 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-12T03:47:01.749 DEBUG:teuthology.orchestra.run.trial091:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-12T03:47:01.749 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-12T03:47:01.749 DEBUG:teuthology.orchestra.run.trial154:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1279775fef08a9169052c6dd6a10581353958aac/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-12T03:47:01.760 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-12T03:47:01.760 DEBUG:teuthology.orchestra.run.trial098:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1279775fef08a9169052c6dd6a10581353958aac/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-12T03:47:01.761 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-12T03:47:01.761 DEBUG:teuthology.orchestra.run.trial111:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1279775fef08a9169052c6dd6a10581353958aac/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-12T03:47:01.774 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2026-02-12T03:47:01.774 DEBUG:teuthology.orchestra.run.trial091:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1279775fef08a9169052c6dd6a10581353958aac/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-12T03:47:01.814 DEBUG:teuthology.orchestra.run.trial154:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-12T03:47:01.824 DEBUG:teuthology.orchestra.run.trial098:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-12T03:47:01.825 DEBUG:teuthology.orchestra.run.trial111:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-12T03:47:01.837 DEBUG:teuthology.orchestra.run.trial091:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-12T03:47:01.887 DEBUG:teuthology.orchestra.run.trial154:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-12T03:47:01.896 DEBUG:teuthology.orchestra.run.trial098:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-12T03:47:01.899 DEBUG:teuthology.orchestra.run.trial111:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-12T03:47:01.909 DEBUG:teuthology.orchestra.run.trial091:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-12T03:47:01.949 INFO:teuthology.orchestra.run.trial154.stdout:check_obsoletes = 1 2026-02-12T03:47:01.951 DEBUG:teuthology.orchestra.run.trial154:> sudo yum clean all 2026-02-12T03:47:01.960 INFO:teuthology.orchestra.run.trial098.stdout:check_obsoletes = 1 2026-02-12T03:47:01.961 DEBUG:teuthology.orchestra.run.trial098:> sudo yum clean all 2026-02-12T03:47:01.962 INFO:teuthology.orchestra.run.trial111.stdout:check_obsoletes = 1 2026-02-12T03:47:01.963 DEBUG:teuthology.orchestra.run.trial111:> sudo yum clean all 2026-02-12T03:47:01.972 INFO:teuthology.orchestra.run.trial091.stdout:check_obsoletes = 1 2026-02-12T03:47:01.974 DEBUG:teuthology.orchestra.run.trial091:> sudo yum clean all 2026-02-12T03:47:02.100 INFO:teuthology.orchestra.run.trial154.stdout:41 files removed 2026-02-12T03:47:02.109 INFO:teuthology.orchestra.run.trial098.stdout:41 files removed 2026-02-12T03:47:02.110 INFO:teuthology.orchestra.run.trial111.stdout:41 files removed 2026-02-12T03:47:02.114 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install ceph-radosgw 2026-02-12T03:47:02.123 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install ceph-radosgw 2026-02-12T03:47:02.125 INFO:teuthology.orchestra.run.trial091.stdout:41 files removed 2026-02-12T03:47:02.126 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-radosgw 2026-02-12T03:47:02.137 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install ceph-radosgw 2026-02-12T03:47:02.910 INFO:teuthology.orchestra.run.trial154.stdout:ceph packages for x86_64 137 kB/s | 89 kB 00:00 2026-02-12T03:47:02.916 INFO:teuthology.orchestra.run.trial111.stdout:ceph packages for x86_64 137 kB/s | 89 kB 00:00 2026-02-12T03:47:02.918 INFO:teuthology.orchestra.run.trial098.stdout:ceph packages for x86_64 137 kB/s | 89 kB 00:00 2026-02-12T03:47:02.935 INFO:teuthology.orchestra.run.trial091.stdout:ceph packages for x86_64 136 kB/s | 89 kB 00:00 2026-02-12T03:47:03.773 INFO:teuthology.orchestra.run.trial091.stdout:ceph noarch packages 23 kB/s | 19 kB 00:00 2026-02-12T03:47:03.774 INFO:teuthology.orchestra.run.trial154.stdout:ceph noarch packages 22 kB/s | 19 kB 00:00 2026-02-12T03:47:03.775 INFO:teuthology.orchestra.run.trial098.stdout:ceph noarch packages 22 kB/s | 19 kB 00:00 2026-02-12T03:47:03.918 INFO:teuthology.orchestra.run.trial111.stdout:ceph noarch packages 19 kB/s | 19 kB 00:00 2026-02-12T03:47:04.349 INFO:teuthology.orchestra.run.trial111.stdout:ceph source packages 4.7 kB/s | 1.9 kB 00:00 2026-02-12T03:47:04.648 INFO:teuthology.orchestra.run.trial098.stdout:ceph source packages 2.3 kB/s | 1.9 kB 00:00 2026-02-12T03:47:04.648 INFO:teuthology.orchestra.run.trial091.stdout:ceph source packages 2.3 kB/s | 1.9 kB 00:00 2026-02-12T03:47:04.651 INFO:teuthology.orchestra.run.trial154.stdout:ceph source packages 2.3 kB/s | 1.9 kB 00:00 2026-02-12T03:47:06.049 INFO:teuthology.orchestra.run.trial098.stdout:CentOS Stream 9 - BaseOS 6.4 MB/s | 8.9 MB 00:01 2026-02-12T03:47:06.217 INFO:teuthology.orchestra.run.trial111.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.9 MB 00:01 2026-02-12T03:47:09.271 INFO:teuthology.orchestra.run.trial154.stdout:CentOS Stream 9 - BaseOS 1.9 MB/s | 8.9 MB 00:04 2026-02-12T03:47:09.295 INFO:teuthology.orchestra.run.trial098.stdout:CentOS Stream 9 - AppStream 9.9 MB/s | 27 MB 00:02 2026-02-12T03:47:09.907 INFO:teuthology.orchestra.run.trial111.stdout:CentOS Stream 9 - AppStream 8.5 MB/s | 27 MB 00:03 2026-02-12T03:47:11.012 INFO:teuthology.orchestra.run.trial091.stdout:CentOS Stream 9 - BaseOS 1.4 MB/s | 8.9 MB 00:06 2026-02-12T03:47:13.977 INFO:teuthology.orchestra.run.trial111.stdout:CentOS Stream 9 - CRB 4.6 MB/s | 7.8 MB 00:01 2026-02-12T03:47:14.931 INFO:teuthology.orchestra.run.trial091.stdout:CentOS Stream 9 - AppStream 7.9 MB/s | 27 MB 00:03 2026-02-12T03:47:15.092 INFO:teuthology.orchestra.run.trial111.stdout:CentOS Stream 9 - Extras packages 50 kB/s | 20 kB 00:00 2026-02-12T03:47:15.976 INFO:teuthology.orchestra.run.trial098.stdout:CentOS Stream 9 - CRB 1.8 MB/s | 7.8 MB 00:04 2026-02-12T03:47:15.984 INFO:teuthology.orchestra.run.trial111.stdout:Extra Packages for Enterprise Linux 25 MB/s | 20 MB 00:00 2026-02-12T03:47:16.694 INFO:teuthology.orchestra.run.trial154.stdout:CentOS Stream 9 - AppStream 3.9 MB/s | 27 MB 00:06 2026-02-12T03:47:16.858 INFO:teuthology.orchestra.run.trial098.stdout:CentOS Stream 9 - Extras packages 118 kB/s | 20 kB 00:00 2026-02-12T03:47:17.492 INFO:teuthology.orchestra.run.trial098.stdout:Extra Packages for Enterprise Linux 36 MB/s | 20 MB 00:00 2026-02-12T03:47:18.198 INFO:teuthology.orchestra.run.trial091.stdout:CentOS Stream 9 - CRB 8.6 MB/s | 7.8 MB 00:00 2026-02-12T03:47:19.263 INFO:teuthology.orchestra.run.trial111.stdout:lab-extras 1.3 MB/s | 50 kB 00:00 2026-02-12T03:47:19.409 INFO:teuthology.orchestra.run.trial091.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 20 kB 00:00 2026-02-12T03:47:20.148 INFO:teuthology.orchestra.run.trial091.stdout:Extra Packages for Enterprise Linux 31 MB/s | 20 MB 00:00 2026-02-12T03:47:20.555 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:47:20.557 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:47:20.557 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repository Size 2026-02-12T03:47:20.557 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:47:20.557 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T03:47:20.557 INFO:teuthology.orchestra.run.trial111.stdout: ceph-radosgw x86_64 2:20.2.0-626.g1279775f.el9 ceph 24 M 2026-02-12T03:47:20.557 INFO:teuthology.orchestra.run.trial111.stdout:Upgrading: 2026-02-12T03:47:20.557 INFO:teuthology.orchestra.run.trial111.stdout: librados2 x86_64 2:20.2.0-626.g1279775f.el9 ceph 3.5 M 2026-02-12T03:47:20.558 INFO:teuthology.orchestra.run.trial111.stdout: librbd1 x86_64 2:20.2.0-626.g1279775f.el9 ceph 2.8 M 2026-02-12T03:47:20.558 INFO:teuthology.orchestra.run.trial111.stdout:Installing dependencies: 2026-02-12T03:47:20.558 INFO:teuthology.orchestra.run.trial111.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-12T03:47:20.558 INFO:teuthology.orchestra.run.trial111.stdout: ceph-base x86_64 2:20.2.0-626.g1279775f.el9 ceph 5.9 M 2026-02-12T03:47:20.558 INFO:teuthology.orchestra.run.trial111.stdout: ceph-common x86_64 2:20.2.0-626.g1279775f.el9 ceph 24 M 2026-02-12T03:47:20.558 INFO:teuthology.orchestra.run.trial111.stdout: ceph-selinux x86_64 2:20.2.0-626.g1279775f.el9 ceph 25 k 2026-02-12T03:47:20.558 INFO:teuthology.orchestra.run.trial111.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-12T03:47:20.558 INFO:teuthology.orchestra.run.trial111.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-12T03:47:20.558 INFO:teuthology.orchestra.run.trial111.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-12T03:47:20.558 INFO:teuthology.orchestra.run.trial111.stdout: libcephfs2 x86_64 2:20.2.0-626.g1279775f.el9 ceph 869 k 2026-02-12T03:47:20.558 INFO:teuthology.orchestra.run.trial111.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-12T03:47:20.559 INFO:teuthology.orchestra.run.trial111.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-12T03:47:20.559 INFO:teuthology.orchestra.run.trial111.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-12T03:47:20.559 INFO:teuthology.orchestra.run.trial111.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-12T03:47:20.559 INFO:teuthology.orchestra.run.trial111.stdout: libradosstriper1 x86_64 2:20.2.0-626.g1279775f.el9 ceph 250 k 2026-02-12T03:47:20.559 INFO:teuthology.orchestra.run.trial111.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-12T03:47:20.559 INFO:teuthology.orchestra.run.trial111.stdout: librgw2 x86_64 2:20.2.0-626.g1279775f.el9 ceph 6.4 M 2026-02-12T03:47:20.559 INFO:teuthology.orchestra.run.trial111.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-12T03:47:20.559 INFO:teuthology.orchestra.run.trial111.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-12T03:47:20.559 INFO:teuthology.orchestra.run.trial111.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-12T03:47:20.559 INFO:teuthology.orchestra.run.trial111.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-12T03:47:20.559 INFO:teuthology.orchestra.run.trial111.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-12T03:47:20.559 INFO:teuthology.orchestra.run.trial111.stdout: python3-ceph-argparse x86_64 2:20.2.0-626.g1279775f.el9 ceph 45 k 2026-02-12T03:47:20.559 INFO:teuthology.orchestra.run.trial111.stdout: python3-ceph-common x86_64 2:20.2.0-626.g1279775f.el9 ceph 175 k 2026-02-12T03:47:20.560 INFO:teuthology.orchestra.run.trial111.stdout: python3-cephfs x86_64 2:20.2.0-626.g1279775f.el9 ceph 163 k 2026-02-12T03:47:20.560 INFO:teuthology.orchestra.run.trial111.stdout: python3-rados x86_64 2:20.2.0-626.g1279775f.el9 ceph 323 k 2026-02-12T03:47:20.560 INFO:teuthology.orchestra.run.trial111.stdout: python3-rbd x86_64 2:20.2.0-626.g1279775f.el9 ceph 304 k 2026-02-12T03:47:20.560 INFO:teuthology.orchestra.run.trial111.stdout: python3-rgw x86_64 2:20.2.0-626.g1279775f.el9 ceph 99 k 2026-02-12T03:47:20.560 INFO:teuthology.orchestra.run.trial111.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-12T03:47:20.560 INFO:teuthology.orchestra.run.trial111.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-12T03:47:20.560 INFO:teuthology.orchestra.run.trial111.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-12T03:47:20.560 INFO:teuthology.orchestra.run.trial111.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-12T03:47:20.560 INFO:teuthology.orchestra.run.trial111.stdout:Installing weak dependencies: 2026-02-12T03:47:20.560 INFO:teuthology.orchestra.run.trial111.stdout: libcephfs-daemon x86_64 2:20.2.0-626.g1279775f.el9 ceph 35 k 2026-02-12T03:47:20.560 INFO:teuthology.orchestra.run.trial111.stdout: libcephfs-proxy2 x86_64 2:20.2.0-626.g1279775f.el9 ceph 24 k 2026-02-12T03:47:20.560 INFO:teuthology.orchestra.run.trial111.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-12T03:47:20.561 INFO:teuthology.orchestra.run.trial111.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-12T03:47:20.561 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:47:20.561 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T03:47:20.561 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:47:20.561 INFO:teuthology.orchestra.run.trial111.stdout:Install 35 Packages 2026-02-12T03:47:20.561 INFO:teuthology.orchestra.run.trial111.stdout:Upgrade 2 Packages 2026-02-12T03:47:20.561 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:47:20.562 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 79 M 2026-02-12T03:47:20.562 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T03:47:20.732 INFO:teuthology.orchestra.run.trial098.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-12T03:47:21.433 INFO:teuthology.orchestra.run.trial111.stdout:(1/37): ceph-base-20.2.0-626.g1279775f.el9.x86_ 15 MB/s | 5.9 MB 00:00 2026-02-12T03:47:21.477 INFO:teuthology.orchestra.run.trial111.stdout:(2/37): ceph-selinux-20.2.0-626.g1279775f.el9.x 578 kB/s | 25 kB 00:00 2026-02-12T03:47:21.522 INFO:teuthology.orchestra.run.trial111.stdout:(3/37): libcephfs-daemon-20.2.0-626.g1279775f.e 791 kB/s | 35 kB 00:00 2026-02-12T03:47:21.570 INFO:teuthology.orchestra.run.trial111.stdout:(4/37): libcephfs-proxy2-20.2.0-626.g1279775f.e 505 kB/s | 24 kB 00:00 2026-02-12T03:47:21.636 INFO:teuthology.orchestra.run.trial111.stdout:(5/37): libcephfs2-20.2.0-626.g1279775f.el9.x86 13 MB/s | 869 kB 00:00 2026-02-12T03:47:21.693 INFO:teuthology.orchestra.run.trial111.stdout:(6/37): libradosstriper1-20.2.0-626.g1279775f.e 4.3 MB/s | 250 kB 00:00 2026-02-12T03:47:22.010 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:47:22.012 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:47:22.012 INFO:teuthology.orchestra.run.trial098.stdout: Package Arch Version Repository Size 2026-02-12T03:47:22.012 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:47:22.012 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-12T03:47:22.012 INFO:teuthology.orchestra.run.trial098.stdout: ceph-radosgw x86_64 2:20.2.0-626.g1279775f.el9 ceph 24 M 2026-02-12T03:47:22.012 INFO:teuthology.orchestra.run.trial098.stdout:Upgrading: 2026-02-12T03:47:22.013 INFO:teuthology.orchestra.run.trial098.stdout: librados2 x86_64 2:20.2.0-626.g1279775f.el9 ceph 3.5 M 2026-02-12T03:47:22.013 INFO:teuthology.orchestra.run.trial098.stdout: librbd1 x86_64 2:20.2.0-626.g1279775f.el9 ceph 2.8 M 2026-02-12T03:47:22.013 INFO:teuthology.orchestra.run.trial098.stdout:Installing dependencies: 2026-02-12T03:47:22.013 INFO:teuthology.orchestra.run.trial098.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-12T03:47:22.013 INFO:teuthology.orchestra.run.trial098.stdout: ceph-base x86_64 2:20.2.0-626.g1279775f.el9 ceph 5.9 M 2026-02-12T03:47:22.013 INFO:teuthology.orchestra.run.trial098.stdout: ceph-common x86_64 2:20.2.0-626.g1279775f.el9 ceph 24 M 2026-02-12T03:47:22.013 INFO:teuthology.orchestra.run.trial098.stdout: ceph-selinux x86_64 2:20.2.0-626.g1279775f.el9 ceph 25 k 2026-02-12T03:47:22.013 INFO:teuthology.orchestra.run.trial098.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-12T03:47:22.013 INFO:teuthology.orchestra.run.trial098.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-12T03:47:22.013 INFO:teuthology.orchestra.run.trial098.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-12T03:47:22.013 INFO:teuthology.orchestra.run.trial098.stdout: libcephfs2 x86_64 2:20.2.0-626.g1279775f.el9 ceph 869 k 2026-02-12T03:47:22.013 INFO:teuthology.orchestra.run.trial098.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-12T03:47:22.014 INFO:teuthology.orchestra.run.trial098.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-12T03:47:22.014 INFO:teuthology.orchestra.run.trial098.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-12T03:47:22.014 INFO:teuthology.orchestra.run.trial098.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-12T03:47:22.014 INFO:teuthology.orchestra.run.trial098.stdout: libradosstriper1 x86_64 2:20.2.0-626.g1279775f.el9 ceph 250 k 2026-02-12T03:47:22.014 INFO:teuthology.orchestra.run.trial098.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-12T03:47:22.014 INFO:teuthology.orchestra.run.trial098.stdout: librgw2 x86_64 2:20.2.0-626.g1279775f.el9 ceph 6.4 M 2026-02-12T03:47:22.014 INFO:teuthology.orchestra.run.trial098.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-12T03:47:22.014 INFO:teuthology.orchestra.run.trial098.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-12T03:47:22.014 INFO:teuthology.orchestra.run.trial098.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-12T03:47:22.014 INFO:teuthology.orchestra.run.trial098.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-12T03:47:22.014 INFO:teuthology.orchestra.run.trial098.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-12T03:47:22.014 INFO:teuthology.orchestra.run.trial098.stdout: python3-ceph-argparse x86_64 2:20.2.0-626.g1279775f.el9 ceph 45 k 2026-02-12T03:47:22.014 INFO:teuthology.orchestra.run.trial098.stdout: python3-ceph-common x86_64 2:20.2.0-626.g1279775f.el9 ceph 175 k 2026-02-12T03:47:22.015 INFO:teuthology.orchestra.run.trial098.stdout: python3-cephfs x86_64 2:20.2.0-626.g1279775f.el9 ceph 163 k 2026-02-12T03:47:22.015 INFO:teuthology.orchestra.run.trial098.stdout: python3-rados x86_64 2:20.2.0-626.g1279775f.el9 ceph 323 k 2026-02-12T03:47:22.015 INFO:teuthology.orchestra.run.trial098.stdout: python3-rbd x86_64 2:20.2.0-626.g1279775f.el9 ceph 304 k 2026-02-12T03:47:22.015 INFO:teuthology.orchestra.run.trial098.stdout: python3-rgw x86_64 2:20.2.0-626.g1279775f.el9 ceph 99 k 2026-02-12T03:47:22.015 INFO:teuthology.orchestra.run.trial098.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-12T03:47:22.015 INFO:teuthology.orchestra.run.trial098.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-12T03:47:22.015 INFO:teuthology.orchestra.run.trial098.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-12T03:47:22.015 INFO:teuthology.orchestra.run.trial098.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-12T03:47:22.015 INFO:teuthology.orchestra.run.trial098.stdout:Installing weak dependencies: 2026-02-12T03:47:22.015 INFO:teuthology.orchestra.run.trial098.stdout: libcephfs-daemon x86_64 2:20.2.0-626.g1279775f.el9 ceph 35 k 2026-02-12T03:47:22.015 INFO:teuthology.orchestra.run.trial098.stdout: libcephfs-proxy2 x86_64 2:20.2.0-626.g1279775f.el9 ceph 24 k 2026-02-12T03:47:22.015 INFO:teuthology.orchestra.run.trial098.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-12T03:47:22.015 INFO:teuthology.orchestra.run.trial098.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-12T03:47:22.016 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:47:22.016 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-12T03:47:22.016 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:47:22.016 INFO:teuthology.orchestra.run.trial098.stdout:Install 35 Packages 2026-02-12T03:47:22.016 INFO:teuthology.orchestra.run.trial098.stdout:Upgrade 2 Packages 2026-02-12T03:47:22.016 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:47:22.017 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 79 M 2026-02-12T03:47:22.017 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-12T03:47:22.124 INFO:teuthology.orchestra.run.trial111.stdout:(7/37): ceph-common-20.2.0-626.g1279775f.el9.x8 22 MB/s | 24 MB 00:01 2026-02-12T03:47:22.138 INFO:teuthology.orchestra.run.trial111.stdout:(8/37): python3-ceph-argparse-20.2.0-626.g12797 3.3 MB/s | 45 kB 00:00 2026-02-12T03:47:22.145 INFO:teuthology.orchestra.run.trial111.stdout:(9/37): librgw2-20.2.0-626.g1279775f.el9.x86_64 14 MB/s | 6.4 MB 00:00 2026-02-12T03:47:22.160 INFO:teuthology.orchestra.run.trial111.stdout:(10/37): python3-ceph-common-20.2.0-626.g127977 7.9 MB/s | 175 kB 00:00 2026-02-12T03:47:22.170 INFO:teuthology.orchestra.run.trial111.stdout:(11/37): python3-cephfs-20.2.0-626.g1279775f.el 6.4 MB/s | 163 kB 00:00 2026-02-12T03:47:22.187 INFO:teuthology.orchestra.run.trial111.stdout:(12/37): python3-rados-20.2.0-626.g1279775f.el9 11 MB/s | 323 kB 00:00 2026-02-12T03:47:22.201 INFO:teuthology.orchestra.run.trial111.stdout:(13/37): python3-rbd-20.2.0-626.g1279775f.el9.x 9.7 MB/s | 304 kB 00:00 2026-02-12T03:47:22.214 INFO:teuthology.orchestra.run.trial111.stdout:(14/37): python3-rgw-20.2.0-626.g1279775f.el9.x 3.6 MB/s | 99 kB 00:00 2026-02-12T03:47:22.303 INFO:teuthology.orchestra.run.trial111.stdout:(15/37): ceph-radosgw-20.2.0-626.g1279775f.el9. 19 MB/s | 24 MB 00:01 2026-02-12T03:47:22.304 INFO:teuthology.orchestra.run.trial111.stdout:(16/37): mailcap-2.1.49-5.el9.noarch.rpm 325 kB/s | 33 kB 00:00 2026-02-12T03:47:22.420 INFO:teuthology.orchestra.run.trial111.stdout:(17/37): nvme-cli-2.13-1.el9.x86_64.rpm 5.3 MB/s | 1.1 MB 00:00 2026-02-12T03:47:22.423 INFO:teuthology.orchestra.run.trial111.stdout:(18/37): pciutils-3.7.0-7.el9.x86_64.rpm 780 kB/s | 93 kB 00:00 2026-02-12T03:47:22.626 INFO:teuthology.orchestra.run.trial098.stdout:(1/37): ceph-base-20.2.0-626.g1279775f.el9.x86_ 15 MB/s | 5.9 MB 00:00 2026-02-12T03:47:22.662 INFO:teuthology.orchestra.run.trial098.stdout:(2/37): ceph-selinux-20.2.0-626.g1279775f.el9.x 681 kB/s | 25 kB 00:00 2026-02-12T03:47:22.703 INFO:teuthology.orchestra.run.trial098.stdout:(3/37): libcephfs-daemon-20.2.0-626.g1279775f.e 870 kB/s | 35 kB 00:00 2026-02-12T03:47:22.744 INFO:teuthology.orchestra.run.trial098.stdout:(4/37): libcephfs-proxy2-20.2.0-626.g1279775f.e 591 kB/s | 24 kB 00:00 2026-02-12T03:47:22.804 INFO:teuthology.orchestra.run.trial098.stdout:(5/37): libcephfs2-20.2.0-626.g1279775f.el9.x86 14 MB/s | 869 kB 00:00 2026-02-12T03:47:22.855 INFO:teuthology.orchestra.run.trial098.stdout:(6/37): libradosstriper1-20.2.0-626.g1279775f.e 4.8 MB/s | 250 kB 00:00 2026-02-12T03:47:22.991 INFO:teuthology.orchestra.run.trial111.stdout:(19/37): boost-program-options-1.75.0-13.el9.x8 151 kB/s | 104 kB 00:00 2026-02-12T03:47:23.145 INFO:teuthology.orchestra.run.trial111.stdout:(20/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 295 kB/s | 45 kB 00:00 2026-02-12T03:47:23.182 INFO:teuthology.orchestra.run.trial111.stdout:(21/37): libnbd-1.20.3-4.el9.x86_64.rpm 215 kB/s | 164 kB 00:00 2026-02-12T03:47:23.195 INFO:teuthology.orchestra.run.trial111.stdout:(22/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 207 kB/s | 160 kB 00:00 2026-02-12T03:47:23.276 INFO:teuthology.orchestra.run.trial098.stdout:(7/37): librgw2-20.2.0-626.g1279775f.el9.x86_64 15 MB/s | 6.4 MB 00:00 2026-02-12T03:47:23.303 INFO:teuthology.orchestra.run.trial091.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-12T03:47:23.314 INFO:teuthology.orchestra.run.trial098.stdout:(8/37): python3-ceph-argparse-20.2.0-626.g12797 1.2 MB/s | 45 kB 00:00 2026-02-12T03:47:23.357 INFO:teuthology.orchestra.run.trial098.stdout:(9/37): python3-ceph-common-20.2.0-626.g1279775 4.1 MB/s | 175 kB 00:00 2026-02-12T03:47:23.399 INFO:teuthology.orchestra.run.trial098.stdout:(10/37): python3-cephfs-20.2.0-626.g1279775f.el 3.8 MB/s | 163 kB 00:00 2026-02-12T03:47:23.444 INFO:teuthology.orchestra.run.trial098.stdout:(11/37): python3-rados-20.2.0-626.g1279775f.el9 6.9 MB/s | 323 kB 00:00 2026-02-12T03:47:23.481 INFO:teuthology.orchestra.run.trial098.stdout:(12/37): ceph-radosgw-20.2.0-626.g1279775f.el9. 19 MB/s | 24 MB 00:01 2026-02-12T03:47:23.482 INFO:teuthology.orchestra.run.trial098.stdout:(13/37): python3-rbd-20.2.0-626.g1279775f.el9.x 7.8 MB/s | 304 kB 00:00 2026-02-12T03:47:23.514 INFO:teuthology.orchestra.run.trial098.stdout:(14/37): ceph-common-20.2.0-626.g1279775f.el9.x 19 MB/s | 24 MB 00:01 2026-02-12T03:47:23.515 INFO:teuthology.orchestra.run.trial098.stdout:(15/37): python3-rgw-20.2.0-626.g1279775f.el9.x 2.9 MB/s | 99 kB 00:00 2026-02-12T03:47:23.540 INFO:teuthology.orchestra.run.trial098.stdout:(16/37): mailcap-2.1.49-5.el9.noarch.rpm 575 kB/s | 33 kB 00:00 2026-02-12T03:47:23.548 INFO:teuthology.orchestra.run.trial098.stdout:(17/37): pciutils-3.7.0-7.el9.x86_64.rpm 2.7 MB/s | 93 kB 00:00 2026-02-12T03:47:23.576 INFO:teuthology.orchestra.run.trial098.stdout:(18/37): nvme-cli-2.13-1.el9.x86_64.rpm 18 MB/s | 1.1 MB 00:00 2026-02-12T03:47:23.579 INFO:teuthology.orchestra.run.trial111.stdout:(23/37): qatlib-25.08.0-2.el9.x86_64.rpm 624 kB/s | 240 kB 00:00 2026-02-12T03:47:23.635 INFO:teuthology.orchestra.run.trial111.stdout:(24/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 645 kB/s | 292 kB 00:00 2026-02-12T03:47:23.732 INFO:teuthology.orchestra.run.trial111.stdout:(25/37): qatlib-service-25.08.0-2.el9.x86_64.rp 242 kB/s | 37 kB 00:00 2026-02-12T03:47:23.790 INFO:teuthology.orchestra.run.trial111.stdout:(26/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 428 kB/s | 66 kB 00:00 2026-02-12T03:47:23.935 INFO:teuthology.orchestra.run.trial111.stdout:(27/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.5 MB/s | 308 kB 00:00 2026-02-12T03:47:23.955 INFO:teuthology.orchestra.run.trial111.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 1.2 MB/s | 25 kB 00:00 2026-02-12T03:47:23.973 INFO:teuthology.orchestra.run.trial111.stdout:(29/37): librdkafka-1.6.1-102.el9.x86_64.rpm 799 kB/s | 662 kB 00:00 2026-02-12T03:47:23.976 INFO:teuthology.orchestra.run.trial111.stdout:(30/37): liboath-2.6.12-1.el9.x86_64.rpm 2.3 MB/s | 49 kB 00:00 2026-02-12T03:47:24.095 INFO:teuthology.orchestra.run.trial111.stdout:(31/37): libunwind-1.6.2-1.el9.x86_64.rpm 555 kB/s | 67 kB 00:00 2026-02-12T03:47:24.153 INFO:teuthology.orchestra.run.trial111.stdout:(32/37): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2026-02-12T03:47:24.167 INFO:teuthology.orchestra.run.trial111.stdout:(33/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 4.3 MB/s | 838 kB 00:00 2026-02-12T03:47:24.230 INFO:teuthology.orchestra.run.trial098.stdout:(19/37): boost-program-options-1.75.0-13.el9.x8 151 kB/s | 104 kB 00:00 2026-02-12T03:47:24.312 INFO:teuthology.orchestra.run.trial098.stdout:(20/37): libnbd-1.20.3-4.el9.x86_64.rpm 214 kB/s | 164 kB 00:00 2026-02-12T03:47:24.336 INFO:teuthology.orchestra.run.trial111.stdout:(34/37): librados2-20.2.0-626.g1279775f.el9.x86 21 MB/s | 3.5 MB 00:00 2026-02-12T03:47:24.383 INFO:teuthology.orchestra.run.trial098.stdout:(21/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 295 kB/s | 45 kB 00:00 2026-02-12T03:47:24.402 INFO:teuthology.orchestra.run.trial111.stdout:(35/37): librbd1-20.2.0-626.g1279775f.el9.x86_6 44 MB/s | 2.8 MB 00:00 2026-02-12T03:47:24.416 INFO:teuthology.orchestra.run.trial098.stdout:(22/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 191 kB/s | 160 kB 00:00 2026-02-12T03:47:24.500 INFO:teuthology.orchestra.run.trial111.stdout:(36/37): thrift-0.15.0-4.el9.x86_64.rpm 4.6 MB/s | 1.6 MB 00:00 2026-02-12T03:47:24.601 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:47:24.603 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:47:24.603 INFO:teuthology.orchestra.run.trial091.stdout: Package Arch Version Repository Size 2026-02-12T03:47:24.603 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:47:24.603 INFO:teuthology.orchestra.run.trial091.stdout:Installing: 2026-02-12T03:47:24.603 INFO:teuthology.orchestra.run.trial091.stdout: ceph-radosgw x86_64 2:20.2.0-626.g1279775f.el9 ceph 24 M 2026-02-12T03:47:24.603 INFO:teuthology.orchestra.run.trial091.stdout:Upgrading: 2026-02-12T03:47:24.603 INFO:teuthology.orchestra.run.trial091.stdout: librados2 x86_64 2:20.2.0-626.g1279775f.el9 ceph 3.5 M 2026-02-12T03:47:24.603 INFO:teuthology.orchestra.run.trial091.stdout: librbd1 x86_64 2:20.2.0-626.g1279775f.el9 ceph 2.8 M 2026-02-12T03:47:24.604 INFO:teuthology.orchestra.run.trial091.stdout:Installing dependencies: 2026-02-12T03:47:24.604 INFO:teuthology.orchestra.run.trial091.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-12T03:47:24.604 INFO:teuthology.orchestra.run.trial091.stdout: ceph-base x86_64 2:20.2.0-626.g1279775f.el9 ceph 5.9 M 2026-02-12T03:47:24.604 INFO:teuthology.orchestra.run.trial091.stdout: ceph-common x86_64 2:20.2.0-626.g1279775f.el9 ceph 24 M 2026-02-12T03:47:24.604 INFO:teuthology.orchestra.run.trial091.stdout: ceph-selinux x86_64 2:20.2.0-626.g1279775f.el9 ceph 25 k 2026-02-12T03:47:24.604 INFO:teuthology.orchestra.run.trial091.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-12T03:47:24.604 INFO:teuthology.orchestra.run.trial091.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-12T03:47:24.604 INFO:teuthology.orchestra.run.trial091.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-12T03:47:24.604 INFO:teuthology.orchestra.run.trial091.stdout: libcephfs2 x86_64 2:20.2.0-626.g1279775f.el9 ceph 869 k 2026-02-12T03:47:24.604 INFO:teuthology.orchestra.run.trial091.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-12T03:47:24.604 INFO:teuthology.orchestra.run.trial091.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-12T03:47:24.604 INFO:teuthology.orchestra.run.trial091.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-12T03:47:24.605 INFO:teuthology.orchestra.run.trial091.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-12T03:47:24.605 INFO:teuthology.orchestra.run.trial091.stdout: libradosstriper1 x86_64 2:20.2.0-626.g1279775f.el9 ceph 250 k 2026-02-12T03:47:24.605 INFO:teuthology.orchestra.run.trial091.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-12T03:47:24.605 INFO:teuthology.orchestra.run.trial091.stdout: librgw2 x86_64 2:20.2.0-626.g1279775f.el9 ceph 6.4 M 2026-02-12T03:47:24.605 INFO:teuthology.orchestra.run.trial091.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-12T03:47:24.605 INFO:teuthology.orchestra.run.trial091.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-12T03:47:24.605 INFO:teuthology.orchestra.run.trial091.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-12T03:47:24.605 INFO:teuthology.orchestra.run.trial091.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-12T03:47:24.605 INFO:teuthology.orchestra.run.trial091.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-12T03:47:24.605 INFO:teuthology.orchestra.run.trial091.stdout: python3-ceph-argparse x86_64 2:20.2.0-626.g1279775f.el9 ceph 45 k 2026-02-12T03:47:24.605 INFO:teuthology.orchestra.run.trial091.stdout: python3-ceph-common x86_64 2:20.2.0-626.g1279775f.el9 ceph 175 k 2026-02-12T03:47:24.605 INFO:teuthology.orchestra.run.trial091.stdout: python3-cephfs x86_64 2:20.2.0-626.g1279775f.el9 ceph 163 k 2026-02-12T03:47:24.606 INFO:teuthology.orchestra.run.trial091.stdout: python3-rados x86_64 2:20.2.0-626.g1279775f.el9 ceph 323 k 2026-02-12T03:47:24.606 INFO:teuthology.orchestra.run.trial091.stdout: python3-rbd x86_64 2:20.2.0-626.g1279775f.el9 ceph 304 k 2026-02-12T03:47:24.606 INFO:teuthology.orchestra.run.trial091.stdout: python3-rgw x86_64 2:20.2.0-626.g1279775f.el9 ceph 99 k 2026-02-12T03:47:24.606 INFO:teuthology.orchestra.run.trial091.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-12T03:47:24.606 INFO:teuthology.orchestra.run.trial091.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-12T03:47:24.606 INFO:teuthology.orchestra.run.trial091.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-12T03:47:24.606 INFO:teuthology.orchestra.run.trial091.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-12T03:47:24.606 INFO:teuthology.orchestra.run.trial091.stdout:Installing weak dependencies: 2026-02-12T03:47:24.606 INFO:teuthology.orchestra.run.trial091.stdout: libcephfs-daemon x86_64 2:20.2.0-626.g1279775f.el9 ceph 35 k 2026-02-12T03:47:24.606 INFO:teuthology.orchestra.run.trial091.stdout: libcephfs-proxy2 x86_64 2:20.2.0-626.g1279775f.el9 ceph 24 k 2026-02-12T03:47:24.606 INFO:teuthology.orchestra.run.trial091.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-12T03:47:24.606 INFO:teuthology.orchestra.run.trial091.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-12T03:47:24.607 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:47:24.607 INFO:teuthology.orchestra.run.trial091.stdout:Transaction Summary 2026-02-12T03:47:24.607 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:47:24.607 INFO:teuthology.orchestra.run.trial091.stdout:Install 35 Packages 2026-02-12T03:47:24.607 INFO:teuthology.orchestra.run.trial091.stdout:Upgrade 2 Packages 2026-02-12T03:47:24.607 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:47:24.608 INFO:teuthology.orchestra.run.trial091.stdout:Total download size: 79 M 2026-02-12T03:47:24.608 INFO:teuthology.orchestra.run.trial091.stdout:Downloading Packages: 2026-02-12T03:47:24.797 INFO:teuthology.orchestra.run.trial098.stdout:(23/37): qatlib-25.08.0-2.el9.x86_64.rpm 630 kB/s | 240 kB 00:00 2026-02-12T03:47:24.839 INFO:teuthology.orchestra.run.trial098.stdout:(24/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 642 kB/s | 292 kB 00:00 2026-02-12T03:47:24.902 INFO:teuthology.orchestra.run.trial111.stdout:(37/37): libarrow-9.0.0-15.el9.x86_64.rpm 4.0 MB/s | 4.4 MB 00:01 2026-02-12T03:47:24.906 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:47:24.906 INFO:teuthology.orchestra.run.trial111.stdout:Total 18 MB/s | 79 MB 00:04 2026-02-12T03:47:24.949 INFO:teuthology.orchestra.run.trial098.stdout:(25/37): qatlib-service-25.08.0-2.el9.x86_64.rp 243 kB/s | 37 kB 00:00 2026-02-12T03:47:24.994 INFO:teuthology.orchestra.run.trial098.stdout:(26/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 429 kB/s | 66 kB 00:00 2026-02-12T03:47:25.005 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T03:47:25.025 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T03:47:25.025 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T03:47:25.148 INFO:teuthology.orchestra.run.trial098.stdout:(27/37): librdkafka-1.6.1-102.el9.x86_64.rpm 793 kB/s | 662 kB 00:00 2026-02-12T03:47:25.272 INFO:teuthology.orchestra.run.trial098.stdout:(28/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 954 kB/s | 308 kB 00:00 2026-02-12T03:47:25.318 INFO:teuthology.orchestra.run.trial098.stdout:(29/37): liboath-2.6.12-1.el9.x86_64.rpm 1.0 MB/s | 49 kB 00:00 2026-02-12T03:47:25.322 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T03:47:25.322 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T03:47:25.328 INFO:teuthology.orchestra.run.trial098.stdout:(30/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 138 kB/s | 25 kB 00:00 2026-02-12T03:47:25.365 INFO:teuthology.orchestra.run.trial098.stdout:(31/37): libunwind-1.6.2-1.el9.x86_64.rpm 1.4 MB/s | 67 kB 00:00 2026-02-12T03:47:25.425 INFO:teuthology.orchestra.run.trial098.stdout:(32/37): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2026-02-12T03:47:25.478 INFO:teuthology.orchestra.run.trial098.stdout:(33/37): libarrow-9.0.0-15.el9.x86_64.rpm 9.1 MB/s | 4.4 MB 00:00 2026-02-12T03:47:25.569 INFO:teuthology.orchestra.run.trial098.stdout:(34/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 3.4 MB/s | 838 kB 00:00 2026-02-12T03:47:25.576 INFO:teuthology.orchestra.run.trial098.stdout:(35/37): thrift-0.15.0-4.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2026-02-12T03:47:25.595 INFO:teuthology.orchestra.run.trial091.stdout:(1/37): ceph-base-20.2.0-626.g1279775f.el9.x86_ 17 MB/s | 5.9 MB 00:00 2026-02-12T03:47:25.629 INFO:teuthology.orchestra.run.trial091.stdout:(2/37): ceph-selinux-20.2.0-626.g1279775f.el9.x 752 kB/s | 25 kB 00:00 2026-02-12T03:47:25.667 INFO:teuthology.orchestra.run.trial091.stdout:(3/37): libcephfs-daemon-20.2.0-626.g1279775f.e 927 kB/s | 35 kB 00:00 2026-02-12T03:47:25.674 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T03:47:25.685 INFO:teuthology.orchestra.run.trial111.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/39 2026-02-12T03:47:25.708 INFO:teuthology.orchestra.run.trial091.stdout:(4/37): libcephfs-proxy2-20.2.0-626.g1279775f.e 591 kB/s | 24 kB 00:00 2026-02-12T03:47:25.768 INFO:teuthology.orchestra.run.trial091.stdout:(5/37): libcephfs2-20.2.0-626.g1279775f.el9.x86 14 MB/s | 869 kB 00:00 2026-02-12T03:47:25.818 INFO:teuthology.orchestra.run.trial091.stdout:(6/37): libradosstriper1-20.2.0-626.g1279775f.e 4.9 MB/s | 250 kB 00:00 2026-02-12T03:47:25.841 INFO:teuthology.orchestra.run.trial111.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/39 2026-02-12T03:47:25.846 INFO:teuthology.orchestra.run.trial111.stdout: Upgrading : librados2-2:20.2.0-626.g1279775f.el9.x86_64 3/39 2026-02-12T03:47:25.896 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: librados2-2:20.2.0-626.g1279775f.el9.x86_64 3/39 2026-02-12T03:47:25.898 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libcephfs2-2:20.2.0-626.g1279775f.el9.x86_64 4/39 2026-02-12T03:47:25.910 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: libcephfs2-2:20.2.0-626.g1279775f.el9.x86_64 4/39 2026-02-12T03:47:25.912 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libcephfs-daemon-2:20.2.0-626.g1279775f.el9.x86_64 5/39 2026-02-12T03:47:25.913 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libcephfs-proxy2-2:20.2.0-626.g1279775f.el9.x86_64 6/39 2026-02-12T03:47:25.940 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-626.g1279775f.el9.x86_64 6/39 2026-02-12T03:47:25.943 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-rados-2:20.2.0-626.g1279775f.el9.x86_64 7/39 2026-02-12T03:47:25.951 INFO:teuthology.orchestra.run.trial111.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/39 2026-02-12T03:47:25.953 INFO:teuthology.orchestra.run.trial111.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/39 2026-02-12T03:47:25.956 INFO:teuthology.orchestra.run.trial111.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 10/39 2026-02-12T03:47:25.960 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 11/39 2026-02-12T03:47:25.969 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-ceph-argparse-2:20.2.0-626.g1279775f.el9.x 12/39 2026-02-12T03:47:25.981 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-cephfs-2:20.2.0-626.g1279775f.el9.x86_64 13/39 2026-02-12T03:47:25.982 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libradosstriper1-2:20.2.0-626.g1279775f.el9.x86_64 14/39 2026-02-12T03:47:25.996 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: libradosstriper1-2:20.2.0-626.g1279775f.el9.x86_64 14/39 2026-02-12T03:47:26.028 INFO:teuthology.orchestra.run.trial111.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-12T03:47:26.032 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-12T03:47:26.038 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-12T03:47:26.041 INFO:teuthology.orchestra.run.trial111.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-12T03:47:26.045 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-12T03:47:26.170 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-12T03:47:26.172 INFO:teuthology.orchestra.run.trial111.stdout: Upgrading : librbd1-2:20.2.0-626.g1279775f.el9.x86_64 21/39 2026-02-12T03:47:26.177 INFO:teuthology.orchestra.run.trial091.stdout:(7/37): librgw2-20.2.0-626.g1279775f.el9.x86_64 18 MB/s | 6.4 MB 00:00 2026-02-12T03:47:26.198 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: librbd1-2:20.2.0-626.g1279775f.el9.x86_64 21/39 2026-02-12T03:47:26.201 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-rbd-2:20.2.0-626.g1279775f.el9.x86_64 22/39 2026-02-12T03:47:26.207 INFO:teuthology.orchestra.run.trial111.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-12T03:47:26.216 INFO:teuthology.orchestra.run.trial091.stdout:(8/37): python3-ceph-argparse-20.2.0-626.g12797 1.2 MB/s | 45 kB 00:00 2026-02-12T03:47:26.257 INFO:teuthology.orchestra.run.trial091.stdout:(9/37): python3-ceph-common-20.2.0-626.g1279775 4.2 MB/s | 175 kB 00:00 2026-02-12T03:47:26.298 INFO:teuthology.orchestra.run.trial091.stdout:(10/37): python3-cephfs-20.2.0-626.g1279775f.el 3.9 MB/s | 163 kB 00:00 2026-02-12T03:47:26.342 INFO:teuthology.orchestra.run.trial091.stdout:(11/37): python3-rados-20.2.0-626.g1279775f.el9 7.1 MB/s | 323 kB 00:00 2026-02-12T03:47:26.394 INFO:teuthology.orchestra.run.trial091.stdout:(12/37): ceph-common-20.2.0-626.g1279775f.el9.x 21 MB/s | 24 MB 00:01 2026-02-12T03:47:26.395 INFO:teuthology.orchestra.run.trial091.stdout:(13/37): python3-rbd-20.2.0-626.g1279775f.el9.x 5.7 MB/s | 304 kB 00:00 2026-02-12T03:47:26.406 INFO:teuthology.orchestra.run.trial091.stdout:(14/37): python3-rgw-20.2.0-626.g1279775f.el9.x 7.8 MB/s | 99 kB 00:00 2026-02-12T03:47:26.477 INFO:teuthology.orchestra.run.trial091.stdout:(15/37): ceph-radosgw-20.2.0-626.g1279775f.el9. 19 MB/s | 24 MB 00:01 2026-02-12T03:47:26.477 INFO:teuthology.orchestra.run.trial091.stdout:(16/37): mailcap-2.1.49-5.el9.noarch.rpm 403 kB/s | 33 kB 00:00 2026-02-12T03:47:26.491 INFO:teuthology.orchestra.run.trial111.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-12T03:47:26.492 INFO:teuthology.orchestra.run.trial111.stdout: Installing : librgw2-2:20.2.0-626.g1279775f.el9.x86_64 25/39 2026-02-12T03:47:26.507 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: librgw2-2:20.2.0-626.g1279775f.el9.x86_64 25/39 2026-02-12T03:47:26.511 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-rgw-2:20.2.0-626.g1279775f.el9.x86_64 26/39 2026-02-12T03:47:26.517 INFO:teuthology.orchestra.run.trial111.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-12T03:47:26.520 INFO:teuthology.orchestra.run.trial111.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-12T03:47:26.520 INFO:teuthology.orchestra.run.trial091.stdout:(17/37): pciutils-3.7.0-7.el9.x86_64.rpm 2.1 MB/s | 93 kB 00:00 2026-02-12T03:47:26.521 INFO:teuthology.orchestra.run.trial111.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-12T03:47:26.538 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-12T03:47:26.542 INFO:teuthology.orchestra.run.trial091.stdout:(18/37): boost-program-options-1.75.0-13.el9.x8 1.6 MB/s | 104 kB 00:00 2026-02-12T03:47:26.544 INFO:teuthology.orchestra.run.trial091.stdout:(19/37): libnbd-1.20.3-4.el9.x86_64.rpm 6.8 MB/s | 164 kB 00:00 2026-02-12T03:47:26.567 INFO:teuthology.orchestra.run.trial091.stdout:(20/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.9 MB/s | 45 kB 00:00 2026-02-12T03:47:26.569 INFO:teuthology.orchestra.run.trial098.stdout:(36/37): librbd1-20.2.0-626.g1279775f.el9.x86_6 2.8 MB/s | 2.8 MB 00:00 2026-02-12T03:47:26.582 INFO:teuthology.orchestra.run.trial091.stdout:(21/37): nvme-cli-2.13-1.el9.x86_64.rpm 6.2 MB/s | 1.1 MB 00:00 2026-02-12T03:47:26.587 INFO:teuthology.orchestra.run.trial091.stdout:(22/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.5 MB/s | 160 kB 00:00 2026-02-12T03:47:26.594 INFO:teuthology.orchestra.run.trial098.stdout:(37/37): librados2-20.2.0-626.g1279775f.el9.x86 3.2 MB/s | 3.5 MB 00:01 2026-02-12T03:47:26.597 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:47:26.597 INFO:teuthology.orchestra.run.trial098.stdout:Total 17 MB/s | 79 MB 00:04 2026-02-12T03:47:26.606 INFO:teuthology.orchestra.run.trial091.stdout:(23/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 12 MB/s | 292 kB 00:00 2026-02-12T03:47:26.612 INFO:teuthology.orchestra.run.trial091.stdout:(24/37): qatlib-25.08.0-2.el9.x86_64.rpm 9.1 MB/s | 240 kB 00:00 2026-02-12T03:47:26.614 INFO:teuthology.orchestra.run.trial091.stdout:(25/37): librdkafka-1.6.1-102.el9.x86_64.rpm 14 MB/s | 662 kB 00:00 2026-02-12T03:47:26.628 INFO:teuthology.orchestra.run.trial091.stdout:(26/37): qatlib-service-25.08.0-2.el9.x86_64.rp 1.7 MB/s | 37 kB 00:00 2026-02-12T03:47:26.635 INFO:teuthology.orchestra.run.trial091.stdout:(27/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.9 MB/s | 66 kB 00:00 2026-02-12T03:47:26.650 INFO:teuthology.orchestra.run.trial111.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-12T03:47:26.652 INFO:teuthology.orchestra.run.trial111.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-12T03:47:26.685 INFO:teuthology.orchestra.run.trial091.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 493 kB/s | 25 kB 00:00 2026-02-12T03:47:26.692 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-12T03:47:26.711 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-12T03:47:26.711 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-12T03:47:26.719 INFO:teuthology.orchestra.run.trial091.stdout:(29/37): liboath-2.6.12-1.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2026-02-12T03:47:26.733 INFO:teuthology.orchestra.run.trial091.stdout:(30/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.5 MB/s | 308 kB 00:00 2026-02-12T03:47:26.744 INFO:teuthology.orchestra.run.trial091.stdout:(31/37): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2026-02-12T03:47:26.784 INFO:teuthology.orchestra.run.trial091.stdout:(32/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 16 MB/s | 838 kB 00:00 2026-02-12T03:47:26.785 INFO:teuthology.orchestra.run.trial091.stdout:(33/37): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2026-02-12T03:47:26.798 INFO:teuthology.orchestra.run.trial091.stdout:(34/37): libarrow-9.0.0-15.el9.x86_64.rpm 26 MB/s | 4.4 MB 00:00 2026-02-12T03:47:26.837 INFO:teuthology.orchestra.run.trial091.stdout:(35/37): thrift-0.15.0-4.el9.x86_64.rpm 30 MB/s | 1.6 MB 00:00 2026-02-12T03:47:26.903 INFO:teuthology.orchestra.run.trial091.stdout:(36/37): librados2-20.2.0-626.g1279775f.el9.x86 30 MB/s | 3.5 MB 00:00 2026-02-12T03:47:26.906 INFO:teuthology.orchestra.run.trial091.stdout:(37/37): librbd1-20.2.0-626.g1279775f.el9.x86_6 27 MB/s | 2.8 MB 00:00 2026-02-12T03:47:26.907 INFO:teuthology.orchestra.run.trial091.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:47:26.907 INFO:teuthology.orchestra.run.trial091.stdout:Total 34 MB/s | 79 MB 00:02 2026-02-12T03:47:26.936 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-12T03:47:26.936 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-12T03:47:26.936 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:47:26.977 INFO:teuthology.orchestra.run.trial111.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-12T03:47:26.979 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-ceph-common-2:20.2.0-626.g1279775f.el9.x86 33/39 2026-02-12T03:47:26.999 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction check 2026-02-12T03:47:27.007 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-12T03:47:27.016 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-12T03:47:27.018 INFO:teuthology.orchestra.run.trial091.stdout:Transaction check succeeded. 2026-02-12T03:47:27.018 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction test 2026-02-12T03:47:27.101 INFO:teuthology.orchestra.run.trial154.stdout:CentOS Stream 9 - CRB 988 kB/s | 7.8 MB 00:08 2026-02-12T03:47:27.315 INFO:teuthology.orchestra.run.trial091.stdout:Transaction test succeeded. 2026-02-12T03:47:27.315 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction 2026-02-12T03:47:27.350 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-12T03:47:27.361 INFO:teuthology.orchestra.run.trial098.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/39 2026-02-12T03:47:27.513 INFO:teuthology.orchestra.run.trial098.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/39 2026-02-12T03:47:27.518 INFO:teuthology.orchestra.run.trial098.stdout: Upgrading : librados2-2:20.2.0-626.g1279775f.el9.x86_64 3/39 2026-02-12T03:47:27.565 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: librados2-2:20.2.0-626.g1279775f.el9.x86_64 3/39 2026-02-12T03:47:27.566 INFO:teuthology.orchestra.run.trial098.stdout: Installing : libcephfs2-2:20.2.0-626.g1279775f.el9.x86_64 4/39 2026-02-12T03:47:27.579 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: libcephfs2-2:20.2.0-626.g1279775f.el9.x86_64 4/39 2026-02-12T03:47:27.582 INFO:teuthology.orchestra.run.trial098.stdout: Installing : libcephfs-daemon-2:20.2.0-626.g1279775f.el9.x86_64 5/39 2026-02-12T03:47:27.582 INFO:teuthology.orchestra.run.trial098.stdout: Installing : libcephfs-proxy2-2:20.2.0-626.g1279775f.el9.x86_64 6/39 2026-02-12T03:47:27.608 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-626.g1279775f.el9.x86_64 6/39 2026-02-12T03:47:27.610 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-rados-2:20.2.0-626.g1279775f.el9.x86_64 7/39 2026-02-12T03:47:27.618 INFO:teuthology.orchestra.run.trial098.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/39 2026-02-12T03:47:27.620 INFO:teuthology.orchestra.run.trial098.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/39 2026-02-12T03:47:27.623 INFO:teuthology.orchestra.run.trial098.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 10/39 2026-02-12T03:47:27.627 INFO:teuthology.orchestra.run.trial098.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 11/39 2026-02-12T03:47:27.636 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-ceph-argparse-2:20.2.0-626.g1279775f.el9.x 12/39 2026-02-12T03:47:27.648 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-cephfs-2:20.2.0-626.g1279775f.el9.x86_64 13/39 2026-02-12T03:47:27.648 INFO:teuthology.orchestra.run.trial098.stdout: Installing : libradosstriper1-2:20.2.0-626.g1279775f.el9.x86_64 14/39 2026-02-12T03:47:27.657 INFO:teuthology.orchestra.run.trial091.stdout: Preparing : 1/1 2026-02-12T03:47:27.660 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: libradosstriper1-2:20.2.0-626.g1279775f.el9.x86_64 14/39 2026-02-12T03:47:27.669 INFO:teuthology.orchestra.run.trial091.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/39 2026-02-12T03:47:27.691 INFO:teuthology.orchestra.run.trial098.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-12T03:47:27.694 INFO:teuthology.orchestra.run.trial098.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-12T03:47:27.700 INFO:teuthology.orchestra.run.trial098.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-12T03:47:27.703 INFO:teuthology.orchestra.run.trial098.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-12T03:47:27.707 INFO:teuthology.orchestra.run.trial098.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-12T03:47:27.823 INFO:teuthology.orchestra.run.trial091.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/39 2026-02-12T03:47:27.828 INFO:teuthology.orchestra.run.trial091.stdout: Upgrading : librados2-2:20.2.0-626.g1279775f.el9.x86_64 3/39 2026-02-12T03:47:27.829 INFO:teuthology.orchestra.run.trial098.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-12T03:47:27.830 INFO:teuthology.orchestra.run.trial098.stdout: Upgrading : librbd1-2:20.2.0-626.g1279775f.el9.x86_64 21/39 2026-02-12T03:47:27.856 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: librbd1-2:20.2.0-626.g1279775f.el9.x86_64 21/39 2026-02-12T03:47:27.858 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-rbd-2:20.2.0-626.g1279775f.el9.x86_64 22/39 2026-02-12T03:47:27.864 INFO:teuthology.orchestra.run.trial098.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-12T03:47:27.879 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: librados2-2:20.2.0-626.g1279775f.el9.x86_64 3/39 2026-02-12T03:47:27.880 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libcephfs2-2:20.2.0-626.g1279775f.el9.x86_64 4/39 2026-02-12T03:47:27.892 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: libcephfs2-2:20.2.0-626.g1279775f.el9.x86_64 4/39 2026-02-12T03:47:27.894 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libcephfs-daemon-2:20.2.0-626.g1279775f.el9.x86_64 5/39 2026-02-12T03:47:27.895 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libcephfs-proxy2-2:20.2.0-626.g1279775f.el9.x86_64 6/39 2026-02-12T03:47:27.922 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-626.g1279775f.el9.x86_64 6/39 2026-02-12T03:47:27.924 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-rados-2:20.2.0-626.g1279775f.el9.x86_64 7/39 2026-02-12T03:47:27.932 INFO:teuthology.orchestra.run.trial091.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/39 2026-02-12T03:47:27.935 INFO:teuthology.orchestra.run.trial091.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/39 2026-02-12T03:47:27.938 INFO:teuthology.orchestra.run.trial091.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 10/39 2026-02-12T03:47:27.942 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 11/39 2026-02-12T03:47:27.951 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-ceph-argparse-2:20.2.0-626.g1279775f.el9.x 12/39 2026-02-12T03:47:27.962 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-cephfs-2:20.2.0-626.g1279775f.el9.x86_64 13/39 2026-02-12T03:47:27.963 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libradosstriper1-2:20.2.0-626.g1279775f.el9.x86_64 14/39 2026-02-12T03:47:27.975 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: libradosstriper1-2:20.2.0-626.g1279775f.el9.x86_64 14/39 2026-02-12T03:47:28.006 INFO:teuthology.orchestra.run.trial091.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-12T03:47:28.010 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-12T03:47:28.016 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-12T03:47:28.018 INFO:teuthology.orchestra.run.trial091.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-12T03:47:28.023 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-12T03:47:28.080 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-common-2:20.2.0-626.g1279775f.el9.x86_64 34/39 2026-02-12T03:47:28.083 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-common-2:20.2.0-626.g1279775f.el9.x86_64 34/39 2026-02-12T03:47:28.142 INFO:teuthology.orchestra.run.trial098.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-12T03:47:28.143 INFO:teuthology.orchestra.run.trial098.stdout: Installing : librgw2-2:20.2.0-626.g1279775f.el9.x86_64 25/39 2026-02-12T03:47:28.145 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-12T03:47:28.146 INFO:teuthology.orchestra.run.trial091.stdout: Upgrading : librbd1-2:20.2.0-626.g1279775f.el9.x86_64 21/39 2026-02-12T03:47:28.159 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: librgw2-2:20.2.0-626.g1279775f.el9.x86_64 25/39 2026-02-12T03:47:28.163 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-rgw-2:20.2.0-626.g1279775f.el9.x86_64 26/39 2026-02-12T03:47:28.167 INFO:teuthology.orchestra.run.trial098.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-12T03:47:28.170 INFO:teuthology.orchestra.run.trial098.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-12T03:47:28.171 INFO:teuthology.orchestra.run.trial098.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-12T03:47:28.171 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: librbd1-2:20.2.0-626.g1279775f.el9.x86_64 21/39 2026-02-12T03:47:28.174 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-rbd-2:20.2.0-626.g1279775f.el9.x86_64 22/39 2026-02-12T03:47:28.182 INFO:teuthology.orchestra.run.trial091.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-12T03:47:28.189 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-12T03:47:28.302 INFO:teuthology.orchestra.run.trial098.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-12T03:47:28.304 INFO:teuthology.orchestra.run.trial098.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-12T03:47:28.381 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-common-2:20.2.0-626.g1279775f.el9.x86_64 34/39 2026-02-12T03:47:28.384 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-base-2:20.2.0-626.g1279775f.el9.x86_64 35/39 2026-02-12T03:47:28.424 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-base-2:20.2.0-626.g1279775f.el9.x86_64 35/39 2026-02-12T03:47:28.424 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-12T03:47:28.424 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-12T03:47:28.424 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:47:28.428 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-selinux-2:20.2.0-626.g1279775f.el9.x86_64 36/39 2026-02-12T03:47:28.461 INFO:teuthology.orchestra.run.trial091.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-12T03:47:28.462 INFO:teuthology.orchestra.run.trial091.stdout: Installing : librgw2-2:20.2.0-626.g1279775f.el9.x86_64 25/39 2026-02-12T03:47:28.477 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: librgw2-2:20.2.0-626.g1279775f.el9.x86_64 25/39 2026-02-12T03:47:28.481 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-rgw-2:20.2.0-626.g1279775f.el9.x86_64 26/39 2026-02-12T03:47:28.486 INFO:teuthology.orchestra.run.trial091.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-12T03:47:28.489 INFO:teuthology.orchestra.run.trial091.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-12T03:47:28.489 INFO:teuthology.orchestra.run.trial091.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-12T03:47:28.508 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-12T03:47:28.580 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-12T03:47:28.580 INFO:teuthology.orchestra.run.trial098.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-12T03:47:28.580 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:47:28.620 INFO:teuthology.orchestra.run.trial091.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-12T03:47:28.623 INFO:teuthology.orchestra.run.trial091.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-12T03:47:28.623 INFO:teuthology.orchestra.run.trial098.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-12T03:47:28.625 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-ceph-common-2:20.2.0-626.g1279775f.el9.x86 33/39 2026-02-12T03:47:28.665 INFO:teuthology.orchestra.run.trial154.stdout:CentOS Stream 9 - Extras packages 23 kB/s | 20 kB 00:00 2026-02-12T03:47:28.889 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-12T03:47:28.889 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-12T03:47:28.889 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:47:28.933 INFO:teuthology.orchestra.run.trial091.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-12T03:47:28.935 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-ceph-common-2:20.2.0-626.g1279775f.el9.x86 33/39 2026-02-12T03:47:29.704 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-common-2:20.2.0-626.g1279775f.el9.x86_64 34/39 2026-02-12T03:47:29.707 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-common-2:20.2.0-626.g1279775f.el9.x86_64 34/39 2026-02-12T03:47:29.888 INFO:teuthology.orchestra.run.trial154.stdout:Extra Packages for Enterprise Linux 18 MB/s | 20 MB 00:01 2026-02-12T03:47:30.000 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-common-2:20.2.0-626.g1279775f.el9.x86_64 34/39 2026-02-12T03:47:30.003 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-base-2:20.2.0-626.g1279775f.el9.x86_64 35/39 2026-02-12T03:47:30.018 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-common-2:20.2.0-626.g1279775f.el9.x86_64 34/39 2026-02-12T03:47:30.020 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-common-2:20.2.0-626.g1279775f.el9.x86_64 34/39 2026-02-12T03:47:30.044 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-base-2:20.2.0-626.g1279775f.el9.x86_64 35/39 2026-02-12T03:47:30.044 INFO:teuthology.orchestra.run.trial098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-12T03:47:30.044 INFO:teuthology.orchestra.run.trial098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-12T03:47:30.044 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:47:30.048 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-selinux-2:20.2.0-626.g1279775f.el9.x86_64 36/39 2026-02-12T03:47:30.316 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-common-2:20.2.0-626.g1279775f.el9.x86_64 34/39 2026-02-12T03:47:30.319 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-base-2:20.2.0-626.g1279775f.el9.x86_64 35/39 2026-02-12T03:47:30.358 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-base-2:20.2.0-626.g1279775f.el9.x86_64 35/39 2026-02-12T03:47:30.358 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-12T03:47:30.358 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-12T03:47:30.359 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:47:30.361 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-selinux-2:20.2.0-626.g1279775f.el9.x86_64 36/39 2026-02-12T03:47:32.962 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-selinux-2:20.2.0-626.g1279775f.el9.x86_64 36/39 2026-02-12T03:47:32.962 INFO:teuthology.orchestra.run.trial111.stdout:skipping the directory /sys 2026-02-12T03:47:32.963 INFO:teuthology.orchestra.run.trial111.stdout:skipping the directory /proc 2026-02-12T03:47:32.963 INFO:teuthology.orchestra.run.trial111.stdout:skipping the directory /mnt 2026-02-12T03:47:32.963 INFO:teuthology.orchestra.run.trial111.stdout:skipping the directory /var/tmp 2026-02-12T03:47:32.963 INFO:teuthology.orchestra.run.trial111.stdout:skipping the directory /home 2026-02-12T03:47:32.963 INFO:teuthology.orchestra.run.trial111.stdout:skipping the directory /root 2026-02-12T03:47:32.963 INFO:teuthology.orchestra.run.trial111.stdout:skipping the directory /tmp 2026-02-12T03:47:32.963 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:47:33.055 INFO:teuthology.orchestra.run.trial154.stdout:lab-extras 2.5 MB/s | 50 kB 00:00 2026-02-12T03:47:34.006 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-radosgw-2:20.2.0-626.g1279775f.el9.x86_64 37/39 2026-02-12T03:47:34.030 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-626.g1279775f.el9.x86_64 37/39 2026-02-12T03:47:34.030 INFO:teuthology.orchestra.run.trial111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T03:47:34.030 INFO:teuthology.orchestra.run.trial111.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-12T03:47:34.031 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T03:47:34.031 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T03:47:34.031 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:47:34.032 INFO:teuthology.orchestra.run.trial111.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-12T03:47:34.045 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-12T03:47:34.045 INFO:teuthology.orchestra.run.trial111.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-12T03:47:34.100 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-12T03:47:34.101 INFO:teuthology.orchestra.run.trial111.stdout:Creating group 'qat' with GID 992. 2026-02-12T03:47:34.101 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:47:34.342 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:47:34.343 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:47:34.344 INFO:teuthology.orchestra.run.trial154.stdout: Package Arch Version Repository Size 2026-02-12T03:47:34.344 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:47:34.344 INFO:teuthology.orchestra.run.trial154.stdout:Installing: 2026-02-12T03:47:34.344 INFO:teuthology.orchestra.run.trial154.stdout: ceph-radosgw x86_64 2:20.2.0-626.g1279775f.el9 ceph 24 M 2026-02-12T03:47:34.344 INFO:teuthology.orchestra.run.trial154.stdout:Upgrading: 2026-02-12T03:47:34.344 INFO:teuthology.orchestra.run.trial154.stdout: librados2 x86_64 2:20.2.0-626.g1279775f.el9 ceph 3.5 M 2026-02-12T03:47:34.344 INFO:teuthology.orchestra.run.trial154.stdout: librbd1 x86_64 2:20.2.0-626.g1279775f.el9 ceph 2.8 M 2026-02-12T03:47:34.344 INFO:teuthology.orchestra.run.trial154.stdout:Installing dependencies: 2026-02-12T03:47:34.344 INFO:teuthology.orchestra.run.trial154.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-12T03:47:34.344 INFO:teuthology.orchestra.run.trial154.stdout: ceph-base x86_64 2:20.2.0-626.g1279775f.el9 ceph 5.9 M 2026-02-12T03:47:34.345 INFO:teuthology.orchestra.run.trial154.stdout: ceph-common x86_64 2:20.2.0-626.g1279775f.el9 ceph 24 M 2026-02-12T03:47:34.345 INFO:teuthology.orchestra.run.trial154.stdout: ceph-selinux x86_64 2:20.2.0-626.g1279775f.el9 ceph 25 k 2026-02-12T03:47:34.345 INFO:teuthology.orchestra.run.trial154.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-12T03:47:34.345 INFO:teuthology.orchestra.run.trial154.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-12T03:47:34.345 INFO:teuthology.orchestra.run.trial154.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-12T03:47:34.345 INFO:teuthology.orchestra.run.trial154.stdout: libcephfs2 x86_64 2:20.2.0-626.g1279775f.el9 ceph 869 k 2026-02-12T03:47:34.345 INFO:teuthology.orchestra.run.trial154.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-12T03:47:34.345 INFO:teuthology.orchestra.run.trial154.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-12T03:47:34.345 INFO:teuthology.orchestra.run.trial154.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-12T03:47:34.345 INFO:teuthology.orchestra.run.trial154.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-12T03:47:34.345 INFO:teuthology.orchestra.run.trial154.stdout: libradosstriper1 x86_64 2:20.2.0-626.g1279775f.el9 ceph 250 k 2026-02-12T03:47:34.345 INFO:teuthology.orchestra.run.trial154.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-12T03:47:34.345 INFO:teuthology.orchestra.run.trial154.stdout: librgw2 x86_64 2:20.2.0-626.g1279775f.el9 ceph 6.4 M 2026-02-12T03:47:34.346 INFO:teuthology.orchestra.run.trial154.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-12T03:47:34.346 INFO:teuthology.orchestra.run.trial154.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-12T03:47:34.346 INFO:teuthology.orchestra.run.trial154.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-12T03:47:34.346 INFO:teuthology.orchestra.run.trial154.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-12T03:47:34.346 INFO:teuthology.orchestra.run.trial154.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-12T03:47:34.346 INFO:teuthology.orchestra.run.trial154.stdout: python3-ceph-argparse x86_64 2:20.2.0-626.g1279775f.el9 ceph 45 k 2026-02-12T03:47:34.346 INFO:teuthology.orchestra.run.trial154.stdout: python3-ceph-common x86_64 2:20.2.0-626.g1279775f.el9 ceph 175 k 2026-02-12T03:47:34.346 INFO:teuthology.orchestra.run.trial154.stdout: python3-cephfs x86_64 2:20.2.0-626.g1279775f.el9 ceph 163 k 2026-02-12T03:47:34.346 INFO:teuthology.orchestra.run.trial154.stdout: python3-rados x86_64 2:20.2.0-626.g1279775f.el9 ceph 323 k 2026-02-12T03:47:34.346 INFO:teuthology.orchestra.run.trial154.stdout: python3-rbd x86_64 2:20.2.0-626.g1279775f.el9 ceph 304 k 2026-02-12T03:47:34.346 INFO:teuthology.orchestra.run.trial154.stdout: python3-rgw x86_64 2:20.2.0-626.g1279775f.el9 ceph 99 k 2026-02-12T03:47:34.347 INFO:teuthology.orchestra.run.trial154.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-12T03:47:34.347 INFO:teuthology.orchestra.run.trial154.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-12T03:47:34.347 INFO:teuthology.orchestra.run.trial154.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-12T03:47:34.347 INFO:teuthology.orchestra.run.trial154.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-12T03:47:34.347 INFO:teuthology.orchestra.run.trial154.stdout:Installing weak dependencies: 2026-02-12T03:47:34.347 INFO:teuthology.orchestra.run.trial154.stdout: libcephfs-daemon x86_64 2:20.2.0-626.g1279775f.el9 ceph 35 k 2026-02-12T03:47:34.347 INFO:teuthology.orchestra.run.trial154.stdout: libcephfs-proxy2 x86_64 2:20.2.0-626.g1279775f.el9 ceph 24 k 2026-02-12T03:47:34.347 INFO:teuthology.orchestra.run.trial154.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-12T03:47:34.347 INFO:teuthology.orchestra.run.trial154.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-12T03:47:34.347 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:47:34.347 INFO:teuthology.orchestra.run.trial154.stdout:Transaction Summary 2026-02-12T03:47:34.347 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:47:34.348 INFO:teuthology.orchestra.run.trial154.stdout:Install 35 Packages 2026-02-12T03:47:34.348 INFO:teuthology.orchestra.run.trial154.stdout:Upgrade 2 Packages 2026-02-12T03:47:34.348 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:47:34.348 INFO:teuthology.orchestra.run.trial154.stdout:Total download size: 79 M 2026-02-12T03:47:34.348 INFO:teuthology.orchestra.run.trial154.stdout:Downloading Packages: 2026-02-12T03:47:34.406 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-base-2:20.2.0-626.g1279775f.el9.x86_64 1/39 2026-02-12T03:47:34.407 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-common-2:20.2.0-626.g1279775f.el9.x86_64 2/39 2026-02-12T03:47:34.407 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-radosgw-2:20.2.0-626.g1279775f.el9.x86_64 3/39 2026-02-12T03:47:34.407 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-selinux-2:20.2.0-626.g1279775f.el9.x86_64 4/39 2026-02-12T03:47:34.407 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libcephfs-daemon-2:20.2.0-626.g1279775f.el9.x86_64 5/39 2026-02-12T03:47:34.407 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libcephfs-proxy2-2:20.2.0-626.g1279775f.el9.x86_64 6/39 2026-02-12T03:47:34.407 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libcephfs2-2:20.2.0-626.g1279775f.el9.x86_64 7/39 2026-02-12T03:47:34.407 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libradosstriper1-2:20.2.0-626.g1279775f.el9.x86_64 8/39 2026-02-12T03:47:34.407 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : librgw2-2:20.2.0-626.g1279775f.el9.x86_64 9/39 2026-02-12T03:47:34.407 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-ceph-argparse-2:20.2.0-626.g1279775f.el9.x 10/39 2026-02-12T03:47:34.407 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-ceph-common-2:20.2.0-626.g1279775f.el9.x86 11/39 2026-02-12T03:47:34.408 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-cephfs-2:20.2.0-626.g1279775f.el9.x86_64 12/39 2026-02-12T03:47:34.408 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-rados-2:20.2.0-626.g1279775f.el9.x86_64 13/39 2026-02-12T03:47:34.408 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-rbd-2:20.2.0-626.g1279775f.el9.x86_64 14/39 2026-02-12T03:47:34.408 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-rgw-2:20.2.0-626.g1279775f.el9.x86_64 15/39 2026-02-12T03:47:34.408 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-12T03:47:34.408 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 17/39 2026-02-12T03:47:34.408 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-12T03:47:34.408 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-12T03:47:34.408 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-12T03:47:34.408 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-12T03:47:34.408 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-12T03:47:34.408 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-12T03:47:34.408 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-12T03:47:34.409 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-12T03:47:34.409 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-12T03:47:34.409 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-12T03:47:34.409 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-12T03:47:34.409 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-12T03:47:34.409 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-12T03:47:34.409 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-12T03:47:34.409 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-12T03:47:34.409 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-12T03:47:34.409 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-12T03:47:34.409 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-12T03:47:34.409 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : librados2-2:20.2.0-626.g1279775f.el9.x86_64 36/39 2026-02-12T03:47:34.410 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-12T03:47:34.410 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : librbd1-2:20.2.0-626.g1279775f.el9.x86_64 38/39 2026-02-12T03:47:34.469 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-12T03:47:34.469 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:47:34.469 INFO:teuthology.orchestra.run.trial111.stdout:Upgraded: 2026-02-12T03:47:34.469 INFO:teuthology.orchestra.run.trial111.stdout: librados2-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:34.469 INFO:teuthology.orchestra.run.trial111.stdout: librbd1-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:34.469 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T03:47:34.469 INFO:teuthology.orchestra.run.trial111.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-12T03:47:34.469 INFO:teuthology.orchestra.run.trial111.stdout: ceph-base-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:34.470 INFO:teuthology.orchestra.run.trial111.stdout: ceph-common-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:34.470 INFO:teuthology.orchestra.run.trial111.stdout: ceph-radosgw-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:34.470 INFO:teuthology.orchestra.run.trial111.stdout: ceph-selinux-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:34.470 INFO:teuthology.orchestra.run.trial111.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-12T03:47:34.470 INFO:teuthology.orchestra.run.trial111.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-12T03:47:34.470 INFO:teuthology.orchestra.run.trial111.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-12T03:47:34.470 INFO:teuthology.orchestra.run.trial111.stdout: libcephfs-daemon-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:34.470 INFO:teuthology.orchestra.run.trial111.stdout: libcephfs-proxy2-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:34.470 INFO:teuthology.orchestra.run.trial111.stdout: libcephfs2-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:34.470 INFO:teuthology.orchestra.run.trial111.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-12T03:47:34.470 INFO:teuthology.orchestra.run.trial111.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-12T03:47:34.470 INFO:teuthology.orchestra.run.trial111.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-12T03:47:34.471 INFO:teuthology.orchestra.run.trial111.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-12T03:47:34.471 INFO:teuthology.orchestra.run.trial111.stdout: libradosstriper1-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:34.471 INFO:teuthology.orchestra.run.trial111.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-12T03:47:34.471 INFO:teuthology.orchestra.run.trial111.stdout: librgw2-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:34.471 INFO:teuthology.orchestra.run.trial111.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-12T03:47:34.471 INFO:teuthology.orchestra.run.trial111.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-12T03:47:34.471 INFO:teuthology.orchestra.run.trial111.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-12T03:47:34.471 INFO:teuthology.orchestra.run.trial111.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-12T03:47:34.471 INFO:teuthology.orchestra.run.trial111.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-12T03:47:34.471 INFO:teuthology.orchestra.run.trial111.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-12T03:47:34.471 INFO:teuthology.orchestra.run.trial111.stdout: python3-ceph-argparse-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:34.471 INFO:teuthology.orchestra.run.trial111.stdout: python3-ceph-common-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:34.471 INFO:teuthology.orchestra.run.trial111.stdout: python3-cephfs-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:34.472 INFO:teuthology.orchestra.run.trial111.stdout: python3-rados-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:34.472 INFO:teuthology.orchestra.run.trial111.stdout: python3-rbd-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:34.472 INFO:teuthology.orchestra.run.trial111.stdout: python3-rgw-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:34.472 INFO:teuthology.orchestra.run.trial111.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-12T03:47:34.472 INFO:teuthology.orchestra.run.trial111.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-12T03:47:34.472 INFO:teuthology.orchestra.run.trial111.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-12T03:47:34.472 INFO:teuthology.orchestra.run.trial111.stdout: re2-1:20211101-20.el9.x86_64 2026-02-12T03:47:34.472 INFO:teuthology.orchestra.run.trial111.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-12T03:47:34.472 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:47:34.472 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:47:34.515 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-test 2026-02-12T03:47:34.579 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-selinux-2:20.2.0-626.g1279775f.el9.x86_64 36/39 2026-02-12T03:47:34.579 INFO:teuthology.orchestra.run.trial098.stdout:skipping the directory /sys 2026-02-12T03:47:34.579 INFO:teuthology.orchestra.run.trial098.stdout:skipping the directory /proc 2026-02-12T03:47:34.579 INFO:teuthology.orchestra.run.trial098.stdout:skipping the directory /mnt 2026-02-12T03:47:34.579 INFO:teuthology.orchestra.run.trial098.stdout:skipping the directory /var/tmp 2026-02-12T03:47:34.579 INFO:teuthology.orchestra.run.trial098.stdout:skipping the directory /home 2026-02-12T03:47:34.580 INFO:teuthology.orchestra.run.trial098.stdout:skipping the directory /root 2026-02-12T03:47:34.580 INFO:teuthology.orchestra.run.trial098.stdout:skipping the directory /tmp 2026-02-12T03:47:34.580 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:47:34.822 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:15 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:47:34.906 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:47:34.907 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:47:34.907 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repository Size 2026-02-12T03:47:34.907 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:47:34.907 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T03:47:34.907 INFO:teuthology.orchestra.run.trial111.stdout: ceph-test x86_64 2:20.2.0-626.g1279775f.el9 ceph 84 M 2026-02-12T03:47:34.907 INFO:teuthology.orchestra.run.trial111.stdout:Installing dependencies: 2026-02-12T03:47:34.907 INFO:teuthology.orchestra.run.trial111.stdout: libcephsqlite x86_64 2:20.2.0-626.g1279775f.el9 ceph 164 k 2026-02-12T03:47:34.908 INFO:teuthology.orchestra.run.trial111.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-12T03:47:34.908 INFO:teuthology.orchestra.run.trial111.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-12T03:47:34.908 INFO:teuthology.orchestra.run.trial111.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-12T03:47:34.908 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:47:34.908 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T03:47:34.908 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:47:34.908 INFO:teuthology.orchestra.run.trial111.stdout:Install 5 Packages 2026-02-12T03:47:34.908 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:47:34.908 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 85 M 2026-02-12T03:47:34.908 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 364 M 2026-02-12T03:47:34.908 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T03:47:34.909 INFO:teuthology.orchestra.run.trial154.stdout:(1/37): ceph-base-20.2.0-626.g1279775f.el9.x86_ 18 MB/s | 5.9 MB 00:00 2026-02-12T03:47:34.935 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-selinux-2:20.2.0-626.g1279775f.el9.x86_64 36/39 2026-02-12T03:47:34.936 INFO:teuthology.orchestra.run.trial091.stdout:skipping the directory /sys 2026-02-12T03:47:34.936 INFO:teuthology.orchestra.run.trial091.stdout:skipping the directory /proc 2026-02-12T03:47:34.936 INFO:teuthology.orchestra.run.trial091.stdout:skipping the directory /mnt 2026-02-12T03:47:34.936 INFO:teuthology.orchestra.run.trial091.stdout:skipping the directory /var/tmp 2026-02-12T03:47:34.936 INFO:teuthology.orchestra.run.trial091.stdout:skipping the directory /home 2026-02-12T03:47:34.936 INFO:teuthology.orchestra.run.trial091.stdout:skipping the directory /root 2026-02-12T03:47:34.936 INFO:teuthology.orchestra.run.trial091.stdout:skipping the directory /tmp 2026-02-12T03:47:34.936 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:47:34.942 INFO:teuthology.orchestra.run.trial154.stdout:(2/37): ceph-selinux-20.2.0-626.g1279775f.el9.x 736 kB/s | 25 kB 00:00 2026-02-12T03:47:34.978 INFO:teuthology.orchestra.run.trial154.stdout:(3/37): libcephfs-daemon-20.2.0-626.g1279775f.e 991 kB/s | 35 kB 00:00 2026-02-12T03:47:35.015 INFO:teuthology.orchestra.run.trial154.stdout:(4/37): libcephfs-proxy2-20.2.0-626.g1279775f.e 651 kB/s | 24 kB 00:00 2026-02-12T03:47:35.032 INFO:teuthology.orchestra.run.trial111.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 3.6 MB/s | 233 kB 00:00 2026-02-12T03:47:35.063 INFO:teuthology.orchestra.run.trial111.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 9.4 MB/s | 303 kB 00:00 2026-02-12T03:47:35.071 INFO:teuthology.orchestra.run.trial154.stdout:(5/37): libcephfs2-20.2.0-626.g1279775f.el9.x86 15 MB/s | 869 kB 00:00 2026-02-12T03:47:35.088 INFO:teuthology.orchestra.run.trial111.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.5 MB/s | 64 kB 00:00 2026-02-12T03:47:35.116 INFO:teuthology.orchestra.run.trial154.stdout:(6/37): libradosstriper1-20.2.0-626.g1279775f.e 5.4 MB/s | 250 kB 00:00 2026-02-12T03:47:35.401 INFO:teuthology.orchestra.run.trial111.stdout:(4/5): libcephsqlite-20.2.0-626.g1279775f.el9.x 379 kB/s | 164 kB 00:00 2026-02-12T03:47:35.472 INFO:teuthology.orchestra.run.trial154.stdout:(7/37): librgw2-20.2.0-626.g1279775f.el9.x86_64 18 MB/s | 6.4 MB 00:00 2026-02-12T03:47:35.508 INFO:teuthology.orchestra.run.trial154.stdout:(8/37): python3-ceph-argparse-20.2.0-626.g12797 1.2 MB/s | 45 kB 00:00 2026-02-12T03:47:35.546 INFO:teuthology.orchestra.run.trial154.stdout:(9/37): python3-ceph-common-20.2.0-626.g1279775 4.5 MB/s | 175 kB 00:00 2026-02-12T03:47:35.584 INFO:teuthology.orchestra.run.trial154.stdout:(10/37): python3-cephfs-20.2.0-626.g1279775f.el 4.2 MB/s | 163 kB 00:00 2026-02-12T03:47:35.605 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-radosgw-2:20.2.0-626.g1279775f.el9.x86_64 37/39 2026-02-12T03:47:35.626 INFO:teuthology.orchestra.run.trial154.stdout:(11/37): python3-rados-20.2.0-626.g1279775f.el9 7.7 MB/s | 323 kB 00:00 2026-02-12T03:47:35.628 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-626.g1279775f.el9.x86_64 37/39 2026-02-12T03:47:35.628 INFO:teuthology.orchestra.run.trial098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T03:47:35.628 INFO:teuthology.orchestra.run.trial098.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-12T03:47:35.629 INFO:teuthology.orchestra.run.trial098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T03:47:35.629 INFO:teuthology.orchestra.run.trial098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T03:47:35.629 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:47:35.630 INFO:teuthology.orchestra.run.trial098.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-12T03:47:35.643 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-12T03:47:35.643 INFO:teuthology.orchestra.run.trial098.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-12T03:47:35.668 INFO:teuthology.orchestra.run.trial154.stdout:(12/37): python3-rbd-20.2.0-626.g1279775f.el9.x 7.1 MB/s | 304 kB 00:00 2026-02-12T03:47:35.697 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-12T03:47:35.697 INFO:teuthology.orchestra.run.trial098.stdout:Creating group 'qat' with GID 992. 2026-02-12T03:47:35.697 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:47:35.705 INFO:teuthology.orchestra.run.trial154.stdout:(13/37): python3-rgw-20.2.0-626.g1279775f.el9.x 2.6 MB/s | 99 kB 00:00 2026-02-12T03:47:35.750 INFO:teuthology.orchestra.run.trial154.stdout:(14/37): ceph-common-20.2.0-626.g1279775f.el9.x 20 MB/s | 24 MB 00:01 2026-02-12T03:47:35.750 INFO:teuthology.orchestra.run.trial154.stdout:(15/37): mailcap-2.1.49-5.el9.noarch.rpm 744 kB/s | 33 kB 00:00 2026-02-12T03:47:35.784 INFO:teuthology.orchestra.run.trial154.stdout:(16/37): ceph-radosgw-20.2.0-626.g1279775f.el9. 20 MB/s | 24 MB 00:01 2026-02-12T03:47:35.785 INFO:teuthology.orchestra.run.trial154.stdout:(17/37): pciutils-3.7.0-7.el9.x86_64.rpm 2.6 MB/s | 93 kB 00:00 2026-02-12T03:47:35.810 INFO:teuthology.orchestra.run.trial154.stdout:(18/37): nvme-cli-2.13-1.el9.x86_64.rpm 18 MB/s | 1.1 MB 00:00 2026-02-12T03:47:35.967 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-radosgw-2:20.2.0-626.g1279775f.el9.x86_64 37/39 2026-02-12T03:47:35.990 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-626.g1279775f.el9.x86_64 37/39 2026-02-12T03:47:35.990 INFO:teuthology.orchestra.run.trial091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T03:47:35.990 INFO:teuthology.orchestra.run.trial091.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-12T03:47:35.990 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T03:47:35.990 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T03:47:35.991 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:47:35.992 INFO:teuthology.orchestra.run.trial091.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-12T03:47:36.004 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-12T03:47:36.004 INFO:teuthology.orchestra.run.trial091.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-12T03:47:36.011 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-base-2:20.2.0-626.g1279775f.el9.x86_64 1/39 2026-02-12T03:47:36.011 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-common-2:20.2.0-626.g1279775f.el9.x86_64 2/39 2026-02-12T03:47:36.012 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-radosgw-2:20.2.0-626.g1279775f.el9.x86_64 3/39 2026-02-12T03:47:36.012 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-selinux-2:20.2.0-626.g1279775f.el9.x86_64 4/39 2026-02-12T03:47:36.012 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : libcephfs-daemon-2:20.2.0-626.g1279775f.el9.x86_64 5/39 2026-02-12T03:47:36.012 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : libcephfs-proxy2-2:20.2.0-626.g1279775f.el9.x86_64 6/39 2026-02-12T03:47:36.012 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : libcephfs2-2:20.2.0-626.g1279775f.el9.x86_64 7/39 2026-02-12T03:47:36.012 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : libradosstriper1-2:20.2.0-626.g1279775f.el9.x86_64 8/39 2026-02-12T03:47:36.012 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : librgw2-2:20.2.0-626.g1279775f.el9.x86_64 9/39 2026-02-12T03:47:36.012 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-ceph-argparse-2:20.2.0-626.g1279775f.el9.x 10/39 2026-02-12T03:47:36.012 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-ceph-common-2:20.2.0-626.g1279775f.el9.x86 11/39 2026-02-12T03:47:36.012 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-cephfs-2:20.2.0-626.g1279775f.el9.x86_64 12/39 2026-02-12T03:47:36.012 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-rados-2:20.2.0-626.g1279775f.el9.x86_64 13/39 2026-02-12T03:47:36.012 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-rbd-2:20.2.0-626.g1279775f.el9.x86_64 14/39 2026-02-12T03:47:36.013 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-rgw-2:20.2.0-626.g1279775f.el9.x86_64 15/39 2026-02-12T03:47:36.013 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-12T03:47:36.013 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 17/39 2026-02-12T03:47:36.013 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-12T03:47:36.013 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-12T03:47:36.013 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-12T03:47:36.013 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-12T03:47:36.013 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-12T03:47:36.013 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-12T03:47:36.013 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-12T03:47:36.013 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-12T03:47:36.013 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-12T03:47:36.014 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-12T03:47:36.014 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-12T03:47:36.014 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-12T03:47:36.014 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-12T03:47:36.014 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-12T03:47:36.014 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-12T03:47:36.014 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-12T03:47:36.014 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-12T03:47:36.014 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-12T03:47:36.014 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : librados2-2:20.2.0-626.g1279775f.el9.x86_64 36/39 2026-02-12T03:47:36.014 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-12T03:47:36.014 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : librbd1-2:20.2.0-626.g1279775f.el9.x86_64 38/39 2026-02-12T03:47:36.058 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-12T03:47:36.058 INFO:teuthology.orchestra.run.trial091.stdout:Creating group 'qat' with GID 992. 2026-02-12T03:47:36.058 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:47:36.072 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-12T03:47:36.072 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:47:36.073 INFO:teuthology.orchestra.run.trial098.stdout:Upgraded: 2026-02-12T03:47:36.073 INFO:teuthology.orchestra.run.trial098.stdout: librados2-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:36.073 INFO:teuthology.orchestra.run.trial098.stdout: librbd1-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:36.073 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-12T03:47:36.073 INFO:teuthology.orchestra.run.trial098.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-12T03:47:36.073 INFO:teuthology.orchestra.run.trial098.stdout: ceph-base-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:36.073 INFO:teuthology.orchestra.run.trial098.stdout: ceph-common-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:36.073 INFO:teuthology.orchestra.run.trial098.stdout: ceph-radosgw-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:36.073 INFO:teuthology.orchestra.run.trial098.stdout: ceph-selinux-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:36.073 INFO:teuthology.orchestra.run.trial098.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-12T03:47:36.073 INFO:teuthology.orchestra.run.trial098.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-12T03:47:36.073 INFO:teuthology.orchestra.run.trial098.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-12T03:47:36.074 INFO:teuthology.orchestra.run.trial098.stdout: libcephfs-daemon-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:36.074 INFO:teuthology.orchestra.run.trial098.stdout: libcephfs-proxy2-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:36.074 INFO:teuthology.orchestra.run.trial098.stdout: libcephfs2-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:36.074 INFO:teuthology.orchestra.run.trial098.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-12T03:47:36.074 INFO:teuthology.orchestra.run.trial098.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-12T03:47:36.074 INFO:teuthology.orchestra.run.trial098.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-12T03:47:36.074 INFO:teuthology.orchestra.run.trial098.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-12T03:47:36.074 INFO:teuthology.orchestra.run.trial098.stdout: libradosstriper1-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:36.074 INFO:teuthology.orchestra.run.trial098.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-12T03:47:36.074 INFO:teuthology.orchestra.run.trial098.stdout: librgw2-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:36.074 INFO:teuthology.orchestra.run.trial098.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-12T03:47:36.074 INFO:teuthology.orchestra.run.trial098.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-12T03:47:36.075 INFO:teuthology.orchestra.run.trial098.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-12T03:47:36.075 INFO:teuthology.orchestra.run.trial098.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-12T03:47:36.075 INFO:teuthology.orchestra.run.trial098.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-12T03:47:36.075 INFO:teuthology.orchestra.run.trial098.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-12T03:47:36.075 INFO:teuthology.orchestra.run.trial098.stdout: python3-ceph-argparse-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:36.075 INFO:teuthology.orchestra.run.trial098.stdout: python3-ceph-common-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:36.075 INFO:teuthology.orchestra.run.trial098.stdout: python3-cephfs-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:36.075 INFO:teuthology.orchestra.run.trial098.stdout: python3-rados-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:36.075 INFO:teuthology.orchestra.run.trial098.stdout: python3-rbd-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:36.075 INFO:teuthology.orchestra.run.trial098.stdout: python3-rgw-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:36.075 INFO:teuthology.orchestra.run.trial098.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-12T03:47:36.075 INFO:teuthology.orchestra.run.trial098.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-12T03:47:36.076 INFO:teuthology.orchestra.run.trial098.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-12T03:47:36.076 INFO:teuthology.orchestra.run.trial098.stdout: re2-1:20211101-20.el9.x86_64 2026-02-12T03:47:36.076 INFO:teuthology.orchestra.run.trial098.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-12T03:47:36.076 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:47:36.076 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:47:36.116 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install ceph-test 2026-02-12T03:47:36.368 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-base-2:20.2.0-626.g1279775f.el9.x86_64 1/39 2026-02-12T03:47:36.369 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-common-2:20.2.0-626.g1279775f.el9.x86_64 2/39 2026-02-12T03:47:36.369 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-radosgw-2:20.2.0-626.g1279775f.el9.x86_64 3/39 2026-02-12T03:47:36.369 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-selinux-2:20.2.0-626.g1279775f.el9.x86_64 4/39 2026-02-12T03:47:36.369 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libcephfs-daemon-2:20.2.0-626.g1279775f.el9.x86_64 5/39 2026-02-12T03:47:36.369 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libcephfs-proxy2-2:20.2.0-626.g1279775f.el9.x86_64 6/39 2026-02-12T03:47:36.369 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libcephfs2-2:20.2.0-626.g1279775f.el9.x86_64 7/39 2026-02-12T03:47:36.369 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libradosstriper1-2:20.2.0-626.g1279775f.el9.x86_64 8/39 2026-02-12T03:47:36.369 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : librgw2-2:20.2.0-626.g1279775f.el9.x86_64 9/39 2026-02-12T03:47:36.369 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-ceph-argparse-2:20.2.0-626.g1279775f.el9.x 10/39 2026-02-12T03:47:36.369 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-ceph-common-2:20.2.0-626.g1279775f.el9.x86 11/39 2026-02-12T03:47:36.369 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-cephfs-2:20.2.0-626.g1279775f.el9.x86_64 12/39 2026-02-12T03:47:36.370 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-rados-2:20.2.0-626.g1279775f.el9.x86_64 13/39 2026-02-12T03:47:36.370 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-rbd-2:20.2.0-626.g1279775f.el9.x86_64 14/39 2026-02-12T03:47:36.370 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-rgw-2:20.2.0-626.g1279775f.el9.x86_64 15/39 2026-02-12T03:47:36.370 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-12T03:47:36.370 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 17/39 2026-02-12T03:47:36.370 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-12T03:47:36.370 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-12T03:47:36.370 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-12T03:47:36.370 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-12T03:47:36.370 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-12T03:47:36.370 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-12T03:47:36.370 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-12T03:47:36.370 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-12T03:47:36.371 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-12T03:47:36.371 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-12T03:47:36.371 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-12T03:47:36.371 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-12T03:47:36.371 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-12T03:47:36.371 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-12T03:47:36.371 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-12T03:47:36.371 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-12T03:47:36.371 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-12T03:47:36.371 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-12T03:47:36.371 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : librados2-2:20.2.0-626.g1279775f.el9.x86_64 36/39 2026-02-12T03:47:36.371 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-12T03:47:36.371 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : librbd1-2:20.2.0-626.g1279775f.el9.x86_64 38/39 2026-02-12T03:47:36.411 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:16 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:47:36.429 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-12T03:47:36.429 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:47:36.430 INFO:teuthology.orchestra.run.trial091.stdout:Upgraded: 2026-02-12T03:47:36.430 INFO:teuthology.orchestra.run.trial091.stdout: librados2-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:36.430 INFO:teuthology.orchestra.run.trial091.stdout: librbd1-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:36.430 INFO:teuthology.orchestra.run.trial091.stdout:Installed: 2026-02-12T03:47:36.430 INFO:teuthology.orchestra.run.trial091.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-12T03:47:36.430 INFO:teuthology.orchestra.run.trial091.stdout: ceph-base-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:36.430 INFO:teuthology.orchestra.run.trial091.stdout: ceph-common-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:36.430 INFO:teuthology.orchestra.run.trial091.stdout: ceph-radosgw-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:36.430 INFO:teuthology.orchestra.run.trial091.stdout: ceph-selinux-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:36.430 INFO:teuthology.orchestra.run.trial091.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-12T03:47:36.431 INFO:teuthology.orchestra.run.trial091.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-12T03:47:36.431 INFO:teuthology.orchestra.run.trial091.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-12T03:47:36.431 INFO:teuthology.orchestra.run.trial091.stdout: libcephfs-daemon-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:36.431 INFO:teuthology.orchestra.run.trial091.stdout: libcephfs-proxy2-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:36.431 INFO:teuthology.orchestra.run.trial091.stdout: libcephfs2-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:36.431 INFO:teuthology.orchestra.run.trial091.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-12T03:47:36.431 INFO:teuthology.orchestra.run.trial091.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-12T03:47:36.431 INFO:teuthology.orchestra.run.trial091.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-12T03:47:36.431 INFO:teuthology.orchestra.run.trial091.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-12T03:47:36.431 INFO:teuthology.orchestra.run.trial091.stdout: libradosstriper1-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:36.431 INFO:teuthology.orchestra.run.trial091.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-12T03:47:36.431 INFO:teuthology.orchestra.run.trial091.stdout: librgw2-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:36.431 INFO:teuthology.orchestra.run.trial091.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-12T03:47:36.432 INFO:teuthology.orchestra.run.trial091.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-12T03:47:36.432 INFO:teuthology.orchestra.run.trial091.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-12T03:47:36.432 INFO:teuthology.orchestra.run.trial091.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-12T03:47:36.432 INFO:teuthology.orchestra.run.trial091.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-12T03:47:36.432 INFO:teuthology.orchestra.run.trial091.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-12T03:47:36.432 INFO:teuthology.orchestra.run.trial091.stdout: python3-ceph-argparse-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:36.432 INFO:teuthology.orchestra.run.trial091.stdout: python3-ceph-common-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:36.432 INFO:teuthology.orchestra.run.trial091.stdout: python3-cephfs-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:36.432 INFO:teuthology.orchestra.run.trial091.stdout: python3-rados-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:36.432 INFO:teuthology.orchestra.run.trial091.stdout: python3-rbd-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:36.432 INFO:teuthology.orchestra.run.trial091.stdout: python3-rgw-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:36.432 INFO:teuthology.orchestra.run.trial091.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-12T03:47:36.432 INFO:teuthology.orchestra.run.trial091.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-12T03:47:36.433 INFO:teuthology.orchestra.run.trial091.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-12T03:47:36.433 INFO:teuthology.orchestra.run.trial091.stdout: re2-1:20211101-20.el9.x86_64 2026-02-12T03:47:36.433 INFO:teuthology.orchestra.run.trial091.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-12T03:47:36.433 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:47:36.433 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:47:36.459 INFO:teuthology.orchestra.run.trial154.stdout:(19/37): boost-program-options-1.75.0-13.el9.x8 154 kB/s | 104 kB 00:00 2026-02-12T03:47:36.472 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install ceph-test 2026-02-12T03:47:36.494 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:47:36.495 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:47:36.495 INFO:teuthology.orchestra.run.trial098.stdout: Package Arch Version Repository Size 2026-02-12T03:47:36.495 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:47:36.495 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-12T03:47:36.495 INFO:teuthology.orchestra.run.trial098.stdout: ceph-test x86_64 2:20.2.0-626.g1279775f.el9 ceph 84 M 2026-02-12T03:47:36.495 INFO:teuthology.orchestra.run.trial098.stdout:Installing dependencies: 2026-02-12T03:47:36.496 INFO:teuthology.orchestra.run.trial098.stdout: libcephsqlite x86_64 2:20.2.0-626.g1279775f.el9 ceph 164 k 2026-02-12T03:47:36.496 INFO:teuthology.orchestra.run.trial098.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-12T03:47:36.496 INFO:teuthology.orchestra.run.trial098.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-12T03:47:36.496 INFO:teuthology.orchestra.run.trial098.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-12T03:47:36.496 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:47:36.496 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-12T03:47:36.496 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:47:36.496 INFO:teuthology.orchestra.run.trial098.stdout:Install 5 Packages 2026-02-12T03:47:36.496 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:47:36.496 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 85 M 2026-02-12T03:47:36.497 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 364 M 2026-02-12T03:47:36.497 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-12T03:47:36.515 INFO:teuthology.orchestra.run.trial154.stdout:(20/37): libnbd-1.20.3-4.el9.x86_64.rpm 225 kB/s | 164 kB 00:00 2026-02-12T03:47:36.527 INFO:teuthology.orchestra.run.trial154.stdout:(21/37): libpmemobj-1.12.1-1.el9.x86_64.rpm 224 kB/s | 160 kB 00:00 2026-02-12T03:47:36.778 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:00:13 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:47:36.863 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:47:36.864 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:47:36.864 INFO:teuthology.orchestra.run.trial091.stdout: Package Arch Version Repository Size 2026-02-12T03:47:36.864 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:47:36.864 INFO:teuthology.orchestra.run.trial091.stdout:Installing: 2026-02-12T03:47:36.864 INFO:teuthology.orchestra.run.trial091.stdout: ceph-test x86_64 2:20.2.0-626.g1279775f.el9 ceph 84 M 2026-02-12T03:47:36.864 INFO:teuthology.orchestra.run.trial091.stdout:Installing dependencies: 2026-02-12T03:47:36.864 INFO:teuthology.orchestra.run.trial091.stdout: libcephsqlite x86_64 2:20.2.0-626.g1279775f.el9 ceph 164 k 2026-02-12T03:47:36.864 INFO:teuthology.orchestra.run.trial091.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-12T03:47:36.865 INFO:teuthology.orchestra.run.trial091.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-12T03:47:36.865 INFO:teuthology.orchestra.run.trial091.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-12T03:47:36.865 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:47:36.865 INFO:teuthology.orchestra.run.trial091.stdout:Transaction Summary 2026-02-12T03:47:36.865 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:47:36.865 INFO:teuthology.orchestra.run.trial091.stdout:Install 5 Packages 2026-02-12T03:47:36.865 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:47:36.865 INFO:teuthology.orchestra.run.trial091.stdout:Total download size: 85 M 2026-02-12T03:47:36.865 INFO:teuthology.orchestra.run.trial091.stdout:Installed size: 364 M 2026-02-12T03:47:36.865 INFO:teuthology.orchestra.run.trial091.stdout:Downloading Packages: 2026-02-12T03:47:36.886 INFO:teuthology.orchestra.run.trial098.stdout:(1/5): libcephsqlite-20.2.0-626.g1279775f.el9.x 1.9 MB/s | 164 kB 00:00 2026-02-12T03:47:37.040 INFO:teuthology.orchestra.run.trial154.stdout:(22/37): librabbitmq-0.11.0-7.el9.x86_64.rpm 78 kB/s | 45 kB 00:00 2026-02-12T03:47:37.128 INFO:teuthology.orchestra.run.trial091.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 11 MB/s | 233 kB 00:00 2026-02-12T03:47:37.140 INFO:teuthology.orchestra.run.trial091.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 25 MB/s | 303 kB 00:00 2026-02-12T03:47:37.145 INFO:teuthology.orchestra.run.trial091.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 13 MB/s | 64 kB 00:00 2026-02-12T03:47:37.303 INFO:teuthology.orchestra.run.trial098.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 464 kB/s | 233 kB 00:00 2026-02-12T03:47:37.308 INFO:teuthology.orchestra.run.trial154.stdout:(23/37): lttng-ust-2.12.0-6.el9.x86_64.rpm 374 kB/s | 292 kB 00:00 2026-02-12T03:47:37.396 INFO:teuthology.orchestra.run.trial154.stdout:(24/37): librdkafka-1.6.1-102.el9.x86_64.rpm 751 kB/s | 662 kB 00:00 2026-02-12T03:47:37.397 INFO:teuthology.orchestra.run.trial098.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 682 kB/s | 64 kB 00:00 2026-02-12T03:47:37.404 INFO:teuthology.orchestra.run.trial098.stdout:(4/5): socat-1.7.4.1-8.el9.x86_64.rpm 585 kB/s | 303 kB 00:00 2026-02-12T03:47:37.550 INFO:teuthology.orchestra.run.trial091.stdout:(4/5): libcephsqlite-20.2.0-626.g1279775f.el9.x 370 kB/s | 164 kB 00:00 2026-02-12T03:47:37.803 INFO:teuthology.orchestra.run.trial154.stdout:(25/37): qatlib-25.08.0-2.el9.x86_64.rpm 314 kB/s | 240 kB 00:00 2026-02-12T03:47:37.877 INFO:teuthology.orchestra.run.trial154.stdout:(26/37): qatlib-service-25.08.0-2.el9.x86_64.rp 65 kB/s | 37 kB 00:00 2026-02-12T03:47:38.019 INFO:teuthology.orchestra.run.trial154.stdout:(27/37): qatzip-libs-1.3.1-1.el9.x86_64.rpm 107 kB/s | 66 kB 00:00 2026-02-12T03:47:38.406 INFO:teuthology.orchestra.run.trial154.stdout:(28/37): libarrow-doc-9.0.0-15.el9.noarch.rpm 64 kB/s | 25 kB 00:00 2026-02-12T03:47:38.423 INFO:teuthology.orchestra.run.trial154.stdout:(29/37): gperftools-libs-2.9.1-3.el9.x86_64.rpm 496 kB/s | 308 kB 00:00 2026-02-12T03:47:38.501 INFO:teuthology.orchestra.run.trial154.stdout:(30/37): libunwind-1.6.2-1.el9.x86_64.rpm 870 kB/s | 67 kB 00:00 2026-02-12T03:47:38.558 INFO:teuthology.orchestra.run.trial154.stdout:(31/37): liboath-2.6.12-1.el9.x86_64.rpm 321 kB/s | 49 kB 00:00 2026-02-12T03:47:38.563 INFO:teuthology.orchestra.run.trial098.stdout:(5/5): ceph-test-20.2.0-626.g1279775f.el9.x86_6 48 MB/s | 84 MB 00:01 2026-02-12T03:47:38.564 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:47:38.565 INFO:teuthology.orchestra.run.trial098.stdout:Total 41 MB/s | 85 MB 00:02 2026-02-12T03:47:38.592 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-12T03:47:38.602 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-12T03:47:38.602 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-12T03:47:38.734 INFO:teuthology.orchestra.run.trial154.stdout:(32/37): parquet-libs-9.0.0-15.el9.x86_64.rpm 3.5 MB/s | 838 kB 00:00 2026-02-12T03:47:38.787 INFO:teuthology.orchestra.run.trial154.stdout:(33/37): re2-20211101-20.el9.x86_64.rpm 838 kB/s | 191 kB 00:00 2026-02-12T03:47:38.887 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-12T03:47:38.887 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-12T03:47:38.950 INFO:teuthology.orchestra.run.trial154.stdout:(34/37): libarrow-9.0.0-15.el9.x86_64.rpm 4.1 MB/s | 4.4 MB 00:01 2026-02-12T03:47:38.986 INFO:teuthology.orchestra.run.trial154.stdout:(35/37): librados2-20.2.0-626.g1279775f.el9.x86 18 MB/s | 3.5 MB 00:00 2026-02-12T03:47:39.120 INFO:teuthology.orchestra.run.trial154.stdout:(36/37): thrift-0.15.0-4.el9.x86_64.rpm 4.1 MB/s | 1.6 MB 00:00 2026-02-12T03:47:39.201 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-12T03:47:39.207 INFO:teuthology.orchestra.run.trial098.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-12T03:47:39.212 INFO:teuthology.orchestra.run.trial098.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-12T03:47:39.214 INFO:teuthology.orchestra.run.trial154.stdout:(37/37): librbd1-20.2.0-626.g1279775f.el9.x86_6 11 MB/s | 2.8 MB 00:00 2026-02-12T03:47:39.218 INFO:teuthology.orchestra.run.trial154.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:47:39.218 INFO:teuthology.orchestra.run.trial154.stdout:Total 16 MB/s | 79 MB 00:04 2026-02-12T03:47:39.220 INFO:teuthology.orchestra.run.trial098.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-12T03:47:39.221 INFO:teuthology.orchestra.run.trial098.stdout: Installing : libcephsqlite-2:20.2.0-626.g1279775f.el9.x86_64 4/5 2026-02-12T03:47:39.314 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction check 2026-02-12T03:47:39.332 INFO:teuthology.orchestra.run.trial154.stdout:Transaction check succeeded. 2026-02-12T03:47:39.332 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction test 2026-02-12T03:47:39.627 INFO:teuthology.orchestra.run.trial154.stdout:Transaction test succeeded. 2026-02-12T03:47:39.628 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction 2026-02-12T03:47:39.967 INFO:teuthology.orchestra.run.trial154.stdout: Preparing : 1/1 2026-02-12T03:47:39.978 INFO:teuthology.orchestra.run.trial154.stdout: Installing : thrift-0.15.0-4.el9.x86_64 1/39 2026-02-12T03:47:40.130 INFO:teuthology.orchestra.run.trial154.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 2/39 2026-02-12T03:47:40.135 INFO:teuthology.orchestra.run.trial154.stdout: Upgrading : librados2-2:20.2.0-626.g1279775f.el9.x86_64 3/39 2026-02-12T03:47:40.183 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: librados2-2:20.2.0-626.g1279775f.el9.x86_64 3/39 2026-02-12T03:47:40.184 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libcephfs2-2:20.2.0-626.g1279775f.el9.x86_64 4/39 2026-02-12T03:47:40.196 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: libcephfs2-2:20.2.0-626.g1279775f.el9.x86_64 4/39 2026-02-12T03:47:40.198 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libcephfs-daemon-2:20.2.0-626.g1279775f.el9.x86_64 5/39 2026-02-12T03:47:40.198 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libcephfs-proxy2-2:20.2.0-626.g1279775f.el9.x86_64 6/39 2026-02-12T03:47:40.224 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: libcephfs-proxy2-2:20.2.0-626.g1279775f.el9.x86_64 6/39 2026-02-12T03:47:40.228 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-rados-2:20.2.0-626.g1279775f.el9.x86_64 7/39 2026-02-12T03:47:40.236 INFO:teuthology.orchestra.run.trial154.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/39 2026-02-12T03:47:40.239 INFO:teuthology.orchestra.run.trial154.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/39 2026-02-12T03:47:40.242 INFO:teuthology.orchestra.run.trial154.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 10/39 2026-02-12T03:47:40.246 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 11/39 2026-02-12T03:47:40.254 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-ceph-argparse-2:20.2.0-626.g1279775f.el9.x 12/39 2026-02-12T03:47:40.266 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-cephfs-2:20.2.0-626.g1279775f.el9.x86_64 13/39 2026-02-12T03:47:40.267 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libradosstriper1-2:20.2.0-626.g1279775f.el9.x86_64 14/39 2026-02-12T03:47:40.278 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: libradosstriper1-2:20.2.0-626.g1279775f.el9.x86_64 14/39 2026-02-12T03:47:40.308 INFO:teuthology.orchestra.run.trial154.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/39 2026-02-12T03:47:40.313 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 16/39 2026-02-12T03:47:40.319 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/39 2026-02-12T03:47:40.322 INFO:teuthology.orchestra.run.trial154.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/39 2026-02-12T03:47:40.326 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 19/39 2026-02-12T03:47:40.398 INFO:teuthology.orchestra.run.trial091.stdout:(5/5): ceph-test-20.2.0-626.g1279775f.el9.x86_6 25 MB/s | 84 MB 00:03 2026-02-12T03:47:40.399 INFO:teuthology.orchestra.run.trial091.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:47:40.399 INFO:teuthology.orchestra.run.trial091.stdout:Total 24 MB/s | 85 MB 00:03 2026-02-12T03:47:40.427 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction check 2026-02-12T03:47:40.437 INFO:teuthology.orchestra.run.trial091.stdout:Transaction check succeeded. 2026-02-12T03:47:40.437 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction test 2026-02-12T03:47:40.447 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-12T03:47:40.449 INFO:teuthology.orchestra.run.trial154.stdout: Upgrading : librbd1-2:20.2.0-626.g1279775f.el9.x86_64 21/39 2026-02-12T03:47:40.474 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: librbd1-2:20.2.0-626.g1279775f.el9.x86_64 21/39 2026-02-12T03:47:40.476 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-rbd-2:20.2.0-626.g1279775f.el9.x86_64 22/39 2026-02-12T03:47:40.482 INFO:teuthology.orchestra.run.trial154.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 23/39 2026-02-12T03:47:40.723 INFO:teuthology.orchestra.run.trial091.stdout:Transaction test succeeded. 2026-02-12T03:47:40.723 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction 2026-02-12T03:47:40.761 INFO:teuthology.orchestra.run.trial154.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 24/39 2026-02-12T03:47:40.762 INFO:teuthology.orchestra.run.trial154.stdout: Installing : librgw2-2:20.2.0-626.g1279775f.el9.x86_64 25/39 2026-02-12T03:47:40.778 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: librgw2-2:20.2.0-626.g1279775f.el9.x86_64 25/39 2026-02-12T03:47:40.783 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-rgw-2:20.2.0-626.g1279775f.el9.x86_64 26/39 2026-02-12T03:47:40.788 INFO:teuthology.orchestra.run.trial154.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 27/39 2026-02-12T03:47:40.790 INFO:teuthology.orchestra.run.trial154.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 28/39 2026-02-12T03:47:40.791 INFO:teuthology.orchestra.run.trial154.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-12T03:47:40.808 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 29/39 2026-02-12T03:47:40.918 INFO:teuthology.orchestra.run.trial154.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 30/39 2026-02-12T03:47:40.921 INFO:teuthology.orchestra.run.trial154.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-12T03:47:41.040 INFO:teuthology.orchestra.run.trial091.stdout: Preparing : 1/1 2026-02-12T03:47:41.046 INFO:teuthology.orchestra.run.trial091.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-12T03:47:41.050 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-12T03:47:41.058 INFO:teuthology.orchestra.run.trial091.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-12T03:47:41.059 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libcephsqlite-2:20.2.0-626.g1279775f.el9.x86_64 4/5 2026-02-12T03:47:41.189 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 31/39 2026-02-12T03:47:41.189 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-12T03:47:41.190 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:47:41.234 INFO:teuthology.orchestra.run.trial154.stdout: Installing : mailcap-2.1.49-5.el9.noarch 32/39 2026-02-12T03:47:41.236 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-ceph-common-2:20.2.0-626.g1279775f.el9.x86 33/39 2026-02-12T03:47:42.314 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-common-2:20.2.0-626.g1279775f.el9.x86_64 34/39 2026-02-12T03:47:42.317 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-common-2:20.2.0-626.g1279775f.el9.x86_64 34/39 2026-02-12T03:47:42.489 INFO:teuthology.orchestra.run.trial111.stdout:(5/5): ceph-test-20.2.0-626.g1279775f.el9.x86_6 11 MB/s | 84 MB 00:07 2026-02-12T03:47:42.491 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:47:42.491 INFO:teuthology.orchestra.run.trial111.stdout:Total 11 MB/s | 85 MB 00:07 2026-02-12T03:47:42.520 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T03:47:42.530 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T03:47:42.530 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T03:47:42.609 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-common-2:20.2.0-626.g1279775f.el9.x86_64 34/39 2026-02-12T03:47:42.612 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-base-2:20.2.0-626.g1279775f.el9.x86_64 35/39 2026-02-12T03:47:42.653 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-base-2:20.2.0-626.g1279775f.el9.x86_64 35/39 2026-02-12T03:47:42.653 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-12T03:47:42.653 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-12T03:47:42.653 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:47:42.658 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-selinux-2:20.2.0-626.g1279775f.el9.x86_64 36/39 2026-02-12T03:47:42.819 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T03:47:42.819 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T03:47:42.944 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: libcephsqlite-2:20.2.0-626.g1279775f.el9.x86_64 4/5 2026-02-12T03:47:42.961 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-test-2:20.2.0-626.g1279775f.el9.x86_64 5/5 2026-02-12T03:47:43.132 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T03:47:43.139 INFO:teuthology.orchestra.run.trial111.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-12T03:47:43.144 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-12T03:47:43.152 INFO:teuthology.orchestra.run.trial111.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-12T03:47:43.153 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libcephsqlite-2:20.2.0-626.g1279775f.el9.x86_64 4/5 2026-02-12T03:47:43.282 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-test-2:20.2.0-626.g1279775f.el9.x86_64 5/5 2026-02-12T03:47:43.282 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-test-2:20.2.0-626.g1279775f.el9.x86_64 1/5 2026-02-12T03:47:43.282 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : libcephsqlite-2:20.2.0-626.g1279775f.el9.x86_64 2/5 2026-02-12T03:47:43.282 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-12T03:47:43.282 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-12T03:47:43.335 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-12T03:47:43.335 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:47:43.335 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-12T03:47:43.335 INFO:teuthology.orchestra.run.trial098.stdout: ceph-test-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:43.336 INFO:teuthology.orchestra.run.trial098.stdout: libcephsqlite-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:43.336 INFO:teuthology.orchestra.run.trial098.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-12T03:47:43.336 INFO:teuthology.orchestra.run.trial098.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-12T03:47:43.336 INFO:teuthology.orchestra.run.trial098.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-12T03:47:43.336 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:47:43.336 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:47:43.371 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install ceph 2026-02-12T03:47:43.668 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:23 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:47:43.755 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:47:43.757 INFO:teuthology.orchestra.run.trial098.stdout:====================================================================================== 2026-02-12T03:47:43.758 INFO:teuthology.orchestra.run.trial098.stdout: Package Arch Version Repository Size 2026-02-12T03:47:43.758 INFO:teuthology.orchestra.run.trial098.stdout:====================================================================================== 2026-02-12T03:47:43.758 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-12T03:47:43.758 INFO:teuthology.orchestra.run.trial098.stdout: ceph x86_64 2:20.2.0-626.g1279775f.el9 ceph 6.5 k 2026-02-12T03:47:43.758 INFO:teuthology.orchestra.run.trial098.stdout:Installing dependencies: 2026-02-12T03:47:43.758 INFO:teuthology.orchestra.run.trial098.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-12T03:47:43.758 INFO:teuthology.orchestra.run.trial098.stdout: ceph-grafana-dashboards noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 43 k 2026-02-12T03:47:43.758 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mds x86_64 2:20.2.0-626.g1279775f.el9 ceph 2.3 M 2026-02-12T03:47:43.758 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mgr x86_64 2:20.2.0-626.g1279775f.el9 ceph 962 k 2026-02-12T03:47:43.759 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mgr-modules-core noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 290 k 2026-02-12T03:47:43.759 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mon x86_64 2:20.2.0-626.g1279775f.el9 ceph 5.0 M 2026-02-12T03:47:43.759 INFO:teuthology.orchestra.run.trial098.stdout: ceph-osd x86_64 2:20.2.0-626.g1279775f.el9 ceph 17 M 2026-02-12T03:47:43.759 INFO:teuthology.orchestra.run.trial098.stdout: ceph-prometheus-alerts noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 17 k 2026-02-12T03:47:43.759 INFO:teuthology.orchestra.run.trial098.stdout: cephadm noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 1.0 M 2026-02-12T03:47:43.759 INFO:teuthology.orchestra.run.trial098.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-12T03:47:43.759 INFO:teuthology.orchestra.run.trial098.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-12T03:47:43.759 INFO:teuthology.orchestra.run.trial098.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-12T03:47:43.759 INFO:teuthology.orchestra.run.trial098.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-12T03:47:43.759 INFO:teuthology.orchestra.run.trial098.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-12T03:47:43.760 INFO:teuthology.orchestra.run.trial098.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-12T03:47:43.760 INFO:teuthology.orchestra.run.trial098.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-12T03:47:43.760 INFO:teuthology.orchestra.run.trial098.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-12T03:47:43.760 INFO:teuthology.orchestra.run.trial098.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-12T03:47:43.760 INFO:teuthology.orchestra.run.trial098.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-12T03:47:43.760 INFO:teuthology.orchestra.run.trial098.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-12T03:47:43.760 INFO:teuthology.orchestra.run.trial098.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-12T03:47:43.760 INFO:teuthology.orchestra.run.trial098.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-12T03:47:43.760 INFO:teuthology.orchestra.run.trial098.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-12T03:47:43.760 INFO:teuthology.orchestra.run.trial098.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-12T03:47:43.760 INFO:teuthology.orchestra.run.trial098.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-12T03:47:43.760 INFO:teuthology.orchestra.run.trial098.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-12T03:47:43.761 INFO:teuthology.orchestra.run.trial098.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-12T03:47:43.761 INFO:teuthology.orchestra.run.trial098.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-12T03:47:43.761 INFO:teuthology.orchestra.run.trial098.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-12T03:47:43.761 INFO:teuthology.orchestra.run.trial098.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-12T03:47:43.761 INFO:teuthology.orchestra.run.trial098.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-12T03:47:43.761 INFO:teuthology.orchestra.run.trial098.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-12T03:47:43.761 INFO:teuthology.orchestra.run.trial098.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-12T03:47:43.761 INFO:teuthology.orchestra.run.trial098.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-12T03:47:43.761 INFO:teuthology.orchestra.run.trial098.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-12T03:47:43.761 INFO:teuthology.orchestra.run.trial098.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-12T03:47:43.761 INFO:teuthology.orchestra.run.trial098.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-12T03:47:43.761 INFO:teuthology.orchestra.run.trial098.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-12T03:47:43.762 INFO:teuthology.orchestra.run.trial098.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-12T03:47:43.762 INFO:teuthology.orchestra.run.trial098.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-12T03:47:43.762 INFO:teuthology.orchestra.run.trial098.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-12T03:47:43.762 INFO:teuthology.orchestra.run.trial098.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-12T03:47:43.762 INFO:teuthology.orchestra.run.trial098.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-12T03:47:43.762 INFO:teuthology.orchestra.run.trial098.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-12T03:47:43.762 INFO:teuthology.orchestra.run.trial098.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-12T03:47:43.762 INFO:teuthology.orchestra.run.trial098.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-12T03:47:43.762 INFO:teuthology.orchestra.run.trial098.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-12T03:47:43.762 INFO:teuthology.orchestra.run.trial098.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-12T03:47:43.762 INFO:teuthology.orchestra.run.trial098.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-12T03:47:43.762 INFO:teuthology.orchestra.run.trial098.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-12T03:47:43.762 INFO:teuthology.orchestra.run.trial098.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-12T03:47:43.763 INFO:teuthology.orchestra.run.trial098.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-12T03:47:43.763 INFO:teuthology.orchestra.run.trial098.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-12T03:47:43.763 INFO:teuthology.orchestra.run.trial098.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-12T03:47:43.763 INFO:teuthology.orchestra.run.trial098.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-12T03:47:43.763 INFO:teuthology.orchestra.run.trial098.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-12T03:47:43.763 INFO:teuthology.orchestra.run.trial098.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-12T03:47:43.763 INFO:teuthology.orchestra.run.trial098.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-12T03:47:43.763 INFO:teuthology.orchestra.run.trial098.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-12T03:47:43.763 INFO:teuthology.orchestra.run.trial098.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-12T03:47:43.763 INFO:teuthology.orchestra.run.trial098.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-12T03:47:43.763 INFO:teuthology.orchestra.run.trial098.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-12T03:47:43.763 INFO:teuthology.orchestra.run.trial098.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-12T03:47:43.763 INFO:teuthology.orchestra.run.trial098.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-12T03:47:43.764 INFO:teuthology.orchestra.run.trial098.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-12T03:47:43.764 INFO:teuthology.orchestra.run.trial098.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-12T03:47:43.764 INFO:teuthology.orchestra.run.trial098.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-12T03:47:43.764 INFO:teuthology.orchestra.run.trial098.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-12T03:47:43.764 INFO:teuthology.orchestra.run.trial098.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-12T03:47:43.764 INFO:teuthology.orchestra.run.trial098.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-12T03:47:43.764 INFO:teuthology.orchestra.run.trial098.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-12T03:47:43.764 INFO:teuthology.orchestra.run.trial098.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-12T03:47:43.764 INFO:teuthology.orchestra.run.trial098.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-12T03:47:43.764 INFO:teuthology.orchestra.run.trial098.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-12T03:47:43.764 INFO:teuthology.orchestra.run.trial098.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-12T03:47:43.764 INFO:teuthology.orchestra.run.trial098.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-12T03:47:43.764 INFO:teuthology.orchestra.run.trial098.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-12T03:47:43.765 INFO:teuthology.orchestra.run.trial098.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-12T03:47:43.765 INFO:teuthology.orchestra.run.trial098.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-12T03:47:43.765 INFO:teuthology.orchestra.run.trial098.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-12T03:47:43.765 INFO:teuthology.orchestra.run.trial098.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-12T03:47:43.765 INFO:teuthology.orchestra.run.trial098.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-12T03:47:43.765 INFO:teuthology.orchestra.run.trial098.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-12T03:47:43.765 INFO:teuthology.orchestra.run.trial098.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-12T03:47:43.765 INFO:teuthology.orchestra.run.trial098.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-12T03:47:43.765 INFO:teuthology.orchestra.run.trial098.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-12T03:47:43.765 INFO:teuthology.orchestra.run.trial098.stdout:Installing weak dependencies: 2026-02-12T03:47:43.765 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mgr-cephadm noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 173 k 2026-02-12T03:47:43.765 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mgr-dashboard noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 11 M 2026-02-12T03:47:43.766 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 7.4 M 2026-02-12T03:47:43.766 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mgr-k8sevents noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 22 k 2026-02-12T03:47:43.766 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mgr-rook noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 50 k 2026-02-12T03:47:43.766 INFO:teuthology.orchestra.run.trial098.stdout: ceph-volume noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 298 k 2026-02-12T03:47:43.766 INFO:teuthology.orchestra.run.trial098.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-12T03:47:43.766 INFO:teuthology.orchestra.run.trial098.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-12T03:47:43.766 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:47:43.766 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-12T03:47:43.766 INFO:teuthology.orchestra.run.trial098.stdout:====================================================================================== 2026-02-12T03:47:43.766 INFO:teuthology.orchestra.run.trial098.stdout:Install 95 Packages 2026-02-12T03:47:43.766 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:47:43.767 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 101 M 2026-02-12T03:47:43.767 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 561 M 2026-02-12T03:47:43.768 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-12T03:47:44.123 INFO:teuthology.orchestra.run.trial098.stdout:(1/95): ceph-20.2.0-626.g1279775f.el9.x86_64.rp 130 kB/s | 6.5 kB 00:00 2026-02-12T03:47:44.223 INFO:teuthology.orchestra.run.trial098.stdout:(2/95): ceph-mgr-20.2.0-626.g1279775f.el9.x86_6 6.3 MB/s | 962 kB 00:00 2026-02-12T03:47:44.245 INFO:teuthology.orchestra.run.trial098.stdout:(3/95): ceph-mds-20.2.0-626.g1279775f.el9.x86_6 14 MB/s | 2.3 MB 00:00 2026-02-12T03:47:44.266 INFO:teuthology.orchestra.run.trial098.stdout:(4/95): ceph-grafana-dashboards-20.2.0-626.g127 2.0 MB/s | 43 kB 00:00 2026-02-12T03:47:44.287 INFO:teuthology.orchestra.run.trial098.stdout:(5/95): ceph-mgr-cephadm-20.2.0-626.g1279775f.e 8.0 MB/s | 173 kB 00:00 2026-02-12T03:47:44.460 INFO:teuthology.orchestra.run.trial098.stdout:(6/95): ceph-mon-20.2.0-626.g1279775f.el9.x86_6 15 MB/s | 5.0 MB 00:00 2026-02-12T03:47:44.962 INFO:teuthology.orchestra.run.trial098.stdout:(7/95): ceph-mgr-dashboard-20.2.0-626.g1279775f 16 MB/s | 11 MB 00:00 2026-02-12T03:47:44.977 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: libcephsqlite-2:20.2.0-626.g1279775f.el9.x86_64 4/5 2026-02-12T03:47:44.995 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-test-2:20.2.0-626.g1279775f.el9.x86_64 5/5 2026-02-12T03:47:45.009 INFO:teuthology.orchestra.run.trial098.stdout:(8/95): ceph-mgr-k8sevents-20.2.0-626.g1279775f 471 kB/s | 22 kB 00:00 2026-02-12T03:47:45.048 INFO:teuthology.orchestra.run.trial098.stdout:(9/95): ceph-mgr-modules-core-20.2.0-626.g12797 7.3 MB/s | 290 kB 00:00 2026-02-12T03:47:45.091 INFO:teuthology.orchestra.run.trial098.stdout:(10/95): ceph-mgr-rook-20.2.0-626.g1279775f.el9 1.1 MB/s | 50 kB 00:00 2026-02-12T03:47:45.139 INFO:teuthology.orchestra.run.trial098.stdout:(11/95): ceph-prometheus-alerts-20.2.0-626.g127 363 kB/s | 17 kB 00:00 2026-02-12T03:47:45.180 INFO:teuthology.orchestra.run.trial098.stdout:(12/95): ceph-volume-20.2.0-626.g1279775f.el9.n 7.0 MB/s | 298 kB 00:00 2026-02-12T03:47:45.289 INFO:teuthology.orchestra.run.trial098.stdout:(13/95): cephadm-20.2.0-626.g1279775f.el9.noarc 9.2 MB/s | 1.0 MB 00:00 2026-02-12T03:47:45.325 INFO:teuthology.orchestra.run.trial098.stdout:(14/95): ceph-mgr-diskprediction-local-20.2.0-6 8.5 MB/s | 7.4 MB 00:00 2026-02-12T03:47:45.337 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-test-2:20.2.0-626.g1279775f.el9.x86_64 5/5 2026-02-12T03:47:45.337 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-test-2:20.2.0-626.g1279775f.el9.x86_64 1/5 2026-02-12T03:47:45.337 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libcephsqlite-2:20.2.0-626.g1279775f.el9.x86_64 2/5 2026-02-12T03:47:45.337 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-12T03:47:45.337 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-12T03:47:45.390 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-12T03:47:45.390 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:47:45.390 INFO:teuthology.orchestra.run.trial091.stdout:Installed: 2026-02-12T03:47:45.390 INFO:teuthology.orchestra.run.trial091.stdout: ceph-test-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:45.390 INFO:teuthology.orchestra.run.trial091.stdout: libcephsqlite-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:45.390 INFO:teuthology.orchestra.run.trial091.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-12T03:47:45.390 INFO:teuthology.orchestra.run.trial091.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-12T03:47:45.390 INFO:teuthology.orchestra.run.trial091.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-12T03:47:45.390 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:47:45.391 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:47:45.411 INFO:teuthology.orchestra.run.trial098.stdout:(15/95): ledmon-libs-1.1.0-3.el9.x86_64.rpm 473 kB/s | 40 kB 00:00 2026-02-12T03:47:45.428 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install ceph 2026-02-12T03:47:45.466 INFO:teuthology.orchestra.run.trial098.stdout:(16/95): cryptsetup-2.8.1-2.el9.x86_64.rpm 1.9 MB/s | 350 kB 00:00 2026-02-12T03:47:45.469 INFO:teuthology.orchestra.run.trial098.stdout:(17/95): libconfig-1.7.2-9.el9.x86_64.rpm 1.2 MB/s | 72 kB 00:00 2026-02-12T03:47:45.541 INFO:teuthology.orchestra.run.trial098.stdout:(18/95): ceph-osd-20.2.0-626.g1279775f.el9.x86_ 13 MB/s | 17 MB 00:01 2026-02-12T03:47:45.542 INFO:teuthology.orchestra.run.trial098.stdout:(19/95): libquadmath-11.5.0-14.el9.x86_64.rpm 2.5 MB/s | 184 kB 00:00 2026-02-12T03:47:45.543 INFO:teuthology.orchestra.run.trial098.stdout:(20/95): libgfortran-11.5.0-14.el9.x86_64.rpm 10 MB/s | 794 kB 00:00 2026-02-12T03:47:45.570 INFO:teuthology.orchestra.run.trial098.stdout:(21/95): python3-ply-3.11-14.el9.noarch.rpm 3.9 MB/s | 106 kB 00:00 2026-02-12T03:47:45.597 INFO:teuthology.orchestra.run.trial098.stdout:(22/95): python3-pycparser-2.20-6.el9.noarch.rp 4.9 MB/s | 135 kB 00:00 2026-02-12T03:47:45.624 INFO:teuthology.orchestra.run.trial098.stdout:(23/95): python3-pyparsing-2.4.7-9.el9.noarch.r 5.4 MB/s | 150 kB 00:00 2026-02-12T03:47:45.635 INFO:teuthology.orchestra.run.trial098.stdout:(24/95): python3-cryptography-36.0.1-5.el9.x86_ 13 MB/s | 1.2 MB 00:00 2026-02-12T03:47:45.652 INFO:teuthology.orchestra.run.trial098.stdout:(25/95): python3-requests-2.25.1-10.el9.noarch. 4.5 MB/s | 126 kB 00:00 2026-02-12T03:47:45.662 INFO:teuthology.orchestra.run.trial098.stdout:(26/95): python3-urllib3-1.26.5-7.el9.noarch.rp 7.8 MB/s | 218 kB 00:00 2026-02-12T03:47:45.679 INFO:teuthology.orchestra.run.trial098.stdout:(27/95): unzip-6.0-59.el9.x86_64.rpm 6.4 MB/s | 182 kB 00:00 2026-02-12T03:47:45.692 INFO:teuthology.orchestra.run.trial098.stdout:(28/95): zip-3.0-35.el9.x86_64.rpm 8.9 MB/s | 266 kB 00:00 2026-02-12T03:47:45.695 INFO:teuthology.orchestra.run.trial098.stdout:(29/95): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.6 MB/s | 253 kB 00:00 2026-02-12T03:47:45.725 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:00:22 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:47:45.812 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:47:45.815 INFO:teuthology.orchestra.run.trial091.stdout:====================================================================================== 2026-02-12T03:47:45.815 INFO:teuthology.orchestra.run.trial091.stdout: Package Arch Version Repository Size 2026-02-12T03:47:45.815 INFO:teuthology.orchestra.run.trial091.stdout:====================================================================================== 2026-02-12T03:47:45.815 INFO:teuthology.orchestra.run.trial091.stdout:Installing: 2026-02-12T03:47:45.815 INFO:teuthology.orchestra.run.trial091.stdout: ceph x86_64 2:20.2.0-626.g1279775f.el9 ceph 6.5 k 2026-02-12T03:47:45.815 INFO:teuthology.orchestra.run.trial091.stdout:Installing dependencies: 2026-02-12T03:47:45.815 INFO:teuthology.orchestra.run.trial091.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-12T03:47:45.815 INFO:teuthology.orchestra.run.trial091.stdout: ceph-grafana-dashboards noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 43 k 2026-02-12T03:47:45.816 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mds x86_64 2:20.2.0-626.g1279775f.el9 ceph 2.3 M 2026-02-12T03:47:45.816 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr x86_64 2:20.2.0-626.g1279775f.el9 ceph 962 k 2026-02-12T03:47:45.816 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr-modules-core noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 290 k 2026-02-12T03:47:45.816 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mon x86_64 2:20.2.0-626.g1279775f.el9 ceph 5.0 M 2026-02-12T03:47:45.816 INFO:teuthology.orchestra.run.trial091.stdout: ceph-osd x86_64 2:20.2.0-626.g1279775f.el9 ceph 17 M 2026-02-12T03:47:45.816 INFO:teuthology.orchestra.run.trial091.stdout: ceph-prometheus-alerts noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 17 k 2026-02-12T03:47:45.816 INFO:teuthology.orchestra.run.trial091.stdout: cephadm noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 1.0 M 2026-02-12T03:47:45.816 INFO:teuthology.orchestra.run.trial091.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-12T03:47:45.816 INFO:teuthology.orchestra.run.trial091.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-12T03:47:45.816 INFO:teuthology.orchestra.run.trial091.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-12T03:47:45.816 INFO:teuthology.orchestra.run.trial091.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-12T03:47:45.816 INFO:teuthology.orchestra.run.trial091.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-12T03:47:45.817 INFO:teuthology.orchestra.run.trial091.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-12T03:47:45.817 INFO:teuthology.orchestra.run.trial091.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-12T03:47:45.817 INFO:teuthology.orchestra.run.trial091.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-12T03:47:45.817 INFO:teuthology.orchestra.run.trial091.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-12T03:47:45.817 INFO:teuthology.orchestra.run.trial091.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-12T03:47:45.817 INFO:teuthology.orchestra.run.trial091.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-12T03:47:45.817 INFO:teuthology.orchestra.run.trial091.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-12T03:47:45.817 INFO:teuthology.orchestra.run.trial091.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-12T03:47:45.817 INFO:teuthology.orchestra.run.trial091.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-12T03:47:45.817 INFO:teuthology.orchestra.run.trial091.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-12T03:47:45.817 INFO:teuthology.orchestra.run.trial091.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-12T03:47:45.817 INFO:teuthology.orchestra.run.trial091.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-12T03:47:45.818 INFO:teuthology.orchestra.run.trial091.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-12T03:47:45.818 INFO:teuthology.orchestra.run.trial091.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-12T03:47:45.818 INFO:teuthology.orchestra.run.trial091.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-12T03:47:45.818 INFO:teuthology.orchestra.run.trial091.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-12T03:47:45.818 INFO:teuthology.orchestra.run.trial091.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-12T03:47:45.818 INFO:teuthology.orchestra.run.trial091.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-12T03:47:45.818 INFO:teuthology.orchestra.run.trial091.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-12T03:47:45.818 INFO:teuthology.orchestra.run.trial091.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-12T03:47:45.818 INFO:teuthology.orchestra.run.trial091.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-12T03:47:45.818 INFO:teuthology.orchestra.run.trial091.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-12T03:47:45.818 INFO:teuthology.orchestra.run.trial091.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-12T03:47:45.818 INFO:teuthology.orchestra.run.trial091.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-12T03:47:45.819 INFO:teuthology.orchestra.run.trial091.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-12T03:47:45.819 INFO:teuthology.orchestra.run.trial091.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-12T03:47:45.819 INFO:teuthology.orchestra.run.trial091.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-12T03:47:45.819 INFO:teuthology.orchestra.run.trial091.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-12T03:47:45.819 INFO:teuthology.orchestra.run.trial091.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-12T03:47:45.819 INFO:teuthology.orchestra.run.trial091.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-12T03:47:45.819 INFO:teuthology.orchestra.run.trial091.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-12T03:47:45.819 INFO:teuthology.orchestra.run.trial091.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-12T03:47:45.819 INFO:teuthology.orchestra.run.trial091.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-12T03:47:45.819 INFO:teuthology.orchestra.run.trial091.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-12T03:47:45.819 INFO:teuthology.orchestra.run.trial091.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-12T03:47:45.819 INFO:teuthology.orchestra.run.trial091.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-12T03:47:45.819 INFO:teuthology.orchestra.run.trial091.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-12T03:47:45.820 INFO:teuthology.orchestra.run.trial091.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-12T03:47:45.820 INFO:teuthology.orchestra.run.trial091.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-12T03:47:45.820 INFO:teuthology.orchestra.run.trial091.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-12T03:47:45.820 INFO:teuthology.orchestra.run.trial091.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-12T03:47:45.820 INFO:teuthology.orchestra.run.trial091.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-12T03:47:45.820 INFO:teuthology.orchestra.run.trial091.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-12T03:47:45.820 INFO:teuthology.orchestra.run.trial091.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-12T03:47:45.820 INFO:teuthology.orchestra.run.trial091.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-12T03:47:45.820 INFO:teuthology.orchestra.run.trial091.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-12T03:47:45.820 INFO:teuthology.orchestra.run.trial091.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-12T03:47:45.820 INFO:teuthology.orchestra.run.trial091.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-12T03:47:45.820 INFO:teuthology.orchestra.run.trial091.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-12T03:47:45.820 INFO:teuthology.orchestra.run.trial091.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-12T03:47:45.821 INFO:teuthology.orchestra.run.trial091.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-12T03:47:45.821 INFO:teuthology.orchestra.run.trial091.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-12T03:47:45.821 INFO:teuthology.orchestra.run.trial091.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-12T03:47:45.821 INFO:teuthology.orchestra.run.trial091.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-12T03:47:45.821 INFO:teuthology.orchestra.run.trial091.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-12T03:47:45.821 INFO:teuthology.orchestra.run.trial091.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-12T03:47:45.821 INFO:teuthology.orchestra.run.trial091.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-12T03:47:45.821 INFO:teuthology.orchestra.run.trial091.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-12T03:47:45.821 INFO:teuthology.orchestra.run.trial091.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-12T03:47:45.821 INFO:teuthology.orchestra.run.trial091.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-12T03:47:45.821 INFO:teuthology.orchestra.run.trial091.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-12T03:47:45.821 INFO:teuthology.orchestra.run.trial091.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-12T03:47:45.821 INFO:teuthology.orchestra.run.trial091.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-12T03:47:45.822 INFO:teuthology.orchestra.run.trial091.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-12T03:47:45.822 INFO:teuthology.orchestra.run.trial091.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-12T03:47:45.822 INFO:teuthology.orchestra.run.trial091.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-12T03:47:45.822 INFO:teuthology.orchestra.run.trial091.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-12T03:47:45.822 INFO:teuthology.orchestra.run.trial091.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-12T03:47:45.822 INFO:teuthology.orchestra.run.trial091.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-12T03:47:45.822 INFO:teuthology.orchestra.run.trial091.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-12T03:47:45.822 INFO:teuthology.orchestra.run.trial091.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-12T03:47:45.822 INFO:teuthology.orchestra.run.trial091.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-12T03:47:45.822 INFO:teuthology.orchestra.run.trial091.stdout:Installing weak dependencies: 2026-02-12T03:47:45.822 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr-cephadm noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 173 k 2026-02-12T03:47:45.822 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr-dashboard noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 11 M 2026-02-12T03:47:45.822 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 7.4 M 2026-02-12T03:47:45.823 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr-k8sevents noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 22 k 2026-02-12T03:47:45.823 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr-rook noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 50 k 2026-02-12T03:47:45.823 INFO:teuthology.orchestra.run.trial091.stdout: ceph-volume noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 298 k 2026-02-12T03:47:45.823 INFO:teuthology.orchestra.run.trial091.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-12T03:47:45.823 INFO:teuthology.orchestra.run.trial091.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-12T03:47:45.823 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:47:45.823 INFO:teuthology.orchestra.run.trial091.stdout:Transaction Summary 2026-02-12T03:47:45.823 INFO:teuthology.orchestra.run.trial091.stdout:====================================================================================== 2026-02-12T03:47:45.823 INFO:teuthology.orchestra.run.trial091.stdout:Install 95 Packages 2026-02-12T03:47:45.823 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:47:45.824 INFO:teuthology.orchestra.run.trial091.stdout:Total download size: 101 M 2026-02-12T03:47:45.824 INFO:teuthology.orchestra.run.trial091.stdout:Installed size: 561 M 2026-02-12T03:47:45.824 INFO:teuthology.orchestra.run.trial091.stdout:Downloading Packages: 2026-02-12T03:47:46.180 INFO:teuthology.orchestra.run.trial098.stdout:(30/95): flexiblas-openblas-openmp-3.0.4-8.el9. 38 kB/s | 18 kB 00:00 2026-02-12T03:47:46.245 INFO:teuthology.orchestra.run.trial098.stdout:(31/95): flexiblas-3.0.4-8.el9.x86_64.rpm 58 kB/s | 33 kB 00:00 2026-02-12T03:47:46.545 INFO:teuthology.orchestra.run.trial091.stdout:(1/95): ceph-20.2.0-626.g1279775f.el9.x86_64.rp 58 kB/s | 6.5 kB 00:00 2026-02-12T03:47:46.745 INFO:teuthology.orchestra.run.trial098.stdout:(32/95): flexiblas-netlib-3.0.4-8.el9.x86_64.rp 2.8 MB/s | 3.0 MB 00:01 2026-02-12T03:47:46.864 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: libcephsqlite-2:20.2.0-626.g1279775f.el9.x86_64 4/5 2026-02-12T03:47:46.882 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-test-2:20.2.0-626.g1279775f.el9.x86_64 5/5 2026-02-12T03:47:46.942 INFO:teuthology.orchestra.run.trial098.stdout:(33/95): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 323 kB/s | 246 kB 00:00 2026-02-12T03:47:46.981 INFO:teuthology.orchestra.run.trial098.stdout:(34/95): lua-5.4.4-4.el9.x86_64.rpm 256 kB/s | 188 kB 00:00 2026-02-12T03:47:47.047 INFO:teuthology.orchestra.run.trial091.stdout:(2/95): ceph-mgr-20.2.0-626.g1279775f.el9.x86_6 1.5 MB/s | 962 kB 00:00 2026-02-12T03:47:47.125 INFO:teuthology.orchestra.run.trial091.stdout:(3/95): ceph-mds-20.2.0-626.g1279775f.el9.x86_6 3.4 MB/s | 2.3 MB 00:00 2026-02-12T03:47:47.166 INFO:teuthology.orchestra.run.trial091.stdout:(4/95): ceph-grafana-dashboards-20.2.0-626.g127 1.0 MB/s | 43 kB 00:00 2026-02-12T03:47:47.195 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-test-2:20.2.0-626.g1279775f.el9.x86_64 5/5 2026-02-12T03:47:47.195 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-test-2:20.2.0-626.g1279775f.el9.x86_64 1/5 2026-02-12T03:47:47.195 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libcephsqlite-2:20.2.0-626.g1279775f.el9.x86_64 2/5 2026-02-12T03:47:47.195 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-12T03:47:47.195 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-12T03:47:47.206 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-selinux-2:20.2.0-626.g1279775f.el9.x86_64 36/39 2026-02-12T03:47:47.206 INFO:teuthology.orchestra.run.trial154.stdout:skipping the directory /sys 2026-02-12T03:47:47.206 INFO:teuthology.orchestra.run.trial154.stdout:skipping the directory /proc 2026-02-12T03:47:47.206 INFO:teuthology.orchestra.run.trial154.stdout:skipping the directory /mnt 2026-02-12T03:47:47.206 INFO:teuthology.orchestra.run.trial154.stdout:skipping the directory /var/tmp 2026-02-12T03:47:47.206 INFO:teuthology.orchestra.run.trial154.stdout:skipping the directory /home 2026-02-12T03:47:47.206 INFO:teuthology.orchestra.run.trial154.stdout:skipping the directory /root 2026-02-12T03:47:47.206 INFO:teuthology.orchestra.run.trial154.stdout:skipping the directory /tmp 2026-02-12T03:47:47.206 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:47:47.211 INFO:teuthology.orchestra.run.trial091.stdout:(5/95): ceph-mgr-cephadm-20.2.0-626.g1279775f.e 3.8 MB/s | 173 kB 00:00 2026-02-12T03:47:47.248 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-12T03:47:47.248 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:47:47.248 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T03:47:47.249 INFO:teuthology.orchestra.run.trial111.stdout: ceph-test-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:47.249 INFO:teuthology.orchestra.run.trial111.stdout: libcephsqlite-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:47.249 INFO:teuthology.orchestra.run.trial111.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-12T03:47:47.249 INFO:teuthology.orchestra.run.trial111.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-12T03:47:47.249 INFO:teuthology.orchestra.run.trial111.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-12T03:47:47.249 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:47:47.249 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:47:47.288 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph 2026-02-12T03:47:47.324 INFO:teuthology.orchestra.run.trial098.stdout:(35/95): openblas-0.3.29-1.el9.x86_64.rpm 73 kB/s | 42 kB 00:00 2026-02-12T03:47:47.587 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:28 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:47:47.674 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:47:47.676 INFO:teuthology.orchestra.run.trial111.stdout:====================================================================================== 2026-02-12T03:47:47.677 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repository Size 2026-02-12T03:47:47.677 INFO:teuthology.orchestra.run.trial111.stdout:====================================================================================== 2026-02-12T03:47:47.677 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T03:47:47.677 INFO:teuthology.orchestra.run.trial111.stdout: ceph x86_64 2:20.2.0-626.g1279775f.el9 ceph 6.5 k 2026-02-12T03:47:47.677 INFO:teuthology.orchestra.run.trial111.stdout:Installing dependencies: 2026-02-12T03:47:47.677 INFO:teuthology.orchestra.run.trial111.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-12T03:47:47.677 INFO:teuthology.orchestra.run.trial111.stdout: ceph-grafana-dashboards noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 43 k 2026-02-12T03:47:47.677 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mds x86_64 2:20.2.0-626.g1279775f.el9 ceph 2.3 M 2026-02-12T03:47:47.677 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr x86_64 2:20.2.0-626.g1279775f.el9 ceph 962 k 2026-02-12T03:47:47.678 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-modules-core noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 290 k 2026-02-12T03:47:47.678 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mon x86_64 2:20.2.0-626.g1279775f.el9 ceph 5.0 M 2026-02-12T03:47:47.678 INFO:teuthology.orchestra.run.trial111.stdout: ceph-osd x86_64 2:20.2.0-626.g1279775f.el9 ceph 17 M 2026-02-12T03:47:47.678 INFO:teuthology.orchestra.run.trial111.stdout: ceph-prometheus-alerts noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 17 k 2026-02-12T03:47:47.678 INFO:teuthology.orchestra.run.trial111.stdout: cephadm noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 1.0 M 2026-02-12T03:47:47.678 INFO:teuthology.orchestra.run.trial111.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-12T03:47:47.678 INFO:teuthology.orchestra.run.trial111.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-12T03:47:47.678 INFO:teuthology.orchestra.run.trial111.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-12T03:47:47.678 INFO:teuthology.orchestra.run.trial111.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-12T03:47:47.678 INFO:teuthology.orchestra.run.trial111.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-12T03:47:47.678 INFO:teuthology.orchestra.run.trial111.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-12T03:47:47.678 INFO:teuthology.orchestra.run.trial111.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-12T03:47:47.679 INFO:teuthology.orchestra.run.trial111.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-12T03:47:47.679 INFO:teuthology.orchestra.run.trial111.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-12T03:47:47.679 INFO:teuthology.orchestra.run.trial111.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-12T03:47:47.679 INFO:teuthology.orchestra.run.trial111.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-12T03:47:47.679 INFO:teuthology.orchestra.run.trial111.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-12T03:47:47.679 INFO:teuthology.orchestra.run.trial111.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-12T03:47:47.679 INFO:teuthology.orchestra.run.trial111.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-12T03:47:47.679 INFO:teuthology.orchestra.run.trial111.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-12T03:47:47.679 INFO:teuthology.orchestra.run.trial111.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-12T03:47:47.679 INFO:teuthology.orchestra.run.trial111.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-12T03:47:47.679 INFO:teuthology.orchestra.run.trial111.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-12T03:47:47.679 INFO:teuthology.orchestra.run.trial111.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-12T03:47:47.680 INFO:teuthology.orchestra.run.trial111.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-12T03:47:47.680 INFO:teuthology.orchestra.run.trial111.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-12T03:47:47.680 INFO:teuthology.orchestra.run.trial111.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-12T03:47:47.680 INFO:teuthology.orchestra.run.trial111.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-12T03:47:47.680 INFO:teuthology.orchestra.run.trial111.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-12T03:47:47.680 INFO:teuthology.orchestra.run.trial111.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-12T03:47:47.680 INFO:teuthology.orchestra.run.trial111.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-12T03:47:47.680 INFO:teuthology.orchestra.run.trial111.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-12T03:47:47.680 INFO:teuthology.orchestra.run.trial111.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-12T03:47:47.680 INFO:teuthology.orchestra.run.trial111.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-12T03:47:47.680 INFO:teuthology.orchestra.run.trial111.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-12T03:47:47.680 INFO:teuthology.orchestra.run.trial111.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-12T03:47:47.680 INFO:teuthology.orchestra.run.trial111.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-12T03:47:47.681 INFO:teuthology.orchestra.run.trial111.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-12T03:47:47.681 INFO:teuthology.orchestra.run.trial111.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-12T03:47:47.681 INFO:teuthology.orchestra.run.trial111.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-12T03:47:47.681 INFO:teuthology.orchestra.run.trial111.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-12T03:47:47.681 INFO:teuthology.orchestra.run.trial111.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-12T03:47:47.681 INFO:teuthology.orchestra.run.trial111.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-12T03:47:47.681 INFO:teuthology.orchestra.run.trial111.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-12T03:47:47.681 INFO:teuthology.orchestra.run.trial111.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-12T03:47:47.681 INFO:teuthology.orchestra.run.trial111.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-12T03:47:47.681 INFO:teuthology.orchestra.run.trial111.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-12T03:47:47.681 INFO:teuthology.orchestra.run.trial111.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-12T03:47:47.682 INFO:teuthology.orchestra.run.trial111.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-12T03:47:47.682 INFO:teuthology.orchestra.run.trial111.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-12T03:47:47.682 INFO:teuthology.orchestra.run.trial111.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-12T03:47:47.682 INFO:teuthology.orchestra.run.trial111.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-12T03:47:47.682 INFO:teuthology.orchestra.run.trial111.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-12T03:47:47.682 INFO:teuthology.orchestra.run.trial111.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-12T03:47:47.682 INFO:teuthology.orchestra.run.trial111.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-12T03:47:47.682 INFO:teuthology.orchestra.run.trial111.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-12T03:47:47.682 INFO:teuthology.orchestra.run.trial111.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-12T03:47:47.682 INFO:teuthology.orchestra.run.trial111.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-12T03:47:47.682 INFO:teuthology.orchestra.run.trial111.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-12T03:47:47.683 INFO:teuthology.orchestra.run.trial111.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-12T03:47:47.683 INFO:teuthology.orchestra.run.trial111.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-12T03:47:47.683 INFO:teuthology.orchestra.run.trial111.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-12T03:47:47.683 INFO:teuthology.orchestra.run.trial111.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-12T03:47:47.683 INFO:teuthology.orchestra.run.trial111.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-12T03:47:47.683 INFO:teuthology.orchestra.run.trial111.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-12T03:47:47.683 INFO:teuthology.orchestra.run.trial111.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-12T03:47:47.683 INFO:teuthology.orchestra.run.trial111.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-12T03:47:47.683 INFO:teuthology.orchestra.run.trial111.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-12T03:47:47.683 INFO:teuthology.orchestra.run.trial111.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-12T03:47:47.684 INFO:teuthology.orchestra.run.trial111.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-12T03:47:47.684 INFO:teuthology.orchestra.run.trial111.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-12T03:47:47.684 INFO:teuthology.orchestra.run.trial111.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-12T03:47:47.684 INFO:teuthology.orchestra.run.trial111.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-12T03:47:47.684 INFO:teuthology.orchestra.run.trial111.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-12T03:47:47.684 INFO:teuthology.orchestra.run.trial111.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-12T03:47:47.684 INFO:teuthology.orchestra.run.trial111.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-12T03:47:47.684 INFO:teuthology.orchestra.run.trial111.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-12T03:47:47.684 INFO:teuthology.orchestra.run.trial111.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-12T03:47:47.684 INFO:teuthology.orchestra.run.trial111.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-12T03:47:47.684 INFO:teuthology.orchestra.run.trial111.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-12T03:47:47.684 INFO:teuthology.orchestra.run.trial111.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-12T03:47:47.684 INFO:teuthology.orchestra.run.trial111.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-12T03:47:47.685 INFO:teuthology.orchestra.run.trial111.stdout:Installing weak dependencies: 2026-02-12T03:47:47.685 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-cephadm noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 173 k 2026-02-12T03:47:47.685 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-dashboard noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 11 M 2026-02-12T03:47:47.685 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 7.4 M 2026-02-12T03:47:47.685 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-k8sevents noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 22 k 2026-02-12T03:47:47.685 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-rook noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 50 k 2026-02-12T03:47:47.685 INFO:teuthology.orchestra.run.trial111.stdout: ceph-volume noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 298 k 2026-02-12T03:47:47.685 INFO:teuthology.orchestra.run.trial111.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-12T03:47:47.685 INFO:teuthology.orchestra.run.trial111.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-12T03:47:47.685 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:47:47.685 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T03:47:47.686 INFO:teuthology.orchestra.run.trial111.stdout:====================================================================================== 2026-02-12T03:47:47.686 INFO:teuthology.orchestra.run.trial111.stdout:Install 95 Packages 2026-02-12T03:47:47.686 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:47:47.687 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 101 M 2026-02-12T03:47:47.687 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 561 M 2026-02-12T03:47:47.687 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T03:47:47.902 INFO:teuthology.orchestra.run.trial098.stdout:(36/95): protobuf-3.14.0-17.el9.x86_64.rpm 1.1 MB/s | 1.0 MB 00:00 2026-02-12T03:47:48.005 INFO:teuthology.orchestra.run.trial091.stdout:(6/95): ceph-mon-20.2.0-626.g1279775f.el9.x86_6 3.5 MB/s | 5.0 MB 00:01 2026-02-12T03:47:48.059 INFO:teuthology.orchestra.run.trial098.stdout:(37/95): openblas-openmp-0.3.29-1.el9.x86_64.rp 4.7 MB/s | 5.3 MB 00:01 2026-02-12T03:47:48.232 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-radosgw-2:20.2.0-626.g1279775f.el9.x86_64 37/39 2026-02-12T03:47:48.256 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-radosgw-2:20.2.0-626.g1279775f.el9.x86_64 37/39 2026-02-12T03:47:48.256 INFO:teuthology.orchestra.run.trial154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T03:47:48.256 INFO:teuthology.orchestra.run.trial154.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-12T03:47:48.256 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T03:47:48.257 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T03:47:48.257 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:47:48.258 INFO:teuthology.orchestra.run.trial154.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-12T03:47:48.270 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 38/39 2026-02-12T03:47:48.270 INFO:teuthology.orchestra.run.trial154.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-12T03:47:48.326 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 39/39 2026-02-12T03:47:48.326 INFO:teuthology.orchestra.run.trial154.stdout:Creating group 'qat' with GID 992. 2026-02-12T03:47:48.326 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:47:48.415 INFO:teuthology.orchestra.run.trial111.stdout:(1/95): ceph-20.2.0-626.g1279775f.el9.x86_64.rp 27 kB/s | 6.5 kB 00:00 2026-02-12T03:47:48.456 INFO:teuthology.orchestra.run.trial098.stdout:(38/95): python3-babel-2.9.1-2.el9.noarch.rpm 5.3 MB/s | 6.0 MB 00:01 2026-02-12T03:47:48.633 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-base-2:20.2.0-626.g1279775f.el9.x86_64 1/39 2026-02-12T03:47:48.634 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-common-2:20.2.0-626.g1279775f.el9.x86_64 2/39 2026-02-12T03:47:48.634 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-radosgw-2:20.2.0-626.g1279775f.el9.x86_64 3/39 2026-02-12T03:47:48.634 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-selinux-2:20.2.0-626.g1279775f.el9.x86_64 4/39 2026-02-12T03:47:48.634 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libcephfs-daemon-2:20.2.0-626.g1279775f.el9.x86_64 5/39 2026-02-12T03:47:48.634 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libcephfs-proxy2-2:20.2.0-626.g1279775f.el9.x86_64 6/39 2026-02-12T03:47:48.634 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libcephfs2-2:20.2.0-626.g1279775f.el9.x86_64 7/39 2026-02-12T03:47:48.634 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libradosstriper1-2:20.2.0-626.g1279775f.el9.x86_64 8/39 2026-02-12T03:47:48.634 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : librgw2-2:20.2.0-626.g1279775f.el9.x86_64 9/39 2026-02-12T03:47:48.634 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-ceph-argparse-2:20.2.0-626.g1279775f.el9.x 10/39 2026-02-12T03:47:48.635 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-ceph-common-2:20.2.0-626.g1279775f.el9.x86 11/39 2026-02-12T03:47:48.635 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-cephfs-2:20.2.0-626.g1279775f.el9.x86_64 12/39 2026-02-12T03:47:48.635 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-rados-2:20.2.0-626.g1279775f.el9.x86_64 13/39 2026-02-12T03:47:48.635 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-rbd-2:20.2.0-626.g1279775f.el9.x86_64 14/39 2026-02-12T03:47:48.635 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-rgw-2:20.2.0-626.g1279775f.el9.x86_64 15/39 2026-02-12T03:47:48.635 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 16/39 2026-02-12T03:47:48.635 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 17/39 2026-02-12T03:47:48.635 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 18/39 2026-02-12T03:47:48.635 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 19/39 2026-02-12T03:47:48.635 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 20/39 2026-02-12T03:47:48.635 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 21/39 2026-02-12T03:47:48.635 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 22/39 2026-02-12T03:47:48.635 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 23/39 2026-02-12T03:47:48.636 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 24/39 2026-02-12T03:47:48.636 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 25/39 2026-02-12T03:47:48.636 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 26/39 2026-02-12T03:47:48.636 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 27/39 2026-02-12T03:47:48.636 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 28/39 2026-02-12T03:47:48.636 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 29/39 2026-02-12T03:47:48.636 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 30/39 2026-02-12T03:47:48.636 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 31/39 2026-02-12T03:47:48.636 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 32/39 2026-02-12T03:47:48.636 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 33/39 2026-02-12T03:47:48.636 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : re2-1:20211101-20.el9.x86_64 34/39 2026-02-12T03:47:48.636 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 35/39 2026-02-12T03:47:48.637 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : librados2-2:20.2.0-626.g1279775f.el9.x86_64 36/39 2026-02-12T03:47:48.637 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 37/39 2026-02-12T03:47:48.637 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : librbd1-2:20.2.0-626.g1279775f.el9.x86_64 38/39 2026-02-12T03:47:48.655 INFO:teuthology.orchestra.run.trial091.stdout:(7/95): ceph-mgr-dashboard-20.2.0-626.g1279775f 7.3 MB/s | 11 MB 00:01 2026-02-12T03:47:48.668 INFO:teuthology.orchestra.run.trial098.stdout:(39/95): python3-devel-3.9.25-2.el9.x86_64.rpm 319 kB/s | 244 kB 00:00 2026-02-12T03:47:48.694 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 39/39 2026-02-12T03:47:48.694 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:47:48.694 INFO:teuthology.orchestra.run.trial154.stdout:Upgraded: 2026-02-12T03:47:48.694 INFO:teuthology.orchestra.run.trial154.stdout: librados2-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:48.694 INFO:teuthology.orchestra.run.trial154.stdout: librbd1-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:48.694 INFO:teuthology.orchestra.run.trial154.stdout:Installed: 2026-02-12T03:47:48.695 INFO:teuthology.orchestra.run.trial154.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-12T03:47:48.695 INFO:teuthology.orchestra.run.trial154.stdout: ceph-base-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:48.695 INFO:teuthology.orchestra.run.trial154.stdout: ceph-common-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:48.695 INFO:teuthology.orchestra.run.trial154.stdout: ceph-radosgw-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:48.695 INFO:teuthology.orchestra.run.trial154.stdout: ceph-selinux-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:48.695 INFO:teuthology.orchestra.run.trial154.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-12T03:47:48.695 INFO:teuthology.orchestra.run.trial154.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-12T03:47:48.695 INFO:teuthology.orchestra.run.trial154.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-12T03:47:48.695 INFO:teuthology.orchestra.run.trial154.stdout: libcephfs-daemon-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:48.696 INFO:teuthology.orchestra.run.trial154.stdout: libcephfs-proxy2-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:48.696 INFO:teuthology.orchestra.run.trial154.stdout: libcephfs2-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:48.696 INFO:teuthology.orchestra.run.trial154.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-12T03:47:48.696 INFO:teuthology.orchestra.run.trial154.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-12T03:47:48.696 INFO:teuthology.orchestra.run.trial154.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-12T03:47:48.696 INFO:teuthology.orchestra.run.trial154.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-12T03:47:48.696 INFO:teuthology.orchestra.run.trial154.stdout: libradosstriper1-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:48.696 INFO:teuthology.orchestra.run.trial154.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-12T03:47:48.696 INFO:teuthology.orchestra.run.trial154.stdout: librgw2-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:48.696 INFO:teuthology.orchestra.run.trial154.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-12T03:47:48.696 INFO:teuthology.orchestra.run.trial154.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-12T03:47:48.696 INFO:teuthology.orchestra.run.trial154.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-12T03:47:48.696 INFO:teuthology.orchestra.run.trial154.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-12T03:47:48.697 INFO:teuthology.orchestra.run.trial154.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-12T03:47:48.697 INFO:teuthology.orchestra.run.trial154.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-12T03:47:48.697 INFO:teuthology.orchestra.run.trial154.stdout: python3-ceph-argparse-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:48.697 INFO:teuthology.orchestra.run.trial154.stdout: python3-ceph-common-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:48.697 INFO:teuthology.orchestra.run.trial154.stdout: python3-cephfs-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:48.697 INFO:teuthology.orchestra.run.trial154.stdout: python3-rados-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:48.697 INFO:teuthology.orchestra.run.trial154.stdout: python3-rbd-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:48.697 INFO:teuthology.orchestra.run.trial154.stdout: python3-rgw-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:48.697 INFO:teuthology.orchestra.run.trial154.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-12T03:47:48.697 INFO:teuthology.orchestra.run.trial154.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-12T03:47:48.697 INFO:teuthology.orchestra.run.trial154.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-12T03:47:48.697 INFO:teuthology.orchestra.run.trial154.stdout: re2-1:20211101-20.el9.x86_64 2026-02-12T03:47:48.698 INFO:teuthology.orchestra.run.trial154.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-12T03:47:48.698 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:47:48.698 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:47:48.714 INFO:teuthology.orchestra.run.trial091.stdout:(8/95): ceph-mgr-k8sevents-20.2.0-626.g1279775f 374 kB/s | 22 kB 00:00 2026-02-12T03:47:48.737 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install ceph-test 2026-02-12T03:47:48.780 INFO:teuthology.orchestra.run.trial091.stdout:(9/95): ceph-mgr-modules-core-20.2.0-626.g12797 4.3 MB/s | 290 kB 00:00 2026-02-12T03:47:48.825 INFO:teuthology.orchestra.run.trial098.stdout:(40/95): python3-jinja2-2.11.3-8.el9.noarch.rpm 324 kB/s | 249 kB 00:00 2026-02-12T03:47:48.827 INFO:teuthology.orchestra.run.trial091.stdout:(10/95): ceph-mgr-rook-20.2.0-626.g1279775f.el9 1.0 MB/s | 50 kB 00:00 2026-02-12T03:47:48.891 INFO:teuthology.orchestra.run.trial091.stdout:(11/95): ceph-prometheus-alerts-20.2.0-626.g127 274 kB/s | 17 kB 00:00 2026-02-12T03:47:48.962 INFO:teuthology.orchestra.run.trial091.stdout:(12/95): ceph-volume-20.2.0-626.g1279775f.el9.n 4.1 MB/s | 298 kB 00:00 2026-02-12T03:47:49.039 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:00:16 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:47:49.045 INFO:teuthology.orchestra.run.trial098.stdout:(41/95): python3-jmespath-1.0.1-1.el9.noarch.rp 81 kB/s | 48 kB 00:00 2026-02-12T03:47:49.051 INFO:teuthology.orchestra.run.trial091.stdout:(13/95): ceph-mgr-diskprediction-local-20.2.0-6 7.1 MB/s | 7.4 MB 00:01 2026-02-12T03:47:49.084 INFO:teuthology.orchestra.run.trial091.stdout:(14/95): cephadm-20.2.0-626.g1279775f.el9.noarc 8.2 MB/s | 1.0 MB 00:00 2026-02-12T03:47:49.122 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:47:49.123 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:47:49.123 INFO:teuthology.orchestra.run.trial154.stdout: Package Arch Version Repository Size 2026-02-12T03:47:49.123 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:47:49.123 INFO:teuthology.orchestra.run.trial154.stdout:Installing: 2026-02-12T03:47:49.123 INFO:teuthology.orchestra.run.trial154.stdout: ceph-test x86_64 2:20.2.0-626.g1279775f.el9 ceph 84 M 2026-02-12T03:47:49.124 INFO:teuthology.orchestra.run.trial154.stdout:Installing dependencies: 2026-02-12T03:47:49.124 INFO:teuthology.orchestra.run.trial154.stdout: libcephsqlite x86_64 2:20.2.0-626.g1279775f.el9 ceph 164 k 2026-02-12T03:47:49.124 INFO:teuthology.orchestra.run.trial154.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-12T03:47:49.124 INFO:teuthology.orchestra.run.trial154.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-12T03:47:49.124 INFO:teuthology.orchestra.run.trial154.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-12T03:47:49.124 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:47:49.124 INFO:teuthology.orchestra.run.trial154.stdout:Transaction Summary 2026-02-12T03:47:49.124 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:47:49.124 INFO:teuthology.orchestra.run.trial154.stdout:Install 5 Packages 2026-02-12T03:47:49.124 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:47:49.124 INFO:teuthology.orchestra.run.trial154.stdout:Total download size: 85 M 2026-02-12T03:47:49.125 INFO:teuthology.orchestra.run.trial154.stdout:Installed size: 364 M 2026-02-12T03:47:49.125 INFO:teuthology.orchestra.run.trial154.stdout:Downloading Packages: 2026-02-12T03:47:49.125 INFO:teuthology.orchestra.run.trial111.stdout:(2/95): ceph-mgr-20.2.0-626.g1279775f.el9.x86_6 1.0 MB/s | 962 kB 00:00 2026-02-12T03:47:49.247 INFO:teuthology.orchestra.run.trial154.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 3.8 MB/s | 233 kB 00:00 2026-02-12T03:47:49.265 INFO:teuthology.orchestra.run.trial154.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 16 MB/s | 303 kB 00:00 2026-02-12T03:47:49.274 INFO:teuthology.orchestra.run.trial154.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 7.0 MB/s | 64 kB 00:00 2026-02-12T03:47:49.393 INFO:teuthology.orchestra.run.trial091.stdout:(15/95): ceph-osd-20.2.0-626.g1279775f.el9.x86_ 7.2 MB/s | 17 MB 00:02 2026-02-12T03:47:49.401 INFO:teuthology.orchestra.run.trial098.stdout:(42/95): python3-libstoragemgmt-1.10.1-1.el9.x8 241 kB/s | 177 kB 00:00 2026-02-12T03:47:49.522 INFO:teuthology.orchestra.run.trial154.stdout:(4/5): libcephsqlite-20.2.0-626.g1279775f.el9.x 490 kB/s | 164 kB 00:00 2026-02-12T03:47:49.543 INFO:teuthology.orchestra.run.trial111.stdout:(3/95): ceph-mds-20.2.0-626.g1279775f.el9.x86_6 1.7 MB/s | 2.3 MB 00:01 2026-02-12T03:47:49.610 INFO:teuthology.orchestra.run.trial098.stdout:(43/95): python3-markupsafe-1.1.1-12.el9.x86_64 61 kB/s | 35 kB 00:00 2026-02-12T03:47:49.625 INFO:teuthology.orchestra.run.trial091.stdout:(16/95): ledmon-libs-1.1.0-3.el9.x86_64.rpm 75 kB/s | 40 kB 00:00 2026-02-12T03:47:49.776 INFO:teuthology.orchestra.run.trial098.stdout:(44/95): python3-lxml-4.6.5-3.el9.x86_64.rpm 1.3 MB/s | 1.2 MB 00:00 2026-02-12T03:47:49.785 INFO:teuthology.orchestra.run.trial111.stdout:(4/95): ceph-grafana-dashboards-20.2.0-626.g127 178 kB/s | 43 kB 00:00 2026-02-12T03:47:49.844 INFO:teuthology.orchestra.run.trial111.stdout:(5/95): ceph-mgr-cephadm-20.2.0-626.g1279775f.e 2.9 MB/s | 173 kB 00:00 2026-02-12T03:47:49.927 INFO:teuthology.orchestra.run.trial091.stdout:(17/95): libconfig-1.7.2-9.el9.x86_64.rpm 135 kB/s | 72 kB 00:00 2026-02-12T03:47:49.971 INFO:teuthology.orchestra.run.trial091.stdout:(18/95): cryptsetup-2.8.1-2.el9.x86_64.rpm 381 kB/s | 350 kB 00:00 2026-02-12T03:47:50.229 INFO:teuthology.orchestra.run.trial091.stdout:(19/95): libquadmath-11.5.0-14.el9.x86_64.rpm 610 kB/s | 184 kB 00:00 2026-02-12T03:47:50.349 INFO:teuthology.orchestra.run.trial091.stdout:(20/95): python3-cffi-1.14.5-5.el9.x86_64.rpm 670 kB/s | 253 kB 00:00 2026-02-12T03:47:50.412 INFO:teuthology.orchestra.run.trial098.stdout:(45/95): python3-packaging-20.9-5.el9.noarch.rp 121 kB/s | 77 kB 00:00 2026-02-12T03:47:50.443 INFO:teuthology.orchestra.run.trial098.stdout:(46/95): python3-numpy-f2py-1.23.5-2.el9.x86_64 531 kB/s | 442 kB 00:00 2026-02-12T03:47:50.515 INFO:teuthology.orchestra.run.trial111.stdout:(6/95): ceph-mon-20.2.0-626.g1279775f.el9.x86_6 2.4 MB/s | 5.0 MB 00:02 2026-02-12T03:47:50.538 INFO:teuthology.orchestra.run.trial098.stdout:(47/95): python3-numpy-1.23.5-2.el9.x86_64.rpm 5.4 MB/s | 6.1 MB 00:01 2026-02-12T03:47:50.577 INFO:teuthology.orchestra.run.trial091.stdout:(21/95): python3-ply-3.11-14.el9.noarch.rpm 469 kB/s | 106 kB 00:00 2026-02-12T03:47:50.653 INFO:teuthology.orchestra.run.trial091.stdout:(22/95): libgfortran-11.5.0-14.el9.x86_64.rpm 773 kB/s | 794 kB 00:01 2026-02-12T03:47:50.807 INFO:teuthology.orchestra.run.trial091.stdout:(23/95): python3-pycparser-2.20-6.el9.noarch.rp 588 kB/s | 135 kB 00:00 2026-02-12T03:47:50.881 INFO:teuthology.orchestra.run.trial091.stdout:(24/95): python3-pyparsing-2.4.7-9.el9.noarch.r 659 kB/s | 150 kB 00:00 2026-02-12T03:47:51.035 INFO:teuthology.orchestra.run.trial091.stdout:(25/95): python3-urllib3-1.26.5-7.el9.noarch.rp 1.4 MB/s | 218 kB 00:00 2026-02-12T03:47:51.036 INFO:teuthology.orchestra.run.trial091.stdout:(26/95): python3-requests-2.25.1-10.el9.noarch. 551 kB/s | 126 kB 00:00 2026-02-12T03:47:51.160 INFO:teuthology.orchestra.run.trial098.stdout:(48/95): python3-pyasn1-0.4.8-6.el9.noarch.rpm 222 kB/s | 159 kB 00:00 2026-02-12T03:47:51.185 INFO:teuthology.orchestra.run.trial098.stdout:(49/95): python3-protobuf-3.14.0-17.el9.noarch. 346 kB/s | 267 kB 00:00 2026-02-12T03:47:51.189 INFO:teuthology.orchestra.run.trial091.stdout:(27/95): zip-3.0-35.el9.x86_64.rpm 1.7 MB/s | 266 kB 00:00 2026-02-12T03:47:51.319 INFO:teuthology.orchestra.run.trial098.stdout:(50/95): python3-pyasn1-modules-0.4.8-6.el9.noa 357 kB/s | 279 kB 00:00 2026-02-12T03:47:51.340 INFO:teuthology.orchestra.run.trial091.stdout:(28/95): unzip-6.0-59.el9.x86_64.rpm 596 kB/s | 182 kB 00:00 2026-02-12T03:47:51.342 INFO:teuthology.orchestra.run.trial091.stdout:(29/95): flexiblas-3.0.4-8.el9.x86_64.rpm 214 kB/s | 33 kB 00:00 2026-02-12T03:47:51.494 INFO:teuthology.orchestra.run.trial091.stdout:(30/95): flexiblas-openblas-openmp-3.0.4-8.el9. 120 kB/s | 18 kB 00:00 2026-02-12T03:47:51.592 INFO:teuthology.orchestra.run.trial111.stdout:(7/95): ceph-mgr-dashboard-20.2.0-626.g1279775f 6.1 MB/s | 11 MB 00:01 2026-02-12T03:47:51.634 INFO:teuthology.orchestra.run.trial111.stdout:(8/95): ceph-mgr-k8sevents-20.2.0-626.g1279775f 520 kB/s | 22 kB 00:00 2026-02-12T03:47:51.647 INFO:teuthology.orchestra.run.trial091.stdout:(31/95): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 1.6 MB/s | 246 kB 00:00 2026-02-12T03:47:51.685 INFO:teuthology.orchestra.run.trial111.stdout:(9/95): ceph-mgr-modules-core-20.2.0-626.g12797 5.5 MB/s | 290 kB 00:00 2026-02-12T03:47:51.731 INFO:teuthology.orchestra.run.trial091.stdout:(32/95): python3-cryptography-36.0.1-5.el9.x86_ 849 kB/s | 1.2 MB 00:01 2026-02-12T03:47:51.732 INFO:teuthology.orchestra.run.trial111.stdout:(10/95): ceph-mgr-rook-20.2.0-626.g1279775f.el9 1.1 MB/s | 50 kB 00:00 2026-02-12T03:47:51.759 INFO:teuthology.orchestra.run.trial098.stdout:(51/95): python3-requests-oauthlib-1.3.0-12.el9 90 kB/s | 54 kB 00:00 2026-02-12T03:47:51.800 INFO:teuthology.orchestra.run.trial091.stdout:(33/95): lua-5.4.4-4.el9.x86_64.rpm 1.2 MB/s | 188 kB 00:00 2026-02-12T03:47:51.883 INFO:teuthology.orchestra.run.trial091.stdout:(34/95): openblas-0.3.29-1.el9.x86_64.rpm 277 kB/s | 42 kB 00:00 2026-02-12T03:47:51.895 INFO:teuthology.orchestra.run.trial098.stdout:(52/95): python3-toml-0.10.2-6.el9.noarch.rpm 72 kB/s | 42 kB 00:00 2026-02-12T03:47:51.979 INFO:teuthology.orchestra.run.trial111.stdout:(11/95): ceph-prometheus-alerts-20.2.0-626.g127 70 kB/s | 17 kB 00:00 2026-02-12T03:47:52.031 INFO:teuthology.orchestra.run.trial111.stdout:(12/95): ceph-volume-20.2.0-626.g1279775f.el9.n 5.6 MB/s | 298 kB 00:00 2026-02-12T03:47:52.143 INFO:teuthology.orchestra.run.trial111.stdout:(13/95): cephadm-20.2.0-626.g1279775f.el9.noarc 8.9 MB/s | 1.0 MB 00:00 2026-02-12T03:47:52.337 INFO:teuthology.orchestra.run.trial091.stdout:(35/95): openblas-openmp-0.3.29-1.el9.x86_64.rp 9.9 MB/s | 5.3 MB 00:00 2026-02-12T03:47:52.496 INFO:teuthology.orchestra.run.trial098.stdout:(53/95): xmlsec1-1.2.29-13.el9.x86_64.rpm 256 kB/s | 189 kB 00:00 2026-02-12T03:47:52.547 INFO:teuthology.orchestra.run.trial098.stdout:(54/95): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 138 kB/s | 90 kB 00:00 2026-02-12T03:47:52.558 INFO:teuthology.orchestra.run.trial111.stdout:(14/95): ceph-mgr-diskprediction-local-20.2.0-6 3.6 MB/s | 7.4 MB 00:02 2026-02-12T03:47:52.562 INFO:teuthology.orchestra.run.trial111.stdout:(15/95): cryptsetup-2.8.1-2.el9.x86_64.rpm 837 kB/s | 350 kB 00:00 2026-02-12T03:47:52.601 INFO:teuthology.orchestra.run.trial098.stdout:(55/95): python3-scipy-1.9.3-2.el9.x86_64.rpm 14 MB/s | 19 MB 00:01 2026-02-12T03:47:52.765 INFO:teuthology.orchestra.run.trial098.stdout:(56/95): lua-devel-5.4.4-4.el9.x86_64.rpm 83 kB/s | 22 kB 00:00 2026-02-12T03:47:52.790 INFO:teuthology.orchestra.run.trial111.stdout:(16/95): ledmon-libs-1.1.0-3.el9.x86_64.rpm 174 kB/s | 40 kB 00:00 2026-02-12T03:47:52.795 INFO:teuthology.orchestra.run.trial111.stdout:(17/95): libconfig-1.7.2-9.el9.x86_64.rpm 308 kB/s | 72 kB 00:00 2026-02-12T03:47:52.823 INFO:teuthology.orchestra.run.trial098.stdout:(57/95): abseil-cpp-20211102.0-4.el9.x86_64.rpm 2.4 MB/s | 551 kB 00:00 2026-02-12T03:47:52.867 INFO:teuthology.orchestra.run.trial098.stdout:(58/95): grpc-data-1.46.7-10.el9.noarch.rpm 192 kB/s | 19 kB 00:00 2026-02-12T03:47:52.877 INFO:teuthology.orchestra.run.trial091.stdout:(36/95): python3-babel-2.9.1-2.el9.noarch.rpm 11 MB/s | 6.0 MB 00:00 2026-02-12T03:47:52.881 INFO:teuthology.orchestra.run.trial098.stdout:(59/95): luarocks-3.9.2-5.el9.noarch.rpm 2.5 MB/s | 151 kB 00:00 2026-02-12T03:47:52.901 INFO:teuthology.orchestra.run.trial098.stdout:(60/95): python3-autocommand-2.2.2-8.el9.noarch 1.5 MB/s | 29 kB 00:00 2026-02-12T03:47:52.921 INFO:teuthology.orchestra.run.trial098.stdout:(61/95): python3-backports-tarfile-1.2.0-1.el9. 3.0 MB/s | 60 kB 00:00 2026-02-12T03:47:52.937 INFO:teuthology.orchestra.run.trial091.stdout:(37/95): flexiblas-netlib-3.0.4-8.el9.x86_64.rp 1.9 MB/s | 3.0 MB 00:01 2026-02-12T03:47:52.941 INFO:teuthology.orchestra.run.trial098.stdout:(62/95): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 2.1 MB/s | 43 kB 00:00 2026-02-12T03:47:52.961 INFO:teuthology.orchestra.run.trial098.stdout:(63/95): python3-cachetools-4.2.4-1.el9.noarch. 1.6 MB/s | 32 kB 00:00 2026-02-12T03:47:52.981 INFO:teuthology.orchestra.run.trial098.stdout:(64/95): python3-certifi-2023.05.07-4.el9.noarc 712 kB/s | 14 kB 00:00 2026-02-12T03:47:53.020 INFO:teuthology.orchestra.run.trial098.stdout:(65/95): python3-asyncssh-2.13.2-5.el9.noarch.r 3.5 MB/s | 548 kB 00:00 2026-02-12T03:47:53.033 INFO:teuthology.orchestra.run.trial091.stdout:(38/95): python3-devel-3.9.25-2.el9.x86_64.rpm 1.5 MB/s | 244 kB 00:00 2026-02-12T03:47:53.039 INFO:teuthology.orchestra.run.trial098.stdout:(66/95): python3-cheroot-10.0.1-4.el9.noarch.rp 2.9 MB/s | 173 kB 00:00 2026-02-12T03:47:53.089 INFO:teuthology.orchestra.run.trial091.stdout:(39/95): protobuf-3.14.0-17.el9.x86_64.rpm 853 kB/s | 1.0 MB 00:01 2026-02-12T03:47:53.091 INFO:teuthology.orchestra.run.trial091.stdout:(40/95): python3-jinja2-2.11.3-8.el9.noarch.rpm 1.6 MB/s | 249 kB 00:00 2026-02-12T03:47:53.116 INFO:teuthology.orchestra.run.trial098.stdout:(67/95): python3-cherrypy-18.6.1-2.el9.noarch.r 3.6 MB/s | 358 kB 00:00 2026-02-12T03:47:53.117 INFO:teuthology.orchestra.run.trial098.stdout:(68/95): python3-google-auth-2.45.0-1.el9.noarc 3.2 MB/s | 254 kB 00:00 2026-02-12T03:47:53.139 INFO:teuthology.orchestra.run.trial111.stdout:(18/95): libquadmath-11.5.0-14.el9.x86_64.rpm 537 kB/s | 184 kB 00:00 2026-02-12T03:47:53.156 INFO:teuthology.orchestra.run.trial098.stdout:(69/95): python3-grpcio-tools-1.46.7-10.el9.x86 3.6 MB/s | 144 kB 00:00 2026-02-12T03:47:53.183 INFO:teuthology.orchestra.run.trial098.stdout:(70/95): protobuf-compiler-3.14.0-17.el9.x86_64 1.3 MB/s | 862 kB 00:00 2026-02-12T03:47:53.185 INFO:teuthology.orchestra.run.trial091.stdout:(41/95): python3-jmespath-1.0.1-1.el9.noarch.rp 312 kB/s | 48 kB 00:00 2026-02-12T03:47:53.195 INFO:teuthology.orchestra.run.trial098.stdout:(71/95): python3-influxdb-5.3.1-1.el9.noarch.rp 3.5 MB/s | 139 kB 00:00 2026-02-12T03:47:53.215 INFO:teuthology.orchestra.run.trial098.stdout:(72/95): python3-jaraco-8.2.1-3.el9.noarch.rpm 541 kB/s | 11 kB 00:00 2026-02-12T03:47:53.235 INFO:teuthology.orchestra.run.trial098.stdout:(73/95): python3-jaraco-classes-3.2.1-5.el9.noa 893 kB/s | 18 kB 00:00 2026-02-12T03:47:53.243 INFO:teuthology.orchestra.run.trial091.stdout:(42/95): python3-libstoragemgmt-1.10.1-1.el9.x8 1.1 MB/s | 177 kB 00:00 2026-02-12T03:47:53.244 INFO:teuthology.orchestra.run.trial154.stdout:(5/5): ceph-test-20.2.0-626.g1279775f.el9.x86_6 21 MB/s | 84 MB 00:04 2026-02-12T03:47:53.245 INFO:teuthology.orchestra.run.trial154.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:47:53.245 INFO:teuthology.orchestra.run.trial154.stdout:Total 21 MB/s | 85 MB 00:04 2026-02-12T03:47:53.255 INFO:teuthology.orchestra.run.trial098.stdout:(74/95): python3-jaraco-collections-3.0.0-8.el9 1.1 MB/s | 23 kB 00:00 2026-02-12T03:47:53.256 INFO:teuthology.orchestra.run.trial111.stdout:(19/95): libgfortran-11.5.0-14.el9.x86_64.rpm 1.7 MB/s | 794 kB 00:00 2026-02-12T03:47:53.272 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction check 2026-02-12T03:47:53.275 INFO:teuthology.orchestra.run.trial098.stdout:(75/95): python3-jaraco-context-6.0.1-3.el9.noa 997 kB/s | 20 kB 00:00 2026-02-12T03:47:53.282 INFO:teuthology.orchestra.run.trial154.stdout:Transaction check succeeded. 2026-02-12T03:47:53.282 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction test 2026-02-12T03:47:53.294 INFO:teuthology.orchestra.run.trial098.stdout:(76/95): python3-jaraco-functools-3.5.0-2.el9.n 983 kB/s | 19 kB 00:00 2026-02-12T03:47:53.304 INFO:teuthology.orchestra.run.trial098.stdout:(77/95): python3-isodate-0.6.1-3.el9.noarch.rpm 463 kB/s | 56 kB 00:00 2026-02-12T03:47:53.314 INFO:teuthology.orchestra.run.trial098.stdout:(78/95): python3-jaraco-text-4.0.0-2.el9.noarch 1.3 MB/s | 26 kB 00:00 2026-02-12T03:47:53.339 INFO:teuthology.orchestra.run.trial091.stdout:(43/95): python3-markupsafe-1.1.1-12.el9.x86_64 226 kB/s | 35 kB 00:00 2026-02-12T03:47:53.353 INFO:teuthology.orchestra.run.trial098.stdout:(79/95): python3-more-itertools-8.12.0-2.el9.no 2.0 MB/s | 79 kB 00:00 2026-02-12T03:47:53.392 INFO:teuthology.orchestra.run.trial098.stdout:(80/95): python3-msgpack-1.0.3-2.el9.x86_64.rpm 2.2 MB/s | 86 kB 00:00 2026-02-12T03:47:53.412 INFO:teuthology.orchestra.run.trial098.stdout:(81/95): python3-natsort-7.1.1-5.el9.noarch.rpm 2.8 MB/s | 58 kB 00:00 2026-02-12T03:47:53.432 INFO:teuthology.orchestra.run.trial098.stdout:(82/95): python3-portend-3.1.0-2.el9.noarch.rpm 833 kB/s | 16 kB 00:00 2026-02-12T03:47:53.469 INFO:teuthology.orchestra.run.trial111.stdout:(20/95): python3-cffi-1.14.5-5.el9.x86_64.rpm 767 kB/s | 253 kB 00:00 2026-02-12T03:47:53.471 INFO:teuthology.orchestra.run.trial098.stdout:(83/95): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.3 MB/s | 90 kB 00:00 2026-02-12T03:47:53.472 INFO:teuthology.orchestra.run.trial091.stdout:(44/95): python3-lxml-4.6.5-3.el9.x86_64.rpm 3.2 MB/s | 1.2 MB 00:00 2026-02-12T03:47:53.491 INFO:teuthology.orchestra.run.trial098.stdout:(84/95): python3-repoze-lru-0.7-16.el9.noarch.r 1.5 MB/s | 31 kB 00:00 2026-02-12T03:47:53.495 INFO:teuthology.orchestra.run.trial091.stdout:(45/95): python3-numpy-f2py-1.23.5-2.el9.x86_64 2.8 MB/s | 442 kB 00:00 2026-02-12T03:47:53.536 INFO:teuthology.orchestra.run.trial098.stdout:(85/95): python3-kubernetes-26.1.0-3.el9.noarch 4.4 MB/s | 1.0 MB 00:00 2026-02-12T03:47:53.538 INFO:teuthology.orchestra.run.trial098.stdout:(86/95): python3-grpcio-1.46.7-10.el9.x86_64.rp 4.8 MB/s | 2.0 MB 00:00 2026-02-12T03:47:53.549 INFO:teuthology.orchestra.run.trial098.stdout:(87/95): python3-routes-2.5.1-5.el9.noarch.rpm 3.2 MB/s | 188 kB 00:00 2026-02-12T03:47:53.556 INFO:teuthology.orchestra.run.trial098.stdout:(88/95): python3-rsa-4.9-2.el9.noarch.rpm 2.9 MB/s | 59 kB 00:00 2026-02-12T03:47:53.569 INFO:teuthology.orchestra.run.trial098.stdout:(89/95): python3-tempora-5.0.0-2.el9.noarch.rpm 1.8 MB/s | 36 kB 00:00 2026-02-12T03:47:53.570 INFO:teuthology.orchestra.run.trial154.stdout:Transaction test succeeded. 2026-02-12T03:47:53.570 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction 2026-02-12T03:47:53.578 INFO:teuthology.orchestra.run.trial098.stdout:(90/95): python3-saml-1.16.0-1.el9.noarch.rpm 3.1 MB/s | 125 kB 00:00 2026-02-12T03:47:53.595 INFO:teuthology.orchestra.run.trial098.stdout:(91/95): python3-typing-extensions-4.15.0-1.el9 2.1 MB/s | 86 kB 00:00 2026-02-12T03:47:53.597 INFO:teuthology.orchestra.run.trial098.stdout:(92/95): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 2.4 MB/s | 48 kB 00:00 2026-02-12T03:47:53.607 INFO:teuthology.orchestra.run.trial098.stdout:(93/95): python3-websocket-client-1.2.3-2.el9.n 2.3 MB/s | 90 kB 00:00 2026-02-12T03:47:53.616 INFO:teuthology.orchestra.run.trial098.stdout:(94/95): python3-xmltodict-0.12.0-15.el9.noarch 1.0 MB/s | 22 kB 00:00 2026-02-12T03:47:53.618 INFO:teuthology.orchestra.run.trial098.stdout:(95/95): python3-zc-lockfile-2.0-10.el9.noarch. 982 kB/s | 20 kB 00:00 2026-02-12T03:47:53.620 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:47:53.620 INFO:teuthology.orchestra.run.trial098.stdout:Total 10 MB/s | 101 MB 00:09 2026-02-12T03:47:53.626 INFO:teuthology.orchestra.run.trial091.stdout:(46/95): python3-packaging-20.9-5.el9.noarch.rp 504 kB/s | 77 kB 00:00 2026-02-12T03:47:53.649 INFO:teuthology.orchestra.run.trial091.stdout:(47/95): python3-protobuf-3.14.0-17.el9.noarch. 1.7 MB/s | 267 kB 00:00 2026-02-12T03:47:53.701 INFO:teuthology.orchestra.run.trial111.stdout:(21/95): python3-cryptography-36.0.1-5.el9.x86_ 2.8 MB/s | 1.2 MB 00:00 2026-02-12T03:47:53.743 INFO:teuthology.orchestra.run.trial111.stdout:(22/95): python3-ply-3.11-14.el9.noarch.rpm 389 kB/s | 106 kB 00:00 2026-02-12T03:47:53.785 INFO:teuthology.orchestra.run.trial091.stdout:(48/95): python3-numpy-1.23.5-2.el9.x86_64.rpm 11 MB/s | 6.1 MB 00:00 2026-02-12T03:47:53.786 INFO:teuthology.orchestra.run.trial091.stdout:(49/95): python3-pyasn1-0.4.8-6.el9.noarch.rpm 992 kB/s | 159 kB 00:00 2026-02-12T03:47:53.804 INFO:teuthology.orchestra.run.trial091.stdout:(50/95): python3-pyasn1-modules-0.4.8-6.el9.noa 1.8 MB/s | 279 kB 00:00 2026-02-12T03:47:53.885 INFO:teuthology.orchestra.run.trial154.stdout: Preparing : 1/1 2026-02-12T03:47:53.891 INFO:teuthology.orchestra.run.trial154.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-12T03:47:53.895 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-12T03:47:53.903 INFO:teuthology.orchestra.run.trial154.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-12T03:47:53.904 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libcephsqlite-2:20.2.0-626.g1279775f.el9.x86_64 4/5 2026-02-12T03:47:53.938 INFO:teuthology.orchestra.run.trial091.stdout:(51/95): python3-requests-oauthlib-1.3.0-12.el9 351 kB/s | 54 kB 00:00 2026-02-12T03:47:53.957 INFO:teuthology.orchestra.run.trial091.stdout:(52/95): python3-toml-0.10.2-6.el9.noarch.rpm 272 kB/s | 42 kB 00:00 2026-02-12T03:47:53.981 INFO:teuthology.orchestra.run.trial111.stdout:(23/95): python3-pycparser-2.20-6.el9.noarch.rp 482 kB/s | 135 kB 00:00 2026-02-12T03:47:54.034 INFO:teuthology.orchestra.run.trial111.stdout:(24/95): python3-pyparsing-2.4.7-9.el9.noarch.r 518 kB/s | 150 kB 00:00 2026-02-12T03:47:54.045 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-12T03:47:54.083 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-12T03:47:54.083 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-12T03:47:54.090 INFO:teuthology.orchestra.run.trial091.stdout:(53/95): xmlsec1-1.2.29-13.el9.x86_64.rpm 1.2 MB/s | 189 kB 00:00 2026-02-12T03:47:54.109 INFO:teuthology.orchestra.run.trial091.stdout:(54/95): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 595 kB/s | 90 kB 00:00 2026-02-12T03:47:54.143 INFO:teuthology.orchestra.run.trial091.stdout:(55/95): lua-devel-5.4.4-4.el9.x86_64.rpm 429 kB/s | 22 kB 00:00 2026-02-12T03:47:54.170 INFO:teuthology.orchestra.run.trial091.stdout:(56/95): protobuf-compiler-3.14.0-17.el9.x86_64 14 MB/s | 862 kB 00:00 2026-02-12T03:47:54.257 INFO:teuthology.orchestra.run.trial111.stdout:(25/95): python3-requests-2.25.1-10.el9.noarch. 458 kB/s | 126 kB 00:00 2026-02-12T03:47:54.327 INFO:teuthology.orchestra.run.trial091.stdout:(57/95): grpc-data-1.46.7-10.el9.noarch.rpm 124 kB/s | 19 kB 00:00 2026-02-12T03:47:54.355 INFO:teuthology.orchestra.run.trial111.stdout:(26/95): python3-urllib3-1.26.5-7.el9.noarch.rp 679 kB/s | 218 kB 00:00 2026-02-12T03:47:54.457 INFO:teuthology.orchestra.run.trial091.stdout:(58/95): luarocks-3.9.2-5.el9.noarch.rpm 1.1 MB/s | 151 kB 00:00 2026-02-12T03:47:54.464 INFO:teuthology.orchestra.run.trial091.stdout:(59/95): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.7 MB/s | 551 kB 00:00 2026-02-12T03:47:54.502 INFO:teuthology.orchestra.run.trial091.stdout:(60/95): python3-autocommand-2.2.2-8.el9.noarch 767 kB/s | 29 kB 00:00 2026-02-12T03:47:54.516 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-12T03:47:54.517 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-12T03:47:54.542 INFO:teuthology.orchestra.run.trial091.stdout:(61/95): python3-backports-tarfile-1.2.0-1.el9. 1.5 MB/s | 60 kB 00:00 2026-02-12T03:47:54.575 INFO:teuthology.orchestra.run.trial091.stdout:(62/95): python3-asyncssh-2.13.2-5.el9.noarch.r 4.5 MB/s | 548 kB 00:00 2026-02-12T03:47:54.581 INFO:teuthology.orchestra.run.trial091.stdout:(63/95): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.1 MB/s | 43 kB 00:00 2026-02-12T03:47:54.599 INFO:teuthology.orchestra.run.trial111.stdout:(27/95): unzip-6.0-59.el9.x86_64.rpm 533 kB/s | 182 kB 00:00 2026-02-12T03:47:54.613 INFO:teuthology.orchestra.run.trial091.stdout:(64/95): python3-cachetools-4.2.4-1.el9.noarch. 847 kB/s | 32 kB 00:00 2026-02-12T03:47:54.619 INFO:teuthology.orchestra.run.trial091.stdout:(65/95): python3-certifi-2023.05.07-4.el9.noarc 375 kB/s | 14 kB 00:00 2026-02-12T03:47:54.655 INFO:teuthology.orchestra.run.trial091.stdout:(66/95): python3-scipy-1.9.3-2.el9.x86_64.rpm 22 MB/s | 19 MB 00:00 2026-02-12T03:47:54.659 INFO:teuthology.orchestra.run.trial091.stdout:(67/95): python3-cheroot-10.0.1-4.el9.noarch.rp 3.8 MB/s | 173 kB 00:00 2026-02-12T03:47:54.673 INFO:teuthology.orchestra.run.trial091.stdout:(68/95): python3-cherrypy-18.6.1-2.el9.noarch.r 6.5 MB/s | 358 kB 00:00 2026-02-12T03:47:54.702 INFO:teuthology.orchestra.run.trial111.stdout:(28/95): zip-3.0-35.el9.x86_64.rpm 766 kB/s | 266 kB 00:00 2026-02-12T03:47:54.725 INFO:teuthology.orchestra.run.trial111.stdout:(29/95): ceph-osd-20.2.0-626.g1279775f.el9.x86_ 3.0 MB/s | 17 MB 00:05 2026-02-12T03:47:54.734 INFO:teuthology.orchestra.run.trial091.stdout:(69/95): python3-grpcio-tools-1.46.7-10.el9.x86 2.3 MB/s | 144 kB 00:00 2026-02-12T03:47:54.776 INFO:teuthology.orchestra.run.trial091.stdout:(70/95): python3-grpcio-1.46.7-10.el9.x86_64.rp 17 MB/s | 2.0 MB 00:00 2026-02-12T03:47:54.783 INFO:teuthology.orchestra.run.trial091.stdout:(71/95): python3-influxdb-5.3.1-1.el9.noarch.rp 2.8 MB/s | 139 kB 00:00 2026-02-12T03:47:54.817 INFO:teuthology.orchestra.run.trial091.stdout:(72/95): python3-isodate-0.6.1-3.el9.noarch.rpm 1.3 MB/s | 56 kB 00:00 2026-02-12T03:47:54.821 INFO:teuthology.orchestra.run.trial091.stdout:(73/95): python3-jaraco-8.2.1-3.el9.noarch.rpm 285 kB/s | 11 kB 00:00 2026-02-12T03:47:54.855 INFO:teuthology.orchestra.run.trial091.stdout:(74/95): python3-jaraco-classes-3.2.1-5.el9.noa 469 kB/s | 18 kB 00:00 2026-02-12T03:47:54.858 INFO:teuthology.orchestra.run.trial091.stdout:(75/95): python3-jaraco-collections-3.0.0-8.el9 611 kB/s | 23 kB 00:00 2026-02-12T03:47:54.860 INFO:teuthology.orchestra.run.trial111.stdout:(30/95): flexiblas-3.0.4-8.el9.x86_64.rpm 125 kB/s | 33 kB 00:00 2026-02-12T03:47:54.893 INFO:teuthology.orchestra.run.trial091.stdout:(76/95): python3-jaraco-context-6.0.1-3.el9.noa 517 kB/s | 20 kB 00:00 2026-02-12T03:47:54.897 INFO:teuthology.orchestra.run.trial091.stdout:(77/95): python3-jaraco-functools-3.5.0-2.el9.n 511 kB/s | 19 kB 00:00 2026-02-12T03:47:54.929 INFO:teuthology.orchestra.run.trial091.stdout:(78/95): python3-google-auth-2.45.0-1.el9.noarc 930 kB/s | 254 kB 00:00 2026-02-12T03:47:54.931 INFO:teuthology.orchestra.run.trial091.stdout:(79/95): python3-jaraco-text-4.0.0-2.el9.noarch 690 kB/s | 26 kB 00:00 2026-02-12T03:47:54.962 INFO:teuthology.orchestra.run.trial111.stdout:(31/95): flexiblas-openblas-openmp-3.0.4-8.el9. 77 kB/s | 18 kB 00:00 2026-02-12T03:47:54.974 INFO:teuthology.orchestra.run.trial091.stdout:(80/95): python3-more-itertools-8.12.0-2.el9.no 1.7 MB/s | 79 kB 00:00 2026-02-12T03:47:54.983 INFO:teuthology.orchestra.run.trial091.stdout:(81/95): python3-kubernetes-26.1.0-3.el9.noarch 12 MB/s | 1.0 MB 00:00 2026-02-12T03:47:54.985 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-12T03:47:54.985 INFO:teuthology.orchestra.run.trial091.stdout:(82/95): python3-msgpack-1.0.3-2.el9.x86_64.rpm 1.6 MB/s | 86 kB 00:00 2026-02-12T03:47:54.987 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/95 2026-02-12T03:47:54.991 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/95 2026-02-12T03:47:55.012 INFO:teuthology.orchestra.run.trial098.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/95 2026-02-12T03:47:55.017 INFO:teuthology.orchestra.run.trial091.stdout:(83/95): python3-natsort-7.1.1-5.el9.noarch.rpm 1.3 MB/s | 58 kB 00:00 2026-02-12T03:47:55.023 INFO:teuthology.orchestra.run.trial091.stdout:(84/95): python3-portend-3.1.0-2.el9.noarch.rpm 416 kB/s | 16 kB 00:00 2026-02-12T03:47:55.026 INFO:teuthology.orchestra.run.trial091.stdout:(85/95): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.1 MB/s | 90 kB 00:00 2026-02-12T03:47:55.046 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/95 2026-02-12T03:47:55.055 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/95 2026-02-12T03:47:55.062 INFO:teuthology.orchestra.run.trial098.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 6/95 2026-02-12T03:47:55.064 INFO:teuthology.orchestra.run.trial098.stdout: Installing : lua-5.4.4-4.el9.x86_64 7/95 2026-02-12T03:47:55.068 INFO:teuthology.orchestra.run.trial098.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 8/95 2026-02-12T03:47:55.091 INFO:teuthology.orchestra.run.trial098.stdout: Installing : unzip-6.0-59.el9.x86_64 9/95 2026-02-12T03:47:55.095 INFO:teuthology.orchestra.run.trial091.stdout:(86/95): python3-repoze-lru-0.7-16.el9.noarch.r 392 kB/s | 31 kB 00:00 2026-02-12T03:47:55.100 INFO:teuthology.orchestra.run.trial091.stdout:(87/95): python3-rsa-4.9-2.el9.noarch.rpm 803 kB/s | 59 kB 00:00 2026-02-12T03:47:55.101 INFO:teuthology.orchestra.run.trial091.stdout:(88/95): python3-routes-2.5.1-5.el9.noarch.rpm 2.4 MB/s | 188 kB 00:00 2026-02-12T03:47:55.104 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 10/95 2026-02-12T03:47:55.107 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 11/95 2026-02-12T03:47:55.113 INFO:teuthology.orchestra.run.trial098.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 12/95 2026-02-12T03:47:55.115 INFO:teuthology.orchestra.run.trial098.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 13/95 2026-02-12T03:47:55.126 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 14/95 2026-02-12T03:47:55.132 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 15/95 2026-02-12T03:47:55.139 INFO:teuthology.orchestra.run.trial091.stdout:(89/95): python3-tempora-5.0.0-2.el9.noarch.rpm 935 kB/s | 36 kB 00:00 2026-02-12T03:47:55.140 INFO:teuthology.orchestra.run.trial091.stdout:(90/95): python3-typing-extensions-4.15.0-1.el9 2.2 MB/s | 86 kB 00:00 2026-02-12T03:47:55.154 INFO:teuthology.orchestra.run.trial091.stdout:(91/95): python3-saml-1.16.0-1.el9.noarch.rpm 2.1 MB/s | 125 kB 00:00 2026-02-12T03:47:55.156 INFO:teuthology.orchestra.run.trial098.stdout: Installing : zip-3.0-35.el9.x86_64 16/95 2026-02-12T03:47:55.159 INFO:teuthology.orchestra.run.trial098.stdout: Installing : luarocks-3.9.2-5.el9.noarch 17/95 2026-02-12T03:47:55.166 INFO:teuthology.orchestra.run.trial098.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 18/95 2026-02-12T03:47:55.179 INFO:teuthology.orchestra.run.trial111.stdout:(32/95): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 773 kB/s | 246 kB 00:00 2026-02-12T03:47:55.180 INFO:teuthology.orchestra.run.trial091.stdout:(92/95): python3-websocket-client-1.2.3-2.el9.n 2.1 MB/s | 90 kB 00:00 2026-02-12T03:47:55.189 INFO:teuthology.orchestra.run.trial091.stdout:(93/95): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 1.0 MB/s | 48 kB 00:00 2026-02-12T03:47:55.199 INFO:teuthology.orchestra.run.trial091.stdout:(94/95): python3-xmltodict-0.12.0-15.el9.noarch 494 kB/s | 22 kB 00:00 2026-02-12T03:47:55.217 INFO:teuthology.orchestra.run.trial098.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 19/95 2026-02-12T03:47:55.218 INFO:teuthology.orchestra.run.trial091.stdout:(95/95): python3-zc-lockfile-2.0-10.el9.noarch. 527 kB/s | 20 kB 00:00 2026-02-12T03:47:55.225 INFO:teuthology.orchestra.run.trial091.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:47:55.225 INFO:teuthology.orchestra.run.trial091.stdout:Total 11 MB/s | 101 MB 00:09 2026-02-12T03:47:55.229 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 20/95 2026-02-12T03:47:55.232 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-rsa-4.9-2.el9.noarch 21/95 2026-02-12T03:47:55.236 INFO:teuthology.orchestra.run.trial098.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 22/95 2026-02-12T03:47:55.242 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 23/95 2026-02-12T03:47:55.246 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 24/95 2026-02-12T03:47:55.249 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 25/95 2026-02-12T03:47:55.264 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 26/95 2026-02-12T03:47:55.264 INFO:teuthology.orchestra.run.trial111.stdout:(33/95): openblas-0.3.29-1.el9.x86_64.rpm 496 kB/s | 42 kB 00:00 2026-02-12T03:47:55.268 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 27/95 2026-02-12T03:47:55.274 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 28/95 2026-02-12T03:47:55.274 INFO:teuthology.orchestra.run.trial111.stdout:(34/95): lua-5.4.4-4.el9.x86_64.rpm 604 kB/s | 188 kB 00:00 2026-02-12T03:47:55.285 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 29/95 2026-02-12T03:47:55.293 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 30/95 2026-02-12T03:47:55.300 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 31/95 2026-02-12T03:47:55.319 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 32/95 2026-02-12T03:47:55.330 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 33/95 2026-02-12T03:47:55.346 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 34/95 2026-02-12T03:47:55.350 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 35/95 2026-02-12T03:47:55.358 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 36/95 2026-02-12T03:47:55.398 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 37/95 2026-02-12T03:47:55.480 INFO:teuthology.orchestra.run.trial111.stdout:(35/95): flexiblas-netlib-3.0.4-8.el9.x86_64.rp 3.8 MB/s | 3.0 MB 00:00 2026-02-12T03:47:55.568 INFO:teuthology.orchestra.run.trial111.stdout:(36/95): protobuf-3.14.0-17.el9.x86_64.rpm 3.4 MB/s | 1.0 MB 00:00 2026-02-12T03:47:55.657 INFO:teuthology.orchestra.run.trial111.stdout:(37/95): python3-devel-3.9.25-2.el9.x86_64.rpm 2.7 MB/s | 244 kB 00:00 2026-02-12T03:47:55.664 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction check 2026-02-12T03:47:55.699 INFO:teuthology.orchestra.run.trial111.stdout:(38/95): python3-babel-2.9.1-2.el9.noarch.rpm 27 MB/s | 6.0 MB 00:00 2026-02-12T03:47:55.703 INFO:teuthology.orchestra.run.trial091.stdout:Transaction check succeeded. 2026-02-12T03:47:55.704 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction test 2026-02-12T03:47:55.705 INFO:teuthology.orchestra.run.trial111.stdout:(39/95): openblas-openmp-0.3.29-1.el9.x86_64.rp 12 MB/s | 5.3 MB 00:00 2026-02-12T03:47:55.722 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 38/95 2026-02-12T03:47:55.732 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 39/95 2026-02-12T03:47:55.736 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 40/95 2026-02-12T03:47:55.742 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 41/95 2026-02-12T03:47:55.744 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 42/95 2026-02-12T03:47:55.747 INFO:teuthology.orchestra.run.trial111.stdout:(40/95): python3-jinja2-2.11.3-8.el9.noarch.rpm 2.7 MB/s | 249 kB 00:00 2026-02-12T03:47:55.771 INFO:teuthology.orchestra.run.trial098.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 43/95 2026-02-12T03:47:55.778 INFO:teuthology.orchestra.run.trial111.stdout:(41/95): python3-jmespath-1.0.1-1.el9.noarch.rp 601 kB/s | 48 kB 00:00 2026-02-12T03:47:55.786 INFO:teuthology.orchestra.run.trial111.stdout:(42/95): python3-libstoragemgmt-1.10.1-1.el9.x8 2.1 MB/s | 177 kB 00:00 2026-02-12T03:47:55.814 INFO:teuthology.orchestra.run.trial098.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 44/95 2026-02-12T03:47:55.821 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 45/95 2026-02-12T03:47:55.824 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 46/95 2026-02-12T03:47:55.830 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 47/95 2026-02-12T03:47:55.834 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 48/95 2026-02-12T03:47:55.841 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 49/95 2026-02-12T03:47:55.844 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 50/95 2026-02-12T03:47:55.856 INFO:teuthology.orchestra.run.trial111.stdout:(43/95): python3-markupsafe-1.1.1-12.el9.x86_64 443 kB/s | 35 kB 00:00 2026-02-12T03:47:55.872 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 51/95 2026-02-12T03:47:55.882 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 52/95 2026-02-12T03:47:55.885 INFO:teuthology.orchestra.run.trial111.stdout:(44/95): python3-lxml-4.6.5-3.el9.x86_64.rpm 8.8 MB/s | 1.2 MB 00:00 2026-02-12T03:47:55.887 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 53/95 2026-02-12T03:47:55.894 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 54/95 2026-02-12T03:47:55.929 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 55/95 2026-02-12T03:47:55.938 INFO:teuthology.orchestra.run.trial111.stdout:(45/95): python3-numpy-f2py-1.23.5-2.el9.x86_64 5.3 MB/s | 442 kB 00:00 2026-02-12T03:47:55.967 INFO:teuthology.orchestra.run.trial111.stdout:(46/95): python3-packaging-20.9-5.el9.noarch.rp 952 kB/s | 77 kB 00:00 2026-02-12T03:47:56.019 INFO:teuthology.orchestra.run.trial111.stdout:(47/95): python3-protobuf-3.14.0-17.el9.noarch. 3.2 MB/s | 267 kB 00:00 2026-02-12T03:47:56.040 INFO:teuthology.orchestra.run.trial111.stdout:(48/95): python3-numpy-1.23.5-2.el9.x86_64.rpm 24 MB/s | 6.1 MB 00:00 2026-02-12T03:47:56.051 INFO:teuthology.orchestra.run.trial111.stdout:(49/95): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.8 MB/s | 159 kB 00:00 2026-02-12T03:47:56.100 INFO:teuthology.orchestra.run.trial111.stdout:(50/95): python3-pyasn1-modules-0.4.8-6.el9.noa 3.4 MB/s | 279 kB 00:00 2026-02-12T03:47:56.119 INFO:teuthology.orchestra.run.trial111.stdout:(51/95): python3-requests-oauthlib-1.3.0-12.el9 677 kB/s | 54 kB 00:00 2026-02-12T03:47:56.137 INFO:teuthology.orchestra.run.trial091.stdout:Transaction test succeeded. 2026-02-12T03:47:56.138 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction 2026-02-12T03:47:56.153 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 56/95 2026-02-12T03:47:56.176 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 57/95 2026-02-12T03:47:56.179 INFO:teuthology.orchestra.run.trial111.stdout:(52/95): python3-toml-0.10.2-6.el9.noarch.rpm 529 kB/s | 42 kB 00:00 2026-02-12T03:47:56.180 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 58/95 2026-02-12T03:47:56.199 INFO:teuthology.orchestra.run.trial111.stdout:(53/95): xmlsec1-1.2.29-13.el9.x86_64.rpm 2.3 MB/s | 189 kB 00:00 2026-02-12T03:47:56.214 INFO:teuthology.orchestra.run.trial111.stdout:(54/95): lua-devel-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 22 kB 00:00 2026-02-12T03:47:56.233 INFO:teuthology.orchestra.run.trial111.stdout:(55/95): protobuf-compiler-3.14.0-17.el9.x86_64 45 MB/s | 862 kB 00:00 2026-02-12T03:47:56.239 INFO:teuthology.orchestra.run.trial098.stdout: Installing : openblas-0.3.29-1.el9.x86_64 59/95 2026-02-12T03:47:56.241 INFO:teuthology.orchestra.run.trial098.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 60/95 2026-02-12T03:47:56.258 INFO:teuthology.orchestra.run.trial111.stdout:(56/95): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 1.1 MB/s | 90 kB 00:00 2026-02-12T03:47:56.262 INFO:teuthology.orchestra.run.trial098.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 61/95 2026-02-12T03:47:56.425 INFO:teuthology.orchestra.run.trial111.stdout:(57/95): grpc-data-1.46.7-10.el9.noarch.rpm 116 kB/s | 19 kB 00:00 2026-02-12T03:47:56.566 INFO:teuthology.orchestra.run.trial111.stdout:(58/95): luarocks-3.9.2-5.el9.noarch.rpm 1.1 MB/s | 151 kB 00:00 2026-02-12T03:47:56.582 INFO:teuthology.orchestra.run.trial111.stdout:(59/95): abseil-cpp-20211102.0-4.el9.x86_64.rpm 1.5 MB/s | 551 kB 00:00 2026-02-12T03:47:56.587 INFO:teuthology.orchestra.run.trial098.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 62/95 2026-02-12T03:47:56.607 INFO:teuthology.orchestra.run.trial091.stdout: Preparing : 1/1 2026-02-12T03:47:56.609 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/95 2026-02-12T03:47:56.613 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/95 2026-02-12T03:47:56.623 INFO:teuthology.orchestra.run.trial111.stdout:(60/95): python3-autocommand-2.2.2-8.el9.noarch 718 kB/s | 29 kB 00:00 2026-02-12T03:47:56.635 INFO:teuthology.orchestra.run.trial091.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/95 2026-02-12T03:47:56.660 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 63/95 2026-02-12T03:47:56.666 INFO:teuthology.orchestra.run.trial111.stdout:(61/95): python3-backports-tarfile-1.2.0-1.el9. 1.4 MB/s | 60 kB 00:00 2026-02-12T03:47:56.670 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/95 2026-02-12T03:47:56.679 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/95 2026-02-12T03:47:56.684 INFO:teuthology.orchestra.run.trial091.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 6/95 2026-02-12T03:47:56.687 INFO:teuthology.orchestra.run.trial091.stdout: Installing : lua-5.4.4-4.el9.x86_64 7/95 2026-02-12T03:47:56.691 INFO:teuthology.orchestra.run.trial091.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 8/95 2026-02-12T03:47:56.694 INFO:teuthology.orchestra.run.trial111.stdout:(62/95): python3-asyncssh-2.13.2-5.el9.noarch.r 4.2 MB/s | 548 kB 00:00 2026-02-12T03:47:56.714 INFO:teuthology.orchestra.run.trial091.stdout: Installing : unzip-6.0-59.el9.x86_64 9/95 2026-02-12T03:47:56.727 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 10/95 2026-02-12T03:47:56.727 INFO:teuthology.orchestra.run.trial111.stdout:(63/95): python3-scipy-1.9.3-2.el9.x86_64.rpm 28 MB/s | 19 MB 00:00 2026-02-12T03:47:56.728 INFO:teuthology.orchestra.run.trial111.stdout:(64/95): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 702 kB/s | 43 kB 00:00 2026-02-12T03:47:56.730 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 11/95 2026-02-12T03:47:56.735 INFO:teuthology.orchestra.run.trial111.stdout:(65/95): python3-cachetools-4.2.4-1.el9.noarch. 785 kB/s | 32 kB 00:00 2026-02-12T03:47:56.738 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 12/95 2026-02-12T03:47:56.742 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 13/95 2026-02-12T03:47:56.754 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 14/95 2026-02-12T03:47:56.760 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 15/95 2026-02-12T03:47:56.777 INFO:teuthology.orchestra.run.trial111.stdout:(66/95): python3-cheroot-10.0.1-4.el9.noarch.rp 3.5 MB/s | 173 kB 00:00 2026-02-12T03:47:56.784 INFO:teuthology.orchestra.run.trial091.stdout: Installing : zip-3.0-35.el9.x86_64 16/95 2026-02-12T03:47:56.787 INFO:teuthology.orchestra.run.trial091.stdout: Installing : luarocks-3.9.2-5.el9.noarch 17/95 2026-02-12T03:47:56.792 INFO:teuthology.orchestra.run.trial111.stdout:(67/95): python3-cherrypy-18.6.1-2.el9.noarch.r 6.2 MB/s | 358 kB 00:00 2026-02-12T03:47:56.794 INFO:teuthology.orchestra.run.trial091.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 18/95 2026-02-12T03:47:56.830 INFO:teuthology.orchestra.run.trial111.stdout:(68/95): python3-google-auth-2.45.0-1.el9.noarc 4.7 MB/s | 254 kB 00:00 2026-02-12T03:47:56.844 INFO:teuthology.orchestra.run.trial091.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 19/95 2026-02-12T03:47:56.857 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 20/95 2026-02-12T03:47:56.860 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-rsa-4.9-2.el9.noarch 21/95 2026-02-12T03:47:56.864 INFO:teuthology.orchestra.run.trial091.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 22/95 2026-02-12T03:47:56.870 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 23/95 2026-02-12T03:47:56.874 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 24/95 2026-02-12T03:47:56.877 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 25/95 2026-02-12T03:47:56.878 INFO:teuthology.orchestra.run.trial111.stdout:(69/95): python3-grpcio-tools-1.46.7-10.el9.x86 3.0 MB/s | 144 kB 00:00 2026-02-12T03:47:56.892 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 26/95 2026-02-12T03:47:56.896 INFO:teuthology.orchestra.run.trial111.stdout:(70/95): python3-certifi-2023.05.07-4.el9.noarc 84 kB/s | 14 kB 00:00 2026-02-12T03:47:56.896 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 27/95 2026-02-12T03:47:56.901 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 28/95 2026-02-12T03:47:56.913 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 29/95 2026-02-12T03:47:56.918 INFO:teuthology.orchestra.run.trial111.stdout:(71/95): python3-grpcio-1.46.7-10.el9.x86_64.rp 16 MB/s | 2.0 MB 00:00 2026-02-12T03:47:56.921 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 30/95 2026-02-12T03:47:56.925 INFO:teuthology.orchestra.run.trial111.stdout:(72/95): python3-influxdb-5.3.1-1.el9.noarch.rp 2.9 MB/s | 139 kB 00:00 2026-02-12T03:47:56.930 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 31/95 2026-02-12T03:47:56.949 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 32/95 2026-02-12T03:47:56.958 INFO:teuthology.orchestra.run.trial111.stdout:(73/95): python3-jaraco-8.2.1-3.el9.noarch.rpm 263 kB/s | 11 kB 00:00 2026-02-12T03:47:56.960 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 33/95 2026-02-12T03:47:56.966 INFO:teuthology.orchestra.run.trial111.stdout:(74/95): python3-jaraco-classes-3.2.1-5.el9.noa 431 kB/s | 18 kB 00:00 2026-02-12T03:47:56.976 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 34/95 2026-02-12T03:47:56.980 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 35/95 2026-02-12T03:47:56.988 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 36/95 2026-02-12T03:47:56.995 INFO:teuthology.orchestra.run.trial111.stdout:(75/95): python3-isodate-0.6.1-3.el9.noarch.rpm 566 kB/s | 56 kB 00:00 2026-02-12T03:47:56.999 INFO:teuthology.orchestra.run.trial111.stdout:(76/95): python3-jaraco-collections-3.0.0-8.el9 569 kB/s | 23 kB 00:00 2026-02-12T03:47:57.007 INFO:teuthology.orchestra.run.trial111.stdout:(77/95): python3-jaraco-context-6.0.1-3.el9.noa 479 kB/s | 20 kB 00:00 2026-02-12T03:47:57.027 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 37/95 2026-02-12T03:47:57.040 INFO:teuthology.orchestra.run.trial111.stdout:(78/95): python3-jaraco-text-4.0.0-2.el9.noarch 650 kB/s | 26 kB 00:00 2026-02-12T03:47:57.042 INFO:teuthology.orchestra.run.trial111.stdout:(79/95): python3-jaraco-functools-3.5.0-2.el9.n 410 kB/s | 19 kB 00:00 2026-02-12T03:47:57.081 INFO:teuthology.orchestra.run.trial111.stdout:(80/95): python3-more-itertools-8.12.0-2.el9.no 1.9 MB/s | 79 kB 00:00 2026-02-12T03:47:57.100 INFO:teuthology.orchestra.run.trial111.stdout:(81/95): python3-kubernetes-26.1.0-3.el9.noarch 11 MB/s | 1.0 MB 00:00 2026-02-12T03:47:57.118 INFO:teuthology.orchestra.run.trial111.stdout:(82/95): python3-msgpack-1.0.3-2.el9.x86_64.rpm 1.1 MB/s | 86 kB 00:00 2026-02-12T03:47:57.122 INFO:teuthology.orchestra.run.trial111.stdout:(83/95): python3-natsort-7.1.1-5.el9.noarch.rpm 1.4 MB/s | 58 kB 00:00 2026-02-12T03:47:57.141 INFO:teuthology.orchestra.run.trial111.stdout:(84/95): python3-portend-3.1.0-2.el9.noarch.rpm 404 kB/s | 16 kB 00:00 2026-02-12T03:47:57.163 INFO:teuthology.orchestra.run.trial111.stdout:(85/95): python3-repoze-lru-0.7-16.el9.noarch.r 754 kB/s | 31 kB 00:00 2026-02-12T03:47:57.184 INFO:teuthology.orchestra.run.trial111.stdout:(86/95): python3-routes-2.5.1-5.el9.noarch.rpm 4.3 MB/s | 188 kB 00:00 2026-02-12T03:47:57.186 INFO:teuthology.orchestra.run.trial111.stdout:(87/95): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.3 MB/s | 90 kB 00:00 2026-02-12T03:47:57.204 INFO:teuthology.orchestra.run.trial111.stdout:(88/95): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2026-02-12T03:47:57.227 INFO:teuthology.orchestra.run.trial111.stdout:(89/95): python3-saml-1.16.0-1.el9.noarch.rpm 2.9 MB/s | 125 kB 00:00 2026-02-12T03:47:57.235 INFO:teuthology.orchestra.run.trial111.stdout:(90/95): python3-tempora-5.0.0-2.el9.noarch.rpm 724 kB/s | 36 kB 00:00 2026-02-12T03:47:57.246 INFO:teuthology.orchestra.run.trial111.stdout:(91/95): python3-typing-extensions-4.15.0-1.el9 2.0 MB/s | 86 kB 00:00 2026-02-12T03:47:57.268 INFO:teuthology.orchestra.run.trial111.stdout:(92/95): python3-websocket-client-1.2.3-2.el9.n 2.1 MB/s | 90 kB 00:00 2026-02-12T03:47:57.286 INFO:teuthology.orchestra.run.trial111.stdout:(93/95): python3-xmltodict-0.12.0-15.el9.noarch 544 kB/s | 22 kB 00:00 2026-02-12T03:47:57.289 INFO:teuthology.orchestra.run.trial111.stdout:(94/95): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 902 kB/s | 48 kB 00:00 2026-02-12T03:47:57.310 INFO:teuthology.orchestra.run.trial111.stdout:(95/95): python3-zc-lockfile-2.0-10.el9.noarch. 483 kB/s | 20 kB 00:00 2026-02-12T03:47:57.312 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:47:57.313 INFO:teuthology.orchestra.run.trial111.stdout:Total 11 MB/s | 101 MB 00:09 2026-02-12T03:47:57.333 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 64/95 2026-02-12T03:47:57.350 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 65/95 2026-02-12T03:47:57.351 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 38/95 2026-02-12T03:47:57.359 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 66/95 2026-02-12T03:47:57.361 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 39/95 2026-02-12T03:47:57.366 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 40/95 2026-02-12T03:47:57.366 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/95 2026-02-12T03:47:57.371 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 41/95 2026-02-12T03:47:57.373 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 42/95 2026-02-12T03:47:57.379 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-ply-3.11-14.el9.noarch 68/95 2026-02-12T03:47:57.395 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 69/95 2026-02-12T03:47:57.400 INFO:teuthology.orchestra.run.trial091.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 43/95 2026-02-12T03:47:57.443 INFO:teuthology.orchestra.run.trial091.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 44/95 2026-02-12T03:47:57.450 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 45/95 2026-02-12T03:47:57.453 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 46/95 2026-02-12T03:47:57.459 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 47/95 2026-02-12T03:47:57.463 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 48/95 2026-02-12T03:47:57.470 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 49/95 2026-02-12T03:47:57.470 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 70/95 2026-02-12T03:47:57.473 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 50/95 2026-02-12T03:47:57.479 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 71/95 2026-02-12T03:47:57.501 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 51/95 2026-02-12T03:47:57.502 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 72/95 2026-02-12T03:47:57.511 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 52/95 2026-02-12T03:47:57.517 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 53/95 2026-02-12T03:47:57.524 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 54/95 2026-02-12T03:47:57.532 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 73/95 2026-02-12T03:47:57.558 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 55/95 2026-02-12T03:47:57.582 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 74/95 2026-02-12T03:47:57.588 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 75/95 2026-02-12T03:47:57.592 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 76/95 2026-02-12T03:47:57.593 INFO:teuthology.orchestra.run.trial098.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 77/95 2026-02-12T03:47:57.611 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-12T03:47:57.611 INFO:teuthology.orchestra.run.trial098.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-12T03:47:57.611 INFO:teuthology.orchestra.run.trial098.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-12T03:47:57.611 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:47:57.613 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: libcephsqlite-2:20.2.0-626.g1279775f.el9.x86_64 4/5 2026-02-12T03:47:57.618 INFO:teuthology.orchestra.run.trial098.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-12T03:47:57.632 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-test-2:20.2.0-626.g1279775f.el9.x86_64 5/5 2026-02-12T03:47:57.643 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-12T03:47:57.643 INFO:teuthology.orchestra.run.trial098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-12T03:47:57.644 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:47:57.680 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 79/95 2026-02-12T03:47:57.740 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T03:47:57.743 INFO:teuthology.orchestra.run.trial098.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 80/95 2026-02-12T03:47:57.745 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-volume-2:20.2.0-626.g1279775f.el9.noarch 81/95 2026-02-12T03:47:57.759 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-volume-2:20.2.0-626.g1279775f.el9.noarch 81/95 2026-02-12T03:47:57.759 INFO:teuthology.orchestra.run.trial098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T03:47:57.759 INFO:teuthology.orchestra.run.trial098.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-12T03:47:57.760 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:47:57.779 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T03:47:57.780 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T03:47:57.781 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 56/95 2026-02-12T03:47:57.805 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 57/95 2026-02-12T03:47:57.808 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 58/95 2026-02-12T03:47:57.867 INFO:teuthology.orchestra.run.trial091.stdout: Installing : openblas-0.3.29-1.el9.x86_64 59/95 2026-02-12T03:47:57.869 INFO:teuthology.orchestra.run.trial091.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 60/95 2026-02-12T03:47:57.890 INFO:teuthology.orchestra.run.trial091.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 61/95 2026-02-12T03:47:57.975 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-test-2:20.2.0-626.g1279775f.el9.x86_64 5/5 2026-02-12T03:47:57.975 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-test-2:20.2.0-626.g1279775f.el9.x86_64 1/5 2026-02-12T03:47:57.975 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libcephsqlite-2:20.2.0-626.g1279775f.el9.x86_64 2/5 2026-02-12T03:47:57.975 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-12T03:47:57.975 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-12T03:47:58.028 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-12T03:47:58.028 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:47:58.028 INFO:teuthology.orchestra.run.trial154.stdout:Installed: 2026-02-12T03:47:58.029 INFO:teuthology.orchestra.run.trial154.stdout: ceph-test-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:58.029 INFO:teuthology.orchestra.run.trial154.stdout: libcephsqlite-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:47:58.029 INFO:teuthology.orchestra.run.trial154.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-12T03:47:58.029 INFO:teuthology.orchestra.run.trial154.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-12T03:47:58.029 INFO:teuthology.orchestra.run.trial154.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-12T03:47:58.029 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:47:58.029 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:47:58.066 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install ceph 2026-02-12T03:47:58.213 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T03:47:58.213 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T03:47:58.215 INFO:teuthology.orchestra.run.trial091.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 62/95 2026-02-12T03:47:58.288 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 63/95 2026-02-12T03:47:58.366 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:00:25 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:47:58.430 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-osd-2:20.2.0-626.g1279775f.el9.x86_64 82/95 2026-02-12T03:47:58.452 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:47:58.455 INFO:teuthology.orchestra.run.trial154.stdout:====================================================================================== 2026-02-12T03:47:58.455 INFO:teuthology.orchestra.run.trial154.stdout: Package Arch Version Repository Size 2026-02-12T03:47:58.455 INFO:teuthology.orchestra.run.trial154.stdout:====================================================================================== 2026-02-12T03:47:58.455 INFO:teuthology.orchestra.run.trial154.stdout:Installing: 2026-02-12T03:47:58.455 INFO:teuthology.orchestra.run.trial154.stdout: ceph x86_64 2:20.2.0-626.g1279775f.el9 ceph 6.5 k 2026-02-12T03:47:58.455 INFO:teuthology.orchestra.run.trial154.stdout:Installing dependencies: 2026-02-12T03:47:58.455 INFO:teuthology.orchestra.run.trial154.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-12T03:47:58.455 INFO:teuthology.orchestra.run.trial154.stdout: ceph-grafana-dashboards noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 43 k 2026-02-12T03:47:58.455 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mds x86_64 2:20.2.0-626.g1279775f.el9 ceph 2.3 M 2026-02-12T03:47:58.456 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr x86_64 2:20.2.0-626.g1279775f.el9 ceph 962 k 2026-02-12T03:47:58.456 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr-modules-core noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 290 k 2026-02-12T03:47:58.456 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mon x86_64 2:20.2.0-626.g1279775f.el9 ceph 5.0 M 2026-02-12T03:47:58.456 INFO:teuthology.orchestra.run.trial154.stdout: ceph-osd x86_64 2:20.2.0-626.g1279775f.el9 ceph 17 M 2026-02-12T03:47:58.456 INFO:teuthology.orchestra.run.trial154.stdout: ceph-prometheus-alerts noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 17 k 2026-02-12T03:47:58.456 INFO:teuthology.orchestra.run.trial154.stdout: cephadm noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 1.0 M 2026-02-12T03:47:58.456 INFO:teuthology.orchestra.run.trial154.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-12T03:47:58.456 INFO:teuthology.orchestra.run.trial154.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-12T03:47:58.456 INFO:teuthology.orchestra.run.trial154.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-12T03:47:58.456 INFO:teuthology.orchestra.run.trial154.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-12T03:47:58.456 INFO:teuthology.orchestra.run.trial154.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-12T03:47:58.457 INFO:teuthology.orchestra.run.trial154.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-12T03:47:58.457 INFO:teuthology.orchestra.run.trial154.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-12T03:47:58.457 INFO:teuthology.orchestra.run.trial154.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-12T03:47:58.457 INFO:teuthology.orchestra.run.trial154.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-12T03:47:58.457 INFO:teuthology.orchestra.run.trial154.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-12T03:47:58.457 INFO:teuthology.orchestra.run.trial154.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-12T03:47:58.457 INFO:teuthology.orchestra.run.trial154.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-12T03:47:58.457 INFO:teuthology.orchestra.run.trial154.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-12T03:47:58.457 INFO:teuthology.orchestra.run.trial154.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-12T03:47:58.458 INFO:teuthology.orchestra.run.trial154.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-12T03:47:58.458 INFO:teuthology.orchestra.run.trial154.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-12T03:47:58.458 INFO:teuthology.orchestra.run.trial154.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-12T03:47:58.458 INFO:teuthology.orchestra.run.trial154.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-12T03:47:58.458 INFO:teuthology.orchestra.run.trial154.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-12T03:47:58.458 INFO:teuthology.orchestra.run.trial154.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-12T03:47:58.458 INFO:teuthology.orchestra.run.trial154.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-12T03:47:58.458 INFO:teuthology.orchestra.run.trial154.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-12T03:47:58.458 INFO:teuthology.orchestra.run.trial154.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-12T03:47:58.458 INFO:teuthology.orchestra.run.trial154.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-12T03:47:58.459 INFO:teuthology.orchestra.run.trial154.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-12T03:47:58.459 INFO:teuthology.orchestra.run.trial154.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-12T03:47:58.459 INFO:teuthology.orchestra.run.trial154.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-12T03:47:58.459 INFO:teuthology.orchestra.run.trial154.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-12T03:47:58.459 INFO:teuthology.orchestra.run.trial154.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-12T03:47:58.459 INFO:teuthology.orchestra.run.trial154.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-12T03:47:58.459 INFO:teuthology.orchestra.run.trial154.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-12T03:47:58.459 INFO:teuthology.orchestra.run.trial154.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-12T03:47:58.459 INFO:teuthology.orchestra.run.trial154.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-12T03:47:58.459 INFO:teuthology.orchestra.run.trial154.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-12T03:47:58.459 INFO:teuthology.orchestra.run.trial154.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-12T03:47:58.460 INFO:teuthology.orchestra.run.trial154.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-12T03:47:58.460 INFO:teuthology.orchestra.run.trial154.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-12T03:47:58.460 INFO:teuthology.orchestra.run.trial154.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-12T03:47:58.460 INFO:teuthology.orchestra.run.trial154.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-12T03:47:58.460 INFO:teuthology.orchestra.run.trial154.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-12T03:47:58.460 INFO:teuthology.orchestra.run.trial154.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-12T03:47:58.460 INFO:teuthology.orchestra.run.trial154.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-12T03:47:58.460 INFO:teuthology.orchestra.run.trial154.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-12T03:47:58.460 INFO:teuthology.orchestra.run.trial154.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-12T03:47:58.460 INFO:teuthology.orchestra.run.trial154.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-12T03:47:58.460 INFO:teuthology.orchestra.run.trial154.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-12T03:47:58.460 INFO:teuthology.orchestra.run.trial154.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-12T03:47:58.460 INFO:teuthology.orchestra.run.trial154.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-12T03:47:58.461 INFO:teuthology.orchestra.run.trial154.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-12T03:47:58.461 INFO:teuthology.orchestra.run.trial154.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-12T03:47:58.461 INFO:teuthology.orchestra.run.trial154.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-12T03:47:58.461 INFO:teuthology.orchestra.run.trial154.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-12T03:47:58.461 INFO:teuthology.orchestra.run.trial154.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-12T03:47:58.461 INFO:teuthology.orchestra.run.trial154.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-12T03:47:58.461 INFO:teuthology.orchestra.run.trial154.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-12T03:47:58.461 INFO:teuthology.orchestra.run.trial154.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-12T03:47:58.461 INFO:teuthology.orchestra.run.trial154.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-12T03:47:58.461 INFO:teuthology.orchestra.run.trial154.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-12T03:47:58.461 INFO:teuthology.orchestra.run.trial154.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-12T03:47:58.461 INFO:teuthology.orchestra.run.trial154.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-12T03:47:58.462 INFO:teuthology.orchestra.run.trial154.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-12T03:47:58.462 INFO:teuthology.orchestra.run.trial154.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-12T03:47:58.462 INFO:teuthology.orchestra.run.trial154.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-12T03:47:58.462 INFO:teuthology.orchestra.run.trial154.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-12T03:47:58.462 INFO:teuthology.orchestra.run.trial154.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-12T03:47:58.462 INFO:teuthology.orchestra.run.trial154.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-12T03:47:58.462 INFO:teuthology.orchestra.run.trial154.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-12T03:47:58.462 INFO:teuthology.orchestra.run.trial154.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-12T03:47:58.462 INFO:teuthology.orchestra.run.trial154.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-12T03:47:58.462 INFO:teuthology.orchestra.run.trial154.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-12T03:47:58.462 INFO:teuthology.orchestra.run.trial154.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-12T03:47:58.462 INFO:teuthology.orchestra.run.trial154.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-12T03:47:58.462 INFO:teuthology.orchestra.run.trial154.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-12T03:47:58.463 INFO:teuthology.orchestra.run.trial154.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-12T03:47:58.463 INFO:teuthology.orchestra.run.trial154.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-12T03:47:58.463 INFO:teuthology.orchestra.run.trial154.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-12T03:47:58.463 INFO:teuthology.orchestra.run.trial154.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-12T03:47:58.463 INFO:teuthology.orchestra.run.trial154.stdout:Installing weak dependencies: 2026-02-12T03:47:58.463 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr-cephadm noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 173 k 2026-02-12T03:47:58.463 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr-dashboard noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 11 M 2026-02-12T03:47:58.463 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr-diskprediction-local noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 7.4 M 2026-02-12T03:47:58.463 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr-k8sevents noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 22 k 2026-02-12T03:47:58.463 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr-rook noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 50 k 2026-02-12T03:47:58.463 INFO:teuthology.orchestra.run.trial154.stdout: ceph-volume noarch 2:20.2.0-626.g1279775f.el9 ceph-noarch 298 k 2026-02-12T03:47:58.463 INFO:teuthology.orchestra.run.trial154.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-12T03:47:58.464 INFO:teuthology.orchestra.run.trial154.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-12T03:47:58.464 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:47:58.464 INFO:teuthology.orchestra.run.trial154.stdout:Transaction Summary 2026-02-12T03:47:58.464 INFO:teuthology.orchestra.run.trial154.stdout:====================================================================================== 2026-02-12T03:47:58.464 INFO:teuthology.orchestra.run.trial154.stdout:Install 95 Packages 2026-02-12T03:47:58.464 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:47:58.465 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-osd-2:20.2.0-626.g1279775f.el9.x86_64 82/95 2026-02-12T03:47:58.465 INFO:teuthology.orchestra.run.trial098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T03:47:58.465 INFO:teuthology.orchestra.run.trial098.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-12T03:47:58.465 INFO:teuthology.orchestra.run.trial098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T03:47:58.465 INFO:teuthology.orchestra.run.trial098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T03:47:58.466 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:47:58.466 INFO:teuthology.orchestra.run.trial154.stdout:Total download size: 101 M 2026-02-12T03:47:58.466 INFO:teuthology.orchestra.run.trial154.stdout:Installed size: 561 M 2026-02-12T03:47:58.466 INFO:teuthology.orchestra.run.trial154.stdout:Downloading Packages: 2026-02-12T03:47:58.516 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: cephadm-2:20.2.0-626.g1279775f.el9.noarch 83/95 2026-02-12T03:47:58.517 INFO:teuthology.orchestra.run.trial098.stdout: Installing : cephadm-2:20.2.0-626.g1279775f.el9.noarch 83/95 2026-02-12T03:47:58.524 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-626.g1279775f.el9. 84/95 2026-02-12T03:47:58.547 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-626.g1279775f.el9 85/95 2026-02-12T03:47:58.548 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-626.g1279775f.el9.noarch 86/95 2026-02-12T03:47:58.687 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T03:47:58.689 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/95 2026-02-12T03:47:58.693 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/95 2026-02-12T03:47:58.714 INFO:teuthology.orchestra.run.trial111.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/95 2026-02-12T03:47:58.747 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/95 2026-02-12T03:47:58.756 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/95 2026-02-12T03:47:58.761 INFO:teuthology.orchestra.run.trial111.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 6/95 2026-02-12T03:47:58.763 INFO:teuthology.orchestra.run.trial111.stdout: Installing : lua-5.4.4-4.el9.x86_64 7/95 2026-02-12T03:47:58.768 INFO:teuthology.orchestra.run.trial111.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 8/95 2026-02-12T03:47:58.791 INFO:teuthology.orchestra.run.trial111.stdout: Installing : unzip-6.0-59.el9.x86_64 9/95 2026-02-12T03:47:58.803 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 10/95 2026-02-12T03:47:58.806 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 11/95 2026-02-12T03:47:58.812 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 12/95 2026-02-12T03:47:58.814 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 13/95 2026-02-12T03:47:58.825 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 14/95 2026-02-12T03:47:58.831 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 15/95 2026-02-12T03:47:58.855 INFO:teuthology.orchestra.run.trial111.stdout: Installing : zip-3.0-35.el9.x86_64 16/95 2026-02-12T03:47:58.858 INFO:teuthology.orchestra.run.trial111.stdout: Installing : luarocks-3.9.2-5.el9.noarch 17/95 2026-02-12T03:47:58.865 INFO:teuthology.orchestra.run.trial111.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 18/95 2026-02-12T03:47:58.915 INFO:teuthology.orchestra.run.trial111.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 19/95 2026-02-12T03:47:58.927 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 20/95 2026-02-12T03:47:58.929 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-rsa-4.9-2.el9.noarch 21/95 2026-02-12T03:47:58.934 INFO:teuthology.orchestra.run.trial111.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 22/95 2026-02-12T03:47:58.939 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 23/95 2026-02-12T03:47:58.944 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 24/95 2026-02-12T03:47:58.947 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 25/95 2026-02-12T03:47:58.956 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 64/95 2026-02-12T03:47:58.961 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 26/95 2026-02-12T03:47:58.965 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 27/95 2026-02-12T03:47:58.970 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 28/95 2026-02-12T03:47:58.972 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 65/95 2026-02-12T03:47:58.981 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 29/95 2026-02-12T03:47:58.982 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 66/95 2026-02-12T03:47:58.989 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/95 2026-02-12T03:47:58.990 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 30/95 2026-02-12T03:47:58.996 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 31/95 2026-02-12T03:47:59.002 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-ply-3.11-14.el9.noarch 68/95 2026-02-12T03:47:59.016 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 32/95 2026-02-12T03:47:59.018 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 69/95 2026-02-12T03:47:59.026 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 33/95 2026-02-12T03:47:59.042 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 34/95 2026-02-12T03:47:59.046 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 35/95 2026-02-12T03:47:59.054 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 36/95 2026-02-12T03:47:59.093 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 37/95 2026-02-12T03:47:59.093 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 70/95 2026-02-12T03:47:59.102 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 71/95 2026-02-12T03:47:59.125 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 72/95 2026-02-12T03:47:59.155 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 73/95 2026-02-12T03:47:59.205 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 74/95 2026-02-12T03:47:59.211 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 75/95 2026-02-12T03:47:59.214 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 76/95 2026-02-12T03:47:59.215 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 77/95 2026-02-12T03:47:59.232 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-12T03:47:59.232 INFO:teuthology.orchestra.run.trial091.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-12T03:47:59.233 INFO:teuthology.orchestra.run.trial091.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-12T03:47:59.233 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:47:59.240 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-12T03:47:59.265 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-12T03:47:59.265 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-12T03:47:59.265 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:47:59.299 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 79/95 2026-02-12T03:47:59.362 INFO:teuthology.orchestra.run.trial091.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 80/95 2026-02-12T03:47:59.364 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-volume-2:20.2.0-626.g1279775f.el9.noarch 81/95 2026-02-12T03:47:59.379 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-volume-2:20.2.0-626.g1279775f.el9.noarch 81/95 2026-02-12T03:47:59.379 INFO:teuthology.orchestra.run.trial091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T03:47:59.379 INFO:teuthology.orchestra.run.trial091.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-12T03:47:59.379 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:47:59.393 INFO:teuthology.orchestra.run.trial154.stdout:(1/95): ceph-20.2.0-626.g1279775f.el9.x86_64.rp 110 kB/s | 6.5 kB 00:00 2026-02-12T03:47:59.411 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 38/95 2026-02-12T03:47:59.421 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 39/95 2026-02-12T03:47:59.425 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 40/95 2026-02-12T03:47:59.431 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 41/95 2026-02-12T03:47:59.432 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 42/95 2026-02-12T03:47:59.459 INFO:teuthology.orchestra.run.trial111.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 43/95 2026-02-12T03:47:59.481 INFO:teuthology.orchestra.run.trial154.stdout:(2/95): ceph-mgr-20.2.0-626.g1279775f.el9.x86_6 6.4 MB/s | 962 kB 00:00 2026-02-12T03:47:59.501 INFO:teuthology.orchestra.run.trial111.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 44/95 2026-02-12T03:47:59.508 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 45/95 2026-02-12T03:47:59.509 INFO:teuthology.orchestra.run.trial154.stdout:(3/95): ceph-mds-20.2.0-626.g1279775f.el9.x86_6 13 MB/s | 2.3 MB 00:00 2026-02-12T03:47:59.511 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 46/95 2026-02-12T03:47:59.517 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 47/95 2026-02-12T03:47:59.521 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 48/95 2026-02-12T03:47:59.527 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 49/95 2026-02-12T03:47:59.531 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 50/95 2026-02-12T03:47:59.544 INFO:teuthology.orchestra.run.trial154.stdout:(4/95): ceph-grafana-dashboards-20.2.0-626.g127 1.2 MB/s | 43 kB 00:00 2026-02-12T03:47:59.558 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 51/95 2026-02-12T03:47:59.568 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 52/95 2026-02-12T03:47:59.574 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 53/95 2026-02-12T03:47:59.580 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 54/95 2026-02-12T03:47:59.581 INFO:teuthology.orchestra.run.trial154.stdout:(5/95): ceph-mgr-cephadm-20.2.0-626.g1279775f.e 4.6 MB/s | 173 kB 00:00 2026-02-12T03:47:59.614 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 55/95 2026-02-12T03:47:59.617 INFO:teuthology.orchestra.run.trial154.stdout:(6/95): ceph-mon-20.2.0-626.g1279775f.el9.x86_6 23 MB/s | 5.0 MB 00:00 2026-02-12T03:47:59.693 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-626.g1279775f.el9.noarch 86/95 2026-02-12T03:47:59.698 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-626.g1279775f.el9.noar 87/95 2026-02-12T03:47:59.837 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 56/95 2026-02-12T03:47:59.861 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 57/95 2026-02-12T03:47:59.865 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 58/95 2026-02-12T03:47:59.923 INFO:teuthology.orchestra.run.trial111.stdout: Installing : openblas-0.3.29-1.el9.x86_64 59/95 2026-02-12T03:47:59.925 INFO:teuthology.orchestra.run.trial111.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 60/95 2026-02-12T03:47:59.946 INFO:teuthology.orchestra.run.trial111.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 61/95 2026-02-12T03:48:00.044 INFO:teuthology.orchestra.run.trial154.stdout:(7/95): ceph-mgr-diskprediction-local-20.2.0-62 17 MB/s | 7.4 MB 00:00 2026-02-12T03:48:00.051 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-osd-2:20.2.0-626.g1279775f.el9.x86_64 82/95 2026-02-12T03:48:00.076 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-osd-2:20.2.0-626.g1279775f.el9.x86_64 82/95 2026-02-12T03:48:00.076 INFO:teuthology.orchestra.run.trial091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T03:48:00.076 INFO:teuthology.orchestra.run.trial091.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-12T03:48:00.076 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T03:48:00.076 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T03:48:00.076 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:00.077 INFO:teuthology.orchestra.run.trial154.stdout:(8/95): ceph-mgr-dashboard-20.2.0-626.g1279775f 21 MB/s | 11 MB 00:00 2026-02-12T03:48:00.078 INFO:teuthology.orchestra.run.trial154.stdout:(9/95): ceph-mgr-k8sevents-20.2.0-626.g1279775f 669 kB/s | 22 kB 00:00 2026-02-12T03:48:00.094 INFO:teuthology.orchestra.run.trial154.stdout:(10/95): ceph-mgr-modules-core-20.2.0-626.g1279 17 MB/s | 290 kB 00:00 2026-02-12T03:48:00.098 INFO:teuthology.orchestra.run.trial154.stdout:(11/95): ceph-mgr-rook-20.2.0-626.g1279775f.el9 2.4 MB/s | 50 kB 00:00 2026-02-12T03:48:00.110 INFO:teuthology.orchestra.run.trial154.stdout:(12/95): ceph-prometheus-alerts-20.2.0-626.g127 1.1 MB/s | 17 kB 00:00 2026-02-12T03:48:00.119 INFO:teuthology.orchestra.run.trial154.stdout:(13/95): ceph-volume-20.2.0-626.g1279775f.el9.n 14 MB/s | 298 kB 00:00 2026-02-12T03:48:00.136 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: cephadm-2:20.2.0-626.g1279775f.el9.noarch 83/95 2026-02-12T03:48:00.138 INFO:teuthology.orchestra.run.trial091.stdout: Installing : cephadm-2:20.2.0-626.g1279775f.el9.noarch 83/95 2026-02-12T03:48:00.145 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-626.g1279775f.el9. 84/95 2026-02-12T03:48:00.149 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-626.g1279775f.el9.noar 87/95 2026-02-12T03:48:00.150 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-626.g127977 88/95 2026-02-12T03:48:00.151 INFO:teuthology.orchestra.run.trial154.stdout:(14/95): cephadm-20.2.0-626.g1279775f.el9.noarc 25 MB/s | 1.0 MB 00:00 2026-02-12T03:48:00.163 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-626.g127977 88/95 2026-02-12T03:48:00.163 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-mgr-k8sevents-2:20.2.0-626.g1279775f.el9.noar 89/95 2026-02-12T03:48:00.167 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-626.g1279775f.el9 85/95 2026-02-12T03:48:00.169 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-626.g1279775f.el9.noarch 86/95 2026-02-12T03:48:00.216 INFO:teuthology.orchestra.run.trial154.stdout:(15/95): ceph-osd-20.2.0-626.g1279775f.el9.x86_ 23 MB/s | 17 MB 00:00 2026-02-12T03:48:00.221 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.2.0-626.g1279775f.el9.noar 89/95 2026-02-12T03:48:00.265 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-626.g1279775f.el9.n 90/95 2026-02-12T03:48:00.266 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-mgr-2:20.2.0-626.g1279775f.el9.x86_64 91/95 2026-02-12T03:48:00.270 INFO:teuthology.orchestra.run.trial111.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 62/95 2026-02-12T03:48:00.288 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-mgr-2:20.2.0-626.g1279775f.el9.x86_64 91/95 2026-02-12T03:48:00.288 INFO:teuthology.orchestra.run.trial098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T03:48:00.288 INFO:teuthology.orchestra.run.trial098.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-12T03:48:00.289 INFO:teuthology.orchestra.run.trial098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T03:48:00.289 INFO:teuthology.orchestra.run.trial098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T03:48:00.289 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:00.300 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-mgr-rook-2:20.2.0-626.g1279775f.el9.noarch 92/95 2026-02-12T03:48:00.343 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 63/95 2026-02-12T03:48:00.527 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-626.g1279775f.el9.noarch 92/95 2026-02-12T03:48:00.528 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-mon-2:20.2.0-626.g1279775f.el9.x86_64 93/95 2026-02-12T03:48:00.550 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-mon-2:20.2.0-626.g1279775f.el9.x86_64 93/95 2026-02-12T03:48:00.550 INFO:teuthology.orchestra.run.trial098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T03:48:00.550 INFO:teuthology.orchestra.run.trial098.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-12T03:48:00.550 INFO:teuthology.orchestra.run.trial098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T03:48:00.550 INFO:teuthology.orchestra.run.trial098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T03:48:00.550 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:00.616 INFO:teuthology.orchestra.run.trial154.stdout:(16/95): ledmon-libs-1.1.0-3.el9.x86_64.rpm 87 kB/s | 40 kB 00:00 2026-02-12T03:48:00.648 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-mds-2:20.2.0-626.g1279775f.el9.x86_64 94/95 2026-02-12T03:48:00.669 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-mds-2:20.2.0-626.g1279775f.el9.x86_64 94/95 2026-02-12T03:48:00.669 INFO:teuthology.orchestra.run.trial098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T03:48:00.669 INFO:teuthology.orchestra.run.trial098.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-12T03:48:00.669 INFO:teuthology.orchestra.run.trial098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T03:48:00.669 INFO:teuthology.orchestra.run.trial098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T03:48:00.669 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:00.686 INFO:teuthology.orchestra.run.trial154.stdout:(17/95): libconfig-1.7.2-9.el9.x86_64.rpm 153 kB/s | 72 kB 00:00 2026-02-12T03:48:00.688 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-2:20.2.0-626.g1279775f.el9.x86_64 95/95 2026-02-12T03:48:00.921 INFO:teuthology.orchestra.run.trial154.stdout:(18/95): libquadmath-11.5.0-14.el9.x86_64.rpm 787 kB/s | 184 kB 00:00 2026-02-12T03:48:01.014 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 64/95 2026-02-12T03:48:01.031 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 65/95 2026-02-12T03:48:01.041 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 66/95 2026-02-12T03:48:01.048 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/95 2026-02-12T03:48:01.061 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-ply-3.11-14.el9.noarch 68/95 2026-02-12T03:48:01.077 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 69/95 2026-02-12T03:48:01.152 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 70/95 2026-02-12T03:48:01.160 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 71/95 2026-02-12T03:48:01.184 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 72/95 2026-02-12T03:48:01.213 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 73/95 2026-02-12T03:48:01.232 INFO:teuthology.orchestra.run.trial154.stdout:(19/95): python3-cffi-1.14.5-5.el9.x86_64.rpm 813 kB/s | 253 kB 00:00 2026-02-12T03:48:01.263 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 74/95 2026-02-12T03:48:01.269 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 75/95 2026-02-12T03:48:01.273 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 76/95 2026-02-12T03:48:01.274 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 77/95 2026-02-12T03:48:01.292 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-12T03:48:01.292 INFO:teuthology.orchestra.run.trial111.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-12T03:48:01.292 INFO:teuthology.orchestra.run.trial111.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-12T03:48:01.292 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:01.299 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-12T03:48:01.311 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-626.g1279775f.el9.noarch 86/95 2026-02-12T03:48:01.316 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-626.g1279775f.el9.noar 87/95 2026-02-12T03:48:01.325 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-12T03:48:01.325 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-12T03:48:01.325 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:01.358 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 79/95 2026-02-12T03:48:01.372 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-2:20.2.0-626.g1279775f.el9.x86_64 95/95 2026-02-12T03:48:01.372 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-2:20.2.0-626.g1279775f.el9.x86_64 1/95 2026-02-12T03:48:01.372 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-mds-2:20.2.0-626.g1279775f.el9.x86_64 2/95 2026-02-12T03:48:01.373 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-mgr-2:20.2.0-626.g1279775f.el9.x86_64 3/95 2026-02-12T03:48:01.373 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-mon-2:20.2.0-626.g1279775f.el9.x86_64 4/95 2026-02-12T03:48:01.373 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-osd-2:20.2.0-626.g1279775f.el9.x86_64 5/95 2026-02-12T03:48:01.373 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-626.g1279775f.el9 6/95 2026-02-12T03:48:01.373 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-626.g1279775f.el9.noarch 7/95 2026-02-12T03:48:01.373 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-626.g1279775f.el9.noar 8/95 2026-02-12T03:48:01.373 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-626.g127977 9/95 2026-02-12T03:48:01.373 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-mgr-k8sevents-2:20.2.0-626.g1279775f.el9.noar 10/95 2026-02-12T03:48:01.373 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-626.g1279775f.el9.n 11/95 2026-02-12T03:48:01.373 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-mgr-rook-2:20.2.0-626.g1279775f.el9.noarch 12/95 2026-02-12T03:48:01.373 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-626.g1279775f.el9. 13/95 2026-02-12T03:48:01.373 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-volume-2:20.2.0-626.g1279775f.el9.noarch 14/95 2026-02-12T03:48:01.374 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : cephadm-2:20.2.0-626.g1279775f.el9.noarch 15/95 2026-02-12T03:48:01.374 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/95 2026-02-12T03:48:01.374 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/95 2026-02-12T03:48:01.374 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/95 2026-02-12T03:48:01.374 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/95 2026-02-12T03:48:01.374 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/95 2026-02-12T03:48:01.374 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/95 2026-02-12T03:48:01.374 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/95 2026-02-12T03:48:01.374 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/95 2026-02-12T03:48:01.374 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/95 2026-02-12T03:48:01.374 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/95 2026-02-12T03:48:01.374 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/95 2026-02-12T03:48:01.375 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/95 2026-02-12T03:48:01.375 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/95 2026-02-12T03:48:01.375 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : zip-3.0-35.el9.x86_64 29/95 2026-02-12T03:48:01.375 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 30/95 2026-02-12T03:48:01.375 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 31/95 2026-02-12T03:48:01.375 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 32/95 2026-02-12T03:48:01.375 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/95 2026-02-12T03:48:01.375 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/95 2026-02-12T03:48:01.375 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/95 2026-02-12T03:48:01.375 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/95 2026-02-12T03:48:01.376 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/95 2026-02-12T03:48:01.376 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/95 2026-02-12T03:48:01.376 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/95 2026-02-12T03:48:01.376 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/95 2026-02-12T03:48:01.376 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 41/95 2026-02-12T03:48:01.376 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 42/95 2026-02-12T03:48:01.376 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 43/95 2026-02-12T03:48:01.376 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/95 2026-02-12T03:48:01.376 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/95 2026-02-12T03:48:01.376 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/95 2026-02-12T03:48:01.376 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/95 2026-02-12T03:48:01.377 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/95 2026-02-12T03:48:01.377 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/95 2026-02-12T03:48:01.377 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/95 2026-02-12T03:48:01.377 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/95 2026-02-12T03:48:01.377 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/95 2026-02-12T03:48:01.377 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/95 2026-02-12T03:48:01.377 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/95 2026-02-12T03:48:01.377 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/95 2026-02-12T03:48:01.377 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/95 2026-02-12T03:48:01.377 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/95 2026-02-12T03:48:01.377 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/95 2026-02-12T03:48:01.377 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/95 2026-02-12T03:48:01.377 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/95 2026-02-12T03:48:01.378 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/95 2026-02-12T03:48:01.378 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/95 2026-02-12T03:48:01.378 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/95 2026-02-12T03:48:01.378 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/95 2026-02-12T03:48:01.378 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/95 2026-02-12T03:48:01.378 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/95 2026-02-12T03:48:01.378 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/95 2026-02-12T03:48:01.378 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/95 2026-02-12T03:48:01.378 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/95 2026-02-12T03:48:01.378 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/95 2026-02-12T03:48:01.378 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/95 2026-02-12T03:48:01.378 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/95 2026-02-12T03:48:01.378 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/95 2026-02-12T03:48:01.379 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/95 2026-02-12T03:48:01.379 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/95 2026-02-12T03:48:01.379 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/95 2026-02-12T03:48:01.379 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/95 2026-02-12T03:48:01.379 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/95 2026-02-12T03:48:01.379 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/95 2026-02-12T03:48:01.379 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/95 2026-02-12T03:48:01.379 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 81/95 2026-02-12T03:48:01.379 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 82/95 2026-02-12T03:48:01.379 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 83/95 2026-02-12T03:48:01.379 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 84/95 2026-02-12T03:48:01.380 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 85/95 2026-02-12T03:48:01.380 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 86/95 2026-02-12T03:48:01.380 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 87/95 2026-02-12T03:48:01.380 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 88/95 2026-02-12T03:48:01.380 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 89/95 2026-02-12T03:48:01.380 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 90/95 2026-02-12T03:48:01.380 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 91/95 2026-02-12T03:48:01.380 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 92/95 2026-02-12T03:48:01.380 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 93/95 2026-02-12T03:48:01.381 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 94/95 2026-02-12T03:48:01.422 INFO:teuthology.orchestra.run.trial111.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 80/95 2026-02-12T03:48:01.425 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-volume-2:20.2.0-626.g1279775f.el9.noarch 81/95 2026-02-12T03:48:01.433 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 95/95 2026-02-12T03:48:01.434 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:01.434 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-12T03:48:01.434 INFO:teuthology.orchestra.run.trial098.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-12T03:48:01.434 INFO:teuthology.orchestra.run.trial098.stdout: ceph-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:01.434 INFO:teuthology.orchestra.run.trial098.stdout: ceph-grafana-dashboards-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:01.434 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mds-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:01.434 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mgr-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:01.434 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mgr-cephadm-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:01.434 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mgr-dashboard-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:01.434 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mgr-diskprediction-local-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:01.434 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mgr-k8sevents-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:01.435 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mgr-modules-core-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:01.435 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mgr-rook-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:01.435 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mon-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:01.435 INFO:teuthology.orchestra.run.trial098.stdout: ceph-osd-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:01.435 INFO:teuthology.orchestra.run.trial098.stdout: ceph-prometheus-alerts-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:01.435 INFO:teuthology.orchestra.run.trial098.stdout: ceph-volume-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:01.435 INFO:teuthology.orchestra.run.trial098.stdout: cephadm-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:01.435 INFO:teuthology.orchestra.run.trial098.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-12T03:48:01.435 INFO:teuthology.orchestra.run.trial098.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-12T03:48:01.435 INFO:teuthology.orchestra.run.trial098.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-12T03:48:01.435 INFO:teuthology.orchestra.run.trial098.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-12T03:48:01.436 INFO:teuthology.orchestra.run.trial098.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-12T03:48:01.436 INFO:teuthology.orchestra.run.trial098.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-12T03:48:01.436 INFO:teuthology.orchestra.run.trial098.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-12T03:48:01.436 INFO:teuthology.orchestra.run.trial098.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-12T03:48:01.436 INFO:teuthology.orchestra.run.trial098.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-12T03:48:01.436 INFO:teuthology.orchestra.run.trial098.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T03:48:01.436 INFO:teuthology.orchestra.run.trial098.stdout: lua-5.4.4-4.el9.x86_64 2026-02-12T03:48:01.436 INFO:teuthology.orchestra.run.trial098.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-12T03:48:01.436 INFO:teuthology.orchestra.run.trial098.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-12T03:48:01.436 INFO:teuthology.orchestra.run.trial098.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-12T03:48:01.436 INFO:teuthology.orchestra.run.trial098.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-12T03:48:01.436 INFO:teuthology.orchestra.run.trial098.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-12T03:48:01.437 INFO:teuthology.orchestra.run.trial098.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-12T03:48:01.437 INFO:teuthology.orchestra.run.trial098.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-12T03:48:01.437 INFO:teuthology.orchestra.run.trial098.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-12T03:48:01.437 INFO:teuthology.orchestra.run.trial098.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-12T03:48:01.437 INFO:teuthology.orchestra.run.trial098.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-12T03:48:01.437 INFO:teuthology.orchestra.run.trial098.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-12T03:48:01.437 INFO:teuthology.orchestra.run.trial098.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-12T03:48:01.437 INFO:teuthology.orchestra.run.trial098.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-12T03:48:01.437 INFO:teuthology.orchestra.run.trial098.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-12T03:48:01.437 INFO:teuthology.orchestra.run.trial098.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-12T03:48:01.437 INFO:teuthology.orchestra.run.trial098.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-12T03:48:01.437 INFO:teuthology.orchestra.run.trial098.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-12T03:48:01.437 INFO:teuthology.orchestra.run.trial098.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-12T03:48:01.438 INFO:teuthology.orchestra.run.trial098.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-12T03:48:01.438 INFO:teuthology.orchestra.run.trial098.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-12T03:48:01.438 INFO:teuthology.orchestra.run.trial098.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-12T03:48:01.438 INFO:teuthology.orchestra.run.trial098.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-12T03:48:01.438 INFO:teuthology.orchestra.run.trial098.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-12T03:48:01.438 INFO:teuthology.orchestra.run.trial098.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-12T03:48:01.438 INFO:teuthology.orchestra.run.trial098.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-12T03:48:01.438 INFO:teuthology.orchestra.run.trial098.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-12T03:48:01.438 INFO:teuthology.orchestra.run.trial098.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-12T03:48:01.438 INFO:teuthology.orchestra.run.trial098.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-12T03:48:01.438 INFO:teuthology.orchestra.run.trial098.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-12T03:48:01.438 INFO:teuthology.orchestra.run.trial098.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-12T03:48:01.438 INFO:teuthology.orchestra.run.trial098.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-12T03:48:01.439 INFO:teuthology.orchestra.run.trial098.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-12T03:48:01.439 INFO:teuthology.orchestra.run.trial098.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T03:48:01.439 INFO:teuthology.orchestra.run.trial098.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-12T03:48:01.439 INFO:teuthology.orchestra.run.trial098.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-12T03:48:01.439 INFO:teuthology.orchestra.run.trial098.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-12T03:48:01.439 INFO:teuthology.orchestra.run.trial098.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-12T03:48:01.439 INFO:teuthology.orchestra.run.trial098.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-12T03:48:01.439 INFO:teuthology.orchestra.run.trial098.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-12T03:48:01.439 INFO:teuthology.orchestra.run.trial098.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-12T03:48:01.439 INFO:teuthology.orchestra.run.trial098.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-12T03:48:01.439 INFO:teuthology.orchestra.run.trial098.stdout: python3-ply-3.11-14.el9.noarch 2026-02-12T03:48:01.439 INFO:teuthology.orchestra.run.trial098.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-12T03:48:01.440 INFO:teuthology.orchestra.run.trial098.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-12T03:48:01.440 INFO:teuthology.orchestra.run.trial098.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-12T03:48:01.440 INFO:teuthology.orchestra.run.trial098.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-12T03:48:01.440 INFO:teuthology.orchestra.run.trial098.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-12T03:48:01.440 INFO:teuthology.orchestra.run.trial098.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-12T03:48:01.440 INFO:teuthology.orchestra.run.trial098.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-12T03:48:01.440 INFO:teuthology.orchestra.run.trial098.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-12T03:48:01.440 INFO:teuthology.orchestra.run.trial098.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-12T03:48:01.440 INFO:teuthology.orchestra.run.trial098.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-12T03:48:01.440 INFO:teuthology.orchestra.run.trial098.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-12T03:48:01.440 INFO:teuthology.orchestra.run.trial098.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-12T03:48:01.440 INFO:teuthology.orchestra.run.trial098.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-12T03:48:01.440 INFO:teuthology.orchestra.run.trial098.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-12T03:48:01.441 INFO:teuthology.orchestra.run.trial098.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-12T03:48:01.441 INFO:teuthology.orchestra.run.trial098.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-12T03:48:01.441 INFO:teuthology.orchestra.run.trial098.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-12T03:48:01.441 INFO:teuthology.orchestra.run.trial098.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-12T03:48:01.441 INFO:teuthology.orchestra.run.trial098.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-12T03:48:01.441 INFO:teuthology.orchestra.run.trial098.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-12T03:48:01.441 INFO:teuthology.orchestra.run.trial098.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-12T03:48:01.441 INFO:teuthology.orchestra.run.trial098.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-12T03:48:01.441 INFO:teuthology.orchestra.run.trial098.stdout: unzip-6.0-59.el9.x86_64 2026-02-12T03:48:01.441 INFO:teuthology.orchestra.run.trial098.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-12T03:48:01.441 INFO:teuthology.orchestra.run.trial098.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-12T03:48:01.441 INFO:teuthology.orchestra.run.trial098.stdout: zip-3.0-35.el9.x86_64 2026-02-12T03:48:01.442 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:01.442 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:48:01.442 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-volume-2:20.2.0-626.g1279775f.el9.noarch 81/95 2026-02-12T03:48:01.442 INFO:teuthology.orchestra.run.trial111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T03:48:01.442 INFO:teuthology.orchestra.run.trial111.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-12T03:48:01.443 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:01.489 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install ceph-base 2026-02-12T03:48:01.558 INFO:teuthology.orchestra.run.trial154.stdout:(20/95): cryptsetup-2.8.1-2.el9.x86_64.rpm 244 kB/s | 350 kB 00:01 2026-02-12T03:48:01.570 INFO:teuthology.orchestra.run.trial154.stdout:(21/95): libgfortran-11.5.0-14.el9.x86_64.rpm 832 kB/s | 794 kB 00:00 2026-02-12T03:48:01.727 INFO:teuthology.orchestra.run.trial154.stdout:(22/95): python3-pycparser-2.20-6.el9.noarch.rp 862 kB/s | 135 kB 00:00 2026-02-12T03:48:01.773 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-626.g1279775f.el9.noar 87/95 2026-02-12T03:48:01.774 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-626.g127977 88/95 2026-02-12T03:48:01.787 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-626.g127977 88/95 2026-02-12T03:48:01.788 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-mgr-k8sevents-2:20.2.0-626.g1279775f.el9.noar 89/95 2026-02-12T03:48:01.793 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:41 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:48:01.846 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.2.0-626.g1279775f.el9.noar 89/95 2026-02-12T03:48:01.858 INFO:teuthology.orchestra.run.trial098.stdout:Package ceph-base-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:48:01.866 INFO:teuthology.orchestra.run.trial154.stdout:(23/95): python3-ply-3.11-14.el9.noarch.rpm 346 kB/s | 106 kB 00:00 2026-02-12T03:48:01.876 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:48:01.876 INFO:teuthology.orchestra.run.trial098.stdout:Nothing to do. 2026-02-12T03:48:01.877 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:48:01.888 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-626.g1279775f.el9.n 90/95 2026-02-12T03:48:01.890 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-mgr-2:20.2.0-626.g1279775f.el9.x86_64 91/95 2026-02-12T03:48:01.898 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install cephadm 2026-02-12T03:48:01.911 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-mgr-2:20.2.0-626.g1279775f.el9.x86_64 91/95 2026-02-12T03:48:01.911 INFO:teuthology.orchestra.run.trial091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T03:48:01.911 INFO:teuthology.orchestra.run.trial091.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-12T03:48:01.911 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T03:48:01.911 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T03:48:01.912 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:01.923 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-mgr-rook-2:20.2.0-626.g1279775f.el9.noarch 92/95 2026-02-12T03:48:01.960 INFO:teuthology.orchestra.run.trial154.stdout:(24/95): python3-pyparsing-2.4.7-9.el9.noarch.r 647 kB/s | 150 kB 00:00 2026-02-12T03:48:02.130 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-osd-2:20.2.0-626.g1279775f.el9.x86_64 82/95 2026-02-12T03:48:02.151 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-626.g1279775f.el9.noarch 92/95 2026-02-12T03:48:02.152 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-mon-2:20.2.0-626.g1279775f.el9.x86_64 93/95 2026-02-12T03:48:02.155 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-osd-2:20.2.0-626.g1279775f.el9.x86_64 82/95 2026-02-12T03:48:02.155 INFO:teuthology.orchestra.run.trial111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T03:48:02.156 INFO:teuthology.orchestra.run.trial111.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-12T03:48:02.156 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T03:48:02.156 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T03:48:02.156 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:02.175 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-mon-2:20.2.0-626.g1279775f.el9.x86_64 93/95 2026-02-12T03:48:02.175 INFO:teuthology.orchestra.run.trial091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T03:48:02.175 INFO:teuthology.orchestra.run.trial091.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-12T03:48:02.175 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T03:48:02.175 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T03:48:02.175 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:02.176 INFO:teuthology.orchestra.run.trial154.stdout:(25/95): python3-requests-2.25.1-10.el9.noarch. 410 kB/s | 126 kB 00:00 2026-02-12T03:48:02.203 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:42 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:48:02.218 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: cephadm-2:20.2.0-626.g1279775f.el9.noarch 83/95 2026-02-12T03:48:02.220 INFO:teuthology.orchestra.run.trial111.stdout: Installing : cephadm-2:20.2.0-626.g1279775f.el9.noarch 83/95 2026-02-12T03:48:02.227 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-626.g1279775f.el9. 84/95 2026-02-12T03:48:02.251 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-626.g1279775f.el9 85/95 2026-02-12T03:48:02.252 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-626.g1279775f.el9.noarch 86/95 2026-02-12T03:48:02.268 INFO:teuthology.orchestra.run.trial154.stdout:(26/95): python3-urllib3-1.26.5-7.el9.noarch.rp 707 kB/s | 218 kB 00:00 2026-02-12T03:48:02.268 INFO:teuthology.orchestra.run.trial098.stdout:Package cephadm-2:20.2.0-626.g1279775f.el9.noarch is already installed. 2026-02-12T03:48:02.271 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-mds-2:20.2.0-626.g1279775f.el9.x86_64 94/95 2026-02-12T03:48:02.286 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:48:02.287 INFO:teuthology.orchestra.run.trial098.stdout:Nothing to do. 2026-02-12T03:48:02.287 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:48:02.292 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-mds-2:20.2.0-626.g1279775f.el9.x86_64 94/95 2026-02-12T03:48:02.292 INFO:teuthology.orchestra.run.trial091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T03:48:02.292 INFO:teuthology.orchestra.run.trial091.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-12T03:48:02.292 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T03:48:02.292 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T03:48:02.293 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:02.310 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install ceph-immutable-object-cache 2026-02-12T03:48:02.311 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-2:20.2.0-626.g1279775f.el9.x86_64 95/95 2026-02-12T03:48:02.483 INFO:teuthology.orchestra.run.trial154.stdout:(27/95): unzip-6.0-59.el9.x86_64.rpm 591 kB/s | 182 kB 00:00 2026-02-12T03:48:02.552 INFO:teuthology.orchestra.run.trial154.stdout:(28/95): flexiblas-3.0.4-8.el9.x86_64.rpm 473 kB/s | 33 kB 00:00 2026-02-12T03:48:02.576 INFO:teuthology.orchestra.run.trial154.stdout:(29/95): zip-3.0-35.el9.x86_64.rpm 862 kB/s | 266 kB 00:00 2026-02-12T03:48:02.611 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:42 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:48:02.619 INFO:teuthology.orchestra.run.trial154.stdout:(30/95): flexiblas-openblas-openmp-3.0.4-8.el9. 432 kB/s | 18 kB 00:00 2026-02-12T03:48:02.681 INFO:teuthology.orchestra.run.trial154.stdout:(31/95): flexiblas-netlib-3.0.4-8.el9.x86_64.rp 23 MB/s | 3.0 MB 00:00 2026-02-12T03:48:02.683 INFO:teuthology.orchestra.run.trial154.stdout:(32/95): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 3.7 MB/s | 246 kB 00:00 2026-02-12T03:48:02.692 INFO:teuthology.orchestra.run.trial154.stdout:(33/95): python3-cryptography-36.0.1-5.el9.x86_ 874 kB/s | 1.2 MB 00:01 2026-02-12T03:48:02.694 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:48:02.694 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:48:02.695 INFO:teuthology.orchestra.run.trial098.stdout: Package Arch Version Repo Size 2026-02-12T03:48:02.695 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:48:02.695 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-12T03:48:02.695 INFO:teuthology.orchestra.run.trial098.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-626.g1279775f.el9 ceph 154 k 2026-02-12T03:48:02.695 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:02.695 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-12T03:48:02.695 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:48:02.695 INFO:teuthology.orchestra.run.trial098.stdout:Install 1 Package 2026-02-12T03:48:02.695 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:02.696 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 154 k 2026-02-12T03:48:02.696 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 447 k 2026-02-12T03:48:02.696 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-12T03:48:02.705 INFO:teuthology.orchestra.run.trial154.stdout:(34/95): openblas-0.3.29-1.el9.x86_64.rpm 1.9 MB/s | 42 kB 00:00 2026-02-12T03:48:02.705 INFO:teuthology.orchestra.run.trial154.stdout:(35/95): lua-5.4.4-4.el9.x86_64.rpm 7.7 MB/s | 188 kB 00:00 2026-02-12T03:48:02.762 INFO:teuthology.orchestra.run.trial154.stdout:(36/95): python3-babel-2.9.1-2.el9.noarch.rpm 105 MB/s | 6.0 MB 00:00 2026-02-12T03:48:02.780 INFO:teuthology.orchestra.run.trial098.stdout:ceph-immutable-object-cache-20.2.0-626.g1279775 1.8 MB/s | 154 kB 00:00 2026-02-12T03:48:02.780 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:48:02.781 INFO:teuthology.orchestra.run.trial098.stdout:Total 1.7 MB/s | 154 kB 00:00 2026-02-12T03:48:02.781 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-12T03:48:02.782 INFO:teuthology.orchestra.run.trial154.stdout:(37/95): protobuf-3.14.0-17.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2026-02-12T03:48:02.785 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-12T03:48:02.785 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-12T03:48:02.787 INFO:teuthology.orchestra.run.trial154.stdout:(38/95): python3-devel-3.9.25-2.el9.x86_64.rpm 9.6 MB/s | 244 kB 00:00 2026-02-12T03:48:02.806 INFO:teuthology.orchestra.run.trial154.stdout:(39/95): python3-jinja2-2.11.3-8.el9.noarch.rpm 9.9 MB/s | 249 kB 00:00 2026-02-12T03:48:02.810 INFO:teuthology.orchestra.run.trial154.stdout:(40/95): python3-jmespath-1.0.1-1.el9.noarch.rp 2.1 MB/s | 48 kB 00:00 2026-02-12T03:48:02.819 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-12T03:48:02.820 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-12T03:48:02.832 INFO:teuthology.orchestra.run.trial154.stdout:(41/95): python3-libstoragemgmt-1.10.1-1.el9.x8 6.9 MB/s | 177 kB 00:00 2026-02-12T03:48:02.837 INFO:teuthology.orchestra.run.trial154.stdout:(42/95): python3-lxml-4.6.5-3.el9.x86_64.rpm 46 MB/s | 1.2 MB 00:00 2026-02-12T03:48:02.855 INFO:teuthology.orchestra.run.trial154.stdout:(43/95): python3-markupsafe-1.1.1-12.el9.x86_64 1.5 MB/s | 35 kB 00:00 2026-02-12T03:48:02.876 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-12T03:48:02.877 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-626.g1279775f.e 1/1 2026-02-12T03:48:02.884 INFO:teuthology.orchestra.run.trial154.stdout:(44/95): openblas-openmp-0.3.29-1.el9.x86_64.rp 27 MB/s | 5.3 MB 00:00 2026-02-12T03:48:02.886 INFO:teuthology.orchestra.run.trial154.stdout:(45/95): python3-numpy-f2py-1.23.5-2.el9.x86_64 14 MB/s | 442 kB 00:00 2026-02-12T03:48:02.896 INFO:teuthology.orchestra.run.trial154.stdout:(46/95): python3-numpy-1.23.5-2.el9.x86_64.rpm 104 MB/s | 6.1 MB 00:00 2026-02-12T03:48:02.901 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-626.g1279775f.e 1/1 2026-02-12T03:48:02.901 INFO:teuthology.orchestra.run.trial098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T03:48:02.901 INFO:teuthology.orchestra.run.trial098.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-12T03:48:02.901 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:02.908 INFO:teuthology.orchestra.run.trial154.stdout:(47/95): python3-packaging-20.9-5.el9.noarch.rp 3.3 MB/s | 77 kB 00:00 2026-02-12T03:48:02.910 INFO:teuthology.orchestra.run.trial154.stdout:(48/95): python3-protobuf-3.14.0-17.el9.noarch. 11 MB/s | 267 kB 00:00 2026-02-12T03:48:02.920 INFO:teuthology.orchestra.run.trial154.stdout:(49/95): python3-pyasn1-0.4.8-6.el9.noarch.rpm 6.4 MB/s | 159 kB 00:00 2026-02-12T03:48:02.931 INFO:teuthology.orchestra.run.trial154.stdout:(50/95): python3-pyasn1-modules-0.4.8-6.el9.noa 12 MB/s | 279 kB 00:00 2026-02-12T03:48:02.933 INFO:teuthology.orchestra.run.trial154.stdout:(51/95): python3-requests-oauthlib-1.3.0-12.el9 2.3 MB/s | 54 kB 00:00 2026-02-12T03:48:02.953 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-2:20.2.0-626.g1279775f.el9.x86_64 95/95 2026-02-12T03:48:02.953 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-2:20.2.0-626.g1279775f.el9.x86_64 1/95 2026-02-12T03:48:02.953 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-mds-2:20.2.0-626.g1279775f.el9.x86_64 2/95 2026-02-12T03:48:02.953 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-mgr-2:20.2.0-626.g1279775f.el9.x86_64 3/95 2026-02-12T03:48:02.953 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-mon-2:20.2.0-626.g1279775f.el9.x86_64 4/95 2026-02-12T03:48:02.954 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-osd-2:20.2.0-626.g1279775f.el9.x86_64 5/95 2026-02-12T03:48:02.954 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-626.g1279775f.el9 6/95 2026-02-12T03:48:02.954 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-626.g1279775f.el9.noarch 7/95 2026-02-12T03:48:02.954 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-626.g1279775f.el9.noar 8/95 2026-02-12T03:48:02.954 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-626.g127977 9/95 2026-02-12T03:48:02.954 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-mgr-k8sevents-2:20.2.0-626.g1279775f.el9.noar 10/95 2026-02-12T03:48:02.954 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-626.g1279775f.el9.n 11/95 2026-02-12T03:48:02.954 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-mgr-rook-2:20.2.0-626.g1279775f.el9.noarch 12/95 2026-02-12T03:48:02.954 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-626.g1279775f.el9. 13/95 2026-02-12T03:48:02.954 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-volume-2:20.2.0-626.g1279775f.el9.noarch 14/95 2026-02-12T03:48:02.954 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : cephadm-2:20.2.0-626.g1279775f.el9.noarch 15/95 2026-02-12T03:48:02.954 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/95 2026-02-12T03:48:02.955 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/95 2026-02-12T03:48:02.955 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/95 2026-02-12T03:48:02.955 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/95 2026-02-12T03:48:02.955 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/95 2026-02-12T03:48:02.955 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/95 2026-02-12T03:48:02.955 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/95 2026-02-12T03:48:02.955 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/95 2026-02-12T03:48:02.955 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/95 2026-02-12T03:48:02.955 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/95 2026-02-12T03:48:02.955 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/95 2026-02-12T03:48:02.955 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/95 2026-02-12T03:48:02.955 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/95 2026-02-12T03:48:02.956 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : zip-3.0-35.el9.x86_64 29/95 2026-02-12T03:48:02.956 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 30/95 2026-02-12T03:48:02.956 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 31/95 2026-02-12T03:48:02.956 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 32/95 2026-02-12T03:48:02.956 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/95 2026-02-12T03:48:02.956 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/95 2026-02-12T03:48:02.956 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/95 2026-02-12T03:48:02.956 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/95 2026-02-12T03:48:02.956 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/95 2026-02-12T03:48:02.956 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/95 2026-02-12T03:48:02.956 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/95 2026-02-12T03:48:02.956 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/95 2026-02-12T03:48:02.957 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 41/95 2026-02-12T03:48:02.957 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 42/95 2026-02-12T03:48:02.957 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 43/95 2026-02-12T03:48:02.957 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/95 2026-02-12T03:48:02.957 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/95 2026-02-12T03:48:02.957 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/95 2026-02-12T03:48:02.957 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/95 2026-02-12T03:48:02.957 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/95 2026-02-12T03:48:02.957 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/95 2026-02-12T03:48:02.957 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/95 2026-02-12T03:48:02.957 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/95 2026-02-12T03:48:02.957 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/95 2026-02-12T03:48:02.957 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/95 2026-02-12T03:48:02.958 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/95 2026-02-12T03:48:02.958 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/95 2026-02-12T03:48:02.958 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/95 2026-02-12T03:48:02.958 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/95 2026-02-12T03:48:02.958 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/95 2026-02-12T03:48:02.958 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/95 2026-02-12T03:48:02.958 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/95 2026-02-12T03:48:02.958 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/95 2026-02-12T03:48:02.958 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/95 2026-02-12T03:48:02.959 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/95 2026-02-12T03:48:02.959 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/95 2026-02-12T03:48:02.959 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/95 2026-02-12T03:48:02.959 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/95 2026-02-12T03:48:02.959 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/95 2026-02-12T03:48:02.959 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/95 2026-02-12T03:48:02.959 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/95 2026-02-12T03:48:02.960 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/95 2026-02-12T03:48:02.960 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/95 2026-02-12T03:48:02.960 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/95 2026-02-12T03:48:02.960 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/95 2026-02-12T03:48:02.960 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/95 2026-02-12T03:48:02.960 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/95 2026-02-12T03:48:02.960 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/95 2026-02-12T03:48:02.960 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/95 2026-02-12T03:48:02.960 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/95 2026-02-12T03:48:02.960 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/95 2026-02-12T03:48:02.961 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/95 2026-02-12T03:48:02.961 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 81/95 2026-02-12T03:48:02.961 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 82/95 2026-02-12T03:48:02.961 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 83/95 2026-02-12T03:48:02.961 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 84/95 2026-02-12T03:48:02.961 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 85/95 2026-02-12T03:48:02.961 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 86/95 2026-02-12T03:48:02.961 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 87/95 2026-02-12T03:48:02.961 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 88/95 2026-02-12T03:48:02.961 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 89/95 2026-02-12T03:48:02.961 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 90/95 2026-02-12T03:48:02.961 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 91/95 2026-02-12T03:48:02.961 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 92/95 2026-02-12T03:48:02.962 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 93/95 2026-02-12T03:48:02.962 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 94/95 2026-02-12T03:48:02.963 INFO:teuthology.orchestra.run.trial154.stdout:(52/95): python3-toml-0.10.2-6.el9.noarch.rpm 1.8 MB/s | 42 kB 00:00 2026-02-12T03:48:02.963 INFO:teuthology.orchestra.run.trial154.stdout:(53/95): xmlsec1-1.2.29-13.el9.x86_64.rpm 8.1 MB/s | 189 kB 00:00 2026-02-12T03:48:02.976 INFO:teuthology.orchestra.run.trial154.stdout:(54/95): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 4.0 MB/s | 90 kB 00:00 2026-02-12T03:48:03.014 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 95/95 2026-02-12T03:48:03.015 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:03.015 INFO:teuthology.orchestra.run.trial091.stdout:Installed: 2026-02-12T03:48:03.015 INFO:teuthology.orchestra.run.trial091.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-12T03:48:03.015 INFO:teuthology.orchestra.run.trial091.stdout: ceph-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:03.015 INFO:teuthology.orchestra.run.trial091.stdout: ceph-grafana-dashboards-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:03.015 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mds-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:03.015 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:03.015 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr-cephadm-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:03.015 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr-dashboard-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:03.015 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr-diskprediction-local-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:03.016 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr-k8sevents-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:03.016 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr-modules-core-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:03.016 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr-rook-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:03.016 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mon-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:03.016 INFO:teuthology.orchestra.run.trial091.stdout: ceph-osd-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:03.016 INFO:teuthology.orchestra.run.trial091.stdout: ceph-prometheus-alerts-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:03.016 INFO:teuthology.orchestra.run.trial091.stdout: ceph-volume-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:03.016 INFO:teuthology.orchestra.run.trial091.stdout: cephadm-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:03.016 INFO:teuthology.orchestra.run.trial091.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-12T03:48:03.016 INFO:teuthology.orchestra.run.trial091.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-12T03:48:03.016 INFO:teuthology.orchestra.run.trial091.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-12T03:48:03.017 INFO:teuthology.orchestra.run.trial091.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-12T03:48:03.017 INFO:teuthology.orchestra.run.trial091.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-12T03:48:03.017 INFO:teuthology.orchestra.run.trial091.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-12T03:48:03.017 INFO:teuthology.orchestra.run.trial091.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-12T03:48:03.017 INFO:teuthology.orchestra.run.trial091.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-12T03:48:03.017 INFO:teuthology.orchestra.run.trial091.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-12T03:48:03.017 INFO:teuthology.orchestra.run.trial091.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T03:48:03.017 INFO:teuthology.orchestra.run.trial091.stdout: lua-5.4.4-4.el9.x86_64 2026-02-12T03:48:03.017 INFO:teuthology.orchestra.run.trial091.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-12T03:48:03.017 INFO:teuthology.orchestra.run.trial091.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-12T03:48:03.017 INFO:teuthology.orchestra.run.trial091.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-12T03:48:03.017 INFO:teuthology.orchestra.run.trial091.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-12T03:48:03.018 INFO:teuthology.orchestra.run.trial091.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-12T03:48:03.018 INFO:teuthology.orchestra.run.trial091.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-12T03:48:03.018 INFO:teuthology.orchestra.run.trial091.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-12T03:48:03.018 INFO:teuthology.orchestra.run.trial091.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-12T03:48:03.018 INFO:teuthology.orchestra.run.trial091.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-12T03:48:03.018 INFO:teuthology.orchestra.run.trial091.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-12T03:48:03.018 INFO:teuthology.orchestra.run.trial091.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-12T03:48:03.018 INFO:teuthology.orchestra.run.trial091.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-12T03:48:03.018 INFO:teuthology.orchestra.run.trial091.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-12T03:48:03.018 INFO:teuthology.orchestra.run.trial091.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-12T03:48:03.018 INFO:teuthology.orchestra.run.trial091.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-12T03:48:03.018 INFO:teuthology.orchestra.run.trial091.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-12T03:48:03.019 INFO:teuthology.orchestra.run.trial091.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-12T03:48:03.019 INFO:teuthology.orchestra.run.trial091.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-12T03:48:03.019 INFO:teuthology.orchestra.run.trial091.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-12T03:48:03.019 INFO:teuthology.orchestra.run.trial091.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-12T03:48:03.019 INFO:teuthology.orchestra.run.trial091.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-12T03:48:03.019 INFO:teuthology.orchestra.run.trial091.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-12T03:48:03.019 INFO:teuthology.orchestra.run.trial091.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-12T03:48:03.019 INFO:teuthology.orchestra.run.trial091.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-12T03:48:03.019 INFO:teuthology.orchestra.run.trial091.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-12T03:48:03.019 INFO:teuthology.orchestra.run.trial091.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-12T03:48:03.019 INFO:teuthology.orchestra.run.trial091.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-12T03:48:03.019 INFO:teuthology.orchestra.run.trial091.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-12T03:48:03.019 INFO:teuthology.orchestra.run.trial091.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-12T03:48:03.020 INFO:teuthology.orchestra.run.trial091.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-12T03:48:03.020 INFO:teuthology.orchestra.run.trial091.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-12T03:48:03.020 INFO:teuthology.orchestra.run.trial091.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-12T03:48:03.020 INFO:teuthology.orchestra.run.trial091.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T03:48:03.020 INFO:teuthology.orchestra.run.trial091.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-12T03:48:03.020 INFO:teuthology.orchestra.run.trial091.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-12T03:48:03.020 INFO:teuthology.orchestra.run.trial091.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-12T03:48:03.020 INFO:teuthology.orchestra.run.trial091.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-12T03:48:03.020 INFO:teuthology.orchestra.run.trial091.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-12T03:48:03.020 INFO:teuthology.orchestra.run.trial091.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-12T03:48:03.020 INFO:teuthology.orchestra.run.trial091.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-12T03:48:03.021 INFO:teuthology.orchestra.run.trial091.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-12T03:48:03.021 INFO:teuthology.orchestra.run.trial091.stdout: python3-ply-3.11-14.el9.noarch 2026-02-12T03:48:03.021 INFO:teuthology.orchestra.run.trial091.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-12T03:48:03.021 INFO:teuthology.orchestra.run.trial091.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-12T03:48:03.021 INFO:teuthology.orchestra.run.trial091.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-12T03:48:03.021 INFO:teuthology.orchestra.run.trial091.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-12T03:48:03.021 INFO:teuthology.orchestra.run.trial091.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-12T03:48:03.021 INFO:teuthology.orchestra.run.trial091.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-12T03:48:03.021 INFO:teuthology.orchestra.run.trial091.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-12T03:48:03.021 INFO:teuthology.orchestra.run.trial091.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-12T03:48:03.021 INFO:teuthology.orchestra.run.trial091.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-12T03:48:03.021 INFO:teuthology.orchestra.run.trial091.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-12T03:48:03.022 INFO:teuthology.orchestra.run.trial091.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-12T03:48:03.022 INFO:teuthology.orchestra.run.trial091.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-12T03:48:03.022 INFO:teuthology.orchestra.run.trial091.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-12T03:48:03.022 INFO:teuthology.orchestra.run.trial091.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-12T03:48:03.022 INFO:teuthology.orchestra.run.trial091.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-12T03:48:03.022 INFO:teuthology.orchestra.run.trial091.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-12T03:48:03.022 INFO:teuthology.orchestra.run.trial091.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-12T03:48:03.022 INFO:teuthology.orchestra.run.trial091.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-12T03:48:03.022 INFO:teuthology.orchestra.run.trial091.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-12T03:48:03.022 INFO:teuthology.orchestra.run.trial091.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-12T03:48:03.022 INFO:teuthology.orchestra.run.trial091.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-12T03:48:03.022 INFO:teuthology.orchestra.run.trial091.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-12T03:48:03.022 INFO:teuthology.orchestra.run.trial091.stdout: unzip-6.0-59.el9.x86_64 2026-02-12T03:48:03.023 INFO:teuthology.orchestra.run.trial091.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-12T03:48:03.023 INFO:teuthology.orchestra.run.trial091.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-12T03:48:03.023 INFO:teuthology.orchestra.run.trial091.stdout: zip-3.0-35.el9.x86_64 2026-02-12T03:48:03.023 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:03.023 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:48:03.037 INFO:teuthology.orchestra.run.trial154.stdout:(55/95): lua-devel-5.4.4-4.el9.x86_64.rpm 276 kB/s | 22 kB 00:00 2026-02-12T03:48:03.071 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install ceph-base 2026-02-12T03:48:03.073 INFO:teuthology.orchestra.run.trial154.stdout:(56/95): python3-scipy-1.9.3-2.el9.x86_64.rpm 127 MB/s | 19 MB 00:00 2026-02-12T03:48:03.101 INFO:teuthology.orchestra.run.trial154.stdout:(57/95): grpc-data-1.46.7-10.el9.noarch.rpm 679 kB/s | 19 kB 00:00 2026-02-12T03:48:03.134 INFO:teuthology.orchestra.run.trial154.stdout:(58/95): abseil-cpp-20211102.0-4.el9.x86_64.rpm 5.5 MB/s | 551 kB 00:00 2026-02-12T03:48:03.135 INFO:teuthology.orchestra.run.trial154.stdout:(59/95): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2026-02-12T03:48:03.146 INFO:teuthology.orchestra.run.trial154.stdout:(60/95): python3-autocommand-2.2.2-8.el9.noarch 2.6 MB/s | 29 kB 00:00 2026-02-12T03:48:03.151 INFO:teuthology.orchestra.run.trial154.stdout:(61/95): python3-asyncssh-2.13.2-5.el9.noarch.r 32 MB/s | 548 kB 00:00 2026-02-12T03:48:03.158 INFO:teuthology.orchestra.run.trial154.stdout:(62/95): python3-backports-tarfile-1.2.0-1.el9. 5.0 MB/s | 60 kB 00:00 2026-02-12T03:48:03.162 INFO:teuthology.orchestra.run.trial154.stdout:(63/95): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 3.8 MB/s | 43 kB 00:00 2026-02-12T03:48:03.169 INFO:teuthology.orchestra.run.trial154.stdout:(64/95): python3-cachetools-4.2.4-1.el9.noarch. 2.9 MB/s | 32 kB 00:00 2026-02-12T03:48:03.173 INFO:teuthology.orchestra.run.trial154.stdout:(65/95): python3-certifi-2023.05.07-4.el9.noarc 1.3 MB/s | 14 kB 00:00 2026-02-12T03:48:03.184 INFO:teuthology.orchestra.run.trial154.stdout:(66/95): python3-cheroot-10.0.1-4.el9.noarch.rp 11 MB/s | 173 kB 00:00 2026-02-12T03:48:03.186 INFO:teuthology.orchestra.run.trial154.stdout:(67/95): python3-cherrypy-18.6.1-2.el9.noarch.r 26 MB/s | 358 kB 00:00 2026-02-12T03:48:03.201 INFO:teuthology.orchestra.run.trial154.stdout:(68/95): python3-google-auth-2.45.0-1.el9.noarc 15 MB/s | 254 kB 00:00 2026-02-12T03:48:03.204 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-626.g1279775f.e 1/1 2026-02-12T03:48:03.204 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:03.204 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-12T03:48:03.204 INFO:teuthology.orchestra.run.trial098.stdout: ceph-immutable-object-cache-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:03.204 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:03.204 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:48:03.214 INFO:teuthology.orchestra.run.trial154.stdout:(69/95): python3-grpcio-tools-1.46.7-10.el9.x86 11 MB/s | 144 kB 00:00 2026-02-12T03:48:03.227 INFO:teuthology.orchestra.run.trial154.stdout:(70/95): python3-influxdb-5.3.1-1.el9.noarch.rp 10 MB/s | 139 kB 00:00 2026-02-12T03:48:03.231 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install ceph-mgr 2026-02-12T03:48:03.238 INFO:teuthology.orchestra.run.trial154.stdout:(71/95): python3-grpcio-1.46.7-10.el9.x86_64.rp 40 MB/s | 2.0 MB 00:00 2026-02-12T03:48:03.239 INFO:teuthology.orchestra.run.trial154.stdout:(72/95): python3-isodate-0.6.1-3.el9.noarch.rpm 4.8 MB/s | 56 kB 00:00 2026-02-12T03:48:03.248 INFO:teuthology.orchestra.run.trial154.stdout:(73/95): python3-jaraco-8.2.1-3.el9.noarch.rpm 987 kB/s | 11 kB 00:00 2026-02-12T03:48:03.249 INFO:teuthology.orchestra.run.trial154.stdout:(74/95): python3-jaraco-classes-3.2.1-5.el9.noa 1.6 MB/s | 18 kB 00:00 2026-02-12T03:48:03.261 INFO:teuthology.orchestra.run.trial154.stdout:(75/95): python3-jaraco-collections-3.0.0-8.el9 2.0 MB/s | 23 kB 00:00 2026-02-12T03:48:03.261 INFO:teuthology.orchestra.run.trial154.stdout:(76/95): python3-jaraco-context-6.0.1-3.el9.noa 1.7 MB/s | 20 kB 00:00 2026-02-12T03:48:03.271 INFO:teuthology.orchestra.run.trial154.stdout:(77/95): python3-jaraco-functools-3.5.0-2.el9.n 1.7 MB/s | 19 kB 00:00 2026-02-12T03:48:03.272 INFO:teuthology.orchestra.run.trial154.stdout:(78/95): python3-jaraco-text-4.0.0-2.el9.noarch 2.3 MB/s | 26 kB 00:00 2026-02-12T03:48:03.283 INFO:teuthology.orchestra.run.trial154.stdout:(79/95): python3-more-itertools-8.12.0-2.el9.no 6.6 MB/s | 79 kB 00:00 2026-02-12T03:48:03.288 INFO:teuthology.orchestra.run.trial154.stdout:(80/95): python3-kubernetes-26.1.0-3.el9.noarch 60 MB/s | 1.0 MB 00:00 2026-02-12T03:48:03.295 INFO:teuthology.orchestra.run.trial154.stdout:(81/95): python3-msgpack-1.0.3-2.el9.x86_64.rpm 7.1 MB/s | 86 kB 00:00 2026-02-12T03:48:03.300 INFO:teuthology.orchestra.run.trial154.stdout:(82/95): python3-natsort-7.1.1-5.el9.noarch.rpm 5.0 MB/s | 58 kB 00:00 2026-02-12T03:48:03.306 INFO:teuthology.orchestra.run.trial154.stdout:(83/95): python3-portend-3.1.0-2.el9.noarch.rpm 1.5 MB/s | 16 kB 00:00 2026-02-12T03:48:03.311 INFO:teuthology.orchestra.run.trial154.stdout:(84/95): python3-pyOpenSSL-21.0.0-1.el9.noarch. 7.7 MB/s | 90 kB 00:00 2026-02-12T03:48:03.317 INFO:teuthology.orchestra.run.trial154.stdout:(85/95): python3-repoze-lru-0.7-16.el9.noarch.r 2.8 MB/s | 31 kB 00:00 2026-02-12T03:48:03.324 INFO:teuthology.orchestra.run.trial154.stdout:(86/95): python3-routes-2.5.1-5.el9.noarch.rpm 15 MB/s | 188 kB 00:00 2026-02-12T03:48:03.328 INFO:teuthology.orchestra.run.trial154.stdout:(87/95): python3-rsa-4.9-2.el9.noarch.rpm 5.2 MB/s | 59 kB 00:00 2026-02-12T03:48:03.336 INFO:teuthology.orchestra.run.trial154.stdout:(88/95): python3-saml-1.16.0-1.el9.noarch.rpm 10 MB/s | 125 kB 00:00 2026-02-12T03:48:03.339 INFO:teuthology.orchestra.run.trial154.stdout:(89/95): python3-tempora-5.0.0-2.el9.noarch.rpm 3.2 MB/s | 36 kB 00:00 2026-02-12T03:48:03.347 INFO:teuthology.orchestra.run.trial154.stdout:(90/95): python3-typing-extensions-4.15.0-1.el9 7.8 MB/s | 86 kB 00:00 2026-02-12T03:48:03.350 INFO:teuthology.orchestra.run.trial154.stdout:(91/95): python3-websocket-client-1.2.3-2.el9.n 7.5 MB/s | 90 kB 00:00 2026-02-12T03:48:03.358 INFO:teuthology.orchestra.run.trial154.stdout:(92/95): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 4.3 MB/s | 48 kB 00:00 2026-02-12T03:48:03.361 INFO:teuthology.orchestra.run.trial154.stdout:(93/95): python3-xmltodict-0.12.0-15.el9.noarch 2.0 MB/s | 22 kB 00:00 2026-02-12T03:48:03.370 INFO:teuthology.orchestra.run.trial154.stdout:(94/95): python3-zc-lockfile-2.0-10.el9.noarch. 1.7 MB/s | 20 kB 00:00 2026-02-12T03:48:03.378 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:00:40 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:48:03.393 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-626.g1279775f.el9.noarch 86/95 2026-02-12T03:48:03.398 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-626.g1279775f.el9.noar 87/95 2026-02-12T03:48:03.443 INFO:teuthology.orchestra.run.trial091.stdout:Package ceph-base-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:48:03.461 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:48:03.461 INFO:teuthology.orchestra.run.trial091.stdout:Nothing to do. 2026-02-12T03:48:03.462 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:48:03.483 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install cephadm 2026-02-12T03:48:03.533 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:43 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:48:03.597 INFO:teuthology.orchestra.run.trial098.stdout:Package ceph-mgr-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:48:03.615 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:48:03.616 INFO:teuthology.orchestra.run.trial098.stdout:Nothing to do. 2026-02-12T03:48:03.616 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:48:03.638 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install ceph-mgr-dashboard 2026-02-12T03:48:03.759 INFO:teuthology.orchestra.run.trial154.stdout:(95/95): protobuf-compiler-3.14.0-17.el9.x86_64 1.1 MB/s | 862 kB 00:00 2026-02-12T03:48:03.764 INFO:teuthology.orchestra.run.trial154.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:48:03.764 INFO:teuthology.orchestra.run.trial154.stdout:Total 19 MB/s | 101 MB 00:05 2026-02-12T03:48:03.782 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:00:40 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:48:03.847 INFO:teuthology.orchestra.run.trial091.stdout:Package cephadm-2:20.2.0-626.g1279775f.el9.noarch is already installed. 2026-02-12T03:48:03.856 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-626.g1279775f.el9.noar 87/95 2026-02-12T03:48:03.857 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-626.g127977 88/95 2026-02-12T03:48:03.865 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:48:03.866 INFO:teuthology.orchestra.run.trial091.stdout:Nothing to do. 2026-02-12T03:48:03.866 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:48:03.869 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-626.g127977 88/95 2026-02-12T03:48:03.870 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-mgr-k8sevents-2:20.2.0-626.g1279775f.el9.noar 89/95 2026-02-12T03:48:03.887 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install ceph-immutable-object-cache 2026-02-12T03:48:03.926 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.2.0-626.g1279775f.el9.noar 89/95 2026-02-12T03:48:03.939 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:43 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:48:03.970 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-626.g1279775f.el9.n 90/95 2026-02-12T03:48:03.971 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-mgr-2:20.2.0-626.g1279775f.el9.x86_64 91/95 2026-02-12T03:48:03.992 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-mgr-2:20.2.0-626.g1279775f.el9.x86_64 91/95 2026-02-12T03:48:03.992 INFO:teuthology.orchestra.run.trial111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T03:48:03.992 INFO:teuthology.orchestra.run.trial111.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-12T03:48:03.992 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T03:48:03.993 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T03:48:03.993 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:04.003 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-mgr-rook-2:20.2.0-626.g1279775f.el9.noarch 92/95 2026-02-12T03:48:04.005 INFO:teuthology.orchestra.run.trial098.stdout:Package ceph-mgr-dashboard-2:20.2.0-626.g1279775f.el9.noarch is already installed. 2026-02-12T03:48:04.024 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:48:04.024 INFO:teuthology.orchestra.run.trial098.stdout:Nothing to do. 2026-02-12T03:48:04.025 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:48:04.046 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-12T03:48:04.183 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:00:41 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:48:04.222 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction check 2026-02-12T03:48:04.231 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-626.g1279775f.el9.noarch 92/95 2026-02-12T03:48:04.232 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-mon-2:20.2.0-626.g1279775f.el9.x86_64 93/95 2026-02-12T03:48:04.254 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-mon-2:20.2.0-626.g1279775f.el9.x86_64 93/95 2026-02-12T03:48:04.254 INFO:teuthology.orchestra.run.trial111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T03:48:04.254 INFO:teuthology.orchestra.run.trial111.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-12T03:48:04.254 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T03:48:04.255 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T03:48:04.255 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:04.259 INFO:teuthology.orchestra.run.trial154.stdout:Transaction check succeeded. 2026-02-12T03:48:04.259 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction test 2026-02-12T03:48:04.266 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:48:04.267 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:48:04.267 INFO:teuthology.orchestra.run.trial091.stdout: Package Arch Version Repo Size 2026-02-12T03:48:04.267 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:48:04.267 INFO:teuthology.orchestra.run.trial091.stdout:Installing: 2026-02-12T03:48:04.267 INFO:teuthology.orchestra.run.trial091.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-626.g1279775f.el9 ceph 154 k 2026-02-12T03:48:04.267 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:04.267 INFO:teuthology.orchestra.run.trial091.stdout:Transaction Summary 2026-02-12T03:48:04.267 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:48:04.267 INFO:teuthology.orchestra.run.trial091.stdout:Install 1 Package 2026-02-12T03:48:04.267 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:04.268 INFO:teuthology.orchestra.run.trial091.stdout:Total download size: 154 k 2026-02-12T03:48:04.268 INFO:teuthology.orchestra.run.trial091.stdout:Installed size: 447 k 2026-02-12T03:48:04.268 INFO:teuthology.orchestra.run.trial091.stdout:Downloading Packages: 2026-02-12T03:48:04.349 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:44 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:48:04.353 INFO:teuthology.orchestra.run.trial091.stdout:ceph-immutable-object-cache-20.2.0-626.g1279775 1.8 MB/s | 154 kB 00:00 2026-02-12T03:48:04.353 INFO:teuthology.orchestra.run.trial091.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:48:04.354 INFO:teuthology.orchestra.run.trial091.stdout:Total 1.7 MB/s | 154 kB 00:00 2026-02-12T03:48:04.354 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction check 2026-02-12T03:48:04.354 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-mds-2:20.2.0-626.g1279775f.el9.x86_64 94/95 2026-02-12T03:48:04.358 INFO:teuthology.orchestra.run.trial091.stdout:Transaction check succeeded. 2026-02-12T03:48:04.358 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction test 2026-02-12T03:48:04.376 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-mds-2:20.2.0-626.g1279775f.el9.x86_64 94/95 2026-02-12T03:48:04.376 INFO:teuthology.orchestra.run.trial111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T03:48:04.376 INFO:teuthology.orchestra.run.trial111.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-12T03:48:04.376 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T03:48:04.376 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T03:48:04.376 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:04.391 INFO:teuthology.orchestra.run.trial091.stdout:Transaction test succeeded. 2026-02-12T03:48:04.391 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction 2026-02-12T03:48:04.394 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-2:20.2.0-626.g1279775f.el9.x86_64 95/95 2026-02-12T03:48:04.413 INFO:teuthology.orchestra.run.trial098.stdout:Package ceph-mgr-diskprediction-local-2:20.2.0-626.g1279775f.el9.noarch is already installed. 2026-02-12T03:48:04.431 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:48:04.432 INFO:teuthology.orchestra.run.trial098.stdout:Nothing to do. 2026-02-12T03:48:04.432 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:48:04.448 INFO:teuthology.orchestra.run.trial091.stdout: Preparing : 1/1 2026-02-12T03:48:04.450 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-626.g1279775f.e 1/1 2026-02-12T03:48:04.453 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install ceph-mgr-rook 2026-02-12T03:48:04.472 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-626.g1279775f.e 1/1 2026-02-12T03:48:04.472 INFO:teuthology.orchestra.run.trial091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T03:48:04.472 INFO:teuthology.orchestra.run.trial091.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-12T03:48:04.472 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:04.691 INFO:teuthology.orchestra.run.trial154.stdout:Transaction test succeeded. 2026-02-12T03:48:04.691 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction 2026-02-12T03:48:04.757 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:44 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:48:04.765 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-626.g1279775f.e 1/1 2026-02-12T03:48:04.765 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:04.765 INFO:teuthology.orchestra.run.trial091.stdout:Installed: 2026-02-12T03:48:04.765 INFO:teuthology.orchestra.run.trial091.stdout: ceph-immutable-object-cache-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:04.765 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:04.765 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:48:04.792 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install ceph-mgr 2026-02-12T03:48:04.822 INFO:teuthology.orchestra.run.trial098.stdout:Package ceph-mgr-rook-2:20.2.0-626.g1279775f.el9.noarch is already installed. 2026-02-12T03:48:04.840 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:48:04.840 INFO:teuthology.orchestra.run.trial098.stdout:Nothing to do. 2026-02-12T03:48:04.841 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:48:04.862 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install ceph-mgr-cephadm 2026-02-12T03:48:05.098 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:00:42 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:48:05.107 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-2:20.2.0-626.g1279775f.el9.x86_64 95/95 2026-02-12T03:48:05.107 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-2:20.2.0-626.g1279775f.el9.x86_64 1/95 2026-02-12T03:48:05.108 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-mds-2:20.2.0-626.g1279775f.el9.x86_64 2/95 2026-02-12T03:48:05.108 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-mgr-2:20.2.0-626.g1279775f.el9.x86_64 3/95 2026-02-12T03:48:05.108 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-mon-2:20.2.0-626.g1279775f.el9.x86_64 4/95 2026-02-12T03:48:05.108 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-osd-2:20.2.0-626.g1279775f.el9.x86_64 5/95 2026-02-12T03:48:05.108 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-626.g1279775f.el9 6/95 2026-02-12T03:48:05.108 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-626.g1279775f.el9.noarch 7/95 2026-02-12T03:48:05.108 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-626.g1279775f.el9.noar 8/95 2026-02-12T03:48:05.108 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-626.g127977 9/95 2026-02-12T03:48:05.108 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-mgr-k8sevents-2:20.2.0-626.g1279775f.el9.noar 10/95 2026-02-12T03:48:05.108 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-626.g1279775f.el9.n 11/95 2026-02-12T03:48:05.108 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-mgr-rook-2:20.2.0-626.g1279775f.el9.noarch 12/95 2026-02-12T03:48:05.109 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-626.g1279775f.el9. 13/95 2026-02-12T03:48:05.109 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-volume-2:20.2.0-626.g1279775f.el9.noarch 14/95 2026-02-12T03:48:05.109 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : cephadm-2:20.2.0-626.g1279775f.el9.noarch 15/95 2026-02-12T03:48:05.109 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/95 2026-02-12T03:48:05.109 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/95 2026-02-12T03:48:05.109 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/95 2026-02-12T03:48:05.109 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/95 2026-02-12T03:48:05.109 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/95 2026-02-12T03:48:05.109 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/95 2026-02-12T03:48:05.109 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/95 2026-02-12T03:48:05.109 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/95 2026-02-12T03:48:05.109 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/95 2026-02-12T03:48:05.110 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/95 2026-02-12T03:48:05.110 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/95 2026-02-12T03:48:05.110 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/95 2026-02-12T03:48:05.110 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/95 2026-02-12T03:48:05.110 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : zip-3.0-35.el9.x86_64 29/95 2026-02-12T03:48:05.110 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 30/95 2026-02-12T03:48:05.110 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 31/95 2026-02-12T03:48:05.110 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 32/95 2026-02-12T03:48:05.110 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/95 2026-02-12T03:48:05.110 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/95 2026-02-12T03:48:05.110 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/95 2026-02-12T03:48:05.110 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/95 2026-02-12T03:48:05.110 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/95 2026-02-12T03:48:05.111 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/95 2026-02-12T03:48:05.111 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/95 2026-02-12T03:48:05.111 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/95 2026-02-12T03:48:05.111 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 41/95 2026-02-12T03:48:05.111 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 42/95 2026-02-12T03:48:05.111 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 43/95 2026-02-12T03:48:05.111 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/95 2026-02-12T03:48:05.111 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/95 2026-02-12T03:48:05.111 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/95 2026-02-12T03:48:05.111 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/95 2026-02-12T03:48:05.111 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/95 2026-02-12T03:48:05.111 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/95 2026-02-12T03:48:05.111 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/95 2026-02-12T03:48:05.112 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/95 2026-02-12T03:48:05.112 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/95 2026-02-12T03:48:05.112 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/95 2026-02-12T03:48:05.112 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/95 2026-02-12T03:48:05.112 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/95 2026-02-12T03:48:05.112 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/95 2026-02-12T03:48:05.112 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/95 2026-02-12T03:48:05.112 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/95 2026-02-12T03:48:05.112 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/95 2026-02-12T03:48:05.112 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/95 2026-02-12T03:48:05.112 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/95 2026-02-12T03:48:05.112 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/95 2026-02-12T03:48:05.112 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/95 2026-02-12T03:48:05.112 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/95 2026-02-12T03:48:05.113 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/95 2026-02-12T03:48:05.113 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/95 2026-02-12T03:48:05.113 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/95 2026-02-12T03:48:05.113 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/95 2026-02-12T03:48:05.113 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/95 2026-02-12T03:48:05.113 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/95 2026-02-12T03:48:05.113 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/95 2026-02-12T03:48:05.113 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/95 2026-02-12T03:48:05.113 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/95 2026-02-12T03:48:05.113 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/95 2026-02-12T03:48:05.113 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/95 2026-02-12T03:48:05.113 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/95 2026-02-12T03:48:05.113 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/95 2026-02-12T03:48:05.114 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/95 2026-02-12T03:48:05.114 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/95 2026-02-12T03:48:05.114 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/95 2026-02-12T03:48:05.114 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 81/95 2026-02-12T03:48:05.114 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 82/95 2026-02-12T03:48:05.114 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 83/95 2026-02-12T03:48:05.114 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 84/95 2026-02-12T03:48:05.114 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 85/95 2026-02-12T03:48:05.114 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 86/95 2026-02-12T03:48:05.114 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 87/95 2026-02-12T03:48:05.114 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 88/95 2026-02-12T03:48:05.114 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 89/95 2026-02-12T03:48:05.114 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 90/95 2026-02-12T03:48:05.115 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 91/95 2026-02-12T03:48:05.115 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 92/95 2026-02-12T03:48:05.115 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 93/95 2026-02-12T03:48:05.115 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 94/95 2026-02-12T03:48:05.160 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:45 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:48:05.161 INFO:teuthology.orchestra.run.trial154.stdout: Preparing : 1/1 2026-02-12T03:48:05.163 INFO:teuthology.orchestra.run.trial091.stdout:Package ceph-mgr-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:48:05.163 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/95 2026-02-12T03:48:05.167 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/95 2026-02-12T03:48:05.168 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 95/95 2026-02-12T03:48:05.168 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:05.169 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T03:48:05.169 INFO:teuthology.orchestra.run.trial111.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-12T03:48:05.169 INFO:teuthology.orchestra.run.trial111.stdout: ceph-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:05.169 INFO:teuthology.orchestra.run.trial111.stdout: ceph-grafana-dashboards-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:05.169 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mds-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:05.169 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:05.169 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-cephadm-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:05.169 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-dashboard-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:05.169 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-diskprediction-local-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:05.169 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-k8sevents-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:05.169 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-modules-core-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:05.170 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-rook-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:05.170 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mon-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:05.170 INFO:teuthology.orchestra.run.trial111.stdout: ceph-osd-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:05.170 INFO:teuthology.orchestra.run.trial111.stdout: ceph-prometheus-alerts-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:05.170 INFO:teuthology.orchestra.run.trial111.stdout: ceph-volume-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:05.170 INFO:teuthology.orchestra.run.trial111.stdout: cephadm-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:05.170 INFO:teuthology.orchestra.run.trial111.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-12T03:48:05.170 INFO:teuthology.orchestra.run.trial111.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-12T03:48:05.170 INFO:teuthology.orchestra.run.trial111.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-12T03:48:05.170 INFO:teuthology.orchestra.run.trial111.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-12T03:48:05.170 INFO:teuthology.orchestra.run.trial111.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-12T03:48:05.170 INFO:teuthology.orchestra.run.trial111.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-12T03:48:05.171 INFO:teuthology.orchestra.run.trial111.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-12T03:48:05.171 INFO:teuthology.orchestra.run.trial111.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-12T03:48:05.171 INFO:teuthology.orchestra.run.trial111.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-12T03:48:05.171 INFO:teuthology.orchestra.run.trial111.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T03:48:05.171 INFO:teuthology.orchestra.run.trial111.stdout: lua-5.4.4-4.el9.x86_64 2026-02-12T03:48:05.171 INFO:teuthology.orchestra.run.trial111.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-12T03:48:05.171 INFO:teuthology.orchestra.run.trial111.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-12T03:48:05.171 INFO:teuthology.orchestra.run.trial111.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-12T03:48:05.171 INFO:teuthology.orchestra.run.trial111.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-12T03:48:05.171 INFO:teuthology.orchestra.run.trial111.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-12T03:48:05.171 INFO:teuthology.orchestra.run.trial111.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-12T03:48:05.171 INFO:teuthology.orchestra.run.trial111.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-12T03:48:05.171 INFO:teuthology.orchestra.run.trial111.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-12T03:48:05.172 INFO:teuthology.orchestra.run.trial111.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-12T03:48:05.172 INFO:teuthology.orchestra.run.trial111.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-12T03:48:05.172 INFO:teuthology.orchestra.run.trial111.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-12T03:48:05.172 INFO:teuthology.orchestra.run.trial111.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-12T03:48:05.172 INFO:teuthology.orchestra.run.trial111.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-12T03:48:05.172 INFO:teuthology.orchestra.run.trial111.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-12T03:48:05.172 INFO:teuthology.orchestra.run.trial111.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-12T03:48:05.172 INFO:teuthology.orchestra.run.trial111.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-12T03:48:05.172 INFO:teuthology.orchestra.run.trial111.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-12T03:48:05.172 INFO:teuthology.orchestra.run.trial111.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-12T03:48:05.172 INFO:teuthology.orchestra.run.trial111.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-12T03:48:05.172 INFO:teuthology.orchestra.run.trial111.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-12T03:48:05.173 INFO:teuthology.orchestra.run.trial111.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-12T03:48:05.173 INFO:teuthology.orchestra.run.trial111.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-12T03:48:05.173 INFO:teuthology.orchestra.run.trial111.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-12T03:48:05.173 INFO:teuthology.orchestra.run.trial111.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-12T03:48:05.173 INFO:teuthology.orchestra.run.trial111.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-12T03:48:05.173 INFO:teuthology.orchestra.run.trial111.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-12T03:48:05.173 INFO:teuthology.orchestra.run.trial111.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-12T03:48:05.173 INFO:teuthology.orchestra.run.trial111.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-12T03:48:05.173 INFO:teuthology.orchestra.run.trial111.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-12T03:48:05.173 INFO:teuthology.orchestra.run.trial111.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-12T03:48:05.173 INFO:teuthology.orchestra.run.trial111.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-12T03:48:05.173 INFO:teuthology.orchestra.run.trial111.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-12T03:48:05.174 INFO:teuthology.orchestra.run.trial111.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T03:48:05.174 INFO:teuthology.orchestra.run.trial111.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-12T03:48:05.174 INFO:teuthology.orchestra.run.trial111.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-12T03:48:05.174 INFO:teuthology.orchestra.run.trial111.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-12T03:48:05.174 INFO:teuthology.orchestra.run.trial111.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-12T03:48:05.174 INFO:teuthology.orchestra.run.trial111.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-12T03:48:05.174 INFO:teuthology.orchestra.run.trial111.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-12T03:48:05.174 INFO:teuthology.orchestra.run.trial111.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-12T03:48:05.174 INFO:teuthology.orchestra.run.trial111.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-12T03:48:05.174 INFO:teuthology.orchestra.run.trial111.stdout: python3-ply-3.11-14.el9.noarch 2026-02-12T03:48:05.174 INFO:teuthology.orchestra.run.trial111.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-12T03:48:05.174 INFO:teuthology.orchestra.run.trial111.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-12T03:48:05.174 INFO:teuthology.orchestra.run.trial111.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-12T03:48:05.175 INFO:teuthology.orchestra.run.trial111.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-12T03:48:05.175 INFO:teuthology.orchestra.run.trial111.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-12T03:48:05.175 INFO:teuthology.orchestra.run.trial111.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-12T03:48:05.175 INFO:teuthology.orchestra.run.trial111.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-12T03:48:05.175 INFO:teuthology.orchestra.run.trial111.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-12T03:48:05.175 INFO:teuthology.orchestra.run.trial111.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-12T03:48:05.175 INFO:teuthology.orchestra.run.trial111.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-12T03:48:05.175 INFO:teuthology.orchestra.run.trial111.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-12T03:48:05.175 INFO:teuthology.orchestra.run.trial111.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-12T03:48:05.175 INFO:teuthology.orchestra.run.trial111.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-12T03:48:05.175 INFO:teuthology.orchestra.run.trial111.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-12T03:48:05.175 INFO:teuthology.orchestra.run.trial111.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-12T03:48:05.175 INFO:teuthology.orchestra.run.trial111.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-12T03:48:05.176 INFO:teuthology.orchestra.run.trial111.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-12T03:48:05.176 INFO:teuthology.orchestra.run.trial111.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-12T03:48:05.176 INFO:teuthology.orchestra.run.trial111.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-12T03:48:05.176 INFO:teuthology.orchestra.run.trial111.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-12T03:48:05.176 INFO:teuthology.orchestra.run.trial111.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-12T03:48:05.176 INFO:teuthology.orchestra.run.trial111.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-12T03:48:05.176 INFO:teuthology.orchestra.run.trial111.stdout: unzip-6.0-59.el9.x86_64 2026-02-12T03:48:05.176 INFO:teuthology.orchestra.run.trial111.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-12T03:48:05.176 INFO:teuthology.orchestra.run.trial111.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-12T03:48:05.176 INFO:teuthology.orchestra.run.trial111.stdout: zip-3.0-35.el9.x86_64 2026-02-12T03:48:05.176 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:05.176 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:48:05.183 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:48:05.184 INFO:teuthology.orchestra.run.trial091.stdout:Nothing to do. 2026-02-12T03:48:05.184 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:48:05.188 INFO:teuthology.orchestra.run.trial154.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 3/95 2026-02-12T03:48:05.206 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install ceph-mgr-dashboard 2026-02-12T03:48:05.221 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 4/95 2026-02-12T03:48:05.224 INFO:teuthology.orchestra.run.trial098.stdout:Package ceph-mgr-cephadm-2:20.2.0-626.g1279775f.el9.noarch is already installed. 2026-02-12T03:48:05.226 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-base 2026-02-12T03:48:05.231 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 5/95 2026-02-12T03:48:05.236 INFO:teuthology.orchestra.run.trial154.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 6/95 2026-02-12T03:48:05.238 INFO:teuthology.orchestra.run.trial154.stdout: Installing : lua-5.4.4-4.el9.x86_64 7/95 2026-02-12T03:48:05.242 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:48:05.243 INFO:teuthology.orchestra.run.trial098.stdout:Nothing to do. 2026-02-12T03:48:05.243 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:48:05.243 INFO:teuthology.orchestra.run.trial154.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 8/95 2026-02-12T03:48:05.264 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install ceph-fuse 2026-02-12T03:48:05.265 INFO:teuthology.orchestra.run.trial154.stdout: Installing : unzip-6.0-59.el9.x86_64 9/95 2026-02-12T03:48:05.278 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 10/95 2026-02-12T03:48:05.281 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 11/95 2026-02-12T03:48:05.287 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 12/95 2026-02-12T03:48:05.289 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 13/95 2026-02-12T03:48:05.300 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 14/95 2026-02-12T03:48:05.306 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 15/95 2026-02-12T03:48:05.330 INFO:teuthology.orchestra.run.trial154.stdout: Installing : zip-3.0-35.el9.x86_64 16/95 2026-02-12T03:48:05.333 INFO:teuthology.orchestra.run.trial154.stdout: Installing : luarocks-3.9.2-5.el9.noarch 17/95 2026-02-12T03:48:05.340 INFO:teuthology.orchestra.run.trial154.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 18/95 2026-02-12T03:48:05.391 INFO:teuthology.orchestra.run.trial154.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 19/95 2026-02-12T03:48:05.403 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 20/95 2026-02-12T03:48:05.407 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-rsa-4.9-2.el9.noarch 21/95 2026-02-12T03:48:05.411 INFO:teuthology.orchestra.run.trial154.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 22/95 2026-02-12T03:48:05.417 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 23/95 2026-02-12T03:48:05.421 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 24/95 2026-02-12T03:48:05.424 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 25/95 2026-02-12T03:48:05.439 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 26/95 2026-02-12T03:48:05.443 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 27/95 2026-02-12T03:48:05.448 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 28/95 2026-02-12T03:48:05.460 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 29/95 2026-02-12T03:48:05.469 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 30/95 2026-02-12T03:48:05.475 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 31/95 2026-02-12T03:48:05.494 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 32/95 2026-02-12T03:48:05.505 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 33/95 2026-02-12T03:48:05.507 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:00:42 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:48:05.521 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 34/95 2026-02-12T03:48:05.525 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 35/95 2026-02-12T03:48:05.532 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:46 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:48:05.533 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 36/95 2026-02-12T03:48:05.566 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:45 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:48:05.573 INFO:teuthology.orchestra.run.trial091.stdout:Package ceph-mgr-dashboard-2:20.2.0-626.g1279775f.el9.noarch is already installed. 2026-02-12T03:48:05.573 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 37/95 2026-02-12T03:48:05.591 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:48:05.592 INFO:teuthology.orchestra.run.trial091.stdout:Nothing to do. 2026-02-12T03:48:05.592 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:48:05.598 INFO:teuthology.orchestra.run.trial111.stdout:Package ceph-base-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:48:05.613 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-12T03:48:05.616 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:48:05.616 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-12T03:48:05.617 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:48:05.639 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install cephadm 2026-02-12T03:48:05.650 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:48:05.651 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:48:05.651 INFO:teuthology.orchestra.run.trial098.stdout: Package Architecture Version Repository Size 2026-02-12T03:48:05.651 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:48:05.651 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-12T03:48:05.651 INFO:teuthology.orchestra.run.trial098.stdout: ceph-fuse x86_64 2:20.2.0-626.g1279775f.el9 ceph 943 k 2026-02-12T03:48:05.651 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:05.651 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-12T03:48:05.651 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:48:05.652 INFO:teuthology.orchestra.run.trial098.stdout:Install 1 Package 2026-02-12T03:48:05.652 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:05.652 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 943 k 2026-02-12T03:48:05.652 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 2.7 M 2026-02-12T03:48:05.652 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-12T03:48:05.769 INFO:teuthology.orchestra.run.trial098.stdout:ceph-fuse-20.2.0-626.g1279775f.el9.x86_64.rpm 7.9 MB/s | 943 kB 00:00 2026-02-12T03:48:05.769 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:48:05.769 INFO:teuthology.orchestra.run.trial098.stdout:Total 7.8 MB/s | 943 kB 00:00 2026-02-12T03:48:05.769 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-12T03:48:05.774 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-12T03:48:05.774 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-12T03:48:05.808 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-12T03:48:05.808 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-12T03:48:05.898 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-12T03:48:05.899 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 38/95 2026-02-12T03:48:05.909 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 39/95 2026-02-12T03:48:05.913 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 40/95 2026-02-12T03:48:05.914 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:00:42 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:48:05.915 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-fuse-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:05.919 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 41/95 2026-02-12T03:48:05.921 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 42/95 2026-02-12T03:48:05.942 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:46 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:48:05.947 INFO:teuthology.orchestra.run.trial154.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 43/95 2026-02-12T03:48:05.978 INFO:teuthology.orchestra.run.trial091.stdout:Package ceph-mgr-diskprediction-local-2:20.2.0-626.g1279775f.el9.noarch is already installed. 2026-02-12T03:48:05.990 INFO:teuthology.orchestra.run.trial154.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 44/95 2026-02-12T03:48:05.996 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:48:05.997 INFO:teuthology.orchestra.run.trial091.stdout:Nothing to do. 2026-02-12T03:48:05.997 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:48:05.998 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 45/95 2026-02-12T03:48:06.001 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 46/95 2026-02-12T03:48:06.006 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 47/95 2026-02-12T03:48:06.009 INFO:teuthology.orchestra.run.trial111.stdout:Package cephadm-2:20.2.0-626.g1279775f.el9.noarch is already installed. 2026-02-12T03:48:06.010 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 48/95 2026-02-12T03:48:06.017 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 49/95 2026-02-12T03:48:06.019 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install ceph-mgr-rook 2026-02-12T03:48:06.021 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 50/95 2026-02-12T03:48:06.027 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:48:06.028 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-12T03:48:06.028 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:48:06.049 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-immutable-object-cache 2026-02-12T03:48:06.050 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 51/95 2026-02-12T03:48:06.058 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 52/95 2026-02-12T03:48:06.064 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 53/95 2026-02-12T03:48:06.071 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 54/95 2026-02-12T03:48:06.105 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 55/95 2026-02-12T03:48:06.162 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-fuse-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:06.219 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-fuse-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:06.220 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:06.220 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-12T03:48:06.220 INFO:teuthology.orchestra.run.trial098.stdout: ceph-fuse-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:06.220 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:06.220 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:48:06.247 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install ceph-volume 2026-02-12T03:48:06.318 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:00:43 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:48:06.328 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 56/95 2026-02-12T03:48:06.351 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 57/95 2026-02-12T03:48:06.353 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:47 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:48:06.355 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 58/95 2026-02-12T03:48:06.383 INFO:teuthology.orchestra.run.trial091.stdout:Package ceph-mgr-rook-2:20.2.0-626.g1279775f.el9.noarch is already installed. 2026-02-12T03:48:06.401 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:48:06.402 INFO:teuthology.orchestra.run.trial091.stdout:Nothing to do. 2026-02-12T03:48:06.402 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:48:06.413 INFO:teuthology.orchestra.run.trial154.stdout: Installing : openblas-0.3.29-1.el9.x86_64 59/95 2026-02-12T03:48:06.415 INFO:teuthology.orchestra.run.trial154.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 60/95 2026-02-12T03:48:06.423 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install ceph-mgr-cephadm 2026-02-12T03:48:06.436 INFO:teuthology.orchestra.run.trial154.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 61/95 2026-02-12T03:48:06.437 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:48:06.437 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:48:06.438 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repo Size 2026-02-12T03:48:06.438 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:48:06.438 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T03:48:06.438 INFO:teuthology.orchestra.run.trial111.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-626.g1279775f.el9 ceph 154 k 2026-02-12T03:48:06.438 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:06.438 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T03:48:06.438 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:48:06.438 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-12T03:48:06.438 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:06.438 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 154 k 2026-02-12T03:48:06.439 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 447 k 2026-02-12T03:48:06.439 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T03:48:06.525 INFO:teuthology.orchestra.run.trial111.stdout:ceph-immutable-object-cache-20.2.0-626.g1279775 1.7 MB/s | 154 kB 00:00 2026-02-12T03:48:06.526 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:48:06.526 INFO:teuthology.orchestra.run.trial111.stdout:Total 1.7 MB/s | 154 kB 00:00 2026-02-12T03:48:06.526 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T03:48:06.530 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T03:48:06.530 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T03:48:06.548 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:46 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:48:06.563 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T03:48:06.564 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T03:48:06.613 INFO:teuthology.orchestra.run.trial098.stdout:Package ceph-volume-2:20.2.0-626.g1279775f.el9.noarch is already installed. 2026-02-12T03:48:06.620 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T03:48:06.621 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-626.g1279775f.e 1/1 2026-02-12T03:48:06.631 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:48:06.632 INFO:teuthology.orchestra.run.trial098.stdout:Nothing to do. 2026-02-12T03:48:06.632 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:48:06.644 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-626.g1279775f.e 1/1 2026-02-12T03:48:06.644 INFO:teuthology.orchestra.run.trial111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T03:48:06.644 INFO:teuthology.orchestra.run.trial111.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-12T03:48:06.644 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:06.653 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install librados-devel 2026-02-12T03:48:06.728 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:00:43 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:48:06.762 INFO:teuthology.orchestra.run.trial154.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 62/95 2026-02-12T03:48:06.792 INFO:teuthology.orchestra.run.trial091.stdout:Package ceph-mgr-cephadm-2:20.2.0-626.g1279775f.el9.noarch is already installed. 2026-02-12T03:48:06.810 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:48:06.811 INFO:teuthology.orchestra.run.trial091.stdout:Nothing to do. 2026-02-12T03:48:06.811 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:48:06.833 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install ceph-fuse 2026-02-12T03:48:06.835 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 63/95 2026-02-12T03:48:06.912 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-626.g1279775f.e 1/1 2026-02-12T03:48:06.912 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:06.913 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T03:48:06.913 INFO:teuthology.orchestra.run.trial111.stdout: ceph-immutable-object-cache-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:06.913 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:06.913 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:48:06.939 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-mgr 2026-02-12T03:48:06.953 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:46 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:48:07.037 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:48:07.037 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:48:07.037 INFO:teuthology.orchestra.run.trial098.stdout: Package Arch Version Repo Size 2026-02-12T03:48:07.037 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:48:07.037 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-12T03:48:07.037 INFO:teuthology.orchestra.run.trial098.stdout: librados-devel x86_64 2:20.2.0-626.g1279775f.el9 ceph 126 k 2026-02-12T03:48:07.037 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:07.037 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-12T03:48:07.038 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:48:07.038 INFO:teuthology.orchestra.run.trial098.stdout:Install 1 Package 2026-02-12T03:48:07.038 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:07.038 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 126 k 2026-02-12T03:48:07.038 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 449 k 2026-02-12T03:48:07.038 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-12T03:48:07.121 INFO:teuthology.orchestra.run.trial098.stdout:librados-devel-20.2.0-626.g1279775f.el9.x86_64. 1.5 MB/s | 126 kB 00:00 2026-02-12T03:48:07.122 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:48:07.122 INFO:teuthology.orchestra.run.trial098.stdout:Total 1.4 MB/s | 126 kB 00:00 2026-02-12T03:48:07.122 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-12T03:48:07.125 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-12T03:48:07.125 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-12T03:48:07.135 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:00:44 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:48:07.157 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-12T03:48:07.157 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-12T03:48:07.212 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-12T03:48:07.218 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:48:07.219 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:48:07.219 INFO:teuthology.orchestra.run.trial091.stdout: Package Architecture Version Repository Size 2026-02-12T03:48:07.219 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:48:07.219 INFO:teuthology.orchestra.run.trial091.stdout:Installing: 2026-02-12T03:48:07.219 INFO:teuthology.orchestra.run.trial091.stdout: ceph-fuse x86_64 2:20.2.0-626.g1279775f.el9 ceph 943 k 2026-02-12T03:48:07.220 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:07.220 INFO:teuthology.orchestra.run.trial091.stdout:Transaction Summary 2026-02-12T03:48:07.220 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:48:07.220 INFO:teuthology.orchestra.run.trial091.stdout:Install 1 Package 2026-02-12T03:48:07.220 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:07.220 INFO:teuthology.orchestra.run.trial091.stdout:Total download size: 943 k 2026-02-12T03:48:07.220 INFO:teuthology.orchestra.run.trial091.stdout:Installed size: 2.7 M 2026-02-12T03:48:07.220 INFO:teuthology.orchestra.run.trial091.stdout:Downloading Packages: 2026-02-12T03:48:07.228 INFO:teuthology.orchestra.run.trial098.stdout: Installing : librados-devel-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:07.244 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:48 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:48:07.311 INFO:teuthology.orchestra.run.trial111.stdout:Package ceph-mgr-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:48:07.314 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: librados-devel-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:07.329 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:48:07.329 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-12T03:48:07.330 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:48:07.338 INFO:teuthology.orchestra.run.trial091.stdout:ceph-fuse-20.2.0-626.g1279775f.el9.x86_64.rpm 7.7 MB/s | 943 kB 00:00 2026-02-12T03:48:07.339 INFO:teuthology.orchestra.run.trial091.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:48:07.339 INFO:teuthology.orchestra.run.trial091.stdout:Total 7.7 MB/s | 943 kB 00:00 2026-02-12T03:48:07.339 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction check 2026-02-12T03:48:07.344 INFO:teuthology.orchestra.run.trial091.stdout:Transaction check succeeded. 2026-02-12T03:48:07.344 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction test 2026-02-12T03:48:07.352 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-mgr-dashboard 2026-02-12T03:48:07.372 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : librados-devel-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:07.372 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:07.372 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-12T03:48:07.372 INFO:teuthology.orchestra.run.trial098.stdout: librados-devel-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:07.372 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:07.372 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:48:07.379 INFO:teuthology.orchestra.run.trial091.stdout:Transaction test succeeded. 2026-02-12T03:48:07.379 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction 2026-02-12T03:48:07.401 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install libcephfs2 2026-02-12T03:48:07.469 INFO:teuthology.orchestra.run.trial091.stdout: Preparing : 1/1 2026-02-12T03:48:07.486 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-fuse-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:07.508 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 64/95 2026-02-12T03:48:07.525 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 65/95 2026-02-12T03:48:07.534 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 66/95 2026-02-12T03:48:07.541 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/95 2026-02-12T03:48:07.554 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-ply-3.11-14.el9.noarch 68/95 2026-02-12T03:48:07.570 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 69/95 2026-02-12T03:48:07.645 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 70/95 2026-02-12T03:48:07.653 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 71/95 2026-02-12T03:48:07.654 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:48 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:48:07.677 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 72/95 2026-02-12T03:48:07.706 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 73/95 2026-02-12T03:48:07.718 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:47 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:48:07.718 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-fuse-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:07.719 INFO:teuthology.orchestra.run.trial111.stdout:Package ceph-mgr-dashboard-2:20.2.0-626.g1279775f.el9.noarch is already installed. 2026-02-12T03:48:07.737 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:48:07.738 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-12T03:48:07.738 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:48:07.757 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 74/95 2026-02-12T03:48:07.760 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-12T03:48:07.763 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 75/95 2026-02-12T03:48:07.767 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 76/95 2026-02-12T03:48:07.769 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 77/95 2026-02-12T03:48:07.776 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-fuse-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:07.776 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:07.776 INFO:teuthology.orchestra.run.trial091.stdout:Installed: 2026-02-12T03:48:07.776 INFO:teuthology.orchestra.run.trial091.stdout: ceph-fuse-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:07.776 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:07.776 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:48:07.783 INFO:teuthology.orchestra.run.trial098.stdout:Package libcephfs2-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:48:07.788 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-12T03:48:07.788 INFO:teuthology.orchestra.run.trial154.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-12T03:48:07.788 INFO:teuthology.orchestra.run.trial154.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-12T03:48:07.788 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:07.796 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-12T03:48:07.801 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:48:07.802 INFO:teuthology.orchestra.run.trial098.stdout:Nothing to do. 2026-02-12T03:48:07.802 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:48:07.805 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install ceph-volume 2026-02-12T03:48:07.821 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 78/95 2026-02-12T03:48:07.822 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-12T03:48:07.822 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:07.824 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install libcephfs-devel 2026-02-12T03:48:07.859 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 79/95 2026-02-12T03:48:07.922 INFO:teuthology.orchestra.run.trial154.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 80/95 2026-02-12T03:48:07.924 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-volume-2:20.2.0-626.g1279775f.el9.noarch 81/95 2026-02-12T03:48:07.938 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-volume-2:20.2.0-626.g1279775f.el9.noarch 81/95 2026-02-12T03:48:07.938 INFO:teuthology.orchestra.run.trial154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T03:48:07.938 INFO:teuthology.orchestra.run.trial154.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-12T03:48:07.938 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:08.062 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:49 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:48:08.105 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:00:45 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:48:08.126 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:48 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:48:08.126 INFO:teuthology.orchestra.run.trial111.stdout:Package ceph-mgr-diskprediction-local-2:20.2.0-626.g1279775f.el9.noarch is already installed. 2026-02-12T03:48:08.145 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:48:08.145 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-12T03:48:08.146 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:48:08.168 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-mgr-rook 2026-02-12T03:48:08.170 INFO:teuthology.orchestra.run.trial091.stdout:Package ceph-volume-2:20.2.0-626.g1279775f.el9.noarch is already installed. 2026-02-12T03:48:08.188 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:48:08.189 INFO:teuthology.orchestra.run.trial091.stdout:Nothing to do. 2026-02-12T03:48:08.189 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:48:08.209 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:48:08.210 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:48:08.210 INFO:teuthology.orchestra.run.trial098.stdout: Package Arch Version Repo Size 2026-02-12T03:48:08.211 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:48:08.211 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-12T03:48:08.211 INFO:teuthology.orchestra.run.trial098.stdout: libcephfs-devel x86_64 2:20.2.0-626.g1279775f.el9 ceph 34 k 2026-02-12T03:48:08.211 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:08.211 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-12T03:48:08.211 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:48:08.211 INFO:teuthology.orchestra.run.trial098.stdout:Install 1 Package 2026-02-12T03:48:08.211 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:08.211 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 34 k 2026-02-12T03:48:08.211 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 155 k 2026-02-12T03:48:08.211 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-12T03:48:08.212 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install librados-devel 2026-02-12T03:48:08.275 INFO:teuthology.orchestra.run.trial098.stdout:libcephfs-devel-20.2.0-626.g1279775f.el9.x86_64 528 kB/s | 34 kB 00:00 2026-02-12T03:48:08.276 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:48:08.276 INFO:teuthology.orchestra.run.trial098.stdout:Total 521 kB/s | 34 kB 00:00 2026-02-12T03:48:08.276 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-12T03:48:08.278 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-12T03:48:08.278 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-12T03:48:08.280 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-12T03:48:08.280 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-12T03:48:08.301 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-12T03:48:08.317 INFO:teuthology.orchestra.run.trial098.stdout: Installing : libcephfs-devel-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:08.372 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:08.428 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : libcephfs-devel-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:08.428 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:08.429 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-12T03:48:08.429 INFO:teuthology.orchestra.run.trial098.stdout: libcephfs-devel-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:08.429 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:08.429 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:48:08.456 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install librados2 2026-02-12T03:48:08.467 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:49 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:48:08.506 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:00:45 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:48:08.532 INFO:teuthology.orchestra.run.trial111.stdout:Package ceph-mgr-rook-2:20.2.0-626.g1279775f.el9.noarch is already installed. 2026-02-12T03:48:08.550 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:48:08.551 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-12T03:48:08.551 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:48:08.572 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-mgr-cephadm 2026-02-12T03:48:08.589 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:48:08.590 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:48:08.590 INFO:teuthology.orchestra.run.trial091.stdout: Package Arch Version Repo Size 2026-02-12T03:48:08.591 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:48:08.591 INFO:teuthology.orchestra.run.trial091.stdout:Installing: 2026-02-12T03:48:08.591 INFO:teuthology.orchestra.run.trial091.stdout: librados-devel x86_64 2:20.2.0-626.g1279775f.el9 ceph 126 k 2026-02-12T03:48:08.591 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:08.591 INFO:teuthology.orchestra.run.trial091.stdout:Transaction Summary 2026-02-12T03:48:08.591 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:48:08.591 INFO:teuthology.orchestra.run.trial091.stdout:Install 1 Package 2026-02-12T03:48:08.591 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:08.591 INFO:teuthology.orchestra.run.trial091.stdout:Total download size: 126 k 2026-02-12T03:48:08.591 INFO:teuthology.orchestra.run.trial091.stdout:Installed size: 449 k 2026-02-12T03:48:08.591 INFO:teuthology.orchestra.run.trial091.stdout:Downloading Packages: 2026-02-12T03:48:08.643 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-osd-2:20.2.0-626.g1279775f.el9.x86_64 82/95 2026-02-12T03:48:08.668 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-osd-2:20.2.0-626.g1279775f.el9.x86_64 82/95 2026-02-12T03:48:08.668 INFO:teuthology.orchestra.run.trial154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T03:48:08.668 INFO:teuthology.orchestra.run.trial154.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-12T03:48:08.669 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T03:48:08.669 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T03:48:08.669 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:08.676 INFO:teuthology.orchestra.run.trial091.stdout:librados-devel-20.2.0-626.g1279775f.el9.x86_64. 1.4 MB/s | 126 kB 00:00 2026-02-12T03:48:08.677 INFO:teuthology.orchestra.run.trial091.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:48:08.677 INFO:teuthology.orchestra.run.trial091.stdout:Total 1.4 MB/s | 126 kB 00:00 2026-02-12T03:48:08.677 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction check 2026-02-12T03:48:08.679 INFO:teuthology.orchestra.run.trial091.stdout:Transaction check succeeded. 2026-02-12T03:48:08.679 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction test 2026-02-12T03:48:08.711 INFO:teuthology.orchestra.run.trial091.stdout:Transaction test succeeded. 2026-02-12T03:48:08.711 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction 2026-02-12T03:48:08.730 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: cephadm-2:20.2.0-626.g1279775f.el9.noarch 83/95 2026-02-12T03:48:08.732 INFO:teuthology.orchestra.run.trial154.stdout: Installing : cephadm-2:20.2.0-626.g1279775f.el9.noarch 83/95 2026-02-12T03:48:08.739 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-prometheus-alerts-2:20.2.0-626.g1279775f.el9. 84/95 2026-02-12T03:48:08.756 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:48 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:48:08.762 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-grafana-dashboards-2:20.2.0-626.g1279775f.el9 85/95 2026-02-12T03:48:08.763 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-mgr-cephadm-2:20.2.0-626.g1279775f.el9.noarch 86/95 2026-02-12T03:48:08.765 INFO:teuthology.orchestra.run.trial091.stdout: Preparing : 1/1 2026-02-12T03:48:08.782 INFO:teuthology.orchestra.run.trial091.stdout: Installing : librados-devel-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:08.821 INFO:teuthology.orchestra.run.trial098.stdout:Package librados2-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:48:08.839 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:48:08.839 INFO:teuthology.orchestra.run.trial098.stdout:Nothing to do. 2026-02-12T03:48:08.840 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:48:08.858 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: librados-devel-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:08.860 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install librbd1 2026-02-12T03:48:08.872 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:49 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:48:08.915 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : librados-devel-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:08.915 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:08.915 INFO:teuthology.orchestra.run.trial091.stdout:Installed: 2026-02-12T03:48:08.915 INFO:teuthology.orchestra.run.trial091.stdout: librados-devel-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:08.915 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:08.915 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:48:08.938 INFO:teuthology.orchestra.run.trial111.stdout:Package ceph-mgr-cephadm-2:20.2.0-626.g1279775f.el9.noarch is already installed. 2026-02-12T03:48:08.941 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install libcephfs2 2026-02-12T03:48:08.957 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:48:08.957 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-12T03:48:08.957 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:48:08.979 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-fuse 2026-02-12T03:48:09.162 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:49 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:48:09.227 INFO:teuthology.orchestra.run.trial098.stdout:Package librbd1-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:48:09.242 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:00:46 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:48:09.245 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:48:09.245 INFO:teuthology.orchestra.run.trial098.stdout:Nothing to do. 2026-02-12T03:48:09.246 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:48:09.266 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install python3-rados 2026-02-12T03:48:09.281 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:50 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:48:09.309 INFO:teuthology.orchestra.run.trial091.stdout:Package libcephfs2-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:48:09.327 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:48:09.328 INFO:teuthology.orchestra.run.trial091.stdout:Nothing to do. 2026-02-12T03:48:09.328 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:48:09.349 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install libcephfs-devel 2026-02-12T03:48:09.366 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:48:09.366 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:48:09.367 INFO:teuthology.orchestra.run.trial111.stdout: Package Architecture Version Repository Size 2026-02-12T03:48:09.367 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:48:09.367 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T03:48:09.367 INFO:teuthology.orchestra.run.trial111.stdout: ceph-fuse x86_64 2:20.2.0-626.g1279775f.el9 ceph 943 k 2026-02-12T03:48:09.367 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:09.367 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T03:48:09.367 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:48:09.367 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-12T03:48:09.367 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:09.367 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 943 k 2026-02-12T03:48:09.368 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 2.7 M 2026-02-12T03:48:09.368 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T03:48:09.488 INFO:teuthology.orchestra.run.trial111.stdout:ceph-fuse-20.2.0-626.g1279775f.el9.x86_64.rpm 7.6 MB/s | 943 kB 00:00 2026-02-12T03:48:09.489 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:48:09.489 INFO:teuthology.orchestra.run.trial111.stdout:Total 7.5 MB/s | 943 kB 00:00 2026-02-12T03:48:09.489 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T03:48:09.494 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T03:48:09.494 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T03:48:09.528 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T03:48:09.528 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T03:48:09.566 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:49 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:48:09.617 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T03:48:09.632 INFO:teuthology.orchestra.run.trial098.stdout:Package python3-rados-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:48:09.634 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-fuse-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:09.649 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:00:46 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:48:09.651 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:48:09.651 INFO:teuthology.orchestra.run.trial098.stdout:Nothing to do. 2026-02-12T03:48:09.651 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:48:09.672 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install python3-rgw 2026-02-12T03:48:09.732 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:48:09.733 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:48:09.733 INFO:teuthology.orchestra.run.trial091.stdout: Package Arch Version Repo Size 2026-02-12T03:48:09.733 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:48:09.733 INFO:teuthology.orchestra.run.trial091.stdout:Installing: 2026-02-12T03:48:09.733 INFO:teuthology.orchestra.run.trial091.stdout: libcephfs-devel x86_64 2:20.2.0-626.g1279775f.el9 ceph 34 k 2026-02-12T03:48:09.733 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:09.733 INFO:teuthology.orchestra.run.trial091.stdout:Transaction Summary 2026-02-12T03:48:09.733 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:48:09.734 INFO:teuthology.orchestra.run.trial091.stdout:Install 1 Package 2026-02-12T03:48:09.734 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:09.734 INFO:teuthology.orchestra.run.trial091.stdout:Total download size: 34 k 2026-02-12T03:48:09.734 INFO:teuthology.orchestra.run.trial091.stdout:Installed size: 155 k 2026-02-12T03:48:09.734 INFO:teuthology.orchestra.run.trial091.stdout:Downloading Packages: 2026-02-12T03:48:09.797 INFO:teuthology.orchestra.run.trial091.stdout:libcephfs-devel-20.2.0-626.g1279775f.el9.x86_64 539 kB/s | 34 kB 00:00 2026-02-12T03:48:09.797 INFO:teuthology.orchestra.run.trial091.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:48:09.798 INFO:teuthology.orchestra.run.trial091.stdout:Total 531 kB/s | 34 kB 00:00 2026-02-12T03:48:09.798 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction check 2026-02-12T03:48:09.799 INFO:teuthology.orchestra.run.trial091.stdout:Transaction check succeeded. 2026-02-12T03:48:09.800 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction test 2026-02-12T03:48:09.802 INFO:teuthology.orchestra.run.trial091.stdout:Transaction test succeeded. 2026-02-12T03:48:09.802 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction 2026-02-12T03:48:09.823 INFO:teuthology.orchestra.run.trial091.stdout: Preparing : 1/1 2026-02-12T03:48:09.839 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libcephfs-devel-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:09.843 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-fuse-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:09.892 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:09.899 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-fuse-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:09.899 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:09.899 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T03:48:09.899 INFO:teuthology.orchestra.run.trial111.stdout: ceph-fuse-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:09.899 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:09.899 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:48:09.927 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-volume 2026-02-12T03:48:09.928 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.2.0-626.g1279775f.el9.noarch 86/95 2026-02-12T03:48:09.933 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-mgr-dashboard-2:20.2.0-626.g1279775f.el9.noar 87/95 2026-02-12T03:48:09.948 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libcephfs-devel-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:09.948 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:09.948 INFO:teuthology.orchestra.run.trial091.stdout:Installed: 2026-02-12T03:48:09.948 INFO:teuthology.orchestra.run.trial091.stdout: libcephfs-devel-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:09.948 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:09.949 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:48:09.969 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:49 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:48:09.975 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install librados2 2026-02-12T03:48:10.034 INFO:teuthology.orchestra.run.trial098.stdout:Package python3-rgw-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:48:10.052 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:48:10.052 INFO:teuthology.orchestra.run.trial098.stdout:Nothing to do. 2026-02-12T03:48:10.053 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:48:10.073 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install python3-cephfs 2026-02-12T03:48:10.227 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:51 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:48:10.271 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:00:47 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:48:10.292 INFO:teuthology.orchestra.run.trial111.stdout:Package ceph-volume-2:20.2.0-626.g1279775f.el9.noarch is already installed. 2026-02-12T03:48:10.311 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:48:10.311 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-12T03:48:10.311 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:48:10.334 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install librados-devel 2026-02-12T03:48:10.336 INFO:teuthology.orchestra.run.trial091.stdout:Package librados2-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:48:10.355 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:48:10.356 INFO:teuthology.orchestra.run.trial091.stdout:Nothing to do. 2026-02-12T03:48:10.356 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:48:10.371 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:50 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:48:10.377 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install librbd1 2026-02-12T03:48:10.396 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.2.0-626.g1279775f.el9.noar 87/95 2026-02-12T03:48:10.397 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-mgr-diskprediction-local-2:20.2.0-626.g127977 88/95 2026-02-12T03:48:10.410 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.2.0-626.g127977 88/95 2026-02-12T03:48:10.411 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-mgr-k8sevents-2:20.2.0-626.g1279775f.el9.noar 89/95 2026-02-12T03:48:10.435 INFO:teuthology.orchestra.run.trial098.stdout:Package python3-cephfs-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:48:10.453 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:48:10.454 INFO:teuthology.orchestra.run.trial098.stdout:Nothing to do. 2026-02-12T03:48:10.454 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:48:10.467 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-mgr-k8sevents-2:20.2.0-626.g1279775f.el9.noar 89/95 2026-02-12T03:48:10.475 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install python3-rbd 2026-02-12T03:48:10.512 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-mgr-modules-core-2:20.2.0-626.g1279775f.el9.n 90/95 2026-02-12T03:48:10.513 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-mgr-2:20.2.0-626.g1279775f.el9.x86_64 91/95 2026-02-12T03:48:10.535 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-mgr-2:20.2.0-626.g1279775f.el9.x86_64 91/95 2026-02-12T03:48:10.535 INFO:teuthology.orchestra.run.trial154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T03:48:10.535 INFO:teuthology.orchestra.run.trial154.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-12T03:48:10.535 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T03:48:10.535 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T03:48:10.536 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:10.547 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-mgr-rook-2:20.2.0-626.g1279775f.el9.noarch 92/95 2026-02-12T03:48:10.637 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:51 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:48:10.674 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:00:47 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:48:10.720 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:48:10.720 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:48:10.721 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repo Size 2026-02-12T03:48:10.721 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:48:10.721 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T03:48:10.721 INFO:teuthology.orchestra.run.trial111.stdout: librados-devel x86_64 2:20.2.0-626.g1279775f.el9 ceph 126 k 2026-02-12T03:48:10.721 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:10.721 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T03:48:10.721 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:48:10.721 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-12T03:48:10.721 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:10.722 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 126 k 2026-02-12T03:48:10.722 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 449 k 2026-02-12T03:48:10.722 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T03:48:10.739 INFO:teuthology.orchestra.run.trial091.stdout:Package librbd1-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:48:10.757 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:48:10.758 INFO:teuthology.orchestra.run.trial091.stdout:Nothing to do. 2026-02-12T03:48:10.758 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:48:10.778 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:50 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:48:10.779 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install python3-rados 2026-02-12T03:48:10.783 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-mgr-rook-2:20.2.0-626.g1279775f.el9.noarch 92/95 2026-02-12T03:48:10.785 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-mon-2:20.2.0-626.g1279775f.el9.x86_64 93/95 2026-02-12T03:48:10.806 INFO:teuthology.orchestra.run.trial111.stdout:librados-devel-20.2.0-626.g1279775f.el9.x86_64. 1.4 MB/s | 126 kB 00:00 2026-02-12T03:48:10.807 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:48:10.807 INFO:teuthology.orchestra.run.trial111.stdout:Total 1.4 MB/s | 126 kB 00:00 2026-02-12T03:48:10.807 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T03:48:10.808 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-mon-2:20.2.0-626.g1279775f.el9.x86_64 93/95 2026-02-12T03:48:10.808 INFO:teuthology.orchestra.run.trial154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T03:48:10.808 INFO:teuthology.orchestra.run.trial154.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-12T03:48:10.808 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T03:48:10.808 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T03:48:10.808 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:10.809 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T03:48:10.810 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T03:48:10.841 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T03:48:10.841 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T03:48:10.843 INFO:teuthology.orchestra.run.trial098.stdout:Package python3-rbd-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:48:10.861 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:48:10.862 INFO:teuthology.orchestra.run.trial098.stdout:Nothing to do. 2026-02-12T03:48:10.862 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:48:10.884 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install rbd-fuse 2026-02-12T03:48:10.895 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T03:48:10.908 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-mds-2:20.2.0-626.g1279775f.el9.x86_64 94/95 2026-02-12T03:48:10.912 INFO:teuthology.orchestra.run.trial111.stdout: Installing : librados-devel-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:10.929 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-mds-2:20.2.0-626.g1279775f.el9.x86_64 94/95 2026-02-12T03:48:10.929 INFO:teuthology.orchestra.run.trial154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T03:48:10.930 INFO:teuthology.orchestra.run.trial154.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-12T03:48:10.930 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T03:48:10.930 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T03:48:10.930 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:10.948 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-2:20.2.0-626.g1279775f.el9.x86_64 95/95 2026-02-12T03:48:10.999 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: librados-devel-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:11.062 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : librados-devel-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:11.062 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:11.063 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T03:48:11.063 INFO:teuthology.orchestra.run.trial111.stdout: librados-devel-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:11.063 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:11.063 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:48:11.080 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:00:48 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:48:11.091 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install libcephfs2 2026-02-12T03:48:11.145 INFO:teuthology.orchestra.run.trial091.stdout:Package python3-rados-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:48:11.163 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:48:11.163 INFO:teuthology.orchestra.run.trial091.stdout:Nothing to do. 2026-02-12T03:48:11.164 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:48:11.183 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:51 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:48:11.185 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install python3-rgw 2026-02-12T03:48:11.266 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:48:11.267 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:48:11.267 INFO:teuthology.orchestra.run.trial098.stdout: Package Architecture Version Repository Size 2026-02-12T03:48:11.267 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:48:11.268 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-12T03:48:11.268 INFO:teuthology.orchestra.run.trial098.stdout: rbd-fuse x86_64 2:20.2.0-626.g1279775f.el9 ceph 91 k 2026-02-12T03:48:11.268 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:11.268 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-12T03:48:11.268 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:48:11.268 INFO:teuthology.orchestra.run.trial098.stdout:Install 1 Package 2026-02-12T03:48:11.268 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:11.268 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 91 k 2026-02-12T03:48:11.268 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 238 k 2026-02-12T03:48:11.268 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-12T03:48:11.342 INFO:teuthology.orchestra.run.trial098.stdout:rbd-fuse-20.2.0-626.g1279775f.el9.x86_64.rpm 1.2 MB/s | 91 kB 00:00 2026-02-12T03:48:11.342 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:48:11.342 INFO:teuthology.orchestra.run.trial098.stdout:Total 1.2 MB/s | 91 kB 00:00 2026-02-12T03:48:11.343 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-12T03:48:11.347 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-12T03:48:11.347 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-12T03:48:11.379 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-12T03:48:11.380 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-12T03:48:11.395 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:52 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:48:11.431 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-12T03:48:11.447 INFO:teuthology.orchestra.run.trial098.stdout: Installing : rbd-fuse-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:11.460 INFO:teuthology.orchestra.run.trial111.stdout:Package libcephfs2-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:48:11.479 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:48:11.479 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-12T03:48:11.479 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:48:11.486 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:00:48 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:48:11.501 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install libcephfs-devel 2026-02-12T03:48:11.528 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: rbd-fuse-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:11.551 INFO:teuthology.orchestra.run.trial091.stdout:Package python3-rgw-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:48:11.569 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:48:11.570 INFO:teuthology.orchestra.run.trial091.stdout:Nothing to do. 2026-02-12T03:48:11.570 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:48:11.589 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : rbd-fuse-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:11.589 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:11.589 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-12T03:48:11.589 INFO:teuthology.orchestra.run.trial098.stdout: rbd-fuse-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:11.589 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:11.589 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:48:11.591 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install python3-cephfs 2026-02-12T03:48:11.599 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-2:20.2.0-626.g1279775f.el9.x86_64 95/95 2026-02-12T03:48:11.599 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-2:20.2.0-626.g1279775f.el9.x86_64 1/95 2026-02-12T03:48:11.599 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-mds-2:20.2.0-626.g1279775f.el9.x86_64 2/95 2026-02-12T03:48:11.599 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-mgr-2:20.2.0-626.g1279775f.el9.x86_64 3/95 2026-02-12T03:48:11.599 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-mon-2:20.2.0-626.g1279775f.el9.x86_64 4/95 2026-02-12T03:48:11.599 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-osd-2:20.2.0-626.g1279775f.el9.x86_64 5/95 2026-02-12T03:48:11.599 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-grafana-dashboards-2:20.2.0-626.g1279775f.el9 6/95 2026-02-12T03:48:11.599 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-mgr-cephadm-2:20.2.0-626.g1279775f.el9.noarch 7/95 2026-02-12T03:48:11.599 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-mgr-dashboard-2:20.2.0-626.g1279775f.el9.noar 8/95 2026-02-12T03:48:11.599 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.2.0-626.g127977 9/95 2026-02-12T03:48:11.599 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-mgr-k8sevents-2:20.2.0-626.g1279775f.el9.noar 10/95 2026-02-12T03:48:11.599 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-mgr-modules-core-2:20.2.0-626.g1279775f.el9.n 11/95 2026-02-12T03:48:11.599 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-mgr-rook-2:20.2.0-626.g1279775f.el9.noarch 12/95 2026-02-12T03:48:11.599 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-prometheus-alerts-2:20.2.0-626.g1279775f.el9. 13/95 2026-02-12T03:48:11.599 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-volume-2:20.2.0-626.g1279775f.el9.noarch 14/95 2026-02-12T03:48:11.599 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : cephadm-2:20.2.0-626.g1279775f.el9.noarch 15/95 2026-02-12T03:48:11.599 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/95 2026-02-12T03:48:11.599 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/95 2026-02-12T03:48:11.599 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/95 2026-02-12T03:48:11.599 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/95 2026-02-12T03:48:11.599 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/95 2026-02-12T03:48:11.600 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/95 2026-02-12T03:48:11.600 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/95 2026-02-12T03:48:11.600 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/95 2026-02-12T03:48:11.600 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/95 2026-02-12T03:48:11.600 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/95 2026-02-12T03:48:11.600 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/95 2026-02-12T03:48:11.600 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/95 2026-02-12T03:48:11.600 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/95 2026-02-12T03:48:11.600 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : zip-3.0-35.el9.x86_64 29/95 2026-02-12T03:48:11.600 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 30/95 2026-02-12T03:48:11.600 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 31/95 2026-02-12T03:48:11.600 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 32/95 2026-02-12T03:48:11.600 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/95 2026-02-12T03:48:11.600 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/95 2026-02-12T03:48:11.600 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/95 2026-02-12T03:48:11.600 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/95 2026-02-12T03:48:11.600 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/95 2026-02-12T03:48:11.600 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/95 2026-02-12T03:48:11.600 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/95 2026-02-12T03:48:11.600 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/95 2026-02-12T03:48:11.600 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 41/95 2026-02-12T03:48:11.600 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 42/95 2026-02-12T03:48:11.600 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 43/95 2026-02-12T03:48:11.600 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/95 2026-02-12T03:48:11.600 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/95 2026-02-12T03:48:11.600 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/95 2026-02-12T03:48:11.600 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/95 2026-02-12T03:48:11.600 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/95 2026-02-12T03:48:11.600 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/95 2026-02-12T03:48:11.600 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/95 2026-02-12T03:48:11.600 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/95 2026-02-12T03:48:11.600 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/95 2026-02-12T03:48:11.600 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/95 2026-02-12T03:48:11.600 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/95 2026-02-12T03:48:11.601 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/95 2026-02-12T03:48:11.601 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/95 2026-02-12T03:48:11.601 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/95 2026-02-12T03:48:11.601 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/95 2026-02-12T03:48:11.601 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/95 2026-02-12T03:48:11.601 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/95 2026-02-12T03:48:11.601 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/95 2026-02-12T03:48:11.601 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/95 2026-02-12T03:48:11.601 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/95 2026-02-12T03:48:11.601 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/95 2026-02-12T03:48:11.601 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/95 2026-02-12T03:48:11.601 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/95 2026-02-12T03:48:11.601 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/95 2026-02-12T03:48:11.601 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/95 2026-02-12T03:48:11.601 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/95 2026-02-12T03:48:11.601 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/95 2026-02-12T03:48:11.601 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/95 2026-02-12T03:48:11.601 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/95 2026-02-12T03:48:11.601 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/95 2026-02-12T03:48:11.601 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/95 2026-02-12T03:48:11.601 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/95 2026-02-12T03:48:11.601 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/95 2026-02-12T03:48:11.601 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/95 2026-02-12T03:48:11.601 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/95 2026-02-12T03:48:11.601 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/95 2026-02-12T03:48:11.601 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/95 2026-02-12T03:48:11.601 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 81/95 2026-02-12T03:48:11.601 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 82/95 2026-02-12T03:48:11.601 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 83/95 2026-02-12T03:48:11.601 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 84/95 2026-02-12T03:48:11.601 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 85/95 2026-02-12T03:48:11.601 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 86/95 2026-02-12T03:48:11.601 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 87/95 2026-02-12T03:48:11.601 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 88/95 2026-02-12T03:48:11.601 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 89/95 2026-02-12T03:48:11.602 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 90/95 2026-02-12T03:48:11.602 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 91/95 2026-02-12T03:48:11.602 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 92/95 2026-02-12T03:48:11.602 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 93/95 2026-02-12T03:48:11.602 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 94/95 2026-02-12T03:48:11.616 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install rbd-mirror 2026-02-12T03:48:11.667 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 95/95 2026-02-12T03:48:11.667 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:11.667 INFO:teuthology.orchestra.run.trial154.stdout:Installed: 2026-02-12T03:48:11.667 INFO:teuthology.orchestra.run.trial154.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-12T03:48:11.667 INFO:teuthology.orchestra.run.trial154.stdout: ceph-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:11.667 INFO:teuthology.orchestra.run.trial154.stdout: ceph-grafana-dashboards-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:11.667 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mds-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:11.667 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:11.668 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr-cephadm-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:11.668 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr-dashboard-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:11.668 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr-diskprediction-local-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:11.668 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr-k8sevents-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:11.668 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr-modules-core-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:11.668 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr-rook-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:11.668 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mon-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:11.668 INFO:teuthology.orchestra.run.trial154.stdout: ceph-osd-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:11.668 INFO:teuthology.orchestra.run.trial154.stdout: ceph-prometheus-alerts-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:11.668 INFO:teuthology.orchestra.run.trial154.stdout: ceph-volume-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:11.668 INFO:teuthology.orchestra.run.trial154.stdout: cephadm-2:20.2.0-626.g1279775f.el9.noarch 2026-02-12T03:48:11.669 INFO:teuthology.orchestra.run.trial154.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-12T03:48:11.669 INFO:teuthology.orchestra.run.trial154.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-12T03:48:11.669 INFO:teuthology.orchestra.run.trial154.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-12T03:48:11.669 INFO:teuthology.orchestra.run.trial154.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-12T03:48:11.669 INFO:teuthology.orchestra.run.trial154.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-12T03:48:11.669 INFO:teuthology.orchestra.run.trial154.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-12T03:48:11.669 INFO:teuthology.orchestra.run.trial154.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-12T03:48:11.669 INFO:teuthology.orchestra.run.trial154.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-12T03:48:11.669 INFO:teuthology.orchestra.run.trial154.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-12T03:48:11.669 INFO:teuthology.orchestra.run.trial154.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T03:48:11.669 INFO:teuthology.orchestra.run.trial154.stdout: lua-5.4.4-4.el9.x86_64 2026-02-12T03:48:11.669 INFO:teuthology.orchestra.run.trial154.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-12T03:48:11.670 INFO:teuthology.orchestra.run.trial154.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-12T03:48:11.670 INFO:teuthology.orchestra.run.trial154.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-12T03:48:11.670 INFO:teuthology.orchestra.run.trial154.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-12T03:48:11.670 INFO:teuthology.orchestra.run.trial154.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-12T03:48:11.670 INFO:teuthology.orchestra.run.trial154.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-12T03:48:11.670 INFO:teuthology.orchestra.run.trial154.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-12T03:48:11.670 INFO:teuthology.orchestra.run.trial154.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-12T03:48:11.670 INFO:teuthology.orchestra.run.trial154.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-12T03:48:11.670 INFO:teuthology.orchestra.run.trial154.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-12T03:48:11.670 INFO:teuthology.orchestra.run.trial154.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-12T03:48:11.670 INFO:teuthology.orchestra.run.trial154.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-12T03:48:11.670 INFO:teuthology.orchestra.run.trial154.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-12T03:48:11.671 INFO:teuthology.orchestra.run.trial154.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-12T03:48:11.671 INFO:teuthology.orchestra.run.trial154.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-12T03:48:11.671 INFO:teuthology.orchestra.run.trial154.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-12T03:48:11.671 INFO:teuthology.orchestra.run.trial154.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-12T03:48:11.671 INFO:teuthology.orchestra.run.trial154.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-12T03:48:11.671 INFO:teuthology.orchestra.run.trial154.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-12T03:48:11.671 INFO:teuthology.orchestra.run.trial154.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-12T03:48:11.671 INFO:teuthology.orchestra.run.trial154.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-12T03:48:11.671 INFO:teuthology.orchestra.run.trial154.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-12T03:48:11.671 INFO:teuthology.orchestra.run.trial154.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-12T03:48:11.671 INFO:teuthology.orchestra.run.trial154.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-12T03:48:11.671 INFO:teuthology.orchestra.run.trial154.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-12T03:48:11.671 INFO:teuthology.orchestra.run.trial154.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-12T03:48:11.672 INFO:teuthology.orchestra.run.trial154.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-12T03:48:11.672 INFO:teuthology.orchestra.run.trial154.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-12T03:48:11.672 INFO:teuthology.orchestra.run.trial154.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-12T03:48:11.672 INFO:teuthology.orchestra.run.trial154.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-12T03:48:11.672 INFO:teuthology.orchestra.run.trial154.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-12T03:48:11.672 INFO:teuthology.orchestra.run.trial154.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-12T03:48:11.672 INFO:teuthology.orchestra.run.trial154.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T03:48:11.672 INFO:teuthology.orchestra.run.trial154.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-12T03:48:11.672 INFO:teuthology.orchestra.run.trial154.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-12T03:48:11.672 INFO:teuthology.orchestra.run.trial154.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-12T03:48:11.672 INFO:teuthology.orchestra.run.trial154.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-12T03:48:11.672 INFO:teuthology.orchestra.run.trial154.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-12T03:48:11.672 INFO:teuthology.orchestra.run.trial154.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-12T03:48:11.673 INFO:teuthology.orchestra.run.trial154.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-12T03:48:11.673 INFO:teuthology.orchestra.run.trial154.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-12T03:48:11.673 INFO:teuthology.orchestra.run.trial154.stdout: python3-ply-3.11-14.el9.noarch 2026-02-12T03:48:11.673 INFO:teuthology.orchestra.run.trial154.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-12T03:48:11.673 INFO:teuthology.orchestra.run.trial154.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-12T03:48:11.673 INFO:teuthology.orchestra.run.trial154.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-12T03:48:11.673 INFO:teuthology.orchestra.run.trial154.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-12T03:48:11.673 INFO:teuthology.orchestra.run.trial154.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-12T03:48:11.673 INFO:teuthology.orchestra.run.trial154.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-12T03:48:11.673 INFO:teuthology.orchestra.run.trial154.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-12T03:48:11.673 INFO:teuthology.orchestra.run.trial154.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-12T03:48:11.673 INFO:teuthology.orchestra.run.trial154.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-12T03:48:11.674 INFO:teuthology.orchestra.run.trial154.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-12T03:48:11.674 INFO:teuthology.orchestra.run.trial154.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-12T03:48:11.674 INFO:teuthology.orchestra.run.trial154.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-12T03:48:11.674 INFO:teuthology.orchestra.run.trial154.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-12T03:48:11.674 INFO:teuthology.orchestra.run.trial154.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-12T03:48:11.674 INFO:teuthology.orchestra.run.trial154.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-12T03:48:11.674 INFO:teuthology.orchestra.run.trial154.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-12T03:48:11.674 INFO:teuthology.orchestra.run.trial154.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-12T03:48:11.674 INFO:teuthology.orchestra.run.trial154.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-12T03:48:11.674 INFO:teuthology.orchestra.run.trial154.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-12T03:48:11.674 INFO:teuthology.orchestra.run.trial154.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-12T03:48:11.674 INFO:teuthology.orchestra.run.trial154.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-12T03:48:11.674 INFO:teuthology.orchestra.run.trial154.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-12T03:48:11.675 INFO:teuthology.orchestra.run.trial154.stdout: unzip-6.0-59.el9.x86_64 2026-02-12T03:48:11.675 INFO:teuthology.orchestra.run.trial154.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-12T03:48:11.675 INFO:teuthology.orchestra.run.trial154.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-12T03:48:11.675 INFO:teuthology.orchestra.run.trial154.stdout: zip-3.0-35.el9.x86_64 2026-02-12T03:48:11.675 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:11.675 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:48:11.721 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install ceph-base 2026-02-12T03:48:11.800 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:52 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:48:11.883 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:48:11.884 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:48:11.884 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repo Size 2026-02-12T03:48:11.885 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:48:11.885 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T03:48:11.885 INFO:teuthology.orchestra.run.trial111.stdout: libcephfs-devel x86_64 2:20.2.0-626.g1279775f.el9 ceph 34 k 2026-02-12T03:48:11.885 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:11.885 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T03:48:11.885 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:48:11.885 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-12T03:48:11.885 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:11.885 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 34 k 2026-02-12T03:48:11.885 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 155 k 2026-02-12T03:48:11.886 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T03:48:11.890 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:00:48 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:48:11.918 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:51 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:48:11.947 INFO:teuthology.orchestra.run.trial111.stdout:libcephfs-devel-20.2.0-626.g1279775f.el9.x86_64 549 kB/s | 34 kB 00:00 2026-02-12T03:48:11.948 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:48:11.948 INFO:teuthology.orchestra.run.trial111.stdout:Total 543 kB/s | 34 kB 00:00 2026-02-12T03:48:11.948 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T03:48:11.949 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T03:48:11.950 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T03:48:11.952 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T03:48:11.952 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T03:48:11.955 INFO:teuthology.orchestra.run.trial091.stdout:Package python3-cephfs-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:48:11.973 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:48:11.974 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T03:48:11.974 INFO:teuthology.orchestra.run.trial091.stdout:Nothing to do. 2026-02-12T03:48:11.974 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:48:11.990 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libcephfs-devel-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:11.995 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install python3-rbd 2026-02-12T03:48:12.001 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:48:12.002 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:48:12.002 INFO:teuthology.orchestra.run.trial098.stdout: Package Arch Version Repo Size 2026-02-12T03:48:12.002 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:48:12.003 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-12T03:48:12.003 INFO:teuthology.orchestra.run.trial098.stdout: rbd-mirror x86_64 2:20.2.0-626.g1279775f.el9 ceph 2.9 M 2026-02-12T03:48:12.003 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:12.003 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-12T03:48:12.003 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:48:12.003 INFO:teuthology.orchestra.run.trial098.stdout:Install 1 Package 2026-02-12T03:48:12.003 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:12.003 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 2.9 M 2026-02-12T03:48:12.003 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 11 M 2026-02-12T03:48:12.003 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-12T03:48:12.021 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:00:39 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:48:12.047 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:12.086 INFO:teuthology.orchestra.run.trial154.stdout:Package ceph-base-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:48:12.103 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libcephfs-devel-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:12.103 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:12.103 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T03:48:12.103 INFO:teuthology.orchestra.run.trial111.stdout: libcephfs-devel-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:12.103 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:12.104 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:48:12.104 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:48:12.105 INFO:teuthology.orchestra.run.trial154.stdout:Nothing to do. 2026-02-12T03:48:12.105 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:48:12.127 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install cephadm 2026-02-12T03:48:12.132 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install librados2 2026-02-12T03:48:12.152 INFO:teuthology.orchestra.run.trial098.stdout:rbd-mirror-20.2.0-626.g1279775f.el9.x86_64.rpm 20 MB/s | 2.9 MB 00:00 2026-02-12T03:48:12.152 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:48:12.153 INFO:teuthology.orchestra.run.trial098.stdout:Total 19 MB/s | 2.9 MB 00:00 2026-02-12T03:48:12.153 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-12T03:48:12.157 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-12T03:48:12.157 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-12T03:48:12.197 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-12T03:48:12.198 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-12T03:48:12.299 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:00:49 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:48:12.364 INFO:teuthology.orchestra.run.trial091.stdout:Package python3-rbd-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:48:12.377 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-12T03:48:12.378 INFO:teuthology.orchestra.run.trial098.stdout: Installing : rbd-mirror-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:12.382 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:48:12.383 INFO:teuthology.orchestra.run.trial091.stdout:Nothing to do. 2026-02-12T03:48:12.383 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:48:12.401 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: rbd-mirror-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:12.401 INFO:teuthology.orchestra.run.trial098.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T03:48:12.401 INFO:teuthology.orchestra.run.trial098.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-12T03:48:12.401 INFO:teuthology.orchestra.run.trial098.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T03:48:12.401 INFO:teuthology.orchestra.run.trial098.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T03:48:12.401 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:12.404 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install rbd-fuse 2026-02-12T03:48:12.426 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:00:39 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:48:12.432 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:53 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:48:12.492 INFO:teuthology.orchestra.run.trial154.stdout:Package cephadm-2:20.2.0-626.g1279775f.el9.noarch is already installed. 2026-02-12T03:48:12.499 INFO:teuthology.orchestra.run.trial111.stdout:Package librados2-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:48:12.510 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:48:12.511 INFO:teuthology.orchestra.run.trial154.stdout:Nothing to do. 2026-02-12T03:48:12.511 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:48:12.517 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:48:12.518 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-12T03:48:12.518 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:48:12.531 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install ceph-immutable-object-cache 2026-02-12T03:48:12.540 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install librbd1 2026-02-12T03:48:12.706 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : rbd-mirror-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:12.707 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:12.707 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-12T03:48:12.707 INFO:teuthology.orchestra.run.trial098.stdout: rbd-mirror-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:12.707 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:12.707 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:48:12.713 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:00:49 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:48:12.734 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install rbd-nbd 2026-02-12T03:48:12.797 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:48:12.798 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:48:12.798 INFO:teuthology.orchestra.run.trial091.stdout: Package Architecture Version Repository Size 2026-02-12T03:48:12.798 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:48:12.798 INFO:teuthology.orchestra.run.trial091.stdout:Installing: 2026-02-12T03:48:12.798 INFO:teuthology.orchestra.run.trial091.stdout: rbd-fuse x86_64 2:20.2.0-626.g1279775f.el9 ceph 91 k 2026-02-12T03:48:12.798 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:12.798 INFO:teuthology.orchestra.run.trial091.stdout:Transaction Summary 2026-02-12T03:48:12.798 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:48:12.798 INFO:teuthology.orchestra.run.trial091.stdout:Install 1 Package 2026-02-12T03:48:12.799 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:12.799 INFO:teuthology.orchestra.run.trial091.stdout:Total download size: 91 k 2026-02-12T03:48:12.799 INFO:teuthology.orchestra.run.trial091.stdout:Installed size: 238 k 2026-02-12T03:48:12.799 INFO:teuthology.orchestra.run.trial091.stdout:Downloading Packages: 2026-02-12T03:48:12.832 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:00:39 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:48:12.843 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:53 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:48:12.872 INFO:teuthology.orchestra.run.trial091.stdout:rbd-fuse-20.2.0-626.g1279775f.el9.x86_64.rpm 1.2 MB/s | 91 kB 00:00 2026-02-12T03:48:12.873 INFO:teuthology.orchestra.run.trial091.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:48:12.873 INFO:teuthology.orchestra.run.trial091.stdout:Total 1.2 MB/s | 91 kB 00:00 2026-02-12T03:48:12.873 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction check 2026-02-12T03:48:12.877 INFO:teuthology.orchestra.run.trial091.stdout:Transaction check succeeded. 2026-02-12T03:48:12.877 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction test 2026-02-12T03:48:12.909 INFO:teuthology.orchestra.run.trial091.stdout:Transaction test succeeded. 2026-02-12T03:48:12.909 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction 2026-02-12T03:48:12.909 INFO:teuthology.orchestra.run.trial111.stdout:Package librbd1-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:48:12.916 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:48:12.917 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:48:12.917 INFO:teuthology.orchestra.run.trial154.stdout: Package Arch Version Repo Size 2026-02-12T03:48:12.918 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:48:12.918 INFO:teuthology.orchestra.run.trial154.stdout:Installing: 2026-02-12T03:48:12.918 INFO:teuthology.orchestra.run.trial154.stdout: ceph-immutable-object-cache x86_64 2:20.2.0-626.g1279775f.el9 ceph 154 k 2026-02-12T03:48:12.918 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:12.918 INFO:teuthology.orchestra.run.trial154.stdout:Transaction Summary 2026-02-12T03:48:12.918 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:48:12.918 INFO:teuthology.orchestra.run.trial154.stdout:Install 1 Package 2026-02-12T03:48:12.918 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:12.918 INFO:teuthology.orchestra.run.trial154.stdout:Total download size: 154 k 2026-02-12T03:48:12.919 INFO:teuthology.orchestra.run.trial154.stdout:Installed size: 447 k 2026-02-12T03:48:12.919 INFO:teuthology.orchestra.run.trial154.stdout:Downloading Packages: 2026-02-12T03:48:12.927 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:48:12.928 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-12T03:48:12.928 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:48:12.950 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install python3-rados 2026-02-12T03:48:12.960 INFO:teuthology.orchestra.run.trial091.stdout: Preparing : 1/1 2026-02-12T03:48:12.977 INFO:teuthology.orchestra.run.trial091.stdout: Installing : rbd-fuse-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:13.004 INFO:teuthology.orchestra.run.trial154.stdout:ceph-immutable-object-cache-20.2.0-626.g1279775 1.7 MB/s | 154 kB 00:00 2026-02-12T03:48:13.005 INFO:teuthology.orchestra.run.trial154.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:48:13.005 INFO:teuthology.orchestra.run.trial154.stdout:Total 1.7 MB/s | 154 kB 00:00 2026-02-12T03:48:13.005 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction check 2026-02-12T03:48:13.009 INFO:teuthology.orchestra.run.trial154.stdout:Transaction check succeeded. 2026-02-12T03:48:13.009 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction test 2026-02-12T03:48:13.042 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:53 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:48:13.043 INFO:teuthology.orchestra.run.trial154.stdout:Transaction test succeeded. 2026-02-12T03:48:13.044 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction 2026-02-12T03:48:13.054 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: rbd-fuse-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:13.101 INFO:teuthology.orchestra.run.trial154.stdout: Preparing : 1/1 2026-02-12T03:48:13.103 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-immutable-object-cache-2:20.2.0-626.g1279775f.e 1/1 2026-02-12T03:48:13.110 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : rbd-fuse-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:13.110 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:13.111 INFO:teuthology.orchestra.run.trial091.stdout:Installed: 2026-02-12T03:48:13.111 INFO:teuthology.orchestra.run.trial091.stdout: rbd-fuse-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:13.111 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:13.111 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:48:13.125 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:48:13.126 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.2.0-626.g1279775f.e 1/1 2026-02-12T03:48:13.126 INFO:teuthology.orchestra.run.trial154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T03:48:13.126 INFO:teuthology.orchestra.run.trial154.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-12T03:48:13.126 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:13.127 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:48:13.127 INFO:teuthology.orchestra.run.trial098.stdout: Package Architecture Version Repository Size 2026-02-12T03:48:13.127 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:48:13.127 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-12T03:48:13.127 INFO:teuthology.orchestra.run.trial098.stdout: rbd-nbd x86_64 2:20.2.0-626.g1279775f.el9 ceph 180 k 2026-02-12T03:48:13.127 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:13.128 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-12T03:48:13.128 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:48:13.128 INFO:teuthology.orchestra.run.trial098.stdout:Install 1 Package 2026-02-12T03:48:13.128 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:13.128 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 180 k 2026-02-12T03:48:13.128 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 498 k 2026-02-12T03:48:13.128 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-12T03:48:13.140 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install rbd-mirror 2026-02-12T03:48:13.212 INFO:teuthology.orchestra.run.trial098.stdout:rbd-nbd-20.2.0-626.g1279775f.el9.x86_64.rpm 2.1 MB/s | 180 kB 00:00 2026-02-12T03:48:13.213 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:48:13.213 INFO:teuthology.orchestra.run.trial098.stdout:Total 2.0 MB/s | 180 kB 00:00 2026-02-12T03:48:13.213 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-12T03:48:13.217 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-12T03:48:13.217 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-12T03:48:13.250 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-12T03:48:13.250 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-12T03:48:13.256 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:54 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:48:13.308 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-12T03:48:13.321 INFO:teuthology.orchestra.run.trial111.stdout:Package python3-rados-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:48:13.325 INFO:teuthology.orchestra.run.trial098.stdout: Installing : rbd-nbd-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:13.340 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:48:13.341 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-12T03:48:13.341 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:48:13.363 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install python3-rgw 2026-02-12T03:48:13.406 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: rbd-nbd-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:13.407 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-immutable-object-cache-2:20.2.0-626.g1279775f.e 1/1 2026-02-12T03:48:13.407 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:13.407 INFO:teuthology.orchestra.run.trial154.stdout:Installed: 2026-02-12T03:48:13.407 INFO:teuthology.orchestra.run.trial154.stdout: ceph-immutable-object-cache-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:13.408 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:13.408 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:48:13.435 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install ceph-mgr 2026-02-12T03:48:13.448 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:00:50 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:48:13.462 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : rbd-nbd-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:13.462 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:13.463 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-12T03:48:13.463 INFO:teuthology.orchestra.run.trial098.stdout: rbd-nbd-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:13.463 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:13.463 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:48:13.491 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install ceph-base-debuginfo 2026-02-12T03:48:13.531 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:48:13.532 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:48:13.532 INFO:teuthology.orchestra.run.trial091.stdout: Package Arch Version Repo Size 2026-02-12T03:48:13.532 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:48:13.532 INFO:teuthology.orchestra.run.trial091.stdout:Installing: 2026-02-12T03:48:13.532 INFO:teuthology.orchestra.run.trial091.stdout: rbd-mirror x86_64 2:20.2.0-626.g1279775f.el9 ceph 2.9 M 2026-02-12T03:48:13.532 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:13.532 INFO:teuthology.orchestra.run.trial091.stdout:Transaction Summary 2026-02-12T03:48:13.532 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:48:13.533 INFO:teuthology.orchestra.run.trial091.stdout:Install 1 Package 2026-02-12T03:48:13.533 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:13.533 INFO:teuthology.orchestra.run.trial091.stdout:Total download size: 2.9 M 2026-02-12T03:48:13.533 INFO:teuthology.orchestra.run.trial091.stdout:Installed size: 11 M 2026-02-12T03:48:13.533 INFO:teuthology.orchestra.run.trial091.stdout:Downloading Packages: 2026-02-12T03:48:13.663 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:54 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:48:13.678 INFO:teuthology.orchestra.run.trial091.stdout:rbd-mirror-20.2.0-626.g1279775f.el9.x86_64.rpm 20 MB/s | 2.9 MB 00:00 2026-02-12T03:48:13.678 INFO:teuthology.orchestra.run.trial091.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:48:13.678 INFO:teuthology.orchestra.run.trial091.stdout:Total 20 MB/s | 2.9 MB 00:00 2026-02-12T03:48:13.678 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction check 2026-02-12T03:48:13.683 INFO:teuthology.orchestra.run.trial091.stdout:Transaction check succeeded. 2026-02-12T03:48:13.683 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction test 2026-02-12T03:48:13.723 INFO:teuthology.orchestra.run.trial091.stdout:Transaction test succeeded. 2026-02-12T03:48:13.723 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction 2026-02-12T03:48:13.728 INFO:teuthology.orchestra.run.trial111.stdout:Package python3-rgw-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:48:13.736 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:00:40 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:48:13.746 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:48:13.747 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-12T03:48:13.747 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:48:13.768 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install python3-cephfs 2026-02-12T03:48:13.801 INFO:teuthology.orchestra.run.trial154.stdout:Package ceph-mgr-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:48:13.812 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:00:53 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:48:13.819 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:48:13.820 INFO:teuthology.orchestra.run.trial154.stdout:Nothing to do. 2026-02-12T03:48:13.820 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:48:13.841 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install ceph-mgr-dashboard 2026-02-12T03:48:13.895 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:48:13.896 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:48:13.897 INFO:teuthology.orchestra.run.trial098.stdout: Package Arch Version Repo Size 2026-02-12T03:48:13.897 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:48:13.897 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-12T03:48:13.897 INFO:teuthology.orchestra.run.trial098.stdout: ceph-base-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 107 M 2026-02-12T03:48:13.897 INFO:teuthology.orchestra.run.trial098.stdout:Installing weak dependencies: 2026-02-12T03:48:13.897 INFO:teuthology.orchestra.run.trial098.stdout: ceph-debugsource x86_64 2:20.2.0-626.g1279775f.el9 ceph 11 M 2026-02-12T03:48:13.897 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:13.897 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-12T03:48:13.898 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:48:13.898 INFO:teuthology.orchestra.run.trial098.stdout:Install 2 Packages 2026-02-12T03:48:13.898 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:13.898 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 118 M 2026-02-12T03:48:13.898 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 751 M 2026-02-12T03:48:13.898 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-12T03:48:13.902 INFO:teuthology.orchestra.run.trial091.stdout: Preparing : 1/1 2026-02-12T03:48:13.904 INFO:teuthology.orchestra.run.trial091.stdout: Installing : rbd-mirror-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:13.927 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: rbd-mirror-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:13.927 INFO:teuthology.orchestra.run.trial091.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T03:48:13.928 INFO:teuthology.orchestra.run.trial091.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-12T03:48:13.928 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T03:48:13.928 INFO:teuthology.orchestra.run.trial091.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T03:48:13.928 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:14.064 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:55 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:48:14.128 INFO:teuthology.orchestra.run.trial111.stdout:Package python3-cephfs-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:48:14.140 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:00:41 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:48:14.146 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:48:14.147 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-12T03:48:14.147 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:48:14.170 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install python3-rbd 2026-02-12T03:48:14.204 INFO:teuthology.orchestra.run.trial154.stdout:Package ceph-mgr-dashboard-2:20.2.0-626.g1279775f.el9.noarch is already installed. 2026-02-12T03:48:14.223 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:48:14.223 INFO:teuthology.orchestra.run.trial154.stdout:Nothing to do. 2026-02-12T03:48:14.224 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:48:14.227 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : rbd-mirror-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:14.227 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:14.227 INFO:teuthology.orchestra.run.trial091.stdout:Installed: 2026-02-12T03:48:14.227 INFO:teuthology.orchestra.run.trial091.stdout: rbd-mirror-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:14.227 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:14.227 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:48:14.244 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-12T03:48:14.256 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install rbd-nbd 2026-02-12T03:48:14.470 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:55 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:48:14.471 INFO:teuthology.orchestra.run.trial098.stdout:(1/2): ceph-debugsource-20.2.0-626.g1279775f.el 19 MB/s | 11 MB 00:00 2026-02-12T03:48:14.536 INFO:teuthology.orchestra.run.trial111.stdout:Package python3-rbd-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:48:14.546 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:00:41 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:48:14.554 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:48:14.555 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-12T03:48:14.555 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:48:14.565 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:00:51 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:48:14.576 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install rbd-fuse 2026-02-12T03:48:14.611 INFO:teuthology.orchestra.run.trial154.stdout:Package ceph-mgr-diskprediction-local-2:20.2.0-626.g1279775f.el9.noarch is already installed. 2026-02-12T03:48:14.629 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:48:14.630 INFO:teuthology.orchestra.run.trial154.stdout:Nothing to do. 2026-02-12T03:48:14.630 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:48:14.648 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:48:14.649 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:48:14.649 INFO:teuthology.orchestra.run.trial091.stdout: Package Architecture Version Repository Size 2026-02-12T03:48:14.650 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:48:14.650 INFO:teuthology.orchestra.run.trial091.stdout:Installing: 2026-02-12T03:48:14.650 INFO:teuthology.orchestra.run.trial091.stdout: rbd-nbd x86_64 2:20.2.0-626.g1279775f.el9 ceph 180 k 2026-02-12T03:48:14.650 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:14.650 INFO:teuthology.orchestra.run.trial091.stdout:Transaction Summary 2026-02-12T03:48:14.650 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:48:14.650 INFO:teuthology.orchestra.run.trial091.stdout:Install 1 Package 2026-02-12T03:48:14.650 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:14.650 INFO:teuthology.orchestra.run.trial091.stdout:Total download size: 180 k 2026-02-12T03:48:14.651 INFO:teuthology.orchestra.run.trial091.stdout:Installed size: 498 k 2026-02-12T03:48:14.651 INFO:teuthology.orchestra.run.trial091.stdout:Downloading Packages: 2026-02-12T03:48:14.652 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install ceph-mgr-rook 2026-02-12T03:48:14.876 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:55 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:48:14.952 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:00:41 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:48:14.960 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:48:14.961 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:48:14.961 INFO:teuthology.orchestra.run.trial111.stdout: Package Architecture Version Repository Size 2026-02-12T03:48:14.961 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:48:14.961 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T03:48:14.961 INFO:teuthology.orchestra.run.trial111.stdout: rbd-fuse x86_64 2:20.2.0-626.g1279775f.el9 ceph 91 k 2026-02-12T03:48:14.961 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:14.961 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T03:48:14.961 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:48:14.961 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-12T03:48:14.962 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:14.962 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 91 k 2026-02-12T03:48:14.962 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 238 k 2026-02-12T03:48:14.962 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T03:48:15.018 INFO:teuthology.orchestra.run.trial154.stdout:Package ceph-mgr-rook-2:20.2.0-626.g1279775f.el9.noarch is already installed. 2026-02-12T03:48:15.019 INFO:teuthology.orchestra.run.trial091.stdout:rbd-nbd-20.2.0-626.g1279775f.el9.x86_64.rpm 486 kB/s | 180 kB 00:00 2026-02-12T03:48:15.020 INFO:teuthology.orchestra.run.trial091.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:48:15.020 INFO:teuthology.orchestra.run.trial091.stdout:Total 484 kB/s | 180 kB 00:00 2026-02-12T03:48:15.020 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction check 2026-02-12T03:48:15.025 INFO:teuthology.orchestra.run.trial091.stdout:Transaction check succeeded. 2026-02-12T03:48:15.026 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction test 2026-02-12T03:48:15.036 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:48:15.037 INFO:teuthology.orchestra.run.trial154.stdout:Nothing to do. 2026-02-12T03:48:15.037 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:48:15.057 INFO:teuthology.orchestra.run.trial091.stdout:Transaction test succeeded. 2026-02-12T03:48:15.058 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction 2026-02-12T03:48:15.059 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install ceph-mgr-cephadm 2026-02-12T03:48:15.113 INFO:teuthology.orchestra.run.trial091.stdout: Preparing : 1/1 2026-02-12T03:48:15.130 INFO:teuthology.orchestra.run.trial091.stdout: Installing : rbd-nbd-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:15.218 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: rbd-nbd-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:15.275 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : rbd-nbd-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:15.275 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:15.275 INFO:teuthology.orchestra.run.trial091.stdout:Installed: 2026-02-12T03:48:15.275 INFO:teuthology.orchestra.run.trial091.stdout: rbd-nbd-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:15.275 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:15.275 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:48:15.304 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install ceph-base-debuginfo 2026-02-12T03:48:15.321 INFO:teuthology.orchestra.run.trial111.stdout:rbd-fuse-20.2.0-626.g1279775f.el9.x86_64.rpm 252 kB/s | 91 kB 00:00 2026-02-12T03:48:15.322 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:48:15.322 INFO:teuthology.orchestra.run.trial111.stdout:Total 252 kB/s | 91 kB 00:00 2026-02-12T03:48:15.322 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T03:48:15.326 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T03:48:15.327 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T03:48:15.358 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T03:48:15.358 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T03:48:15.362 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:00:42 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:48:15.409 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T03:48:15.426 INFO:teuthology.orchestra.run.trial111.stdout: Installing : rbd-fuse-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:15.426 INFO:teuthology.orchestra.run.trial154.stdout:Package ceph-mgr-cephadm-2:20.2.0-626.g1279775f.el9.noarch is already installed. 2026-02-12T03:48:15.444 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:48:15.445 INFO:teuthology.orchestra.run.trial154.stdout:Nothing to do. 2026-02-12T03:48:15.445 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:48:15.466 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install ceph-fuse 2026-02-12T03:48:15.508 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: rbd-fuse-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:15.565 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : rbd-fuse-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:15.565 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:15.565 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T03:48:15.565 INFO:teuthology.orchestra.run.trial111.stdout: rbd-fuse-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:15.565 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:15.565 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:48:15.592 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install rbd-mirror 2026-02-12T03:48:15.609 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:00:52 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:48:15.694 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:48:15.694 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:48:15.694 INFO:teuthology.orchestra.run.trial091.stdout: Package Arch Version Repo Size 2026-02-12T03:48:15.694 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:48:15.694 INFO:teuthology.orchestra.run.trial091.stdout:Installing: 2026-02-12T03:48:15.694 INFO:teuthology.orchestra.run.trial091.stdout: ceph-base-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 107 M 2026-02-12T03:48:15.694 INFO:teuthology.orchestra.run.trial091.stdout:Installing weak dependencies: 2026-02-12T03:48:15.694 INFO:teuthology.orchestra.run.trial091.stdout: ceph-debugsource x86_64 2:20.2.0-626.g1279775f.el9 ceph 11 M 2026-02-12T03:48:15.695 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:15.695 INFO:teuthology.orchestra.run.trial091.stdout:Transaction Summary 2026-02-12T03:48:15.695 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:48:15.695 INFO:teuthology.orchestra.run.trial091.stdout:Install 2 Packages 2026-02-12T03:48:15.695 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:15.695 INFO:teuthology.orchestra.run.trial091.stdout:Total download size: 118 M 2026-02-12T03:48:15.695 INFO:teuthology.orchestra.run.trial091.stdout:Installed size: 751 M 2026-02-12T03:48:15.695 INFO:teuthology.orchestra.run.trial091.stdout:Downloading Packages: 2026-02-12T03:48:15.771 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:00:42 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:48:15.853 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:48:15.854 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:48:15.854 INFO:teuthology.orchestra.run.trial154.stdout: Package Architecture Version Repository Size 2026-02-12T03:48:15.854 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:48:15.854 INFO:teuthology.orchestra.run.trial154.stdout:Installing: 2026-02-12T03:48:15.854 INFO:teuthology.orchestra.run.trial154.stdout: ceph-fuse x86_64 2:20.2.0-626.g1279775f.el9 ceph 943 k 2026-02-12T03:48:15.854 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:15.854 INFO:teuthology.orchestra.run.trial154.stdout:Transaction Summary 2026-02-12T03:48:15.854 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:48:15.854 INFO:teuthology.orchestra.run.trial154.stdout:Install 1 Package 2026-02-12T03:48:15.854 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:15.854 INFO:teuthology.orchestra.run.trial154.stdout:Total download size: 943 k 2026-02-12T03:48:15.854 INFO:teuthology.orchestra.run.trial154.stdout:Installed size: 2.7 M 2026-02-12T03:48:15.854 INFO:teuthology.orchestra.run.trial154.stdout:Downloading Packages: 2026-02-12T03:48:15.889 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:56 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:48:15.973 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:48:15.973 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:48:15.974 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repo Size 2026-02-12T03:48:15.974 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:48:15.974 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T03:48:15.974 INFO:teuthology.orchestra.run.trial111.stdout: rbd-mirror x86_64 2:20.2.0-626.g1279775f.el9 ceph 2.9 M 2026-02-12T03:48:15.974 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:15.974 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T03:48:15.974 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:48:15.974 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-12T03:48:15.974 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:15.974 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 2.9 M 2026-02-12T03:48:15.975 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 11 M 2026-02-12T03:48:15.975 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T03:48:16.148 INFO:teuthology.orchestra.run.trial098.stdout:(2/2): ceph-base-debuginfo-20.2.0-626.g1279775f 47 MB/s | 107 MB 00:02 2026-02-12T03:48:16.150 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:48:16.150 INFO:teuthology.orchestra.run.trial098.stdout:Total 52 MB/s | 118 MB 00:02 2026-02-12T03:48:16.150 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-12T03:48:16.155 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-12T03:48:16.156 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-12T03:48:16.175 INFO:teuthology.orchestra.run.trial154.stdout:ceph-fuse-20.2.0-626.g1279775f.el9.x86_64.rpm 2.9 MB/s | 943 kB 00:00 2026-02-12T03:48:16.175 INFO:teuthology.orchestra.run.trial154.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:48:16.175 INFO:teuthology.orchestra.run.trial154.stdout:Total 2.9 MB/s | 943 kB 00:00 2026-02-12T03:48:16.175 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction check 2026-02-12T03:48:16.180 INFO:teuthology.orchestra.run.trial154.stdout:Transaction check succeeded. 2026-02-12T03:48:16.181 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction test 2026-02-12T03:48:16.215 INFO:teuthology.orchestra.run.trial154.stdout:Transaction test succeeded. 2026-02-12T03:48:16.215 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction 2026-02-12T03:48:16.262 INFO:teuthology.orchestra.run.trial091.stdout:(1/2): ceph-debugsource-20.2.0-626.g1279775f.el 20 MB/s | 11 MB 00:00 2026-02-12T03:48:16.304 INFO:teuthology.orchestra.run.trial154.stdout: Preparing : 1/1 2026-02-12T03:48:16.321 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-fuse-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:16.450 INFO:teuthology.orchestra.run.trial111.stdout:rbd-mirror-20.2.0-626.g1279775f.el9.x86_64.rpm 6.1 MB/s | 2.9 MB 00:00 2026-02-12T03:48:16.451 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:48:16.451 INFO:teuthology.orchestra.run.trial111.stdout:Total 6.1 MB/s | 2.9 MB 00:00 2026-02-12T03:48:16.451 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T03:48:16.456 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T03:48:16.456 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T03:48:16.496 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T03:48:16.496 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T03:48:16.538 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-fuse-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:16.568 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-12T03:48:16.568 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-12T03:48:16.596 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-fuse-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:16.596 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:16.596 INFO:teuthology.orchestra.run.trial154.stdout:Installed: 2026-02-12T03:48:16.596 INFO:teuthology.orchestra.run.trial154.stdout: ceph-fuse-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:16.596 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:16.596 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:48:16.624 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install ceph-volume 2026-02-12T03:48:16.674 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T03:48:16.676 INFO:teuthology.orchestra.run.trial111.stdout: Installing : rbd-mirror-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:16.699 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: rbd-mirror-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:16.699 INFO:teuthology.orchestra.run.trial111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T03:48:16.699 INFO:teuthology.orchestra.run.trial111.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-12T03:48:16.699 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T03:48:16.699 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T03:48:16.700 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:16.927 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:00:43 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:48:16.992 INFO:teuthology.orchestra.run.trial154.stdout:Package ceph-volume-2:20.2.0-626.g1279775f.el9.noarch is already installed. 2026-02-12T03:48:17.006 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : rbd-mirror-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:17.007 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:17.007 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T03:48:17.007 INFO:teuthology.orchestra.run.trial111.stdout: rbd-mirror-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:17.007 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:17.007 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:48:17.010 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:48:17.011 INFO:teuthology.orchestra.run.trial154.stdout:Nothing to do. 2026-02-12T03:48:17.011 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:48:17.033 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install librados-devel 2026-02-12T03:48:17.035 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install rbd-nbd 2026-02-12T03:48:17.333 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:00:44 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:48:17.338 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:58 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:48:17.416 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:48:17.417 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:48:17.417 INFO:teuthology.orchestra.run.trial154.stdout: Package Arch Version Repo Size 2026-02-12T03:48:17.417 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:48:17.417 INFO:teuthology.orchestra.run.trial154.stdout:Installing: 2026-02-12T03:48:17.418 INFO:teuthology.orchestra.run.trial154.stdout: librados-devel x86_64 2:20.2.0-626.g1279775f.el9 ceph 126 k 2026-02-12T03:48:17.418 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:17.418 INFO:teuthology.orchestra.run.trial154.stdout:Transaction Summary 2026-02-12T03:48:17.418 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:48:17.418 INFO:teuthology.orchestra.run.trial154.stdout:Install 1 Package 2026-02-12T03:48:17.418 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:17.418 INFO:teuthology.orchestra.run.trial154.stdout:Total download size: 126 k 2026-02-12T03:48:17.418 INFO:teuthology.orchestra.run.trial154.stdout:Installed size: 449 k 2026-02-12T03:48:17.418 INFO:teuthology.orchestra.run.trial154.stdout:Downloading Packages: 2026-02-12T03:48:17.423 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:48:17.424 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:48:17.424 INFO:teuthology.orchestra.run.trial111.stdout: Package Architecture Version Repository Size 2026-02-12T03:48:17.424 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:48:17.424 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T03:48:17.424 INFO:teuthology.orchestra.run.trial111.stdout: rbd-nbd x86_64 2:20.2.0-626.g1279775f.el9 ceph 180 k 2026-02-12T03:48:17.424 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:17.424 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T03:48:17.424 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:48:17.424 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-12T03:48:17.424 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:17.425 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 180 k 2026-02-12T03:48:17.425 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 498 k 2026-02-12T03:48:17.425 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T03:48:17.791 INFO:teuthology.orchestra.run.trial154.stdout:librados-devel-20.2.0-626.g1279775f.el9.x86_64. 336 kB/s | 126 kB 00:00 2026-02-12T03:48:17.792 INFO:teuthology.orchestra.run.trial154.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:48:17.792 INFO:teuthology.orchestra.run.trial154.stdout:Total 335 kB/s | 126 kB 00:00 2026-02-12T03:48:17.792 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction check 2026-02-12T03:48:17.793 INFO:teuthology.orchestra.run.trial111.stdout:rbd-nbd-20.2.0-626.g1279775f.el9.x86_64.rpm 488 kB/s | 180 kB 00:00 2026-02-12T03:48:17.793 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:48:17.793 INFO:teuthology.orchestra.run.trial111.stdout:Total 486 kB/s | 180 kB 00:00 2026-02-12T03:48:17.794 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T03:48:17.794 INFO:teuthology.orchestra.run.trial154.stdout:Transaction check succeeded. 2026-02-12T03:48:17.795 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction test 2026-02-12T03:48:17.799 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T03:48:17.799 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T03:48:17.826 INFO:teuthology.orchestra.run.trial154.stdout:Transaction test succeeded. 2026-02-12T03:48:17.827 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction 2026-02-12T03:48:17.831 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T03:48:17.831 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T03:48:17.881 INFO:teuthology.orchestra.run.trial154.stdout: Preparing : 1/1 2026-02-12T03:48:17.887 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T03:48:17.898 INFO:teuthology.orchestra.run.trial154.stdout: Installing : librados-devel-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:17.903 INFO:teuthology.orchestra.run.trial111.stdout: Installing : rbd-nbd-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:17.978 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: librados-devel-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:17.982 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: rbd-nbd-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:18.039 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : librados-devel-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:18.039 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:18.039 INFO:teuthology.orchestra.run.trial154.stdout:Installed: 2026-02-12T03:48:18.039 INFO:teuthology.orchestra.run.trial154.stdout: librados-devel-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:18.039 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:18.039 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:48:18.040 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : rbd-nbd-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:18.040 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:18.040 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T03:48:18.040 INFO:teuthology.orchestra.run.trial111.stdout: rbd-nbd-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:18.040 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:18.040 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:48:18.065 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install libcephfs2 2026-02-12T03:48:18.068 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-base-debuginfo 2026-02-12T03:48:18.371 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:00:45 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:48:18.372 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:59 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:48:18.400 INFO:teuthology.orchestra.run.trial091.stdout:(2/2): ceph-base-debuginfo-20.2.0-626.g1279775f 39 MB/s | 107 MB 00:02 2026-02-12T03:48:18.401 INFO:teuthology.orchestra.run.trial091.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:48:18.401 INFO:teuthology.orchestra.run.trial091.stdout:Total 43 MB/s | 118 MB 00:02 2026-02-12T03:48:18.401 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction check 2026-02-12T03:48:18.407 INFO:teuthology.orchestra.run.trial091.stdout:Transaction check succeeded. 2026-02-12T03:48:18.407 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction test 2026-02-12T03:48:18.437 INFO:teuthology.orchestra.run.trial154.stdout:Package libcephfs2-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:48:18.455 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:48:18.456 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:48:18.457 INFO:teuthology.orchestra.run.trial154.stdout:Nothing to do. 2026-02-12T03:48:18.457 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:48:18.457 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:48:18.457 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repo Size 2026-02-12T03:48:18.457 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:48:18.457 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T03:48:18.457 INFO:teuthology.orchestra.run.trial111.stdout: ceph-base-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 107 M 2026-02-12T03:48:18.458 INFO:teuthology.orchestra.run.trial111.stdout:Installing weak dependencies: 2026-02-12T03:48:18.458 INFO:teuthology.orchestra.run.trial111.stdout: ceph-debugsource x86_64 2:20.2.0-626.g1279775f.el9 ceph 11 M 2026-02-12T03:48:18.458 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:18.458 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T03:48:18.458 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:48:18.458 INFO:teuthology.orchestra.run.trial111.stdout:Install 2 Packages 2026-02-12T03:48:18.458 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:18.458 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 118 M 2026-02-12T03:48:18.458 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 751 M 2026-02-12T03:48:18.458 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T03:48:18.478 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install libcephfs-devel 2026-02-12T03:48:18.778 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:00:45 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:48:18.819 INFO:teuthology.orchestra.run.trial091.stdout:Transaction test succeeded. 2026-02-12T03:48:18.819 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction 2026-02-12T03:48:18.861 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:48:18.862 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:48:18.862 INFO:teuthology.orchestra.run.trial154.stdout: Package Arch Version Repo Size 2026-02-12T03:48:18.862 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:48:18.862 INFO:teuthology.orchestra.run.trial154.stdout:Installing: 2026-02-12T03:48:18.862 INFO:teuthology.orchestra.run.trial154.stdout: libcephfs-devel x86_64 2:20.2.0-626.g1279775f.el9 ceph 34 k 2026-02-12T03:48:18.862 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:18.862 INFO:teuthology.orchestra.run.trial154.stdout:Transaction Summary 2026-02-12T03:48:18.862 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:48:18.863 INFO:teuthology.orchestra.run.trial154.stdout:Install 1 Package 2026-02-12T03:48:18.863 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:18.863 INFO:teuthology.orchestra.run.trial154.stdout:Total download size: 34 k 2026-02-12T03:48:18.863 INFO:teuthology.orchestra.run.trial154.stdout:Installed size: 155 k 2026-02-12T03:48:18.863 INFO:teuthology.orchestra.run.trial154.stdout:Downloading Packages: 2026-02-12T03:48:18.863 INFO:teuthology.orchestra.run.trial111.stdout:(1/2): ceph-debugsource-20.2.0-626.g1279775f.el 27 MB/s | 11 MB 00:00 2026-02-12T03:48:18.977 INFO:teuthology.orchestra.run.trial154.stdout:libcephfs-devel-20.2.0-626.g1279775f.el9.x86_64 298 kB/s | 34 kB 00:00 2026-02-12T03:48:18.978 INFO:teuthology.orchestra.run.trial154.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:48:18.979 INFO:teuthology.orchestra.run.trial154.stdout:Total 293 kB/s | 34 kB 00:00 2026-02-12T03:48:18.979 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction check 2026-02-12T03:48:18.981 INFO:teuthology.orchestra.run.trial154.stdout:Transaction check succeeded. 2026-02-12T03:48:18.982 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction test 2026-02-12T03:48:18.984 INFO:teuthology.orchestra.run.trial154.stdout:Transaction test succeeded. 2026-02-12T03:48:18.984 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction 2026-02-12T03:48:19.006 INFO:teuthology.orchestra.run.trial154.stdout: Preparing : 1/1 2026-02-12T03:48:19.022 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libcephfs-devel-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:19.057 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-12T03:48:19.081 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: libcephfs-devel-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:19.140 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libcephfs-devel-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:19.140 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:19.140 INFO:teuthology.orchestra.run.trial154.stdout:Installed: 2026-02-12T03:48:19.140 INFO:teuthology.orchestra.run.trial154.stdout: libcephfs-devel-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:19.140 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:19.140 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:48:19.168 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install librados2 2026-02-12T03:48:19.470 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:00:46 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:48:19.535 INFO:teuthology.orchestra.run.trial154.stdout:Package librados2-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:48:19.553 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:48:19.554 INFO:teuthology.orchestra.run.trial154.stdout:Nothing to do. 2026-02-12T03:48:19.554 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:48:19.575 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install librbd1 2026-02-12T03:48:19.881 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:00:46 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:48:19.946 INFO:teuthology.orchestra.run.trial154.stdout:Package librbd1-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:48:19.964 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:48:19.965 INFO:teuthology.orchestra.run.trial154.stdout:Nothing to do. 2026-02-12T03:48:19.965 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:48:19.986 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install python3-rados 2026-02-12T03:48:20.291 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:00:47 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:48:20.356 INFO:teuthology.orchestra.run.trial154.stdout:Package python3-rados-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:48:20.375 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:48:20.375 INFO:teuthology.orchestra.run.trial154.stdout:Nothing to do. 2026-02-12T03:48:20.375 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:48:20.398 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install python3-rgw 2026-02-12T03:48:20.698 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:00:47 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:48:20.706 INFO:teuthology.orchestra.run.trial111.stdout:(2/2): ceph-base-debuginfo-20.2.0-626.g1279775f 47 MB/s | 107 MB 00:02 2026-02-12T03:48:20.707 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:48:20.707 INFO:teuthology.orchestra.run.trial111.stdout:Total 52 MB/s | 118 MB 00:02 2026-02-12T03:48:20.707 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T03:48:20.713 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T03:48:20.713 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T03:48:20.764 INFO:teuthology.orchestra.run.trial154.stdout:Package python3-rgw-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:48:20.782 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:48:20.782 INFO:teuthology.orchestra.run.trial154.stdout:Nothing to do. 2026-02-12T03:48:20.783 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:48:20.805 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install python3-cephfs 2026-02-12T03:48:21.105 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:00:48 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:48:21.123 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T03:48:21.123 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T03:48:21.170 INFO:teuthology.orchestra.run.trial154.stdout:Package python3-cephfs-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:48:21.188 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:48:21.189 INFO:teuthology.orchestra.run.trial154.stdout:Nothing to do. 2026-02-12T03:48:21.189 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:48:21.211 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install python3-rbd 2026-02-12T03:48:21.294 INFO:teuthology.orchestra.run.trial091.stdout: Preparing : 1/1 2026-02-12T03:48:21.518 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:00:48 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:48:21.583 INFO:teuthology.orchestra.run.trial154.stdout:Package python3-rbd-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:48:21.601 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:48:21.602 INFO:teuthology.orchestra.run.trial154.stdout:Nothing to do. 2026-02-12T03:48:21.602 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:48:21.624 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install rbd-fuse 2026-02-12T03:48:21.924 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:00:48 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:48:22.009 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:48:22.009 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:48:22.009 INFO:teuthology.orchestra.run.trial154.stdout: Package Architecture Version Repository Size 2026-02-12T03:48:22.009 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:48:22.010 INFO:teuthology.orchestra.run.trial154.stdout:Installing: 2026-02-12T03:48:22.010 INFO:teuthology.orchestra.run.trial154.stdout: rbd-fuse x86_64 2:20.2.0-626.g1279775f.el9 ceph 91 k 2026-02-12T03:48:22.010 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:22.010 INFO:teuthology.orchestra.run.trial154.stdout:Transaction Summary 2026-02-12T03:48:22.010 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:48:22.010 INFO:teuthology.orchestra.run.trial154.stdout:Install 1 Package 2026-02-12T03:48:22.010 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:22.010 INFO:teuthology.orchestra.run.trial154.stdout:Total download size: 91 k 2026-02-12T03:48:22.010 INFO:teuthology.orchestra.run.trial154.stdout:Installed size: 238 k 2026-02-12T03:48:22.010 INFO:teuthology.orchestra.run.trial154.stdout:Downloading Packages: 2026-02-12T03:48:22.084 INFO:teuthology.orchestra.run.trial154.stdout:rbd-fuse-20.2.0-626.g1279775f.el9.x86_64.rpm 1.2 MB/s | 91 kB 00:00 2026-02-12T03:48:22.085 INFO:teuthology.orchestra.run.trial154.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:48:22.085 INFO:teuthology.orchestra.run.trial154.stdout:Total 1.2 MB/s | 91 kB 00:00 2026-02-12T03:48:22.085 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction check 2026-02-12T03:48:22.089 INFO:teuthology.orchestra.run.trial154.stdout:Transaction check succeeded. 2026-02-12T03:48:22.090 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction test 2026-02-12T03:48:22.123 INFO:teuthology.orchestra.run.trial154.stdout:Transaction test succeeded. 2026-02-12T03:48:22.123 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction 2026-02-12T03:48:22.175 INFO:teuthology.orchestra.run.trial154.stdout: Preparing : 1/1 2026-02-12T03:48:22.192 INFO:teuthology.orchestra.run.trial154.stdout: Installing : rbd-fuse-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:22.274 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: rbd-fuse-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:22.332 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : rbd-fuse-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:22.332 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:22.333 INFO:teuthology.orchestra.run.trial154.stdout:Installed: 2026-02-12T03:48:22.333 INFO:teuthology.orchestra.run.trial154.stdout: rbd-fuse-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:22.333 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:22.333 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:48:22.361 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install rbd-mirror 2026-02-12T03:48:22.669 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:00:49 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:48:22.753 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:48:22.753 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:48:22.754 INFO:teuthology.orchestra.run.trial154.stdout: Package Arch Version Repo Size 2026-02-12T03:48:22.754 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:48:22.754 INFO:teuthology.orchestra.run.trial154.stdout:Installing: 2026-02-12T03:48:22.754 INFO:teuthology.orchestra.run.trial154.stdout: rbd-mirror x86_64 2:20.2.0-626.g1279775f.el9 ceph 2.9 M 2026-02-12T03:48:22.754 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:22.754 INFO:teuthology.orchestra.run.trial154.stdout:Transaction Summary 2026-02-12T03:48:22.754 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:48:22.754 INFO:teuthology.orchestra.run.trial154.stdout:Install 1 Package 2026-02-12T03:48:22.754 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:22.754 INFO:teuthology.orchestra.run.trial154.stdout:Total download size: 2.9 M 2026-02-12T03:48:22.755 INFO:teuthology.orchestra.run.trial154.stdout:Installed size: 11 M 2026-02-12T03:48:22.755 INFO:teuthology.orchestra.run.trial154.stdout:Downloading Packages: 2026-02-12T03:48:22.898 INFO:teuthology.orchestra.run.trial154.stdout:rbd-mirror-20.2.0-626.g1279775f.el9.x86_64.rpm 20 MB/s | 2.9 MB 00:00 2026-02-12T03:48:22.899 INFO:teuthology.orchestra.run.trial154.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:48:22.899 INFO:teuthology.orchestra.run.trial154.stdout:Total 20 MB/s | 2.9 MB 00:00 2026-02-12T03:48:22.900 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction check 2026-02-12T03:48:22.904 INFO:teuthology.orchestra.run.trial154.stdout:Transaction check succeeded. 2026-02-12T03:48:22.904 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction test 2026-02-12T03:48:22.944 INFO:teuthology.orchestra.run.trial154.stdout:Transaction test succeeded. 2026-02-12T03:48:22.944 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction 2026-02-12T03:48:23.124 INFO:teuthology.orchestra.run.trial154.stdout: Preparing : 1/1 2026-02-12T03:48:23.125 INFO:teuthology.orchestra.run.trial154.stdout: Installing : rbd-mirror-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:23.148 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: rbd-mirror-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:23.148 INFO:teuthology.orchestra.run.trial154.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T03:48:23.148 INFO:teuthology.orchestra.run.trial154.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-12T03:48:23.148 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T03:48:23.148 INFO:teuthology.orchestra.run.trial154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T03:48:23.148 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:23.467 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : rbd-mirror-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:23.467 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:23.467 INFO:teuthology.orchestra.run.trial154.stdout:Installed: 2026-02-12T03:48:23.467 INFO:teuthology.orchestra.run.trial154.stdout: rbd-mirror-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:23.467 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:23.467 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:48:23.496 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install rbd-nbd 2026-02-12T03:48:23.624 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T03:48:23.808 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:00:50 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:48:23.894 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:48:23.894 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:48:23.894 INFO:teuthology.orchestra.run.trial154.stdout: Package Architecture Version Repository Size 2026-02-12T03:48:23.894 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:48:23.894 INFO:teuthology.orchestra.run.trial154.stdout:Installing: 2026-02-12T03:48:23.894 INFO:teuthology.orchestra.run.trial154.stdout: rbd-nbd x86_64 2:20.2.0-626.g1279775f.el9 ceph 180 k 2026-02-12T03:48:23.894 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:23.895 INFO:teuthology.orchestra.run.trial154.stdout:Transaction Summary 2026-02-12T03:48:23.895 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:48:23.895 INFO:teuthology.orchestra.run.trial154.stdout:Install 1 Package 2026-02-12T03:48:23.895 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:23.895 INFO:teuthology.orchestra.run.trial154.stdout:Total download size: 180 k 2026-02-12T03:48:23.895 INFO:teuthology.orchestra.run.trial154.stdout:Installed size: 498 k 2026-02-12T03:48:23.895 INFO:teuthology.orchestra.run.trial154.stdout:Downloading Packages: 2026-02-12T03:48:23.979 INFO:teuthology.orchestra.run.trial154.stdout:rbd-nbd-20.2.0-626.g1279775f.el9.x86_64.rpm 2.1 MB/s | 180 kB 00:00 2026-02-12T03:48:23.979 INFO:teuthology.orchestra.run.trial154.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:48:23.980 INFO:teuthology.orchestra.run.trial154.stdout:Total 2.0 MB/s | 180 kB 00:00 2026-02-12T03:48:23.980 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction check 2026-02-12T03:48:23.985 INFO:teuthology.orchestra.run.trial154.stdout:Transaction check succeeded. 2026-02-12T03:48:23.986 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction test 2026-02-12T03:48:24.018 INFO:teuthology.orchestra.run.trial154.stdout:Transaction test succeeded. 2026-02-12T03:48:24.018 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction 2026-02-12T03:48:24.075 INFO:teuthology.orchestra.run.trial154.stdout: Preparing : 1/1 2026-02-12T03:48:24.091 INFO:teuthology.orchestra.run.trial154.stdout: Installing : rbd-nbd-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:24.176 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: rbd-nbd-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:24.234 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : rbd-nbd-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:48:24.234 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:24.234 INFO:teuthology.orchestra.run.trial154.stdout:Installed: 2026-02-12T03:48:24.234 INFO:teuthology.orchestra.run.trial154.stdout: rbd-nbd-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:24.234 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:24.235 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:48:24.264 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install ceph-base-debuginfo 2026-02-12T03:48:24.566 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:00:51 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:48:24.599 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-debugsource-2:20.2.0-626.g1279775f.el9.x86_64 1/2 2026-02-12T03:48:24.618 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-base-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 2/2 2026-02-12T03:48:24.650 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:48:24.651 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:48:24.651 INFO:teuthology.orchestra.run.trial154.stdout: Package Arch Version Repo Size 2026-02-12T03:48:24.651 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:48:24.651 INFO:teuthology.orchestra.run.trial154.stdout:Installing: 2026-02-12T03:48:24.651 INFO:teuthology.orchestra.run.trial154.stdout: ceph-base-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 107 M 2026-02-12T03:48:24.651 INFO:teuthology.orchestra.run.trial154.stdout:Installing weak dependencies: 2026-02-12T03:48:24.651 INFO:teuthology.orchestra.run.trial154.stdout: ceph-debugsource x86_64 2:20.2.0-626.g1279775f.el9 ceph 11 M 2026-02-12T03:48:24.651 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:24.651 INFO:teuthology.orchestra.run.trial154.stdout:Transaction Summary 2026-02-12T03:48:24.652 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:48:24.652 INFO:teuthology.orchestra.run.trial154.stdout:Install 2 Packages 2026-02-12T03:48:24.652 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:24.652 INFO:teuthology.orchestra.run.trial154.stdout:Total download size: 118 M 2026-02-12T03:48:24.652 INFO:teuthology.orchestra.run.trial154.stdout:Installed size: 751 M 2026-02-12T03:48:24.652 INFO:teuthology.orchestra.run.trial154.stdout:Downloading Packages: 2026-02-12T03:48:25.073 INFO:teuthology.orchestra.run.trial154.stdout:(1/2): ceph-debugsource-20.2.0-626.g1279775f.el 26 MB/s | 11 MB 00:00 2026-02-12T03:48:25.223 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-base-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 2/2 2026-02-12T03:48:25.223 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-base-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/2 2026-02-12T03:48:25.281 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-debugsource-2:20.2.0-626.g1279775f.el9.x86_64 2/2 2026-02-12T03:48:25.281 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:25.281 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-12T03:48:25.281 INFO:teuthology.orchestra.run.trial098.stdout: ceph-base-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:25.281 INFO:teuthology.orchestra.run.trial098.stdout: ceph-debugsource-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:25.281 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:25.281 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:48:25.325 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install ceph-common-debuginfo 2026-02-12T03:48:25.635 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:01:05 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:48:25.719 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:48:25.719 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:48:25.719 INFO:teuthology.orchestra.run.trial098.stdout: Package Arch Version Repo Size 2026-02-12T03:48:25.719 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:48:25.720 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-12T03:48:25.720 INFO:teuthology.orchestra.run.trial098.stdout: ceph-common-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 586 M 2026-02-12T03:48:25.720 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:25.720 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-12T03:48:25.720 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:48:25.720 INFO:teuthology.orchestra.run.trial098.stdout:Install 1 Package 2026-02-12T03:48:25.720 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:48:25.720 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 586 M 2026-02-12T03:48:25.720 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 3.4 G 2026-02-12T03:48:25.720 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-12T03:48:26.933 INFO:teuthology.orchestra.run.trial154.stdout:(2/2): ceph-base-debuginfo-20.2.0-626.g1279775f 47 MB/s | 107 MB 00:02 2026-02-12T03:48:26.934 INFO:teuthology.orchestra.run.trial154.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:48:26.934 INFO:teuthology.orchestra.run.trial154.stdout:Total 52 MB/s | 118 MB 00:02 2026-02-12T03:48:26.935 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction check 2026-02-12T03:48:26.940 INFO:teuthology.orchestra.run.trial154.stdout:Transaction check succeeded. 2026-02-12T03:48:26.940 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction test 2026-02-12T03:48:26.946 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-debugsource-2:20.2.0-626.g1279775f.el9.x86_64 1/2 2026-02-12T03:48:26.965 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-base-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 2/2 2026-02-12T03:48:27.354 INFO:teuthology.orchestra.run.trial154.stdout:Transaction test succeeded. 2026-02-12T03:48:27.354 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction 2026-02-12T03:48:27.593 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-base-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 2/2 2026-02-12T03:48:27.593 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-base-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/2 2026-02-12T03:48:27.650 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-debugsource-2:20.2.0-626.g1279775f.el9.x86_64 2/2 2026-02-12T03:48:27.650 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:27.650 INFO:teuthology.orchestra.run.trial091.stdout:Installed: 2026-02-12T03:48:27.650 INFO:teuthology.orchestra.run.trial091.stdout: ceph-base-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:27.650 INFO:teuthology.orchestra.run.trial091.stdout: ceph-debugsource-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:27.651 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:27.651 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:48:27.692 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install ceph-common-debuginfo 2026-02-12T03:48:27.999 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:01:04 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:48:28.082 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:48:28.083 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:48:28.083 INFO:teuthology.orchestra.run.trial091.stdout: Package Arch Version Repo Size 2026-02-12T03:48:28.083 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:48:28.083 INFO:teuthology.orchestra.run.trial091.stdout:Installing: 2026-02-12T03:48:28.083 INFO:teuthology.orchestra.run.trial091.stdout: ceph-common-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 586 M 2026-02-12T03:48:28.083 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:28.083 INFO:teuthology.orchestra.run.trial091.stdout:Transaction Summary 2026-02-12T03:48:28.083 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:48:28.083 INFO:teuthology.orchestra.run.trial091.stdout:Install 1 Package 2026-02-12T03:48:28.084 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:48:28.084 INFO:teuthology.orchestra.run.trial091.stdout:Total download size: 586 M 2026-02-12T03:48:28.084 INFO:teuthology.orchestra.run.trial091.stdout:Installed size: 3.4 G 2026-02-12T03:48:28.084 INFO:teuthology.orchestra.run.trial091.stdout:Downloading Packages: 2026-02-12T03:48:29.167 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-debugsource-2:20.2.0-626.g1279775f.el9.x86_64 1/2 2026-02-12T03:48:29.186 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-base-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 2/2 2026-02-12T03:48:29.793 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-base-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 2/2 2026-02-12T03:48:29.793 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-base-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/2 2026-02-12T03:48:29.840 INFO:teuthology.orchestra.run.trial154.stdout: Preparing : 1/1 2026-02-12T03:48:29.851 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-debugsource-2:20.2.0-626.g1279775f.el9.x86_64 2/2 2026-02-12T03:48:29.851 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:29.851 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T03:48:29.851 INFO:teuthology.orchestra.run.trial111.stdout: ceph-base-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:29.851 INFO:teuthology.orchestra.run.trial111.stdout: ceph-debugsource-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:29.852 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:29.852 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:48:29.893 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-common-debuginfo 2026-02-12T03:48:30.189 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:01:11 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:48:30.273 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:48:30.274 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:48:30.274 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repo Size 2026-02-12T03:48:30.274 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:48:30.274 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T03:48:30.274 INFO:teuthology.orchestra.run.trial111.stdout: ceph-common-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 586 M 2026-02-12T03:48:30.274 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:30.274 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T03:48:30.274 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:48:30.274 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-12T03:48:30.275 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:48:30.275 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 586 M 2026-02-12T03:48:30.275 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 3.4 G 2026-02-12T03:48:30.275 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T03:48:35.489 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-debugsource-2:20.2.0-626.g1279775f.el9.x86_64 1/2 2026-02-12T03:48:35.508 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-base-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 2/2 2026-02-12T03:48:36.141 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-base-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 2/2 2026-02-12T03:48:36.141 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-base-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/2 2026-02-12T03:48:36.199 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-debugsource-2:20.2.0-626.g1279775f.el9.x86_64 2/2 2026-02-12T03:48:36.199 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:36.199 INFO:teuthology.orchestra.run.trial154.stdout:Installed: 2026-02-12T03:48:36.200 INFO:teuthology.orchestra.run.trial154.stdout: ceph-base-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:36.200 INFO:teuthology.orchestra.run.trial154.stdout: ceph-debugsource-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:48:36.200 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:36.200 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:48:36.241 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install ceph-common-debuginfo 2026-02-12T03:48:36.555 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:01:03 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:48:36.638 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:48:36.639 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:48:36.639 INFO:teuthology.orchestra.run.trial154.stdout: Package Arch Version Repo Size 2026-02-12T03:48:36.639 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:48:36.639 INFO:teuthology.orchestra.run.trial154.stdout:Installing: 2026-02-12T03:48:36.639 INFO:teuthology.orchestra.run.trial154.stdout: ceph-common-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 586 M 2026-02-12T03:48:36.640 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:36.640 INFO:teuthology.orchestra.run.trial154.stdout:Transaction Summary 2026-02-12T03:48:36.640 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:48:36.640 INFO:teuthology.orchestra.run.trial154.stdout:Install 1 Package 2026-02-12T03:48:36.640 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:48:36.640 INFO:teuthology.orchestra.run.trial154.stdout:Total download size: 586 M 2026-02-12T03:48:36.640 INFO:teuthology.orchestra.run.trial154.stdout:Installed size: 3.4 G 2026-02-12T03:48:36.640 INFO:teuthology.orchestra.run.trial154.stdout:Downloading Packages: 2026-02-12T03:48:50.440 INFO:teuthology.orchestra.run.trial098.stdout:ceph-common-debuginfo-20.2.0-626.g1279775f.el9. 24 MB/s | 586 MB 00:24 2026-02-12T03:48:50.441 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:48:50.441 INFO:teuthology.orchestra.run.trial098.stdout:Total 24 MB/s | 586 MB 00:24 2026-02-12T03:48:50.441 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-12T03:48:50.443 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-12T03:48:50.443 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-12T03:48:52.182 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-12T03:48:52.182 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-12T03:48:59.129 INFO:teuthology.orchestra.run.trial111.stdout:ceph-common-debuginfo-20.2.0-626.g1279775f.el9. 20 MB/s | 586 MB 00:28 2026-02-12T03:48:59.130 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:48:59.130 INFO:teuthology.orchestra.run.trial111.stdout:Total 20 MB/s | 586 MB 00:28 2026-02-12T03:48:59.130 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T03:48:59.132 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T03:48:59.132 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T03:49:00.866 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T03:49:00.866 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T03:49:24.701 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-12T03:49:24.719 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-common-debuginfo-2:20.2.0-626.g1279775f.el9.x86 1/1 2026-02-12T03:49:27.220 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-common-debuginfo-2:20.2.0-626.g1279775f.el9.x86 1/1 2026-02-12T03:49:27.277 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-common-debuginfo-2:20.2.0-626.g1279775f.el9.x86 1/1 2026-02-12T03:49:27.277 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:49:27.278 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-12T03:49:27.278 INFO:teuthology.orchestra.run.trial098.stdout: ceph-common-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:49:27.278 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:49:27.278 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:49:27.363 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-12T03:49:27.671 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:02:07 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:49:27.756 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:49:27.756 INFO:teuthology.orchestra.run.trial098.stdout:======================================================================================= 2026-02-12T03:49:27.756 INFO:teuthology.orchestra.run.trial098.stdout: Package Arch Version Repo Size 2026-02-12T03:49:27.756 INFO:teuthology.orchestra.run.trial098.stdout:======================================================================================= 2026-02-12T03:49:27.756 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-12T03:49:27.756 INFO:teuthology.orchestra.run.trial098.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 3.0 M 2026-02-12T03:49:27.756 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:49:27.756 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-12T03:49:27.756 INFO:teuthology.orchestra.run.trial098.stdout:======================================================================================= 2026-02-12T03:49:27.756 INFO:teuthology.orchestra.run.trial098.stdout:Install 1 Package 2026-02-12T03:49:27.756 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:49:27.756 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 3.0 M 2026-02-12T03:49:27.756 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 15 M 2026-02-12T03:49:27.756 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-12T03:49:28.422 INFO:teuthology.orchestra.run.trial098.stdout:ceph-immutable-object-cache-debuginfo-20.2.0-62 4.6 MB/s | 3.0 MB 00:00 2026-02-12T03:49:28.422 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:49:28.422 INFO:teuthology.orchestra.run.trial098.stdout:Total 4.6 MB/s | 3.0 MB 00:00 2026-02-12T03:49:28.422 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-12T03:49:28.423 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-12T03:49:28.424 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-12T03:49:28.450 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-12T03:49:28.450 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-12T03:49:28.638 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-12T03:49:28.655 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:20.2.0-626.g 1/1 2026-02-12T03:49:28.719 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:20.2.0-626.g 1/1 2026-02-12T03:49:28.776 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:20.2.0-626.g 1/1 2026-02-12T03:49:28.776 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:49:28.777 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-12T03:49:28.777 INFO:teuthology.orchestra.run.trial098.stdout: ceph-immutable-object-cache-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:49:28.777 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:49:28.777 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:49:28.803 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-12T03:49:29.105 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:02:09 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:49:29.187 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:49:29.188 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:49:29.188 INFO:teuthology.orchestra.run.trial098.stdout: Package Arch Version Repo Size 2026-02-12T03:49:29.188 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:49:29.188 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-12T03:49:29.188 INFO:teuthology.orchestra.run.trial098.stdout: ceph-radosgw-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 543 M 2026-02-12T03:49:29.188 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:49:29.188 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-12T03:49:29.188 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:49:29.188 INFO:teuthology.orchestra.run.trial098.stdout:Install 1 Package 2026-02-12T03:49:29.189 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:49:29.189 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 543 M 2026-02-12T03:49:29.189 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 4.0 G 2026-02-12T03:49:29.189 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-12T03:49:33.318 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T03:49:33.336 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-common-debuginfo-2:20.2.0-626.g1279775f.el9.x86 1/1 2026-02-12T03:49:35.961 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-common-debuginfo-2:20.2.0-626.g1279775f.el9.x86 1/1 2026-02-12T03:49:36.018 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-common-debuginfo-2:20.2.0-626.g1279775f.el9.x86 1/1 2026-02-12T03:49:36.018 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:49:36.018 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T03:49:36.018 INFO:teuthology.orchestra.run.trial111.stdout: ceph-common-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:49:36.018 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:49:36.018 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:49:36.100 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-12T03:49:36.402 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:02:17 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:49:36.488 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:49:36.488 INFO:teuthology.orchestra.run.trial111.stdout:======================================================================================= 2026-02-12T03:49:36.488 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repo Size 2026-02-12T03:49:36.489 INFO:teuthology.orchestra.run.trial111.stdout:======================================================================================= 2026-02-12T03:49:36.489 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T03:49:36.489 INFO:teuthology.orchestra.run.trial111.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 3.0 M 2026-02-12T03:49:36.489 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:49:36.489 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T03:49:36.489 INFO:teuthology.orchestra.run.trial111.stdout:======================================================================================= 2026-02-12T03:49:36.489 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-12T03:49:36.489 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:49:36.489 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 3.0 M 2026-02-12T03:49:36.490 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 15 M 2026-02-12T03:49:36.490 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T03:49:37.642 INFO:teuthology.orchestra.run.trial111.stdout:ceph-immutable-object-cache-debuginfo-20.2.0-62 2.6 MB/s | 3.0 MB 00:01 2026-02-12T03:49:37.642 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:49:37.642 INFO:teuthology.orchestra.run.trial111.stdout:Total 2.6 MB/s | 3.0 MB 00:01 2026-02-12T03:49:37.642 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T03:49:37.643 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T03:49:37.644 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T03:49:37.670 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T03:49:37.670 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T03:49:37.855 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T03:49:37.872 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:20.2.0-626.g 1/1 2026-02-12T03:49:37.935 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:20.2.0-626.g 1/1 2026-02-12T03:49:37.992 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:20.2.0-626.g 1/1 2026-02-12T03:49:37.992 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:49:37.992 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T03:49:37.992 INFO:teuthology.orchestra.run.trial111.stdout: ceph-immutable-object-cache-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:49:37.992 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:49:37.992 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:49:38.018 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-12T03:49:38.318 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:02:19 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:49:38.401 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:49:38.402 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:49:38.402 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repo Size 2026-02-12T03:49:38.402 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:49:38.403 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T03:49:38.403 INFO:teuthology.orchestra.run.trial111.stdout: ceph-radosgw-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 543 M 2026-02-12T03:49:38.403 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:49:38.403 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T03:49:38.403 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:49:38.403 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-12T03:49:38.403 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:49:38.403 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 543 M 2026-02-12T03:49:38.403 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 4.0 G 2026-02-12T03:49:38.403 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T03:49:39.777 INFO:teuthology.orchestra.run.trial091.stdout:ceph-common-debuginfo-20.2.0-626.g1279775f.el9. 8.2 MB/s | 586 MB 01:11 2026-02-12T03:49:39.778 INFO:teuthology.orchestra.run.trial091.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:49:39.778 INFO:teuthology.orchestra.run.trial091.stdout:Total 8.2 MB/s | 586 MB 01:11 2026-02-12T03:49:39.779 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction check 2026-02-12T03:49:39.780 INFO:teuthology.orchestra.run.trial091.stdout:Transaction check succeeded. 2026-02-12T03:49:39.780 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction test 2026-02-12T03:49:41.508 INFO:teuthology.orchestra.run.trial091.stdout:Transaction test succeeded. 2026-02-12T03:49:41.508 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction 2026-02-12T03:49:45.054 INFO:teuthology.orchestra.run.trial154.stdout:ceph-common-debuginfo-20.2.0-626.g1279775f.el9. 8.6 MB/s | 586 MB 01:08 2026-02-12T03:49:45.055 INFO:teuthology.orchestra.run.trial154.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:49:45.056 INFO:teuthology.orchestra.run.trial154.stdout:Total 8.6 MB/s | 586 MB 01:08 2026-02-12T03:49:45.056 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction check 2026-02-12T03:49:45.057 INFO:teuthology.orchestra.run.trial154.stdout:Transaction check succeeded. 2026-02-12T03:49:45.058 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction test 2026-02-12T03:49:46.796 INFO:teuthology.orchestra.run.trial154.stdout:Transaction test succeeded. 2026-02-12T03:49:46.796 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction 2026-02-12T03:49:54.150 INFO:teuthology.orchestra.run.trial098.stdout:ceph-radosgw-debuginfo-20.2.0-626.g1279775f.el9 22 MB/s | 543 MB 00:24 2026-02-12T03:49:54.151 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:49:54.151 INFO:teuthology.orchestra.run.trial098.stdout:Total 22 MB/s | 543 MB 00:24 2026-02-12T03:49:54.151 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-12T03:49:54.153 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-12T03:49:54.154 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-12T03:49:55.767 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-12T03:49:55.767 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-12T03:50:02.764 INFO:teuthology.orchestra.run.trial111.stdout:ceph-radosgw-debuginfo-20.2.0-626.g1279775f.el9 22 MB/s | 543 MB 00:24 2026-02-12T03:50:02.765 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:50:02.765 INFO:teuthology.orchestra.run.trial111.stdout:Total 22 MB/s | 543 MB 00:24 2026-02-12T03:50:02.765 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T03:50:02.767 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T03:50:02.767 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T03:50:04.379 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T03:50:04.379 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T03:50:13.429 INFO:teuthology.orchestra.run.trial091.stdout: Preparing : 1/1 2026-02-12T03:50:13.448 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-common-debuginfo-2:20.2.0-626.g1279775f.el9.x86 1/1 2026-02-12T03:50:13.629 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-common-debuginfo-2:20.2.0-626.g1279775f.el9.x86 1/1 2026-02-12T03:50:13.687 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-common-debuginfo-2:20.2.0-626.g1279775f.el9.x86 1/1 2026-02-12T03:50:13.688 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:50:13.688 INFO:teuthology.orchestra.run.trial091.stdout:Installed: 2026-02-12T03:50:13.688 INFO:teuthology.orchestra.run.trial091.stdout: ceph-common-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:50:13.688 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:50:13.688 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:50:13.767 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-12T03:50:14.066 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:02:51 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:50:14.152 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:50:14.152 INFO:teuthology.orchestra.run.trial091.stdout:======================================================================================= 2026-02-12T03:50:14.152 INFO:teuthology.orchestra.run.trial091.stdout: Package Arch Version Repo Size 2026-02-12T03:50:14.152 INFO:teuthology.orchestra.run.trial091.stdout:======================================================================================= 2026-02-12T03:50:14.152 INFO:teuthology.orchestra.run.trial091.stdout:Installing: 2026-02-12T03:50:14.152 INFO:teuthology.orchestra.run.trial091.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 3.0 M 2026-02-12T03:50:14.153 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:50:14.153 INFO:teuthology.orchestra.run.trial091.stdout:Transaction Summary 2026-02-12T03:50:14.153 INFO:teuthology.orchestra.run.trial091.stdout:======================================================================================= 2026-02-12T03:50:14.153 INFO:teuthology.orchestra.run.trial091.stdout:Install 1 Package 2026-02-12T03:50:14.153 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:50:14.153 INFO:teuthology.orchestra.run.trial091.stdout:Total download size: 3.0 M 2026-02-12T03:50:14.153 INFO:teuthology.orchestra.run.trial091.stdout:Installed size: 15 M 2026-02-12T03:50:14.153 INFO:teuthology.orchestra.run.trial091.stdout:Downloading Packages: 2026-02-12T03:50:14.300 INFO:teuthology.orchestra.run.trial091.stdout:ceph-immutable-object-cache-debuginfo-20.2.0-62 21 MB/s | 3.0 MB 00:00 2026-02-12T03:50:14.301 INFO:teuthology.orchestra.run.trial091.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:50:14.301 INFO:teuthology.orchestra.run.trial091.stdout:Total 20 MB/s | 3.0 MB 00:00 2026-02-12T03:50:14.301 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction check 2026-02-12T03:50:14.302 INFO:teuthology.orchestra.run.trial091.stdout:Transaction check succeeded. 2026-02-12T03:50:14.302 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction test 2026-02-12T03:50:14.328 INFO:teuthology.orchestra.run.trial091.stdout:Transaction test succeeded. 2026-02-12T03:50:14.329 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction 2026-02-12T03:50:14.516 INFO:teuthology.orchestra.run.trial091.stdout: Preparing : 1/1 2026-02-12T03:50:14.533 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:20.2.0-626.g 1/1 2026-02-12T03:50:14.596 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:20.2.0-626.g 1/1 2026-02-12T03:50:14.654 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:20.2.0-626.g 1/1 2026-02-12T03:50:14.654 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:50:14.654 INFO:teuthology.orchestra.run.trial091.stdout:Installed: 2026-02-12T03:50:14.654 INFO:teuthology.orchestra.run.trial091.stdout: ceph-immutable-object-cache-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:50:14.654 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:50:14.654 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:50:14.680 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-12T03:50:14.980 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:02:51 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:50:15.062 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:50:15.063 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:50:15.063 INFO:teuthology.orchestra.run.trial091.stdout: Package Arch Version Repo Size 2026-02-12T03:50:15.063 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:50:15.063 INFO:teuthology.orchestra.run.trial091.stdout:Installing: 2026-02-12T03:50:15.063 INFO:teuthology.orchestra.run.trial091.stdout: ceph-radosgw-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 543 M 2026-02-12T03:50:15.063 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:50:15.063 INFO:teuthology.orchestra.run.trial091.stdout:Transaction Summary 2026-02-12T03:50:15.063 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:50:15.063 INFO:teuthology.orchestra.run.trial091.stdout:Install 1 Package 2026-02-12T03:50:15.063 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:50:15.063 INFO:teuthology.orchestra.run.trial091.stdout:Total download size: 543 M 2026-02-12T03:50:15.063 INFO:teuthology.orchestra.run.trial091.stdout:Installed size: 4.0 G 2026-02-12T03:50:15.063 INFO:teuthology.orchestra.run.trial091.stdout:Downloading Packages: 2026-02-12T03:50:18.561 INFO:teuthology.orchestra.run.trial154.stdout: Preparing : 1/1 2026-02-12T03:50:18.580 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-common-debuginfo-2:20.2.0-626.g1279775f.el9.x86 1/1 2026-02-12T03:50:20.982 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-common-debuginfo-2:20.2.0-626.g1279775f.el9.x86 1/1 2026-02-12T03:50:21.040 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-common-debuginfo-2:20.2.0-626.g1279775f.el9.x86 1/1 2026-02-12T03:50:21.040 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:50:21.041 INFO:teuthology.orchestra.run.trial154.stdout:Installed: 2026-02-12T03:50:21.041 INFO:teuthology.orchestra.run.trial154.stdout: ceph-common-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:50:21.041 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:50:21.041 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:50:21.123 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2026-02-12T03:50:21.424 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:02:48 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:50:21.508 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:50:21.508 INFO:teuthology.orchestra.run.trial154.stdout:======================================================================================= 2026-02-12T03:50:21.509 INFO:teuthology.orchestra.run.trial154.stdout: Package Arch Version Repo Size 2026-02-12T03:50:21.509 INFO:teuthology.orchestra.run.trial154.stdout:======================================================================================= 2026-02-12T03:50:21.509 INFO:teuthology.orchestra.run.trial154.stdout:Installing: 2026-02-12T03:50:21.509 INFO:teuthology.orchestra.run.trial154.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 3.0 M 2026-02-12T03:50:21.509 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:50:21.509 INFO:teuthology.orchestra.run.trial154.stdout:Transaction Summary 2026-02-12T03:50:21.509 INFO:teuthology.orchestra.run.trial154.stdout:======================================================================================= 2026-02-12T03:50:21.509 INFO:teuthology.orchestra.run.trial154.stdout:Install 1 Package 2026-02-12T03:50:21.509 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:50:21.509 INFO:teuthology.orchestra.run.trial154.stdout:Total download size: 3.0 M 2026-02-12T03:50:21.510 INFO:teuthology.orchestra.run.trial154.stdout:Installed size: 15 M 2026-02-12T03:50:21.510 INFO:teuthology.orchestra.run.trial154.stdout:Downloading Packages: 2026-02-12T03:50:22.152 INFO:teuthology.orchestra.run.trial154.stdout:ceph-immutable-object-cache-debuginfo-20.2.0-62 4.7 MB/s | 3.0 MB 00:00 2026-02-12T03:50:22.152 INFO:teuthology.orchestra.run.trial154.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:50:22.153 INFO:teuthology.orchestra.run.trial154.stdout:Total 4.7 MB/s | 3.0 MB 00:00 2026-02-12T03:50:22.153 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction check 2026-02-12T03:50:22.154 INFO:teuthology.orchestra.run.trial154.stdout:Transaction check succeeded. 2026-02-12T03:50:22.154 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction test 2026-02-12T03:50:22.181 INFO:teuthology.orchestra.run.trial154.stdout:Transaction test succeeded. 2026-02-12T03:50:22.181 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction 2026-02-12T03:50:22.371 INFO:teuthology.orchestra.run.trial154.stdout: Preparing : 1/1 2026-02-12T03:50:22.388 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:20.2.0-626.g 1/1 2026-02-12T03:50:22.459 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:20.2.0-626.g 1/1 2026-02-12T03:50:22.519 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:20.2.0-626.g 1/1 2026-02-12T03:50:22.519 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:50:22.519 INFO:teuthology.orchestra.run.trial154.stdout:Installed: 2026-02-12T03:50:22.519 INFO:teuthology.orchestra.run.trial154.stdout: ceph-immutable-object-cache-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:50:22.520 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:50:22.520 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:50:22.549 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install ceph-radosgw-debuginfo 2026-02-12T03:50:22.854 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:02:49 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:50:22.937 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:50:22.937 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:50:22.937 INFO:teuthology.orchestra.run.trial154.stdout: Package Arch Version Repo Size 2026-02-12T03:50:22.938 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:50:22.938 INFO:teuthology.orchestra.run.trial154.stdout:Installing: 2026-02-12T03:50:22.938 INFO:teuthology.orchestra.run.trial154.stdout: ceph-radosgw-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 543 M 2026-02-12T03:50:22.938 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:50:22.938 INFO:teuthology.orchestra.run.trial154.stdout:Transaction Summary 2026-02-12T03:50:22.938 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:50:22.938 INFO:teuthology.orchestra.run.trial154.stdout:Install 1 Package 2026-02-12T03:50:22.938 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:50:22.938 INFO:teuthology.orchestra.run.trial154.stdout:Total download size: 543 M 2026-02-12T03:50:22.938 INFO:teuthology.orchestra.run.trial154.stdout:Installed size: 4.0 G 2026-02-12T03:50:22.938 INFO:teuthology.orchestra.run.trial154.stdout:Downloading Packages: 2026-02-12T03:50:27.986 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-12T03:50:28.004 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-radosgw-debuginfo-2:20.2.0-626.g1279775f.el9.x8 1/1 2026-02-12T03:50:29.541 INFO:teuthology.orchestra.run.trial091.stdout:ceph-radosgw-debuginfo-20.2.0-626.g1279775f.el9 38 MB/s | 543 MB 00:14 2026-02-12T03:50:29.542 INFO:teuthology.orchestra.run.trial091.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:50:29.542 INFO:teuthology.orchestra.run.trial091.stdout:Total 38 MB/s | 543 MB 00:14 2026-02-12T03:50:29.543 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction check 2026-02-12T03:50:29.544 INFO:teuthology.orchestra.run.trial091.stdout:Transaction check succeeded. 2026-02-12T03:50:29.544 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction test 2026-02-12T03:50:30.942 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:20.2.0-626.g1279775f.el9.x8 1/1 2026-02-12T03:50:31.000 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-radosgw-debuginfo-2:20.2.0-626.g1279775f.el9.x8 1/1 2026-02-12T03:50:31.000 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:50:31.000 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-12T03:50:31.000 INFO:teuthology.orchestra.run.trial098.stdout: ceph-radosgw-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:50:31.000 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:50:31.000 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:50:31.082 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install ceph-test-debuginfo 2026-02-12T03:50:31.151 INFO:teuthology.orchestra.run.trial091.stdout:Transaction test succeeded. 2026-02-12T03:50:31.151 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction 2026-02-12T03:50:31.385 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:03:11 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:50:31.468 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:50:31.468 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:50:31.468 INFO:teuthology.orchestra.run.trial098.stdout: Package Arch Version Repo Size 2026-02-12T03:50:31.468 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:50:31.468 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-12T03:50:31.469 INFO:teuthology.orchestra.run.trial098.stdout: ceph-test-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 1.7 G 2026-02-12T03:50:31.469 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:50:31.469 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-12T03:50:31.469 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:50:31.469 INFO:teuthology.orchestra.run.trial098.stdout:Install 1 Package 2026-02-12T03:50:31.469 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:50:31.469 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 1.7 G 2026-02-12T03:50:31.469 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 12 G 2026-02-12T03:50:31.469 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-12T03:50:36.551 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T03:50:36.569 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-radosgw-debuginfo-2:20.2.0-626.g1279775f.el9.x8 1/1 2026-02-12T03:50:39.589 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:20.2.0-626.g1279775f.el9.x8 1/1 2026-02-12T03:50:39.646 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-radosgw-debuginfo-2:20.2.0-626.g1279775f.el9.x8 1/1 2026-02-12T03:50:39.646 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:50:39.646 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T03:50:39.646 INFO:teuthology.orchestra.run.trial111.stdout: ceph-radosgw-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:50:39.646 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:50:39.646 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:50:39.724 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-test-debuginfo 2026-02-12T03:50:40.029 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:03:21 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:50:40.113 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:50:40.114 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:50:40.114 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repo Size 2026-02-12T03:50:40.114 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:50:40.114 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T03:50:40.114 INFO:teuthology.orchestra.run.trial111.stdout: ceph-test-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 1.7 G 2026-02-12T03:50:40.114 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:50:40.114 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T03:50:40.114 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:50:40.114 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-12T03:50:40.114 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:50:40.115 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 1.7 G 2026-02-12T03:50:40.115 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 12 G 2026-02-12T03:50:40.115 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T03:51:00.821 INFO:teuthology.orchestra.run.trial154.stdout:ceph-radosgw-debuginfo-20.2.0-626.g1279775f.el9 14 MB/s | 543 MB 00:37 2026-02-12T03:51:00.822 INFO:teuthology.orchestra.run.trial154.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:51:00.822 INFO:teuthology.orchestra.run.trial154.stdout:Total 14 MB/s | 543 MB 00:37 2026-02-12T03:51:00.822 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction check 2026-02-12T03:51:00.824 INFO:teuthology.orchestra.run.trial154.stdout:Transaction check succeeded. 2026-02-12T03:51:00.824 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction test 2026-02-12T03:51:02.444 INFO:teuthology.orchestra.run.trial154.stdout:Transaction test succeeded. 2026-02-12T03:51:02.445 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction 2026-02-12T03:51:03.538 INFO:teuthology.orchestra.run.trial091.stdout: Preparing : 1/1 2026-02-12T03:51:03.556 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-radosgw-debuginfo-2:20.2.0-626.g1279775f.el9.x8 1/1 2026-02-12T03:51:06.595 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:20.2.0-626.g1279775f.el9.x8 1/1 2026-02-12T03:51:06.656 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-radosgw-debuginfo-2:20.2.0-626.g1279775f.el9.x8 1/1 2026-02-12T03:51:06.656 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:51:06.656 INFO:teuthology.orchestra.run.trial091.stdout:Installed: 2026-02-12T03:51:06.656 INFO:teuthology.orchestra.run.trial091.stdout: ceph-radosgw-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:51:06.656 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:51:06.657 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:51:06.731 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install ceph-test-debuginfo 2026-02-12T03:51:07.027 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:03:44 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:51:07.110 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:51:07.110 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:51:07.111 INFO:teuthology.orchestra.run.trial091.stdout: Package Arch Version Repo Size 2026-02-12T03:51:07.111 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:51:07.111 INFO:teuthology.orchestra.run.trial091.stdout:Installing: 2026-02-12T03:51:07.111 INFO:teuthology.orchestra.run.trial091.stdout: ceph-test-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 1.7 G 2026-02-12T03:51:07.111 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:51:07.111 INFO:teuthology.orchestra.run.trial091.stdout:Transaction Summary 2026-02-12T03:51:07.111 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:51:07.111 INFO:teuthology.orchestra.run.trial091.stdout:Install 1 Package 2026-02-12T03:51:07.111 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:51:07.111 INFO:teuthology.orchestra.run.trial091.stdout:Total download size: 1.7 G 2026-02-12T03:51:07.111 INFO:teuthology.orchestra.run.trial091.stdout:Installed size: 12 G 2026-02-12T03:51:07.112 INFO:teuthology.orchestra.run.trial091.stdout:Downloading Packages: 2026-02-12T03:51:34.647 INFO:teuthology.orchestra.run.trial154.stdout: Preparing : 1/1 2026-02-12T03:51:34.670 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-radosgw-debuginfo-2:20.2.0-626.g1279775f.el9.x8 1/1 2026-02-12T03:51:37.558 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:20.2.0-626.g1279775f.el9.x8 1/1 2026-02-12T03:51:37.616 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-radosgw-debuginfo-2:20.2.0-626.g1279775f.el9.x8 1/1 2026-02-12T03:51:37.617 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:51:37.617 INFO:teuthology.orchestra.run.trial154.stdout:Installed: 2026-02-12T03:51:37.617 INFO:teuthology.orchestra.run.trial154.stdout: ceph-radosgw-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:51:37.617 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:51:37.617 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:51:37.702 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install ceph-test-debuginfo 2026-02-12T03:51:38.008 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:04:05 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:51:38.091 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:51:38.091 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:51:38.091 INFO:teuthology.orchestra.run.trial154.stdout: Package Arch Version Repo Size 2026-02-12T03:51:38.091 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:51:38.092 INFO:teuthology.orchestra.run.trial154.stdout:Installing: 2026-02-12T03:51:38.092 INFO:teuthology.orchestra.run.trial154.stdout: ceph-test-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 1.7 G 2026-02-12T03:51:38.092 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:51:38.092 INFO:teuthology.orchestra.run.trial154.stdout:Transaction Summary 2026-02-12T03:51:38.092 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:51:38.092 INFO:teuthology.orchestra.run.trial154.stdout:Install 1 Package 2026-02-12T03:51:38.092 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:51:38.092 INFO:teuthology.orchestra.run.trial154.stdout:Total download size: 1.7 G 2026-02-12T03:51:38.092 INFO:teuthology.orchestra.run.trial154.stdout:Installed size: 12 G 2026-02-12T03:51:38.092 INFO:teuthology.orchestra.run.trial154.stdout:Downloading Packages: 2026-02-12T03:52:20.637 INFO:teuthology.orchestra.run.trial098.stdout:ceph-test-debuginfo-20.2.0-626.g1279775f.el9.x8 16 MB/s | 1.7 GB 01:49 2026-02-12T03:52:20.638 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:52:20.638 INFO:teuthology.orchestra.run.trial098.stdout:Total 16 MB/s | 1.7 GB 01:49 2026-02-12T03:52:20.639 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-12T03:52:20.641 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-12T03:52:20.641 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-12T03:52:25.824 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-12T03:52:25.825 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-12T03:53:13.104 INFO:teuthology.orchestra.run.trial091.stdout:ceph-test-debuginfo-20.2.0-626.g1279775f.el9.x8 14 MB/s | 1.7 GB 02:05 2026-02-12T03:53:13.105 INFO:teuthology.orchestra.run.trial091.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:53:13.105 INFO:teuthology.orchestra.run.trial091.stdout:Total 14 MB/s | 1.7 GB 02:05 2026-02-12T03:53:13.106 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction check 2026-02-12T03:53:13.109 INFO:teuthology.orchestra.run.trial091.stdout:Transaction check succeeded. 2026-02-12T03:53:13.109 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction test 2026-02-12T03:53:18.278 INFO:teuthology.orchestra.run.trial091.stdout:Transaction test succeeded. 2026-02-12T03:53:18.278 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction 2026-02-12T03:53:33.156 INFO:teuthology.orchestra.run.trial111.stdout:ceph-test-debuginfo-20.2.0-626.g1279775f.el9.x8 10 MB/s | 1.7 GB 02:53 2026-02-12T03:53:33.157 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:53:33.157 INFO:teuthology.orchestra.run.trial111.stdout:Total 10 MB/s | 1.7 GB 02:53 2026-02-12T03:53:33.157 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T03:53:33.160 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T03:53:33.160 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T03:53:38.339 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T03:53:38.339 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T03:53:44.940 INFO:teuthology.orchestra.run.trial154.stdout:ceph-test-debuginfo-20.2.0-626.g1279775f.el9.x8 14 MB/s | 1.7 GB 02:06 2026-02-12T03:53:44.940 INFO:teuthology.orchestra.run.trial154.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:53:44.941 INFO:teuthology.orchestra.run.trial154.stdout:Total 14 MB/s | 1.7 GB 02:06 2026-02-12T03:53:44.941 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction check 2026-02-12T03:53:44.945 INFO:teuthology.orchestra.run.trial154.stdout:Transaction check succeeded. 2026-02-12T03:53:44.945 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction test 2026-02-12T03:53:50.130 INFO:teuthology.orchestra.run.trial154.stdout:Transaction test succeeded. 2026-02-12T03:53:50.130 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction 2026-02-12T03:54:10.874 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-12T03:54:10.894 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-test-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/1 2026-02-12T03:54:13.360 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-test-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/1 2026-02-12T03:54:13.417 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-test-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/1 2026-02-12T03:54:13.417 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:54:13.418 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-12T03:54:13.418 INFO:teuthology.orchestra.run.trial098.stdout: ceph-test-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:54:13.418 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:54:13.418 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:54:13.620 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install ceph-base-debuginfo 2026-02-12T03:54:13.923 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:06:53 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:54:13.988 INFO:teuthology.orchestra.run.trial098.stdout:Package ceph-base-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:54:14.005 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:54:14.006 INFO:teuthology.orchestra.run.trial098.stdout:Nothing to do. 2026-02-12T03:54:14.006 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:54:14.028 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install ceph-mgr-debuginfo 2026-02-12T03:54:14.326 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:06:54 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:54:14.409 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:54:14.410 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:54:14.410 INFO:teuthology.orchestra.run.trial098.stdout: Package Arch Version Repo Size 2026-02-12T03:54:14.410 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:54:14.410 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-12T03:54:14.410 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mgr-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 22 M 2026-02-12T03:54:14.410 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:54:14.410 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-12T03:54:14.411 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:54:14.411 INFO:teuthology.orchestra.run.trial098.stdout:Install 1 Package 2026-02-12T03:54:14.411 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:54:14.411 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 22 M 2026-02-12T03:54:14.411 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 146 M 2026-02-12T03:54:14.411 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-12T03:54:15.462 INFO:teuthology.orchestra.run.trial098.stdout:ceph-mgr-debuginfo-20.2.0-626.g1279775f.el9.x86 21 MB/s | 22 MB 00:01 2026-02-12T03:54:15.463 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:54:15.463 INFO:teuthology.orchestra.run.trial098.stdout:Total 21 MB/s | 22 MB 00:01 2026-02-12T03:54:15.464 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-12T03:54:15.465 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-12T03:54:15.465 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-12T03:54:15.548 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-12T03:54:15.548 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-12T03:54:16.803 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-12T03:54:16.820 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-mgr-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:54:16.981 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-mgr-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:54:17.039 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-mgr-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:54:17.039 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:54:17.039 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-12T03:54:17.039 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mgr-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:54:17.039 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:54:17.039 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:54:17.069 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install ceph-mds-debuginfo 2026-02-12T03:54:17.370 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:06:57 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:54:17.452 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:54:17.453 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:54:17.453 INFO:teuthology.orchestra.run.trial098.stdout: Package Arch Version Repo Size 2026-02-12T03:54:17.453 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:54:17.453 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-12T03:54:17.453 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mds-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 54 M 2026-02-12T03:54:17.453 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:54:17.453 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-12T03:54:17.453 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:54:17.453 INFO:teuthology.orchestra.run.trial098.stdout:Install 1 Package 2026-02-12T03:54:17.454 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:54:17.454 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 54 M 2026-02-12T03:54:17.454 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 221 M 2026-02-12T03:54:17.454 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-12T03:54:19.493 INFO:teuthology.orchestra.run.trial098.stdout:ceph-mds-debuginfo-20.2.0-626.g1279775f.el9.x86 26 MB/s | 54 MB 00:02 2026-02-12T03:54:19.494 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:54:19.494 INFO:teuthology.orchestra.run.trial098.stdout:Total 26 MB/s | 54 MB 00:02 2026-02-12T03:54:19.494 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-12T03:54:19.496 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-12T03:54:19.496 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-12T03:54:19.672 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-12T03:54:19.672 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-12T03:54:22.329 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-12T03:54:22.346 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-mds-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:54:22.563 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-mds-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:54:22.620 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-mds-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:54:22.620 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:54:22.620 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-12T03:54:22.620 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mds-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:54:22.620 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:54:22.620 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:54:22.652 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install ceph-mon-debuginfo 2026-02-12T03:54:22.955 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:07:02 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:54:23.037 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:54:23.038 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:54:23.038 INFO:teuthology.orchestra.run.trial098.stdout: Package Arch Version Repo Size 2026-02-12T03:54:23.038 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:54:23.038 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-12T03:54:23.038 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mon-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 129 M 2026-02-12T03:54:23.039 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:54:23.039 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-12T03:54:23.039 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:54:23.039 INFO:teuthology.orchestra.run.trial098.stdout:Install 1 Package 2026-02-12T03:54:23.039 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:54:23.039 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 129 M 2026-02-12T03:54:23.039 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 641 M 2026-02-12T03:54:23.039 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-12T03:54:28.126 INFO:teuthology.orchestra.run.trial098.stdout:ceph-mon-debuginfo-20.2.0-626.g1279775f.el9.x86 25 MB/s | 129 MB 00:05 2026-02-12T03:54:28.127 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:54:28.127 INFO:teuthology.orchestra.run.trial098.stdout:Total 25 MB/s | 129 MB 00:05 2026-02-12T03:54:28.127 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-12T03:54:28.129 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-12T03:54:28.129 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-12T03:54:28.524 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-12T03:54:28.524 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-12T03:54:35.148 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-12T03:54:35.166 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-mon-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:54:35.691 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-mon-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:54:35.749 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-mon-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:54:35.750 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:54:35.750 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-12T03:54:35.750 INFO:teuthology.orchestra.run.trial098.stdout: ceph-mon-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:54:35.750 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:54:35.750 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:54:35.789 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install ceph-osd-debuginfo 2026-02-12T03:54:36.091 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:07:16 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:54:36.173 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:54:36.174 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:54:36.174 INFO:teuthology.orchestra.run.trial098.stdout: Package Arch Version Repo Size 2026-02-12T03:54:36.174 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:54:36.174 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-12T03:54:36.174 INFO:teuthology.orchestra.run.trial098.stdout: ceph-osd-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 343 M 2026-02-12T03:54:36.174 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:54:36.174 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-12T03:54:36.175 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:54:36.175 INFO:teuthology.orchestra.run.trial098.stdout:Install 1 Package 2026-02-12T03:54:36.175 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:54:36.175 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 343 M 2026-02-12T03:54:36.175 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 1.6 G 2026-02-12T03:54:36.175 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-12T03:54:46.149 INFO:teuthology.orchestra.run.trial098.stdout:ceph-osd-debuginfo-20.2.0-626.g1279775f.el9.x86 34 MB/s | 343 MB 00:09 2026-02-12T03:54:46.150 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:54:46.150 INFO:teuthology.orchestra.run.trial098.stdout:Total 34 MB/s | 343 MB 00:09 2026-02-12T03:54:46.150 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-12T03:54:46.152 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-12T03:54:46.152 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-12T03:54:47.176 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-12T03:54:47.177 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-12T03:55:00.115 INFO:teuthology.orchestra.run.trial091.stdout: Preparing : 1/1 2026-02-12T03:55:00.136 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-test-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/1 2026-02-12T03:55:03.405 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-test-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/1 2026-02-12T03:55:03.461 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-test-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/1 2026-02-12T03:55:03.461 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:55:03.462 INFO:teuthology.orchestra.run.trial091.stdout:Installed: 2026-02-12T03:55:03.462 INFO:teuthology.orchestra.run.trial091.stdout: ceph-test-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:55:03.462 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:55:03.462 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:55:03.660 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install ceph-base-debuginfo 2026-02-12T03:55:03.965 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:07:40 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:55:04.031 INFO:teuthology.orchestra.run.trial091.stdout:Package ceph-base-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:55:04.048 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:55:04.049 INFO:teuthology.orchestra.run.trial091.stdout:Nothing to do. 2026-02-12T03:55:04.049 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:55:04.070 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install ceph-mgr-debuginfo 2026-02-12T03:55:04.369 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:07:41 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:55:04.451 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:55:04.452 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:55:04.452 INFO:teuthology.orchestra.run.trial091.stdout: Package Arch Version Repo Size 2026-02-12T03:55:04.452 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:55:04.452 INFO:teuthology.orchestra.run.trial091.stdout:Installing: 2026-02-12T03:55:04.452 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 22 M 2026-02-12T03:55:04.452 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:55:04.452 INFO:teuthology.orchestra.run.trial091.stdout:Transaction Summary 2026-02-12T03:55:04.452 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:55:04.452 INFO:teuthology.orchestra.run.trial091.stdout:Install 1 Package 2026-02-12T03:55:04.453 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:55:04.453 INFO:teuthology.orchestra.run.trial091.stdout:Total download size: 22 M 2026-02-12T03:55:04.453 INFO:teuthology.orchestra.run.trial091.stdout:Installed size: 146 M 2026-02-12T03:55:04.453 INFO:teuthology.orchestra.run.trial091.stdout:Downloading Packages: 2026-02-12T03:55:04.725 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-12T03:55:04.742 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-osd-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:04.986 INFO:teuthology.orchestra.run.trial091.stdout:ceph-mgr-debuginfo-20.2.0-626.g1279775f.el9.x86 41 MB/s | 22 MB 00:00 2026-02-12T03:55:04.986 INFO:teuthology.orchestra.run.trial091.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:55:04.987 INFO:teuthology.orchestra.run.trial091.stdout:Total 41 MB/s | 22 MB 00:00 2026-02-12T03:55:04.987 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction check 2026-02-12T03:55:04.988 INFO:teuthology.orchestra.run.trial091.stdout:Transaction check succeeded. 2026-02-12T03:55:04.988 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction test 2026-02-12T03:55:05.072 INFO:teuthology.orchestra.run.trial091.stdout:Transaction test succeeded. 2026-02-12T03:55:05.072 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction 2026-02-12T03:55:05.975 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-osd-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:06.033 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-osd-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:06.033 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:06.033 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-12T03:55:06.033 INFO:teuthology.orchestra.run.trial098.stdout: ceph-osd-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:55:06.033 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:06.033 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:55:06.090 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install ceph-fuse-debuginfo 2026-02-12T03:55:06.324 INFO:teuthology.orchestra.run.trial091.stdout: Preparing : 1/1 2026-02-12T03:55:06.341 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-mgr-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:06.391 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:07:46 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:55:06.473 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:55:06.474 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:55:06.474 INFO:teuthology.orchestra.run.trial098.stdout: Package Arch Version Repo Size 2026-02-12T03:55:06.474 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:55:06.474 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-12T03:55:06.474 INFO:teuthology.orchestra.run.trial098.stdout: ceph-fuse-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 10 M 2026-02-12T03:55:06.474 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:06.474 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-12T03:55:06.474 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:55:06.474 INFO:teuthology.orchestra.run.trial098.stdout:Install 1 Package 2026-02-12T03:55:06.474 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:06.475 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 10 M 2026-02-12T03:55:06.475 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 51 M 2026-02-12T03:55:06.475 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-12T03:55:06.503 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-mgr-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:06.560 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-mgr-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:06.560 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:55:06.560 INFO:teuthology.orchestra.run.trial091.stdout:Installed: 2026-02-12T03:55:06.561 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mgr-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:55:06.561 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:55:06.561 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:55:06.588 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install ceph-mds-debuginfo 2026-02-12T03:55:06.757 INFO:teuthology.orchestra.run.trial098.stdout:ceph-fuse-debuginfo-20.2.0-626.g1279775f.el9.x8 36 MB/s | 10 MB 00:00 2026-02-12T03:55:06.758 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:55:06.758 INFO:teuthology.orchestra.run.trial098.stdout:Total 36 MB/s | 10 MB 00:00 2026-02-12T03:55:06.758 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-12T03:55:06.759 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-12T03:55:06.759 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-12T03:55:06.807 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-12T03:55:06.807 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-12T03:55:06.889 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:07:43 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:55:06.972 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:55:06.973 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:55:06.973 INFO:teuthology.orchestra.run.trial091.stdout: Package Arch Version Repo Size 2026-02-12T03:55:06.973 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:55:06.973 INFO:teuthology.orchestra.run.trial091.stdout:Installing: 2026-02-12T03:55:06.974 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mds-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 54 M 2026-02-12T03:55:06.974 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:55:06.974 INFO:teuthology.orchestra.run.trial091.stdout:Transaction Summary 2026-02-12T03:55:06.974 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:55:06.974 INFO:teuthology.orchestra.run.trial091.stdout:Install 1 Package 2026-02-12T03:55:06.974 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:55:06.974 INFO:teuthology.orchestra.run.trial091.stdout:Total download size: 54 M 2026-02-12T03:55:06.974 INFO:teuthology.orchestra.run.trial091.stdout:Installed size: 221 M 2026-02-12T03:55:06.974 INFO:teuthology.orchestra.run.trial091.stdout:Downloading Packages: 2026-02-12T03:55:07.358 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-12T03:55:07.375 INFO:teuthology.orchestra.run.trial098.stdout: Installing : ceph-fuse-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/1 2026-02-12T03:55:07.471 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: ceph-fuse-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/1 2026-02-12T03:55:07.529 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : ceph-fuse-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/1 2026-02-12T03:55:07.530 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:07.530 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-12T03:55:07.530 INFO:teuthology.orchestra.run.trial098.stdout: ceph-fuse-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:55:07.530 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:07.530 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:55:07.558 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install librados-devel-debuginfo 2026-02-12T03:55:07.858 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:07:47 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:55:07.940 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:55:07.940 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:55:07.940 INFO:teuthology.orchestra.run.trial098.stdout: Package Arch Version Repo Size 2026-02-12T03:55:07.940 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:55:07.940 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-12T03:55:07.940 INFO:teuthology.orchestra.run.trial098.stdout: librados-devel-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 144 k 2026-02-12T03:55:07.940 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:07.940 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-12T03:55:07.941 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:55:07.941 INFO:teuthology.orchestra.run.trial098.stdout:Install 1 Package 2026-02-12T03:55:07.941 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:07.941 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 144 k 2026-02-12T03:55:07.941 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 802 k 2026-02-12T03:55:07.941 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-12T03:55:08.060 INFO:teuthology.orchestra.run.trial098.stdout:librados-devel-debuginfo-20.2.0-626.g1279775f.e 1.2 MB/s | 144 kB 00:00 2026-02-12T03:55:08.061 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:55:08.061 INFO:teuthology.orchestra.run.trial098.stdout:Total 1.2 MB/s | 144 kB 00:00 2026-02-12T03:55:08.061 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-12T03:55:08.063 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-12T03:55:08.063 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-12T03:55:08.069 INFO:teuthology.orchestra.run.trial091.stdout:ceph-mds-debuginfo-20.2.0-626.g1279775f.el9.x86 49 MB/s | 54 MB 00:01 2026-02-12T03:55:08.070 INFO:teuthology.orchestra.run.trial091.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:55:08.070 INFO:teuthology.orchestra.run.trial091.stdout:Total 49 MB/s | 54 MB 00:01 2026-02-12T03:55:08.070 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction check 2026-02-12T03:55:08.072 INFO:teuthology.orchestra.run.trial091.stdout:Transaction check succeeded. 2026-02-12T03:55:08.072 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction test 2026-02-12T03:55:08.082 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-12T03:55:08.082 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-12T03:55:08.124 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-12T03:55:08.141 INFO:teuthology.orchestra.run.trial098.stdout: Installing : librados-devel-debuginfo-2:20.2.0-626.g1279775f.el9. 1/1 2026-02-12T03:55:08.195 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: librados-devel-debuginfo-2:20.2.0-626.g1279775f.el9. 1/1 2026-02-12T03:55:08.249 INFO:teuthology.orchestra.run.trial091.stdout:Transaction test succeeded. 2026-02-12T03:55:08.249 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction 2026-02-12T03:55:08.253 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : librados-devel-debuginfo-2:20.2.0-626.g1279775f.el9. 1/1 2026-02-12T03:55:08.253 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:08.253 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-12T03:55:08.253 INFO:teuthology.orchestra.run.trial098.stdout: librados-devel-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:55:08.253 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:08.253 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:55:08.279 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install libcephfs2-debuginfo 2026-02-12T03:55:08.585 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:07:48 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:55:08.668 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:55:08.668 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:55:08.668 INFO:teuthology.orchestra.run.trial098.stdout: Package Arch Version Repo Size 2026-02-12T03:55:08.668 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:55:08.668 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-12T03:55:08.668 INFO:teuthology.orchestra.run.trial098.stdout: libcephfs2-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 9.1 M 2026-02-12T03:55:08.668 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:08.669 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-12T03:55:08.669 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:55:08.669 INFO:teuthology.orchestra.run.trial098.stdout:Install 1 Package 2026-02-12T03:55:08.669 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:08.669 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 9.1 M 2026-02-12T03:55:08.669 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 46 M 2026-02-12T03:55:08.669 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-12T03:55:08.929 INFO:teuthology.orchestra.run.trial098.stdout:libcephfs2-debuginfo-20.2.0-626.g1279775f.el9.x 35 MB/s | 9.1 MB 00:00 2026-02-12T03:55:08.929 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:55:08.929 INFO:teuthology.orchestra.run.trial098.stdout:Total 35 MB/s | 9.1 MB 00:00 2026-02-12T03:55:08.929 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-12T03:55:08.931 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-12T03:55:08.931 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-12T03:55:08.976 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-12T03:55:08.976 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-12T03:55:09.480 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-12T03:55:09.498 INFO:teuthology.orchestra.run.trial098.stdout: Installing : libcephfs2-debuginfo-2:20.2.0-626.g1279775f.el9.x86_ 1/1 2026-02-12T03:55:09.586 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: libcephfs2-debuginfo-2:20.2.0-626.g1279775f.el9.x86_ 1/1 2026-02-12T03:55:09.644 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : libcephfs2-debuginfo-2:20.2.0-626.g1279775f.el9.x86_ 1/1 2026-02-12T03:55:09.644 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:09.644 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-12T03:55:09.644 INFO:teuthology.orchestra.run.trial098.stdout: libcephfs2-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:55:09.644 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:09.645 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:55:09.672 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install librados2-debuginfo 2026-02-12T03:55:09.978 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:07:49 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:55:10.060 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:55:10.061 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:55:10.061 INFO:teuthology.orchestra.run.trial098.stdout: Package Arch Version Repo Size 2026-02-12T03:55:10.061 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:55:10.062 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-12T03:55:10.062 INFO:teuthology.orchestra.run.trial098.stdout: librados2-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 63 M 2026-02-12T03:55:10.062 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:10.062 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-12T03:55:10.062 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:55:10.062 INFO:teuthology.orchestra.run.trial098.stdout:Install 1 Package 2026-02-12T03:55:10.062 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:10.062 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 63 M 2026-02-12T03:55:10.062 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 397 M 2026-02-12T03:55:10.062 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-12T03:55:10.912 INFO:teuthology.orchestra.run.trial091.stdout: Preparing : 1/1 2026-02-12T03:55:10.929 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-mds-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:11.149 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-mds-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:11.205 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-mds-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:11.205 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:55:11.205 INFO:teuthology.orchestra.run.trial091.stdout:Installed: 2026-02-12T03:55:11.205 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mds-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:55:11.205 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:55:11.205 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:55:11.237 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install ceph-mon-debuginfo 2026-02-12T03:55:11.343 INFO:teuthology.orchestra.run.trial098.stdout:librados2-debuginfo-20.2.0-626.g1279775f.el9.x8 50 MB/s | 63 MB 00:01 2026-02-12T03:55:11.344 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:55:11.344 INFO:teuthology.orchestra.run.trial098.stdout:Total 49 MB/s | 63 MB 00:01 2026-02-12T03:55:11.345 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-12T03:55:11.346 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-12T03:55:11.347 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-12T03:55:11.537 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:07:48 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:55:11.554 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-12T03:55:11.554 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-12T03:55:11.619 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:55:11.620 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:55:11.620 INFO:teuthology.orchestra.run.trial091.stdout: Package Arch Version Repo Size 2026-02-12T03:55:11.620 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:55:11.620 INFO:teuthology.orchestra.run.trial091.stdout:Installing: 2026-02-12T03:55:11.620 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mon-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 129 M 2026-02-12T03:55:11.621 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:55:11.621 INFO:teuthology.orchestra.run.trial091.stdout:Transaction Summary 2026-02-12T03:55:11.621 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:55:11.621 INFO:teuthology.orchestra.run.trial091.stdout:Install 1 Package 2026-02-12T03:55:11.621 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:55:11.621 INFO:teuthology.orchestra.run.trial091.stdout:Total download size: 129 M 2026-02-12T03:55:11.621 INFO:teuthology.orchestra.run.trial091.stdout:Installed size: 641 M 2026-02-12T03:55:11.621 INFO:teuthology.orchestra.run.trial091.stdout:Downloading Packages: 2026-02-12T03:55:14.163 INFO:teuthology.orchestra.run.trial091.stdout:ceph-mon-debuginfo-20.2.0-626.g1279775f.el9.x86 51 MB/s | 129 MB 00:02 2026-02-12T03:55:14.164 INFO:teuthology.orchestra.run.trial091.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:55:14.164 INFO:teuthology.orchestra.run.trial091.stdout:Total 51 MB/s | 129 MB 00:02 2026-02-12T03:55:14.164 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction check 2026-02-12T03:55:14.166 INFO:teuthology.orchestra.run.trial091.stdout:Transaction check succeeded. 2026-02-12T03:55:14.166 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction test 2026-02-12T03:55:14.565 INFO:teuthology.orchestra.run.trial091.stdout:Transaction test succeeded. 2026-02-12T03:55:14.565 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction 2026-02-12T03:55:15.131 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-12T03:55:15.149 INFO:teuthology.orchestra.run.trial098.stdout: Installing : librados2-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/1 2026-02-12T03:55:15.488 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: librados2-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/1 2026-02-12T03:55:15.546 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : librados2-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/1 2026-02-12T03:55:15.546 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:15.546 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-12T03:55:15.546 INFO:teuthology.orchestra.run.trial098.stdout: librados2-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:55:15.546 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:15.546 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:55:15.576 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install librbd1-debuginfo 2026-02-12T03:55:15.874 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:07:55 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:55:15.957 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:55:15.957 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:55:15.957 INFO:teuthology.orchestra.run.trial098.stdout: Package Arch Version Repo Size 2026-02-12T03:55:15.957 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:55:15.957 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-12T03:55:15.957 INFO:teuthology.orchestra.run.trial098.stdout: librbd1-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 80 M 2026-02-12T03:55:15.957 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:15.957 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-12T03:55:15.957 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:55:15.957 INFO:teuthology.orchestra.run.trial098.stdout:Install 1 Package 2026-02-12T03:55:15.957 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:15.957 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 80 M 2026-02-12T03:55:15.957 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 405 M 2026-02-12T03:55:15.957 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-12T03:55:17.551 INFO:teuthology.orchestra.run.trial098.stdout:librbd1-debuginfo-20.2.0-626.g1279775f.el9.x86_ 50 MB/s | 80 MB 00:01 2026-02-12T03:55:17.552 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:55:17.553 INFO:teuthology.orchestra.run.trial098.stdout:Total 50 MB/s | 80 MB 00:01 2026-02-12T03:55:17.553 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-12T03:55:17.554 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-12T03:55:17.555 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-12T03:55:17.810 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-12T03:55:17.810 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-12T03:55:18.269 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T03:55:18.289 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-test-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/1 2026-02-12T03:55:21.306 INFO:teuthology.orchestra.run.trial091.stdout: Preparing : 1/1 2026-02-12T03:55:21.324 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-mon-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:21.560 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-test-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/1 2026-02-12T03:55:21.616 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-test-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/1 2026-02-12T03:55:21.616 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:55:21.616 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T03:55:21.617 INFO:teuthology.orchestra.run.trial111.stdout: ceph-test-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:55:21.617 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:55:21.617 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:55:21.817 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-base-debuginfo 2026-02-12T03:55:21.843 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-mon-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:21.900 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-mon-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:21.900 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:55:21.900 INFO:teuthology.orchestra.run.trial091.stdout:Installed: 2026-02-12T03:55:21.900 INFO:teuthology.orchestra.run.trial091.stdout: ceph-mon-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:55:21.901 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:55:21.901 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:55:21.940 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install ceph-osd-debuginfo 2026-02-12T03:55:21.971 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-12T03:55:21.989 INFO:teuthology.orchestra.run.trial098.stdout: Installing : librbd1-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:22.120 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:08:03 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:55:22.185 INFO:teuthology.orchestra.run.trial111.stdout:Package ceph-base-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:55:22.203 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:55:22.203 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-12T03:55:22.203 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:55:22.225 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-mgr-debuginfo 2026-02-12T03:55:22.244 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:07:59 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:55:22.326 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:55:22.327 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:55:22.327 INFO:teuthology.orchestra.run.trial091.stdout: Package Arch Version Repo Size 2026-02-12T03:55:22.327 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:55:22.327 INFO:teuthology.orchestra.run.trial091.stdout:Installing: 2026-02-12T03:55:22.327 INFO:teuthology.orchestra.run.trial091.stdout: ceph-osd-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 343 M 2026-02-12T03:55:22.327 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:55:22.327 INFO:teuthology.orchestra.run.trial091.stdout:Transaction Summary 2026-02-12T03:55:22.327 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:55:22.328 INFO:teuthology.orchestra.run.trial091.stdout:Install 1 Package 2026-02-12T03:55:22.328 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:55:22.328 INFO:teuthology.orchestra.run.trial091.stdout:Total download size: 343 M 2026-02-12T03:55:22.328 INFO:teuthology.orchestra.run.trial091.stdout:Installed size: 1.6 G 2026-02-12T03:55:22.328 INFO:teuthology.orchestra.run.trial091.stdout:Downloading Packages: 2026-02-12T03:55:22.334 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: librbd1-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:22.391 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : librbd1-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:22.392 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:22.392 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-12T03:55:22.392 INFO:teuthology.orchestra.run.trial098.stdout: librbd1-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:55:22.392 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:22.392 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:55:22.424 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install python3-cephfs-debuginfo 2026-02-12T03:55:22.525 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:08:03 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:55:22.608 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:55:22.609 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:55:22.609 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repo Size 2026-02-12T03:55:22.609 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:55:22.609 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T03:55:22.609 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 22 M 2026-02-12T03:55:22.609 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:55:22.610 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T03:55:22.610 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:55:22.610 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-12T03:55:22.610 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:55:22.610 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 22 M 2026-02-12T03:55:22.610 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 146 M 2026-02-12T03:55:22.610 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T03:55:22.727 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:08:02 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:55:22.811 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:55:22.811 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:55:22.811 INFO:teuthology.orchestra.run.trial098.stdout: Package Arch Version Repo Size 2026-02-12T03:55:22.811 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:55:22.812 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-12T03:55:22.812 INFO:teuthology.orchestra.run.trial098.stdout: python3-cephfs-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 645 k 2026-02-12T03:55:22.812 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:22.812 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-12T03:55:22.812 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:55:22.812 INFO:teuthology.orchestra.run.trial098.stdout:Install 1 Package 2026-02-12T03:55:22.812 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:22.812 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 645 k 2026-02-12T03:55:22.812 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 2.3 M 2026-02-12T03:55:22.812 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-12T03:55:23.364 INFO:teuthology.orchestra.run.trial098.stdout:python3-cephfs-debuginfo-20.2.0-626.g1279775f.e 1.1 MB/s | 645 kB 00:00 2026-02-12T03:55:23.364 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:55:23.364 INFO:teuthology.orchestra.run.trial098.stdout:Total 1.1 MB/s | 645 kB 00:00 2026-02-12T03:55:23.364 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-12T03:55:23.366 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-12T03:55:23.366 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-12T03:55:23.386 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-12T03:55:23.387 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-12T03:55:23.451 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-12T03:55:23.469 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-cephfs-debuginfo-2:20.2.0-626.g1279775f.el9. 1/1 2026-02-12T03:55:23.524 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: python3-cephfs-debuginfo-2:20.2.0-626.g1279775f.el9. 1/1 2026-02-12T03:55:23.581 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-cephfs-debuginfo-2:20.2.0-626.g1279775f.el9. 1/1 2026-02-12T03:55:23.581 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:23.582 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-12T03:55:23.582 INFO:teuthology.orchestra.run.trial098.stdout: python3-cephfs-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:55:23.582 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:23.582 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:55:23.607 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install python3-rados-debuginfo 2026-02-12T03:55:23.909 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:08:03 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:55:23.992 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:55:23.993 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:55:23.993 INFO:teuthology.orchestra.run.trial098.stdout: Package Arch Version Repo Size 2026-02-12T03:55:23.993 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:55:23.993 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-12T03:55:23.993 INFO:teuthology.orchestra.run.trial098.stdout: python3-rados-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 804 k 2026-02-12T03:55:23.993 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:23.993 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-12T03:55:23.993 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:55:23.994 INFO:teuthology.orchestra.run.trial098.stdout:Install 1 Package 2026-02-12T03:55:23.994 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:23.994 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 804 k 2026-02-12T03:55:23.994 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 3.1 M 2026-02-12T03:55:23.994 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-12T03:55:24.512 INFO:teuthology.orchestra.run.trial098.stdout:python3-rados-debuginfo-20.2.0-626.g1279775f.el 1.5 MB/s | 804 kB 00:00 2026-02-12T03:55:24.514 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:55:24.515 INFO:teuthology.orchestra.run.trial098.stdout:Total 1.5 MB/s | 804 kB 00:00 2026-02-12T03:55:24.515 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-12T03:55:24.517 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-12T03:55:24.517 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-12T03:55:24.538 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-12T03:55:24.539 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-12T03:55:24.612 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-12T03:55:24.630 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-rados-debuginfo-2:20.2.0-626.g1279775f.el9.x 1/1 2026-02-12T03:55:24.686 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: python3-rados-debuginfo-2:20.2.0-626.g1279775f.el9.x 1/1 2026-02-12T03:55:24.744 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-rados-debuginfo-2:20.2.0-626.g1279775f.el9.x 1/1 2026-02-12T03:55:24.744 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:24.744 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-12T03:55:24.745 INFO:teuthology.orchestra.run.trial098.stdout: python3-rados-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:55:24.745 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:24.745 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:55:24.772 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install python3-rbd-debuginfo 2026-02-12T03:55:25.079 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:08:05 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:55:25.163 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:55:25.164 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:55:25.164 INFO:teuthology.orchestra.run.trial098.stdout: Package Arch Version Repo Size 2026-02-12T03:55:25.164 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:55:25.164 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-12T03:55:25.165 INFO:teuthology.orchestra.run.trial098.stdout: python3-rbd-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 1.2 M 2026-02-12T03:55:25.165 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:25.165 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-12T03:55:25.165 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:55:25.165 INFO:teuthology.orchestra.run.trial098.stdout:Install 1 Package 2026-02-12T03:55:25.165 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:25.165 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 1.2 M 2026-02-12T03:55:25.165 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 4.7 M 2026-02-12T03:55:25.165 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-12T03:55:26.301 INFO:teuthology.orchestra.run.trial098.stdout:python3-rbd-debuginfo-20.2.0-626.g1279775f.el9. 1.0 MB/s | 1.2 MB 00:01 2026-02-12T03:55:26.302 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:55:26.302 INFO:teuthology.orchestra.run.trial098.stdout:Total 1.0 MB/s | 1.2 MB 00:01 2026-02-12T03:55:26.302 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-12T03:55:26.303 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-12T03:55:26.304 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-12T03:55:26.326 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-12T03:55:26.327 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-12T03:55:26.418 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-12T03:55:26.435 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-rbd-debuginfo-2:20.2.0-626.g1279775f.el9.x86 1/1 2026-02-12T03:55:26.492 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: python3-rbd-debuginfo-2:20.2.0-626.g1279775f.el9.x86 1/1 2026-02-12T03:55:26.550 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-rbd-debuginfo-2:20.2.0-626.g1279775f.el9.x86 1/1 2026-02-12T03:55:26.550 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:26.550 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-12T03:55:26.550 INFO:teuthology.orchestra.run.trial098.stdout: python3-rbd-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:55:26.550 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:26.551 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:55:26.577 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install python3-rgw-debuginfo 2026-02-12T03:55:26.881 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:08:06 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:55:26.963 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:55:26.964 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:55:26.964 INFO:teuthology.orchestra.run.trial098.stdout: Package Arch Version Repo Size 2026-02-12T03:55:26.964 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:55:26.964 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-12T03:55:26.964 INFO:teuthology.orchestra.run.trial098.stdout: python3-rgw-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 350 k 2026-02-12T03:55:26.964 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:26.964 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-12T03:55:26.965 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:55:26.965 INFO:teuthology.orchestra.run.trial098.stdout:Install 1 Package 2026-02-12T03:55:26.965 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:26.965 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 350 k 2026-02-12T03:55:26.965 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 1.1 M 2026-02-12T03:55:26.965 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-12T03:55:27.314 INFO:teuthology.orchestra.run.trial098.stdout:python3-rgw-debuginfo-20.2.0-626.g1279775f.el9. 1.0 MB/s | 350 kB 00:00 2026-02-12T03:55:27.315 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:55:27.315 INFO:teuthology.orchestra.run.trial098.stdout:Total 1.0 MB/s | 350 kB 00:00 2026-02-12T03:55:27.315 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-12T03:55:27.316 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-12T03:55:27.317 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-12T03:55:27.337 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-12T03:55:27.337 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-12T03:55:27.387 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-12T03:55:27.405 INFO:teuthology.orchestra.run.trial098.stdout: Installing : python3-rgw-debuginfo-2:20.2.0-626.g1279775f.el9.x86 1/1 2026-02-12T03:55:27.460 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: python3-rgw-debuginfo-2:20.2.0-626.g1279775f.el9.x86 1/1 2026-02-12T03:55:27.517 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : python3-rgw-debuginfo-2:20.2.0-626.g1279775f.el9.x86 1/1 2026-02-12T03:55:27.517 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:27.517 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-12T03:55:27.517 INFO:teuthology.orchestra.run.trial098.stdout: python3-rgw-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:55:27.517 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:27.517 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:55:27.544 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install rbd-fuse-debuginfo 2026-02-12T03:55:27.849 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:08:07 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:55:27.932 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:55:27.933 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:55:27.933 INFO:teuthology.orchestra.run.trial098.stdout: Package Arch Version Repo Size 2026-02-12T03:55:27.933 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:55:27.933 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-12T03:55:27.933 INFO:teuthology.orchestra.run.trial098.stdout: rbd-fuse-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 1.5 M 2026-02-12T03:55:27.933 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:27.933 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-12T03:55:27.933 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:55:27.933 INFO:teuthology.orchestra.run.trial098.stdout:Install 1 Package 2026-02-12T03:55:27.934 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:27.934 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 1.5 M 2026-02-12T03:55:27.934 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 7.9 M 2026-02-12T03:55:27.934 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-12T03:55:28.424 INFO:teuthology.orchestra.run.trial098.stdout:rbd-fuse-debuginfo-20.2.0-626.g1279775f.el9.x86 3.1 MB/s | 1.5 MB 00:00 2026-02-12T03:55:28.425 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:55:28.425 INFO:teuthology.orchestra.run.trial098.stdout:Total 3.1 MB/s | 1.5 MB 00:00 2026-02-12T03:55:28.425 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-12T03:55:28.426 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-12T03:55:28.427 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-12T03:55:28.449 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-12T03:55:28.449 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-12T03:55:28.561 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-12T03:55:28.578 INFO:teuthology.orchestra.run.trial098.stdout: Installing : rbd-fuse-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:28.638 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: rbd-fuse-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:28.696 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : rbd-fuse-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:28.696 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:28.696 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-12T03:55:28.696 INFO:teuthology.orchestra.run.trial098.stdout: rbd-fuse-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:55:28.696 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:28.696 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:55:28.723 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install rbd-mirror-debuginfo 2026-02-12T03:55:29.027 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:08:09 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:55:29.111 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:55:29.111 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:55:29.111 INFO:teuthology.orchestra.run.trial098.stdout: Package Arch Version Repo Size 2026-02-12T03:55:29.111 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:55:29.111 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-12T03:55:29.111 INFO:teuthology.orchestra.run.trial098.stdout: rbd-mirror-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 79 M 2026-02-12T03:55:29.111 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:29.111 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-12T03:55:29.112 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:55:29.112 INFO:teuthology.orchestra.run.trial098.stdout:Install 1 Package 2026-02-12T03:55:29.112 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:29.112 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 79 M 2026-02-12T03:55:29.112 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 374 M 2026-02-12T03:55:29.112 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-12T03:55:32.336 INFO:teuthology.orchestra.run.trial111.stdout:ceph-mgr-debuginfo-20.2.0-626.g1279775f.el9.x86 2.2 MB/s | 22 MB 00:09 2026-02-12T03:55:32.337 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:55:32.337 INFO:teuthology.orchestra.run.trial111.stdout:Total 2.2 MB/s | 22 MB 00:09 2026-02-12T03:55:32.338 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T03:55:32.339 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T03:55:32.339 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T03:55:32.422 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T03:55:32.422 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T03:55:32.866 INFO:teuthology.orchestra.run.trial091.stdout:ceph-osd-debuginfo-20.2.0-626.g1279775f.el9.x86 33 MB/s | 343 MB 00:10 2026-02-12T03:55:32.866 INFO:teuthology.orchestra.run.trial091.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:55:32.866 INFO:teuthology.orchestra.run.trial091.stdout:Total 33 MB/s | 343 MB 00:10 2026-02-12T03:55:32.867 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction check 2026-02-12T03:55:32.869 INFO:teuthology.orchestra.run.trial091.stdout:Transaction check succeeded. 2026-02-12T03:55:32.869 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction test 2026-02-12T03:55:33.671 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T03:55:33.683 INFO:teuthology.orchestra.run.trial098.stdout:rbd-mirror-debuginfo-20.2.0-626.g1279775f.el9.x 17 MB/s | 79 MB 00:04 2026-02-12T03:55:33.683 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:55:33.684 INFO:teuthology.orchestra.run.trial098.stdout:Total 17 MB/s | 79 MB 00:04 2026-02-12T03:55:33.684 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-12T03:55:33.685 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-12T03:55:33.686 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-12T03:55:33.689 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-mgr-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:33.696 INFO:teuthology.orchestra.run.trial154.stdout: Preparing : 1/1 2026-02-12T03:55:33.716 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-test-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/1 2026-02-12T03:55:33.848 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-mgr-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:33.892 INFO:teuthology.orchestra.run.trial091.stdout:Transaction test succeeded. 2026-02-12T03:55:33.892 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction 2026-02-12T03:55:33.905 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-mgr-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:33.905 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:55:33.905 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T03:55:33.905 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:55:33.905 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:55:33.905 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:55:33.932 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-mds-debuginfo 2026-02-12T03:55:33.937 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-12T03:55:33.938 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-12T03:55:34.230 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:08:15 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:55:34.313 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:55:34.314 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:55:34.314 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repo Size 2026-02-12T03:55:34.314 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:55:34.314 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T03:55:34.314 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mds-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 54 M 2026-02-12T03:55:34.315 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:55:34.315 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T03:55:34.315 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:55:34.315 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-12T03:55:34.315 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:55:34.315 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 54 M 2026-02-12T03:55:34.315 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 221 M 2026-02-12T03:55:34.315 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T03:55:35.411 INFO:teuthology.orchestra.run.trial111.stdout:ceph-mds-debuginfo-20.2.0-626.g1279775f.el9.x86 49 MB/s | 54 MB 00:01 2026-02-12T03:55:35.412 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:55:35.412 INFO:teuthology.orchestra.run.trial111.stdout:Total 49 MB/s | 54 MB 00:01 2026-02-12T03:55:35.412 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T03:55:35.414 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T03:55:35.414 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T03:55:35.591 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T03:55:35.591 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T03:55:36.189 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-test-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/1 2026-02-12T03:55:36.247 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-test-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/1 2026-02-12T03:55:36.247 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:55:36.248 INFO:teuthology.orchestra.run.trial154.stdout:Installed: 2026-02-12T03:55:36.248 INFO:teuthology.orchestra.run.trial154.stdout: ceph-test-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:55:36.248 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:55:36.248 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:55:36.448 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install ceph-base-debuginfo 2026-02-12T03:55:36.746 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:08:03 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:55:36.811 INFO:teuthology.orchestra.run.trial154.stdout:Package ceph-base-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 is already installed. 2026-02-12T03:55:36.828 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:55:36.829 INFO:teuthology.orchestra.run.trial154.stdout:Nothing to do. 2026-02-12T03:55:36.829 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:55:36.849 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install ceph-mgr-debuginfo 2026-02-12T03:55:37.151 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:08:04 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:55:37.233 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:55:37.234 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:55:37.235 INFO:teuthology.orchestra.run.trial154.stdout: Package Arch Version Repo Size 2026-02-12T03:55:37.235 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:55:37.235 INFO:teuthology.orchestra.run.trial154.stdout:Installing: 2026-02-12T03:55:37.235 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 22 M 2026-02-12T03:55:37.235 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:55:37.235 INFO:teuthology.orchestra.run.trial154.stdout:Transaction Summary 2026-02-12T03:55:37.235 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:55:37.235 INFO:teuthology.orchestra.run.trial154.stdout:Install 1 Package 2026-02-12T03:55:37.235 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:55:37.235 INFO:teuthology.orchestra.run.trial154.stdout:Total download size: 22 M 2026-02-12T03:55:37.235 INFO:teuthology.orchestra.run.trial154.stdout:Installed size: 146 M 2026-02-12T03:55:37.236 INFO:teuthology.orchestra.run.trial154.stdout:Downloading Packages: 2026-02-12T03:55:37.751 INFO:teuthology.orchestra.run.trial154.stdout:ceph-mgr-debuginfo-20.2.0-626.g1279775f.el9.x86 42 MB/s | 22 MB 00:00 2026-02-12T03:55:37.752 INFO:teuthology.orchestra.run.trial154.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:55:37.752 INFO:teuthology.orchestra.run.trial154.stdout:Total 42 MB/s | 22 MB 00:00 2026-02-12T03:55:37.752 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction check 2026-02-12T03:55:37.754 INFO:teuthology.orchestra.run.trial154.stdout:Transaction check succeeded. 2026-02-12T03:55:37.754 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction test 2026-02-12T03:55:37.837 INFO:teuthology.orchestra.run.trial154.stdout:Transaction test succeeded. 2026-02-12T03:55:37.838 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction 2026-02-12T03:55:37.981 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-12T03:55:37.999 INFO:teuthology.orchestra.run.trial098.stdout: Installing : rbd-mirror-debuginfo-2:20.2.0-626.g1279775f.el9.x86_ 1/1 2026-02-12T03:55:38.329 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: rbd-mirror-debuginfo-2:20.2.0-626.g1279775f.el9.x86_ 1/1 2026-02-12T03:55:38.390 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : rbd-mirror-debuginfo-2:20.2.0-626.g1279775f.el9.x86_ 1/1 2026-02-12T03:55:38.390 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:38.390 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-12T03:55:38.390 INFO:teuthology.orchestra.run.trial098.stdout: rbd-mirror-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:55:38.391 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:38.391 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:55:38.425 DEBUG:teuthology.orchestra.run.trial098:> sudo yum -y install rbd-nbd-debuginfo 2026-02-12T03:55:38.694 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T03:55:38.712 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-mds-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:38.725 INFO:teuthology.orchestra.run.trial098.stdout:Last metadata expiration check: 0:08:18 ago on Thu 12 Feb 2026 03:47:20 AM UTC. 2026-02-12T03:55:38.808 INFO:teuthology.orchestra.run.trial098.stdout:Dependencies resolved. 2026-02-12T03:55:38.808 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:55:38.808 INFO:teuthology.orchestra.run.trial098.stdout: Package Arch Version Repo Size 2026-02-12T03:55:38.808 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:55:38.808 INFO:teuthology.orchestra.run.trial098.stdout:Installing: 2026-02-12T03:55:38.808 INFO:teuthology.orchestra.run.trial098.stdout: rbd-nbd-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 2.4 M 2026-02-12T03:55:38.809 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:38.809 INFO:teuthology.orchestra.run.trial098.stdout:Transaction Summary 2026-02-12T03:55:38.809 INFO:teuthology.orchestra.run.trial098.stdout:================================================================================ 2026-02-12T03:55:38.809 INFO:teuthology.orchestra.run.trial098.stdout:Install 1 Package 2026-02-12T03:55:38.809 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:38.809 INFO:teuthology.orchestra.run.trial098.stdout:Total download size: 2.4 M 2026-02-12T03:55:38.809 INFO:teuthology.orchestra.run.trial098.stdout:Installed size: 12 M 2026-02-12T03:55:38.809 INFO:teuthology.orchestra.run.trial098.stdout:Downloading Packages: 2026-02-12T03:55:38.924 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-mds-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:38.981 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-mds-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:38.981 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:55:38.982 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T03:55:38.982 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mds-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:55:38.982 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:55:38.982 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:55:39.013 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-mon-debuginfo 2026-02-12T03:55:39.098 INFO:teuthology.orchestra.run.trial154.stdout: Preparing : 1/1 2026-02-12T03:55:39.115 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-mgr-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:39.290 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-mgr-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:39.316 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:08:20 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:55:39.349 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-mgr-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:39.349 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:55:39.349 INFO:teuthology.orchestra.run.trial154.stdout:Installed: 2026-02-12T03:55:39.349 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mgr-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:55:39.349 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:55:39.349 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:55:39.380 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install ceph-mds-debuginfo 2026-02-12T03:55:39.400 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:55:39.401 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:55:39.401 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repo Size 2026-02-12T03:55:39.401 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:55:39.401 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T03:55:39.401 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mon-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 129 M 2026-02-12T03:55:39.401 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:55:39.401 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T03:55:39.401 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:55:39.401 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-12T03:55:39.401 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:55:39.402 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 129 M 2026-02-12T03:55:39.402 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 641 M 2026-02-12T03:55:39.402 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T03:55:39.690 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:08:06 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:55:39.775 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:55:39.775 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:55:39.776 INFO:teuthology.orchestra.run.trial154.stdout: Package Arch Version Repo Size 2026-02-12T03:55:39.776 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:55:39.776 INFO:teuthology.orchestra.run.trial154.stdout:Installing: 2026-02-12T03:55:39.776 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mds-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 54 M 2026-02-12T03:55:39.776 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:55:39.776 INFO:teuthology.orchestra.run.trial154.stdout:Transaction Summary 2026-02-12T03:55:39.776 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:55:39.776 INFO:teuthology.orchestra.run.trial154.stdout:Install 1 Package 2026-02-12T03:55:39.776 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:55:39.777 INFO:teuthology.orchestra.run.trial154.stdout:Total download size: 54 M 2026-02-12T03:55:39.777 INFO:teuthology.orchestra.run.trial154.stdout:Installed size: 221 M 2026-02-12T03:55:39.777 INFO:teuthology.orchestra.run.trial154.stdout:Downloading Packages: 2026-02-12T03:55:39.781 INFO:teuthology.orchestra.run.trial098.stdout:rbd-nbd-debuginfo-20.2.0-626.g1279775f.el9.x86_ 2.5 MB/s | 2.4 MB 00:00 2026-02-12T03:55:39.781 INFO:teuthology.orchestra.run.trial098.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:55:39.781 INFO:teuthology.orchestra.run.trial098.stdout:Total 2.5 MB/s | 2.4 MB 00:00 2026-02-12T03:55:39.781 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction check 2026-02-12T03:55:39.783 INFO:teuthology.orchestra.run.trial098.stdout:Transaction check succeeded. 2026-02-12T03:55:39.783 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction test 2026-02-12T03:55:39.808 INFO:teuthology.orchestra.run.trial098.stdout:Transaction test succeeded. 2026-02-12T03:55:39.808 INFO:teuthology.orchestra.run.trial098.stdout:Running transaction 2026-02-12T03:55:39.966 INFO:teuthology.orchestra.run.trial098.stdout: Preparing : 1/1 2026-02-12T03:55:39.984 INFO:teuthology.orchestra.run.trial098.stdout: Installing : rbd-nbd-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:40.050 INFO:teuthology.orchestra.run.trial098.stdout: Running scriptlet: rbd-nbd-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:40.107 INFO:teuthology.orchestra.run.trial098.stdout: Verifying : rbd-nbd-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:40.107 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:40.107 INFO:teuthology.orchestra.run.trial098.stdout:Installed: 2026-02-12T03:55:40.108 INFO:teuthology.orchestra.run.trial098.stdout: rbd-nbd-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:55:40.108 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:55:40.108 INFO:teuthology.orchestra.run.trial098.stdout:Complete! 2026-02-12T03:55:40.135 DEBUG:teuthology.parallel:result is None 2026-02-12T03:55:43.099 INFO:teuthology.orchestra.run.trial111.stdout:ceph-mon-debuginfo-20.2.0-626.g1279775f.el9.x86 35 MB/s | 129 MB 00:03 2026-02-12T03:55:43.100 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:55:43.100 INFO:teuthology.orchestra.run.trial111.stdout:Total 35 MB/s | 129 MB 00:03 2026-02-12T03:55:43.100 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T03:55:43.102 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T03:55:43.102 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T03:55:43.498 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T03:55:43.499 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T03:55:48.429 INFO:teuthology.orchestra.run.trial154.stdout:ceph-mds-debuginfo-20.2.0-626.g1279775f.el9.x86 6.2 MB/s | 54 MB 00:08 2026-02-12T03:55:48.429 INFO:teuthology.orchestra.run.trial154.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:55:48.430 INFO:teuthology.orchestra.run.trial154.stdout:Total 6.2 MB/s | 54 MB 00:08 2026-02-12T03:55:48.430 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction check 2026-02-12T03:55:48.431 INFO:teuthology.orchestra.run.trial154.stdout:Transaction check succeeded. 2026-02-12T03:55:48.431 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction test 2026-02-12T03:55:48.610 INFO:teuthology.orchestra.run.trial154.stdout:Transaction test succeeded. 2026-02-12T03:55:48.610 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction 2026-02-12T03:55:50.221 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T03:55:50.239 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-mon-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:50.757 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-mon-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:50.815 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-mon-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:50.815 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:55:50.815 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T03:55:50.816 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mon-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:55:50.816 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:55:50.816 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:55:50.854 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-osd-debuginfo 2026-02-12T03:55:51.092 INFO:teuthology.orchestra.run.trial091.stdout: Preparing : 1/1 2026-02-12T03:55:51.109 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-osd-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:51.156 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:08:32 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:55:51.240 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:55:51.240 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:55:51.240 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repo Size 2026-02-12T03:55:51.240 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:55:51.241 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T03:55:51.241 INFO:teuthology.orchestra.run.trial111.stdout: ceph-osd-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 343 M 2026-02-12T03:55:51.241 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:55:51.241 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T03:55:51.241 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:55:51.241 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-12T03:55:51.241 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:55:51.241 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 343 M 2026-02-12T03:55:51.241 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 1.6 G 2026-02-12T03:55:51.241 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T03:55:51.258 INFO:teuthology.orchestra.run.trial154.stdout: Preparing : 1/1 2026-02-12T03:55:51.276 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-mds-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:51.490 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-mds-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:51.549 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-mds-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:51.549 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:55:51.549 INFO:teuthology.orchestra.run.trial154.stdout:Installed: 2026-02-12T03:55:51.549 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mds-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:55:51.550 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:55:51.550 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:55:51.581 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install ceph-mon-debuginfo 2026-02-12T03:55:51.882 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:08:18 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:55:51.965 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:55:51.965 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:55:51.965 INFO:teuthology.orchestra.run.trial154.stdout: Package Arch Version Repo Size 2026-02-12T03:55:51.965 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:55:51.965 INFO:teuthology.orchestra.run.trial154.stdout:Installing: 2026-02-12T03:55:51.965 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mon-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 129 M 2026-02-12T03:55:51.965 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:55:51.965 INFO:teuthology.orchestra.run.trial154.stdout:Transaction Summary 2026-02-12T03:55:51.965 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:55:51.965 INFO:teuthology.orchestra.run.trial154.stdout:Install 1 Package 2026-02-12T03:55:51.965 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:55:51.965 INFO:teuthology.orchestra.run.trial154.stdout:Total download size: 129 M 2026-02-12T03:55:51.965 INFO:teuthology.orchestra.run.trial154.stdout:Installed size: 641 M 2026-02-12T03:55:51.966 INFO:teuthology.orchestra.run.trial154.stdout:Downloading Packages: 2026-02-12T03:55:52.337 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-osd-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:52.395 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-osd-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:55:52.395 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:55:52.395 INFO:teuthology.orchestra.run.trial091.stdout:Installed: 2026-02-12T03:55:52.396 INFO:teuthology.orchestra.run.trial091.stdout: ceph-osd-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:55:52.396 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:55:52.396 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:55:52.452 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install ceph-fuse-debuginfo 2026-02-12T03:55:52.753 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:08:29 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:55:52.836 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:55:52.836 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:55:52.836 INFO:teuthology.orchestra.run.trial091.stdout: Package Arch Version Repo Size 2026-02-12T03:55:52.836 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:55:52.836 INFO:teuthology.orchestra.run.trial091.stdout:Installing: 2026-02-12T03:55:52.836 INFO:teuthology.orchestra.run.trial091.stdout: ceph-fuse-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 10 M 2026-02-12T03:55:52.836 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:55:52.836 INFO:teuthology.orchestra.run.trial091.stdout:Transaction Summary 2026-02-12T03:55:52.836 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:55:52.836 INFO:teuthology.orchestra.run.trial091.stdout:Install 1 Package 2026-02-12T03:55:52.836 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:55:52.836 INFO:teuthology.orchestra.run.trial091.stdout:Total download size: 10 M 2026-02-12T03:55:52.836 INFO:teuthology.orchestra.run.trial091.stdout:Installed size: 51 M 2026-02-12T03:55:52.836 INFO:teuthology.orchestra.run.trial091.stdout:Downloading Packages: 2026-02-12T03:55:56.432 INFO:teuthology.orchestra.run.trial154.stdout:ceph-mon-debuginfo-20.2.0-626.g1279775f.el9.x86 29 MB/s | 129 MB 00:04 2026-02-12T03:55:56.433 INFO:teuthology.orchestra.run.trial154.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:55:56.433 INFO:teuthology.orchestra.run.trial154.stdout:Total 29 MB/s | 129 MB 00:04 2026-02-12T03:55:56.433 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction check 2026-02-12T03:55:56.435 INFO:teuthology.orchestra.run.trial154.stdout:Transaction check succeeded. 2026-02-12T03:55:56.435 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction test 2026-02-12T03:55:56.834 INFO:teuthology.orchestra.run.trial154.stdout:Transaction test succeeded. 2026-02-12T03:55:56.834 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction 2026-02-12T03:55:57.450 INFO:teuthology.orchestra.run.trial091.stdout:ceph-fuse-debuginfo-20.2.0-626.g1279775f.el9.x8 2.2 MB/s | 10 MB 00:04 2026-02-12T03:55:57.451 INFO:teuthology.orchestra.run.trial091.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:55:57.451 INFO:teuthology.orchestra.run.trial091.stdout:Total 2.2 MB/s | 10 MB 00:04 2026-02-12T03:55:57.451 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction check 2026-02-12T03:55:57.453 INFO:teuthology.orchestra.run.trial091.stdout:Transaction check succeeded. 2026-02-12T03:55:57.453 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction test 2026-02-12T03:55:57.500 INFO:teuthology.orchestra.run.trial091.stdout:Transaction test succeeded. 2026-02-12T03:55:57.501 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction 2026-02-12T03:55:58.051 INFO:teuthology.orchestra.run.trial091.stdout: Preparing : 1/1 2026-02-12T03:55:58.068 INFO:teuthology.orchestra.run.trial091.stdout: Installing : ceph-fuse-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/1 2026-02-12T03:55:58.158 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: ceph-fuse-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/1 2026-02-12T03:55:58.215 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : ceph-fuse-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/1 2026-02-12T03:55:58.215 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:55:58.215 INFO:teuthology.orchestra.run.trial091.stdout:Installed: 2026-02-12T03:55:58.215 INFO:teuthology.orchestra.run.trial091.stdout: ceph-fuse-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:55:58.216 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:55:58.216 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:55:58.243 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install librados-devel-debuginfo 2026-02-12T03:55:58.548 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:08:35 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:55:58.630 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:55:58.631 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:55:58.631 INFO:teuthology.orchestra.run.trial091.stdout: Package Arch Version Repo Size 2026-02-12T03:55:58.631 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:55:58.631 INFO:teuthology.orchestra.run.trial091.stdout:Installing: 2026-02-12T03:55:58.632 INFO:teuthology.orchestra.run.trial091.stdout: librados-devel-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 144 k 2026-02-12T03:55:58.632 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:55:58.632 INFO:teuthology.orchestra.run.trial091.stdout:Transaction Summary 2026-02-12T03:55:58.632 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:55:58.632 INFO:teuthology.orchestra.run.trial091.stdout:Install 1 Package 2026-02-12T03:55:58.632 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:55:58.632 INFO:teuthology.orchestra.run.trial091.stdout:Total download size: 144 k 2026-02-12T03:55:58.632 INFO:teuthology.orchestra.run.trial091.stdout:Installed size: 802 k 2026-02-12T03:55:58.632 INFO:teuthology.orchestra.run.trial091.stdout:Downloading Packages: 2026-02-12T03:55:58.832 INFO:teuthology.orchestra.run.trial091.stdout:librados-devel-debuginfo-20.2.0-626.g1279775f.e 714 kB/s | 144 kB 00:00 2026-02-12T03:55:58.833 INFO:teuthology.orchestra.run.trial091.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:55:58.833 INFO:teuthology.orchestra.run.trial091.stdout:Total 711 kB/s | 144 kB 00:00 2026-02-12T03:55:58.833 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction check 2026-02-12T03:55:58.835 INFO:teuthology.orchestra.run.trial091.stdout:Transaction check succeeded. 2026-02-12T03:55:58.835 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction test 2026-02-12T03:55:58.855 INFO:teuthology.orchestra.run.trial091.stdout:Transaction test succeeded. 2026-02-12T03:55:58.855 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction 2026-02-12T03:55:58.896 INFO:teuthology.orchestra.run.trial091.stdout: Preparing : 1/1 2026-02-12T03:55:58.913 INFO:teuthology.orchestra.run.trial091.stdout: Installing : librados-devel-debuginfo-2:20.2.0-626.g1279775f.el9. 1/1 2026-02-12T03:55:58.967 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: librados-devel-debuginfo-2:20.2.0-626.g1279775f.el9. 1/1 2026-02-12T03:55:59.025 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : librados-devel-debuginfo-2:20.2.0-626.g1279775f.el9. 1/1 2026-02-12T03:55:59.025 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:55:59.025 INFO:teuthology.orchestra.run.trial091.stdout:Installed: 2026-02-12T03:55:59.025 INFO:teuthology.orchestra.run.trial091.stdout: librados-devel-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:55:59.025 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:55:59.025 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:55:59.050 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install libcephfs2-debuginfo 2026-02-12T03:55:59.350 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:08:36 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:55:59.434 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:55:59.435 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:55:59.435 INFO:teuthology.orchestra.run.trial091.stdout: Package Arch Version Repo Size 2026-02-12T03:55:59.435 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:55:59.435 INFO:teuthology.orchestra.run.trial091.stdout:Installing: 2026-02-12T03:55:59.435 INFO:teuthology.orchestra.run.trial091.stdout: libcephfs2-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 9.1 M 2026-02-12T03:55:59.435 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:55:59.435 INFO:teuthology.orchestra.run.trial091.stdout:Transaction Summary 2026-02-12T03:55:59.435 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:55:59.436 INFO:teuthology.orchestra.run.trial091.stdout:Install 1 Package 2026-02-12T03:55:59.436 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:55:59.436 INFO:teuthology.orchestra.run.trial091.stdout:Total download size: 9.1 M 2026-02-12T03:55:59.436 INFO:teuthology.orchestra.run.trial091.stdout:Installed size: 46 M 2026-02-12T03:55:59.436 INFO:teuthology.orchestra.run.trial091.stdout:Downloading Packages: 2026-02-12T03:56:01.459 INFO:teuthology.orchestra.run.trial091.stdout:libcephfs2-debuginfo-20.2.0-626.g1279775f.el9.x 4.5 MB/s | 9.1 MB 00:02 2026-02-12T03:56:01.460 INFO:teuthology.orchestra.run.trial091.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:56:01.460 INFO:teuthology.orchestra.run.trial091.stdout:Total 4.5 MB/s | 9.1 MB 00:02 2026-02-12T03:56:01.460 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction check 2026-02-12T03:56:01.462 INFO:teuthology.orchestra.run.trial091.stdout:Transaction check succeeded. 2026-02-12T03:56:01.462 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction test 2026-02-12T03:56:01.506 INFO:teuthology.orchestra.run.trial091.stdout:Transaction test succeeded. 2026-02-12T03:56:01.506 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction 2026-02-12T03:56:02.003 INFO:teuthology.orchestra.run.trial091.stdout: Preparing : 1/1 2026-02-12T03:56:02.020 INFO:teuthology.orchestra.run.trial091.stdout: Installing : libcephfs2-debuginfo-2:20.2.0-626.g1279775f.el9.x86_ 1/1 2026-02-12T03:56:02.110 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: libcephfs2-debuginfo-2:20.2.0-626.g1279775f.el9.x86_ 1/1 2026-02-12T03:56:02.167 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : libcephfs2-debuginfo-2:20.2.0-626.g1279775f.el9.x86_ 1/1 2026-02-12T03:56:02.167 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:56:02.167 INFO:teuthology.orchestra.run.trial091.stdout:Installed: 2026-02-12T03:56:02.167 INFO:teuthology.orchestra.run.trial091.stdout: libcephfs2-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:56:02.167 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:56:02.167 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:56:02.195 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install librados2-debuginfo 2026-02-12T03:56:02.497 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:08:39 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:56:02.581 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:56:02.581 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:56:02.581 INFO:teuthology.orchestra.run.trial091.stdout: Package Arch Version Repo Size 2026-02-12T03:56:02.582 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:56:02.582 INFO:teuthology.orchestra.run.trial091.stdout:Installing: 2026-02-12T03:56:02.582 INFO:teuthology.orchestra.run.trial091.stdout: librados2-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 63 M 2026-02-12T03:56:02.582 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:56:02.582 INFO:teuthology.orchestra.run.trial091.stdout:Transaction Summary 2026-02-12T03:56:02.582 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:56:02.582 INFO:teuthology.orchestra.run.trial091.stdout:Install 1 Package 2026-02-12T03:56:02.582 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:56:02.582 INFO:teuthology.orchestra.run.trial091.stdout:Total download size: 63 M 2026-02-12T03:56:02.582 INFO:teuthology.orchestra.run.trial091.stdout:Installed size: 397 M 2026-02-12T03:56:02.582 INFO:teuthology.orchestra.run.trial091.stdout:Downloading Packages: 2026-02-12T03:56:03.556 INFO:teuthology.orchestra.run.trial154.stdout: Preparing : 1/1 2026-02-12T03:56:03.573 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-mon-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:56:04.095 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-mon-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:56:04.154 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-mon-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:56:04.154 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:04.154 INFO:teuthology.orchestra.run.trial154.stdout:Installed: 2026-02-12T03:56:04.154 INFO:teuthology.orchestra.run.trial154.stdout: ceph-mon-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:56:04.154 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:04.154 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:56:04.194 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install ceph-osd-debuginfo 2026-02-12T03:56:04.416 INFO:teuthology.orchestra.run.trial091.stdout:librados2-debuginfo-20.2.0-626.g1279775f.el9.x8 35 MB/s | 63 MB 00:01 2026-02-12T03:56:04.417 INFO:teuthology.orchestra.run.trial091.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:56:04.417 INFO:teuthology.orchestra.run.trial091.stdout:Total 35 MB/s | 63 MB 00:01 2026-02-12T03:56:04.418 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction check 2026-02-12T03:56:04.419 INFO:teuthology.orchestra.run.trial091.stdout:Transaction check succeeded. 2026-02-12T03:56:04.419 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction test 2026-02-12T03:56:04.493 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:08:31 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:56:04.576 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:56:04.576 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:56:04.576 INFO:teuthology.orchestra.run.trial154.stdout: Package Arch Version Repo Size 2026-02-12T03:56:04.576 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:56:04.576 INFO:teuthology.orchestra.run.trial154.stdout:Installing: 2026-02-12T03:56:04.576 INFO:teuthology.orchestra.run.trial154.stdout: ceph-osd-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 343 M 2026-02-12T03:56:04.576 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:04.577 INFO:teuthology.orchestra.run.trial154.stdout:Transaction Summary 2026-02-12T03:56:04.577 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:56:04.577 INFO:teuthology.orchestra.run.trial154.stdout:Install 1 Package 2026-02-12T03:56:04.577 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:04.577 INFO:teuthology.orchestra.run.trial154.stdout:Total download size: 343 M 2026-02-12T03:56:04.577 INFO:teuthology.orchestra.run.trial154.stdout:Installed size: 1.6 G 2026-02-12T03:56:04.577 INFO:teuthology.orchestra.run.trial154.stdout:Downloading Packages: 2026-02-12T03:56:04.627 INFO:teuthology.orchestra.run.trial091.stdout:Transaction test succeeded. 2026-02-12T03:56:04.627 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction 2026-02-12T03:56:06.075 INFO:teuthology.orchestra.run.trial111.stdout:ceph-osd-debuginfo-20.2.0-626.g1279775f.el9.x86 23 MB/s | 343 MB 00:14 2026-02-12T03:56:06.076 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:56:06.076 INFO:teuthology.orchestra.run.trial111.stdout:Total 23 MB/s | 343 MB 00:14 2026-02-12T03:56:06.076 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T03:56:06.078 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T03:56:06.078 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T03:56:07.104 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T03:56:07.104 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T03:56:08.182 INFO:teuthology.orchestra.run.trial091.stdout: Preparing : 1/1 2026-02-12T03:56:08.199 INFO:teuthology.orchestra.run.trial091.stdout: Installing : librados2-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/1 2026-02-12T03:56:08.538 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: librados2-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/1 2026-02-12T03:56:08.595 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : librados2-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/1 2026-02-12T03:56:08.596 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:56:08.596 INFO:teuthology.orchestra.run.trial091.stdout:Installed: 2026-02-12T03:56:08.596 INFO:teuthology.orchestra.run.trial091.stdout: librados2-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:56:08.596 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:56:08.596 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:56:08.627 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install librbd1-debuginfo 2026-02-12T03:56:08.930 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:08:45 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:56:09.012 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:56:09.013 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:56:09.013 INFO:teuthology.orchestra.run.trial091.stdout: Package Arch Version Repo Size 2026-02-12T03:56:09.013 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:56:09.013 INFO:teuthology.orchestra.run.trial091.stdout:Installing: 2026-02-12T03:56:09.013 INFO:teuthology.orchestra.run.trial091.stdout: librbd1-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 80 M 2026-02-12T03:56:09.013 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:56:09.013 INFO:teuthology.orchestra.run.trial091.stdout:Transaction Summary 2026-02-12T03:56:09.013 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:56:09.013 INFO:teuthology.orchestra.run.trial091.stdout:Install 1 Package 2026-02-12T03:56:09.014 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:56:09.014 INFO:teuthology.orchestra.run.trial091.stdout:Total download size: 80 M 2026-02-12T03:56:09.014 INFO:teuthology.orchestra.run.trial091.stdout:Installed size: 405 M 2026-02-12T03:56:09.014 INFO:teuthology.orchestra.run.trial091.stdout:Downloading Packages: 2026-02-12T03:56:12.892 INFO:teuthology.orchestra.run.trial091.stdout:librbd1-debuginfo-20.2.0-626.g1279775f.el9.x86_ 21 MB/s | 80 MB 00:03 2026-02-12T03:56:12.893 INFO:teuthology.orchestra.run.trial091.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:56:12.893 INFO:teuthology.orchestra.run.trial091.stdout:Total 21 MB/s | 80 MB 00:03 2026-02-12T03:56:12.894 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction check 2026-02-12T03:56:12.895 INFO:teuthology.orchestra.run.trial091.stdout:Transaction check succeeded. 2026-02-12T03:56:12.895 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction test 2026-02-12T03:56:13.151 INFO:teuthology.orchestra.run.trial091.stdout:Transaction test succeeded. 2026-02-12T03:56:13.151 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction 2026-02-12T03:56:14.070 INFO:teuthology.orchestra.run.trial154.stdout:ceph-osd-debuginfo-20.2.0-626.g1279775f.el9.x86 36 MB/s | 343 MB 00:09 2026-02-12T03:56:14.071 INFO:teuthology.orchestra.run.trial154.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:56:14.071 INFO:teuthology.orchestra.run.trial154.stdout:Total 36 MB/s | 343 MB 00:09 2026-02-12T03:56:14.071 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction check 2026-02-12T03:56:14.072 INFO:teuthology.orchestra.run.trial154.stdout:Transaction check succeeded. 2026-02-12T03:56:14.073 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction test 2026-02-12T03:56:15.092 INFO:teuthology.orchestra.run.trial154.stdout:Transaction test succeeded. 2026-02-12T03:56:15.093 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction 2026-02-12T03:56:17.386 INFO:teuthology.orchestra.run.trial091.stdout: Preparing : 1/1 2026-02-12T03:56:17.404 INFO:teuthology.orchestra.run.trial091.stdout: Installing : librbd1-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:56:17.752 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: librbd1-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:56:17.809 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : librbd1-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:56:17.809 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:56:17.809 INFO:teuthology.orchestra.run.trial091.stdout:Installed: 2026-02-12T03:56:17.809 INFO:teuthology.orchestra.run.trial091.stdout: librbd1-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:56:17.809 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:56:17.809 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:56:17.843 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install python3-cephfs-debuginfo 2026-02-12T03:56:18.145 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:08:55 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:56:18.227 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:56:18.228 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:56:18.228 INFO:teuthology.orchestra.run.trial091.stdout: Package Arch Version Repo Size 2026-02-12T03:56:18.228 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:56:18.228 INFO:teuthology.orchestra.run.trial091.stdout:Installing: 2026-02-12T03:56:18.228 INFO:teuthology.orchestra.run.trial091.stdout: python3-cephfs-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 645 k 2026-02-12T03:56:18.228 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:56:18.228 INFO:teuthology.orchestra.run.trial091.stdout:Transaction Summary 2026-02-12T03:56:18.228 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:56:18.228 INFO:teuthology.orchestra.run.trial091.stdout:Install 1 Package 2026-02-12T03:56:18.229 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:56:18.229 INFO:teuthology.orchestra.run.trial091.stdout:Total download size: 645 k 2026-02-12T03:56:18.229 INFO:teuthology.orchestra.run.trial091.stdout:Installed size: 2.3 M 2026-02-12T03:56:18.229 INFO:teuthology.orchestra.run.trial091.stdout:Downloading Packages: 2026-02-12T03:56:18.336 INFO:teuthology.orchestra.run.trial091.stdout:python3-cephfs-debuginfo-20.2.0-626.g1279775f.e 5.8 MB/s | 645 kB 00:00 2026-02-12T03:56:18.337 INFO:teuthology.orchestra.run.trial091.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:56:18.337 INFO:teuthology.orchestra.run.trial091.stdout:Total 5.8 MB/s | 645 kB 00:00 2026-02-12T03:56:18.337 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction check 2026-02-12T03:56:18.338 INFO:teuthology.orchestra.run.trial091.stdout:Transaction check succeeded. 2026-02-12T03:56:18.339 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction test 2026-02-12T03:56:18.359 INFO:teuthology.orchestra.run.trial091.stdout:Transaction test succeeded. 2026-02-12T03:56:18.359 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction 2026-02-12T03:56:18.428 INFO:teuthology.orchestra.run.trial091.stdout: Preparing : 1/1 2026-02-12T03:56:18.445 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-cephfs-debuginfo-2:20.2.0-626.g1279775f.el9. 1/1 2026-02-12T03:56:18.504 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: python3-cephfs-debuginfo-2:20.2.0-626.g1279775f.el9. 1/1 2026-02-12T03:56:18.561 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-cephfs-debuginfo-2:20.2.0-626.g1279775f.el9. 1/1 2026-02-12T03:56:18.562 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:56:18.562 INFO:teuthology.orchestra.run.trial091.stdout:Installed: 2026-02-12T03:56:18.562 INFO:teuthology.orchestra.run.trial091.stdout: python3-cephfs-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:56:18.562 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:56:18.562 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:56:18.590 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install python3-rados-debuginfo 2026-02-12T03:56:18.889 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:08:55 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:56:18.975 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:56:18.975 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:56:18.975 INFO:teuthology.orchestra.run.trial091.stdout: Package Arch Version Repo Size 2026-02-12T03:56:18.975 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:56:18.975 INFO:teuthology.orchestra.run.trial091.stdout:Installing: 2026-02-12T03:56:18.975 INFO:teuthology.orchestra.run.trial091.stdout: python3-rados-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 804 k 2026-02-12T03:56:18.975 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:56:18.976 INFO:teuthology.orchestra.run.trial091.stdout:Transaction Summary 2026-02-12T03:56:18.976 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:56:18.976 INFO:teuthology.orchestra.run.trial091.stdout:Install 1 Package 2026-02-12T03:56:18.976 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:56:18.976 INFO:teuthology.orchestra.run.trial091.stdout:Total download size: 804 k 2026-02-12T03:56:18.976 INFO:teuthology.orchestra.run.trial091.stdout:Installed size: 3.1 M 2026-02-12T03:56:18.976 INFO:teuthology.orchestra.run.trial091.stdout:Downloading Packages: 2026-02-12T03:56:19.082 INFO:teuthology.orchestra.run.trial091.stdout:python3-rados-debuginfo-20.2.0-626.g1279775f.el 7.4 MB/s | 804 kB 00:00 2026-02-12T03:56:19.082 INFO:teuthology.orchestra.run.trial091.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:56:19.083 INFO:teuthology.orchestra.run.trial091.stdout:Total 7.3 MB/s | 804 kB 00:00 2026-02-12T03:56:19.083 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction check 2026-02-12T03:56:19.084 INFO:teuthology.orchestra.run.trial091.stdout:Transaction check succeeded. 2026-02-12T03:56:19.084 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction test 2026-02-12T03:56:19.104 INFO:teuthology.orchestra.run.trial091.stdout:Transaction test succeeded. 2026-02-12T03:56:19.105 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction 2026-02-12T03:56:19.178 INFO:teuthology.orchestra.run.trial091.stdout: Preparing : 1/1 2026-02-12T03:56:19.195 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-rados-debuginfo-2:20.2.0-626.g1279775f.el9.x 1/1 2026-02-12T03:56:19.251 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: python3-rados-debuginfo-2:20.2.0-626.g1279775f.el9.x 1/1 2026-02-12T03:56:19.308 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-rados-debuginfo-2:20.2.0-626.g1279775f.el9.x 1/1 2026-02-12T03:56:19.308 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:56:19.308 INFO:teuthology.orchestra.run.trial091.stdout:Installed: 2026-02-12T03:56:19.308 INFO:teuthology.orchestra.run.trial091.stdout: python3-rados-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:56:19.309 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:56:19.309 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:56:19.335 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install python3-rbd-debuginfo 2026-02-12T03:56:19.641 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:08:56 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:56:19.725 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:56:19.725 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:56:19.725 INFO:teuthology.orchestra.run.trial091.stdout: Package Arch Version Repo Size 2026-02-12T03:56:19.726 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:56:19.726 INFO:teuthology.orchestra.run.trial091.stdout:Installing: 2026-02-12T03:56:19.726 INFO:teuthology.orchestra.run.trial091.stdout: python3-rbd-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 1.2 M 2026-02-12T03:56:19.726 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:56:19.726 INFO:teuthology.orchestra.run.trial091.stdout:Transaction Summary 2026-02-12T03:56:19.726 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:56:19.726 INFO:teuthology.orchestra.run.trial091.stdout:Install 1 Package 2026-02-12T03:56:19.727 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:56:19.727 INFO:teuthology.orchestra.run.trial091.stdout:Total download size: 1.2 M 2026-02-12T03:56:19.727 INFO:teuthology.orchestra.run.trial091.stdout:Installed size: 4.7 M 2026-02-12T03:56:19.727 INFO:teuthology.orchestra.run.trial091.stdout:Downloading Packages: 2026-02-12T03:56:19.846 INFO:teuthology.orchestra.run.trial091.stdout:python3-rbd-debuginfo-20.2.0-626.g1279775f.el9. 9.7 MB/s | 1.2 MB 00:00 2026-02-12T03:56:19.846 INFO:teuthology.orchestra.run.trial091.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:56:19.846 INFO:teuthology.orchestra.run.trial091.stdout:Total 9.7 MB/s | 1.2 MB 00:00 2026-02-12T03:56:19.846 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction check 2026-02-12T03:56:19.848 INFO:teuthology.orchestra.run.trial091.stdout:Transaction check succeeded. 2026-02-12T03:56:19.848 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction test 2026-02-12T03:56:19.870 INFO:teuthology.orchestra.run.trial091.stdout:Transaction test succeeded. 2026-02-12T03:56:19.870 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction 2026-02-12T03:56:19.962 INFO:teuthology.orchestra.run.trial091.stdout: Preparing : 1/1 2026-02-12T03:56:19.979 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-rbd-debuginfo-2:20.2.0-626.g1279775f.el9.x86 1/1 2026-02-12T03:56:20.039 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: python3-rbd-debuginfo-2:20.2.0-626.g1279775f.el9.x86 1/1 2026-02-12T03:56:20.097 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-rbd-debuginfo-2:20.2.0-626.g1279775f.el9.x86 1/1 2026-02-12T03:56:20.097 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:56:20.097 INFO:teuthology.orchestra.run.trial091.stdout:Installed: 2026-02-12T03:56:20.097 INFO:teuthology.orchestra.run.trial091.stdout: python3-rbd-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:56:20.097 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:56:20.097 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:56:20.125 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install python3-rgw-debuginfo 2026-02-12T03:56:20.429 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:08:57 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:56:20.512 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:56:20.513 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:56:20.513 INFO:teuthology.orchestra.run.trial091.stdout: Package Arch Version Repo Size 2026-02-12T03:56:20.513 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:56:20.513 INFO:teuthology.orchestra.run.trial091.stdout:Installing: 2026-02-12T03:56:20.513 INFO:teuthology.orchestra.run.trial091.stdout: python3-rgw-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 350 k 2026-02-12T03:56:20.513 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:56:20.513 INFO:teuthology.orchestra.run.trial091.stdout:Transaction Summary 2026-02-12T03:56:20.513 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:56:20.513 INFO:teuthology.orchestra.run.trial091.stdout:Install 1 Package 2026-02-12T03:56:20.513 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:56:20.514 INFO:teuthology.orchestra.run.trial091.stdout:Total download size: 350 k 2026-02-12T03:56:20.514 INFO:teuthology.orchestra.run.trial091.stdout:Installed size: 1.1 M 2026-02-12T03:56:20.514 INFO:teuthology.orchestra.run.trial091.stdout:Downloading Packages: 2026-02-12T03:56:20.610 INFO:teuthology.orchestra.run.trial091.stdout:python3-rgw-debuginfo-20.2.0-626.g1279775f.el9. 3.5 MB/s | 350 kB 00:00 2026-02-12T03:56:20.611 INFO:teuthology.orchestra.run.trial091.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:56:20.611 INFO:teuthology.orchestra.run.trial091.stdout:Total 3.5 MB/s | 350 kB 00:00 2026-02-12T03:56:20.611 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction check 2026-02-12T03:56:20.613 INFO:teuthology.orchestra.run.trial091.stdout:Transaction check succeeded. 2026-02-12T03:56:20.613 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction test 2026-02-12T03:56:20.633 INFO:teuthology.orchestra.run.trial091.stdout:Transaction test succeeded. 2026-02-12T03:56:20.633 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction 2026-02-12T03:56:20.685 INFO:teuthology.orchestra.run.trial091.stdout: Preparing : 1/1 2026-02-12T03:56:20.701 INFO:teuthology.orchestra.run.trial091.stdout: Installing : python3-rgw-debuginfo-2:20.2.0-626.g1279775f.el9.x86 1/1 2026-02-12T03:56:20.763 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: python3-rgw-debuginfo-2:20.2.0-626.g1279775f.el9.x86 1/1 2026-02-12T03:56:20.821 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : python3-rgw-debuginfo-2:20.2.0-626.g1279775f.el9.x86 1/1 2026-02-12T03:56:20.821 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:56:20.821 INFO:teuthology.orchestra.run.trial091.stdout:Installed: 2026-02-12T03:56:20.821 INFO:teuthology.orchestra.run.trial091.stdout: python3-rgw-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:56:20.821 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:56:20.821 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:56:20.848 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install rbd-fuse-debuginfo 2026-02-12T03:56:21.156 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:08:58 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:56:21.239 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:56:21.239 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:56:21.240 INFO:teuthology.orchestra.run.trial091.stdout: Package Arch Version Repo Size 2026-02-12T03:56:21.240 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:56:21.240 INFO:teuthology.orchestra.run.trial091.stdout:Installing: 2026-02-12T03:56:21.240 INFO:teuthology.orchestra.run.trial091.stdout: rbd-fuse-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 1.5 M 2026-02-12T03:56:21.240 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:56:21.240 INFO:teuthology.orchestra.run.trial091.stdout:Transaction Summary 2026-02-12T03:56:21.240 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:56:21.240 INFO:teuthology.orchestra.run.trial091.stdout:Install 1 Package 2026-02-12T03:56:21.240 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:56:21.241 INFO:teuthology.orchestra.run.trial091.stdout:Total download size: 1.5 M 2026-02-12T03:56:21.241 INFO:teuthology.orchestra.run.trial091.stdout:Installed size: 7.9 M 2026-02-12T03:56:21.241 INFO:teuthology.orchestra.run.trial091.stdout:Downloading Packages: 2026-02-12T03:56:21.361 INFO:teuthology.orchestra.run.trial091.stdout:rbd-fuse-debuginfo-20.2.0-626.g1279775f.el9.x86 13 MB/s | 1.5 MB 00:00 2026-02-12T03:56:21.362 INFO:teuthology.orchestra.run.trial091.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:56:21.362 INFO:teuthology.orchestra.run.trial091.stdout:Total 13 MB/s | 1.5 MB 00:00 2026-02-12T03:56:21.362 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction check 2026-02-12T03:56:21.363 INFO:teuthology.orchestra.run.trial091.stdout:Transaction check succeeded. 2026-02-12T03:56:21.364 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction test 2026-02-12T03:56:21.387 INFO:teuthology.orchestra.run.trial091.stdout:Transaction test succeeded. 2026-02-12T03:56:21.387 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction 2026-02-12T03:56:21.499 INFO:teuthology.orchestra.run.trial091.stdout: Preparing : 1/1 2026-02-12T03:56:21.516 INFO:teuthology.orchestra.run.trial091.stdout: Installing : rbd-fuse-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:56:21.580 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: rbd-fuse-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:56:21.638 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : rbd-fuse-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:56:21.639 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:56:21.639 INFO:teuthology.orchestra.run.trial091.stdout:Installed: 2026-02-12T03:56:21.639 INFO:teuthology.orchestra.run.trial091.stdout: rbd-fuse-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:56:21.639 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:56:21.639 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:56:21.666 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install rbd-mirror-debuginfo 2026-02-12T03:56:21.972 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:08:58 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:56:22.056 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:56:22.057 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:56:22.057 INFO:teuthology.orchestra.run.trial091.stdout: Package Arch Version Repo Size 2026-02-12T03:56:22.057 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:56:22.057 INFO:teuthology.orchestra.run.trial091.stdout:Installing: 2026-02-12T03:56:22.057 INFO:teuthology.orchestra.run.trial091.stdout: rbd-mirror-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 79 M 2026-02-12T03:56:22.057 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:56:22.057 INFO:teuthology.orchestra.run.trial091.stdout:Transaction Summary 2026-02-12T03:56:22.057 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:56:22.057 INFO:teuthology.orchestra.run.trial091.stdout:Install 1 Package 2026-02-12T03:56:22.057 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:56:22.058 INFO:teuthology.orchestra.run.trial091.stdout:Total download size: 79 M 2026-02-12T03:56:22.058 INFO:teuthology.orchestra.run.trial091.stdout:Installed size: 374 M 2026-02-12T03:56:22.058 INFO:teuthology.orchestra.run.trial091.stdout:Downloading Packages: 2026-02-12T03:56:23.622 INFO:teuthology.orchestra.run.trial091.stdout:rbd-mirror-debuginfo-20.2.0-626.g1279775f.el9.x 51 MB/s | 79 MB 00:01 2026-02-12T03:56:23.624 INFO:teuthology.orchestra.run.trial091.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:56:23.624 INFO:teuthology.orchestra.run.trial091.stdout:Total 51 MB/s | 79 MB 00:01 2026-02-12T03:56:23.624 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction check 2026-02-12T03:56:23.626 INFO:teuthology.orchestra.run.trial091.stdout:Transaction check succeeded. 2026-02-12T03:56:23.626 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction test 2026-02-12T03:56:23.874 INFO:teuthology.orchestra.run.trial091.stdout:Transaction test succeeded. 2026-02-12T03:56:23.875 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction 2026-02-12T03:56:24.714 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T03:56:24.732 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-osd-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:56:25.955 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-osd-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:56:26.013 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-osd-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:56:26.013 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:26.013 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T03:56:26.013 INFO:teuthology.orchestra.run.trial111.stdout: ceph-osd-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:56:26.013 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:26.013 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:56:26.071 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-fuse-debuginfo 2026-02-12T03:56:26.369 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:09:07 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:56:26.453 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:56:26.454 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:56:26.454 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repo Size 2026-02-12T03:56:26.454 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:56:26.454 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T03:56:26.454 INFO:teuthology.orchestra.run.trial111.stdout: ceph-fuse-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 10 M 2026-02-12T03:56:26.454 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:26.455 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T03:56:26.455 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:56:26.455 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-12T03:56:26.455 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:26.455 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 10 M 2026-02-12T03:56:26.455 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 51 M 2026-02-12T03:56:26.455 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T03:56:26.734 INFO:teuthology.orchestra.run.trial111.stdout:ceph-fuse-debuginfo-20.2.0-626.g1279775f.el9.x8 36 MB/s | 10 MB 00:00 2026-02-12T03:56:26.735 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:56:26.735 INFO:teuthology.orchestra.run.trial111.stdout:Total 36 MB/s | 10 MB 00:00 2026-02-12T03:56:26.735 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T03:56:26.736 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T03:56:26.737 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T03:56:26.785 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T03:56:26.785 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T03:56:27.333 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T03:56:27.351 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-fuse-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/1 2026-02-12T03:56:27.445 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-fuse-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/1 2026-02-12T03:56:27.502 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-fuse-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/1 2026-02-12T03:56:27.502 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:27.503 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T03:56:27.503 INFO:teuthology.orchestra.run.trial111.stdout: ceph-fuse-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:56:27.503 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:27.503 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:56:27.529 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install librados-devel-debuginfo 2026-02-12T03:56:27.827 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:09:08 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:56:27.910 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:56:27.910 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:56:27.911 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repo Size 2026-02-12T03:56:27.911 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:56:27.911 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T03:56:27.911 INFO:teuthology.orchestra.run.trial111.stdout: librados-devel-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 144 k 2026-02-12T03:56:27.911 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:27.911 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T03:56:27.911 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:56:27.911 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-12T03:56:27.911 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:27.911 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 144 k 2026-02-12T03:56:27.912 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 802 k 2026-02-12T03:56:27.912 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T03:56:27.942 INFO:teuthology.orchestra.run.trial091.stdout: Preparing : 1/1 2026-02-12T03:56:27.960 INFO:teuthology.orchestra.run.trial091.stdout: Installing : rbd-mirror-debuginfo-2:20.2.0-626.g1279775f.el9.x86_ 1/1 2026-02-12T03:56:27.997 INFO:teuthology.orchestra.run.trial111.stdout:librados-devel-debuginfo-20.2.0-626.g1279775f.e 1.6 MB/s | 144 kB 00:00 2026-02-12T03:56:27.998 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:56:27.998 INFO:teuthology.orchestra.run.trial111.stdout:Total 1.6 MB/s | 144 kB 00:00 2026-02-12T03:56:27.998 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T03:56:27.999 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T03:56:27.999 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T03:56:28.018 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T03:56:28.018 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T03:56:28.060 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T03:56:28.076 INFO:teuthology.orchestra.run.trial111.stdout: Installing : librados-devel-debuginfo-2:20.2.0-626.g1279775f.el9. 1/1 2026-02-12T03:56:28.130 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: librados-devel-debuginfo-2:20.2.0-626.g1279775f.el9. 1/1 2026-02-12T03:56:28.188 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : librados-devel-debuginfo-2:20.2.0-626.g1279775f.el9. 1/1 2026-02-12T03:56:28.188 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:28.188 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T03:56:28.188 INFO:teuthology.orchestra.run.trial111.stdout: librados-devel-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:56:28.189 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:28.189 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:56:28.216 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install libcephfs2-debuginfo 2026-02-12T03:56:28.288 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: rbd-mirror-debuginfo-2:20.2.0-626.g1279775f.el9.x86_ 1/1 2026-02-12T03:56:28.345 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : rbd-mirror-debuginfo-2:20.2.0-626.g1279775f.el9.x86_ 1/1 2026-02-12T03:56:28.345 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:56:28.346 INFO:teuthology.orchestra.run.trial091.stdout:Installed: 2026-02-12T03:56:28.346 INFO:teuthology.orchestra.run.trial091.stdout: rbd-mirror-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:56:28.346 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:56:28.346 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:56:28.378 DEBUG:teuthology.orchestra.run.trial091:> sudo yum -y install rbd-nbd-debuginfo 2026-02-12T03:56:28.518 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:09:09 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:56:28.601 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:56:28.602 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:56:28.602 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repo Size 2026-02-12T03:56:28.602 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:56:28.603 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T03:56:28.603 INFO:teuthology.orchestra.run.trial111.stdout: libcephfs2-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 9.1 M 2026-02-12T03:56:28.603 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:28.603 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T03:56:28.603 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:56:28.603 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-12T03:56:28.603 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:28.603 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 9.1 M 2026-02-12T03:56:28.603 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 46 M 2026-02-12T03:56:28.603 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T03:56:28.684 INFO:teuthology.orchestra.run.trial091.stdout:Last metadata expiration check: 0:09:05 ago on Thu 12 Feb 2026 03:47:23 AM UTC. 2026-02-12T03:56:28.766 INFO:teuthology.orchestra.run.trial091.stdout:Dependencies resolved. 2026-02-12T03:56:28.767 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:56:28.767 INFO:teuthology.orchestra.run.trial091.stdout: Package Arch Version Repo Size 2026-02-12T03:56:28.767 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:56:28.767 INFO:teuthology.orchestra.run.trial091.stdout:Installing: 2026-02-12T03:56:28.767 INFO:teuthology.orchestra.run.trial091.stdout: rbd-nbd-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 2.4 M 2026-02-12T03:56:28.767 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:56:28.767 INFO:teuthology.orchestra.run.trial091.stdout:Transaction Summary 2026-02-12T03:56:28.767 INFO:teuthology.orchestra.run.trial091.stdout:================================================================================ 2026-02-12T03:56:28.768 INFO:teuthology.orchestra.run.trial091.stdout:Install 1 Package 2026-02-12T03:56:28.768 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:56:28.768 INFO:teuthology.orchestra.run.trial091.stdout:Total download size: 2.4 M 2026-02-12T03:56:28.768 INFO:teuthology.orchestra.run.trial091.stdout:Installed size: 12 M 2026-02-12T03:56:28.768 INFO:teuthology.orchestra.run.trial091.stdout:Downloading Packages: 2026-02-12T03:56:28.863 INFO:teuthology.orchestra.run.trial111.stdout:libcephfs2-debuginfo-20.2.0-626.g1279775f.el9.x 35 MB/s | 9.1 MB 00:00 2026-02-12T03:56:28.864 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:56:28.864 INFO:teuthology.orchestra.run.trial111.stdout:Total 35 MB/s | 9.1 MB 00:00 2026-02-12T03:56:28.864 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T03:56:28.866 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T03:56:28.866 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T03:56:28.911 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T03:56:28.912 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T03:56:28.964 INFO:teuthology.orchestra.run.trial091.stdout:rbd-nbd-debuginfo-20.2.0-626.g1279775f.el9.x86_ 12 MB/s | 2.4 MB 00:00 2026-02-12T03:56:28.965 INFO:teuthology.orchestra.run.trial091.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:56:28.965 INFO:teuthology.orchestra.run.trial091.stdout:Total 12 MB/s | 2.4 MB 00:00 2026-02-12T03:56:28.965 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction check 2026-02-12T03:56:28.966 INFO:teuthology.orchestra.run.trial091.stdout:Transaction check succeeded. 2026-02-12T03:56:28.966 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction test 2026-02-12T03:56:28.992 INFO:teuthology.orchestra.run.trial091.stdout:Transaction test succeeded. 2026-02-12T03:56:28.992 INFO:teuthology.orchestra.run.trial091.stdout:Running transaction 2026-02-12T03:56:29.151 INFO:teuthology.orchestra.run.trial091.stdout: Preparing : 1/1 2026-02-12T03:56:29.168 INFO:teuthology.orchestra.run.trial091.stdout: Installing : rbd-nbd-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:56:29.231 INFO:teuthology.orchestra.run.trial091.stdout: Running scriptlet: rbd-nbd-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:56:29.289 INFO:teuthology.orchestra.run.trial091.stdout: Verifying : rbd-nbd-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:56:29.289 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:56:29.289 INFO:teuthology.orchestra.run.trial091.stdout:Installed: 2026-02-12T03:56:29.289 INFO:teuthology.orchestra.run.trial091.stdout: rbd-nbd-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:56:29.289 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:56:29.289 INFO:teuthology.orchestra.run.trial091.stdout:Complete! 2026-02-12T03:56:29.319 DEBUG:teuthology.parallel:result is None 2026-02-12T03:56:29.416 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T03:56:29.433 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libcephfs2-debuginfo-2:20.2.0-626.g1279775f.el9.x86_ 1/1 2026-02-12T03:56:29.526 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: libcephfs2-debuginfo-2:20.2.0-626.g1279775f.el9.x86_ 1/1 2026-02-12T03:56:29.584 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libcephfs2-debuginfo-2:20.2.0-626.g1279775f.el9.x86_ 1/1 2026-02-12T03:56:29.584 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:29.584 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T03:56:29.584 INFO:teuthology.orchestra.run.trial111.stdout: libcephfs2-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:56:29.584 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:29.584 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:56:29.612 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install librados2-debuginfo 2026-02-12T03:56:29.914 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:09:10 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:56:29.997 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:56:29.998 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:56:29.999 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repo Size 2026-02-12T03:56:29.999 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:56:29.999 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T03:56:29.999 INFO:teuthology.orchestra.run.trial111.stdout: librados2-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 63 M 2026-02-12T03:56:29.999 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:29.999 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T03:56:29.999 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:56:29.999 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-12T03:56:29.999 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:30.000 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 63 M 2026-02-12T03:56:30.000 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 397 M 2026-02-12T03:56:30.000 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T03:56:31.275 INFO:teuthology.orchestra.run.trial111.stdout:librados2-debuginfo-20.2.0-626.g1279775f.el9.x8 50 MB/s | 63 MB 00:01 2026-02-12T03:56:31.276 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:56:31.276 INFO:teuthology.orchestra.run.trial111.stdout:Total 50 MB/s | 63 MB 00:01 2026-02-12T03:56:31.276 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T03:56:31.278 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T03:56:31.278 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T03:56:31.484 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T03:56:31.485 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T03:56:32.603 INFO:teuthology.orchestra.run.trial154.stdout: Preparing : 1/1 2026-02-12T03:56:32.621 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-osd-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:56:33.843 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-osd-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:56:33.903 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-osd-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:56:33.903 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:33.903 INFO:teuthology.orchestra.run.trial154.stdout:Installed: 2026-02-12T03:56:33.903 INFO:teuthology.orchestra.run.trial154.stdout: ceph-osd-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:56:33.903 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:33.903 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:56:33.961 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install ceph-fuse-debuginfo 2026-02-12T03:56:34.259 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:09:01 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:56:34.342 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:56:34.342 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:56:34.343 INFO:teuthology.orchestra.run.trial154.stdout: Package Arch Version Repo Size 2026-02-12T03:56:34.343 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:56:34.343 INFO:teuthology.orchestra.run.trial154.stdout:Installing: 2026-02-12T03:56:34.343 INFO:teuthology.orchestra.run.trial154.stdout: ceph-fuse-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 10 M 2026-02-12T03:56:34.343 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:34.343 INFO:teuthology.orchestra.run.trial154.stdout:Transaction Summary 2026-02-12T03:56:34.343 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:56:34.343 INFO:teuthology.orchestra.run.trial154.stdout:Install 1 Package 2026-02-12T03:56:34.343 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:34.344 INFO:teuthology.orchestra.run.trial154.stdout:Total download size: 10 M 2026-02-12T03:56:34.344 INFO:teuthology.orchestra.run.trial154.stdout:Installed size: 51 M 2026-02-12T03:56:34.344 INFO:teuthology.orchestra.run.trial154.stdout:Downloading Packages: 2026-02-12T03:56:34.624 INFO:teuthology.orchestra.run.trial154.stdout:ceph-fuse-debuginfo-20.2.0-626.g1279775f.el9.x8 36 MB/s | 10 MB 00:00 2026-02-12T03:56:34.625 INFO:teuthology.orchestra.run.trial154.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:56:34.625 INFO:teuthology.orchestra.run.trial154.stdout:Total 36 MB/s | 10 MB 00:00 2026-02-12T03:56:34.625 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction check 2026-02-12T03:56:34.626 INFO:teuthology.orchestra.run.trial154.stdout:Transaction check succeeded. 2026-02-12T03:56:34.626 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction test 2026-02-12T03:56:34.675 INFO:teuthology.orchestra.run.trial154.stdout:Transaction test succeeded. 2026-02-12T03:56:34.676 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction 2026-02-12T03:56:34.973 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T03:56:34.991 INFO:teuthology.orchestra.run.trial111.stdout: Installing : librados2-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/1 2026-02-12T03:56:35.227 INFO:teuthology.orchestra.run.trial154.stdout: Preparing : 1/1 2026-02-12T03:56:35.244 INFO:teuthology.orchestra.run.trial154.stdout: Installing : ceph-fuse-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/1 2026-02-12T03:56:35.344 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: ceph-fuse-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/1 2026-02-12T03:56:35.347 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: librados2-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/1 2026-02-12T03:56:35.403 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : ceph-fuse-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/1 2026-02-12T03:56:35.403 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:35.403 INFO:teuthology.orchestra.run.trial154.stdout:Installed: 2026-02-12T03:56:35.403 INFO:teuthology.orchestra.run.trial154.stdout: ceph-fuse-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:56:35.403 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:35.404 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:56:35.404 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : librados2-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/1 2026-02-12T03:56:35.404 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:35.404 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T03:56:35.404 INFO:teuthology.orchestra.run.trial111.stdout: librados2-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:56:35.404 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:35.405 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:56:35.431 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install librados-devel-debuginfo 2026-02-12T03:56:35.436 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install librbd1-debuginfo 2026-02-12T03:56:35.731 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:09:16 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:56:35.740 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:09:02 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:56:35.813 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:56:35.814 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:56:35.814 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repo Size 2026-02-12T03:56:35.814 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:56:35.814 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T03:56:35.814 INFO:teuthology.orchestra.run.trial111.stdout: librbd1-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 80 M 2026-02-12T03:56:35.815 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:35.815 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T03:56:35.815 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:56:35.815 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-12T03:56:35.815 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:35.815 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 80 M 2026-02-12T03:56:35.815 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 405 M 2026-02-12T03:56:35.815 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T03:56:35.822 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:56:35.823 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:56:35.823 INFO:teuthology.orchestra.run.trial154.stdout: Package Arch Version Repo Size 2026-02-12T03:56:35.823 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:56:35.823 INFO:teuthology.orchestra.run.trial154.stdout:Installing: 2026-02-12T03:56:35.823 INFO:teuthology.orchestra.run.trial154.stdout: librados-devel-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 144 k 2026-02-12T03:56:35.824 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:35.824 INFO:teuthology.orchestra.run.trial154.stdout:Transaction Summary 2026-02-12T03:56:35.824 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:56:35.824 INFO:teuthology.orchestra.run.trial154.stdout:Install 1 Package 2026-02-12T03:56:35.824 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:35.824 INFO:teuthology.orchestra.run.trial154.stdout:Total download size: 144 k 2026-02-12T03:56:35.824 INFO:teuthology.orchestra.run.trial154.stdout:Installed size: 802 k 2026-02-12T03:56:35.824 INFO:teuthology.orchestra.run.trial154.stdout:Downloading Packages: 2026-02-12T03:56:35.908 INFO:teuthology.orchestra.run.trial154.stdout:librados-devel-debuginfo-20.2.0-626.g1279775f.e 1.7 MB/s | 144 kB 00:00 2026-02-12T03:56:35.908 INFO:teuthology.orchestra.run.trial154.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:56:35.908 INFO:teuthology.orchestra.run.trial154.stdout:Total 1.6 MB/s | 144 kB 00:00 2026-02-12T03:56:35.909 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction check 2026-02-12T03:56:35.910 INFO:teuthology.orchestra.run.trial154.stdout:Transaction check succeeded. 2026-02-12T03:56:35.910 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction test 2026-02-12T03:56:35.930 INFO:teuthology.orchestra.run.trial154.stdout:Transaction test succeeded. 2026-02-12T03:56:35.930 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction 2026-02-12T03:56:35.975 INFO:teuthology.orchestra.run.trial154.stdout: Preparing : 1/1 2026-02-12T03:56:35.992 INFO:teuthology.orchestra.run.trial154.stdout: Installing : librados-devel-debuginfo-2:20.2.0-626.g1279775f.el9. 1/1 2026-02-12T03:56:36.049 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: librados-devel-debuginfo-2:20.2.0-626.g1279775f.el9. 1/1 2026-02-12T03:56:36.108 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : librados-devel-debuginfo-2:20.2.0-626.g1279775f.el9. 1/1 2026-02-12T03:56:36.108 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:36.109 INFO:teuthology.orchestra.run.trial154.stdout:Installed: 2026-02-12T03:56:36.109 INFO:teuthology.orchestra.run.trial154.stdout: librados-devel-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:56:36.109 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:36.109 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:56:36.136 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install libcephfs2-debuginfo 2026-02-12T03:56:36.436 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:09:03 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:56:36.520 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:56:36.520 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:56:36.520 INFO:teuthology.orchestra.run.trial154.stdout: Package Arch Version Repo Size 2026-02-12T03:56:36.520 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:56:36.520 INFO:teuthology.orchestra.run.trial154.stdout:Installing: 2026-02-12T03:56:36.520 INFO:teuthology.orchestra.run.trial154.stdout: libcephfs2-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 9.1 M 2026-02-12T03:56:36.520 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:36.521 INFO:teuthology.orchestra.run.trial154.stdout:Transaction Summary 2026-02-12T03:56:36.521 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:56:36.521 INFO:teuthology.orchestra.run.trial154.stdout:Install 1 Package 2026-02-12T03:56:36.521 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:36.521 INFO:teuthology.orchestra.run.trial154.stdout:Total download size: 9.1 M 2026-02-12T03:56:36.521 INFO:teuthology.orchestra.run.trial154.stdout:Installed size: 46 M 2026-02-12T03:56:36.521 INFO:teuthology.orchestra.run.trial154.stdout:Downloading Packages: 2026-02-12T03:56:37.412 INFO:teuthology.orchestra.run.trial111.stdout:librbd1-debuginfo-20.2.0-626.g1279775f.el9.x86_ 50 MB/s | 80 MB 00:01 2026-02-12T03:56:37.414 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:56:37.414 INFO:teuthology.orchestra.run.trial111.stdout:Total 50 MB/s | 80 MB 00:01 2026-02-12T03:56:37.414 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T03:56:37.415 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T03:56:37.416 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T03:56:37.671 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T03:56:37.671 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T03:56:37.706 INFO:teuthology.orchestra.run.trial154.stdout:libcephfs2-debuginfo-20.2.0-626.g1279775f.el9.x 7.7 MB/s | 9.1 MB 00:01 2026-02-12T03:56:37.707 INFO:teuthology.orchestra.run.trial154.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:56:37.707 INFO:teuthology.orchestra.run.trial154.stdout:Total 7.7 MB/s | 9.1 MB 00:01 2026-02-12T03:56:37.707 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction check 2026-02-12T03:56:37.709 INFO:teuthology.orchestra.run.trial154.stdout:Transaction check succeeded. 2026-02-12T03:56:37.709 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction test 2026-02-12T03:56:37.753 INFO:teuthology.orchestra.run.trial154.stdout:Transaction test succeeded. 2026-02-12T03:56:37.753 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction 2026-02-12T03:56:38.256 INFO:teuthology.orchestra.run.trial154.stdout: Preparing : 1/1 2026-02-12T03:56:38.273 INFO:teuthology.orchestra.run.trial154.stdout: Installing : libcephfs2-debuginfo-2:20.2.0-626.g1279775f.el9.x86_ 1/1 2026-02-12T03:56:38.364 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: libcephfs2-debuginfo-2:20.2.0-626.g1279775f.el9.x86_ 1/1 2026-02-12T03:56:38.423 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : libcephfs2-debuginfo-2:20.2.0-626.g1279775f.el9.x86_ 1/1 2026-02-12T03:56:38.423 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:38.423 INFO:teuthology.orchestra.run.trial154.stdout:Installed: 2026-02-12T03:56:38.424 INFO:teuthology.orchestra.run.trial154.stdout: libcephfs2-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:56:38.424 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:38.424 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:56:38.452 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install librados2-debuginfo 2026-02-12T03:56:38.755 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:09:05 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:56:38.838 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:56:38.839 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:56:38.839 INFO:teuthology.orchestra.run.trial154.stdout: Package Arch Version Repo Size 2026-02-12T03:56:38.839 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:56:38.839 INFO:teuthology.orchestra.run.trial154.stdout:Installing: 2026-02-12T03:56:38.839 INFO:teuthology.orchestra.run.trial154.stdout: librados2-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 63 M 2026-02-12T03:56:38.839 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:38.839 INFO:teuthology.orchestra.run.trial154.stdout:Transaction Summary 2026-02-12T03:56:38.839 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:56:38.839 INFO:teuthology.orchestra.run.trial154.stdout:Install 1 Package 2026-02-12T03:56:38.839 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:38.839 INFO:teuthology.orchestra.run.trial154.stdout:Total download size: 63 M 2026-02-12T03:56:38.839 INFO:teuthology.orchestra.run.trial154.stdout:Installed size: 397 M 2026-02-12T03:56:38.840 INFO:teuthology.orchestra.run.trial154.stdout:Downloading Packages: 2026-02-12T03:56:40.145 INFO:teuthology.orchestra.run.trial154.stdout:librados2-debuginfo-20.2.0-626.g1279775f.el9.x8 49 MB/s | 63 MB 00:01 2026-02-12T03:56:40.146 INFO:teuthology.orchestra.run.trial154.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:56:40.146 INFO:teuthology.orchestra.run.trial154.stdout:Total 49 MB/s | 63 MB 00:01 2026-02-12T03:56:40.146 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction check 2026-02-12T03:56:40.148 INFO:teuthology.orchestra.run.trial154.stdout:Transaction check succeeded. 2026-02-12T03:56:40.148 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction test 2026-02-12T03:56:40.355 INFO:teuthology.orchestra.run.trial154.stdout:Transaction test succeeded. 2026-02-12T03:56:40.355 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction 2026-02-12T03:56:41.967 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T03:56:41.985 INFO:teuthology.orchestra.run.trial111.stdout: Installing : librbd1-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:56:42.327 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: librbd1-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:56:42.384 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : librbd1-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:56:42.384 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:42.384 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T03:56:42.384 INFO:teuthology.orchestra.run.trial111.stdout: librbd1-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:56:42.384 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:42.384 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:56:42.417 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install python3-cephfs-debuginfo 2026-02-12T03:56:42.717 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:09:23 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:56:42.800 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:56:42.801 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:56:42.801 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repo Size 2026-02-12T03:56:42.801 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:56:42.801 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T03:56:42.801 INFO:teuthology.orchestra.run.trial111.stdout: python3-cephfs-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 645 k 2026-02-12T03:56:42.801 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:42.801 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T03:56:42.801 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:56:42.801 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-12T03:56:42.801 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:42.802 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 645 k 2026-02-12T03:56:42.802 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 2.3 M 2026-02-12T03:56:42.802 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T03:56:42.910 INFO:teuthology.orchestra.run.trial111.stdout:python3-cephfs-debuginfo-20.2.0-626.g1279775f.e 5.8 MB/s | 645 kB 00:00 2026-02-12T03:56:42.911 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:56:42.911 INFO:teuthology.orchestra.run.trial111.stdout:Total 5.7 MB/s | 645 kB 00:00 2026-02-12T03:56:42.911 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T03:56:42.913 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T03:56:42.913 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T03:56:42.938 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T03:56:42.938 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T03:56:43.002 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T03:56:43.019 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-cephfs-debuginfo-2:20.2.0-626.g1279775f.el9. 1/1 2026-02-12T03:56:43.076 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: python3-cephfs-debuginfo-2:20.2.0-626.g1279775f.el9. 1/1 2026-02-12T03:56:43.133 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-cephfs-debuginfo-2:20.2.0-626.g1279775f.el9. 1/1 2026-02-12T03:56:43.133 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:43.134 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T03:56:43.134 INFO:teuthology.orchestra.run.trial111.stdout: python3-cephfs-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:56:43.134 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:43.134 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:56:43.159 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install python3-rados-debuginfo 2026-02-12T03:56:43.457 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:09:24 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:56:43.540 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:56:43.541 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:56:43.541 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repo Size 2026-02-12T03:56:43.541 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:56:43.541 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T03:56:43.541 INFO:teuthology.orchestra.run.trial111.stdout: python3-rados-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 804 k 2026-02-12T03:56:43.542 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:43.542 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T03:56:43.542 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:56:43.542 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-12T03:56:43.542 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:43.542 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 804 k 2026-02-12T03:56:43.542 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 3.1 M 2026-02-12T03:56:43.542 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T03:56:43.651 INFO:teuthology.orchestra.run.trial111.stdout:python3-rados-debuginfo-20.2.0-626.g1279775f.el 7.2 MB/s | 804 kB 00:00 2026-02-12T03:56:43.651 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:56:43.651 INFO:teuthology.orchestra.run.trial111.stdout:Total 7.1 MB/s | 804 kB 00:00 2026-02-12T03:56:43.651 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T03:56:43.652 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T03:56:43.653 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T03:56:43.673 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T03:56:43.673 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T03:56:43.745 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T03:56:43.762 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-rados-debuginfo-2:20.2.0-626.g1279775f.el9.x 1/1 2026-02-12T03:56:43.819 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: python3-rados-debuginfo-2:20.2.0-626.g1279775f.el9.x 1/1 2026-02-12T03:56:43.854 INFO:teuthology.orchestra.run.trial154.stdout: Preparing : 1/1 2026-02-12T03:56:43.872 INFO:teuthology.orchestra.run.trial154.stdout: Installing : librados2-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/1 2026-02-12T03:56:43.877 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-rados-debuginfo-2:20.2.0-626.g1279775f.el9.x 1/1 2026-02-12T03:56:43.877 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:43.877 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T03:56:43.877 INFO:teuthology.orchestra.run.trial111.stdout: python3-rados-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:56:43.877 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:43.877 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:56:43.904 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install python3-rbd-debuginfo 2026-02-12T03:56:44.202 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:09:25 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:56:44.212 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: librados2-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/1 2026-02-12T03:56:44.272 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : librados2-debuginfo-2:20.2.0-626.g1279775f.el9.x86_6 1/1 2026-02-12T03:56:44.272 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:44.272 INFO:teuthology.orchestra.run.trial154.stdout:Installed: 2026-02-12T03:56:44.272 INFO:teuthology.orchestra.run.trial154.stdout: librados2-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:56:44.272 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:44.272 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:56:44.286 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:56:44.286 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:56:44.286 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repo Size 2026-02-12T03:56:44.286 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:56:44.286 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T03:56:44.286 INFO:teuthology.orchestra.run.trial111.stdout: python3-rbd-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 1.2 M 2026-02-12T03:56:44.286 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:44.286 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T03:56:44.287 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:56:44.287 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-12T03:56:44.287 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:44.287 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 1.2 M 2026-02-12T03:56:44.287 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 4.7 M 2026-02-12T03:56:44.287 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T03:56:44.305 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install librbd1-debuginfo 2026-02-12T03:56:44.408 INFO:teuthology.orchestra.run.trial111.stdout:python3-rbd-debuginfo-20.2.0-626.g1279775f.el9. 9.6 MB/s | 1.2 MB 00:00 2026-02-12T03:56:44.408 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:56:44.408 INFO:teuthology.orchestra.run.trial111.stdout:Total 9.5 MB/s | 1.2 MB 00:00 2026-02-12T03:56:44.409 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T03:56:44.410 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T03:56:44.410 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T03:56:44.432 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T03:56:44.432 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T03:56:44.524 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T03:56:44.541 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-rbd-debuginfo-2:20.2.0-626.g1279775f.el9.x86 1/1 2026-02-12T03:56:44.600 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: python3-rbd-debuginfo-2:20.2.0-626.g1279775f.el9.x86 1/1 2026-02-12T03:56:44.603 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:09:11 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:56:44.657 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-rbd-debuginfo-2:20.2.0-626.g1279775f.el9.x86 1/1 2026-02-12T03:56:44.657 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:44.657 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T03:56:44.657 INFO:teuthology.orchestra.run.trial111.stdout: python3-rbd-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:56:44.657 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:44.657 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:56:44.683 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install python3-rgw-debuginfo 2026-02-12T03:56:44.686 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:56:44.686 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:56:44.686 INFO:teuthology.orchestra.run.trial154.stdout: Package Arch Version Repo Size 2026-02-12T03:56:44.686 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:56:44.686 INFO:teuthology.orchestra.run.trial154.stdout:Installing: 2026-02-12T03:56:44.686 INFO:teuthology.orchestra.run.trial154.stdout: librbd1-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 80 M 2026-02-12T03:56:44.687 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:44.687 INFO:teuthology.orchestra.run.trial154.stdout:Transaction Summary 2026-02-12T03:56:44.687 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:56:44.687 INFO:teuthology.orchestra.run.trial154.stdout:Install 1 Package 2026-02-12T03:56:44.687 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:44.687 INFO:teuthology.orchestra.run.trial154.stdout:Total download size: 80 M 2026-02-12T03:56:44.687 INFO:teuthology.orchestra.run.trial154.stdout:Installed size: 405 M 2026-02-12T03:56:44.687 INFO:teuthology.orchestra.run.trial154.stdout:Downloading Packages: 2026-02-12T03:56:44.982 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:09:25 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:56:45.065 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:56:45.066 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:56:45.066 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repo Size 2026-02-12T03:56:45.066 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:56:45.066 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T03:56:45.066 INFO:teuthology.orchestra.run.trial111.stdout: python3-rgw-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 350 k 2026-02-12T03:56:45.067 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:45.067 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T03:56:45.067 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:56:45.067 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-12T03:56:45.067 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:45.067 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 350 k 2026-02-12T03:56:45.067 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 1.1 M 2026-02-12T03:56:45.067 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T03:56:45.510 INFO:teuthology.orchestra.run.trial111.stdout:python3-rgw-debuginfo-20.2.0-626.g1279775f.el9. 791 kB/s | 350 kB 00:00 2026-02-12T03:56:45.510 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:56:45.510 INFO:teuthology.orchestra.run.trial111.stdout:Total 789 kB/s | 350 kB 00:00 2026-02-12T03:56:45.510 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T03:56:45.512 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T03:56:45.512 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T03:56:45.532 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T03:56:45.532 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T03:56:45.582 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T03:56:45.599 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-rgw-debuginfo-2:20.2.0-626.g1279775f.el9.x86 1/1 2026-02-12T03:56:45.653 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: python3-rgw-debuginfo-2:20.2.0-626.g1279775f.el9.x86 1/1 2026-02-12T03:56:45.712 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-rgw-debuginfo-2:20.2.0-626.g1279775f.el9.x86 1/1 2026-02-12T03:56:45.712 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:45.712 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T03:56:45.712 INFO:teuthology.orchestra.run.trial111.stdout: python3-rgw-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:56:45.712 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:45.712 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:56:45.739 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install rbd-fuse-debuginfo 2026-02-12T03:56:46.040 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:09:27 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:56:46.123 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:56:46.124 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:56:46.124 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repo Size 2026-02-12T03:56:46.124 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:56:46.124 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T03:56:46.124 INFO:teuthology.orchestra.run.trial111.stdout: rbd-fuse-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 1.5 M 2026-02-12T03:56:46.124 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:46.124 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T03:56:46.124 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:56:46.124 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-12T03:56:46.125 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:46.125 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 1.5 M 2026-02-12T03:56:46.125 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 7.9 M 2026-02-12T03:56:46.125 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T03:56:46.400 INFO:teuthology.orchestra.run.trial111.stdout:rbd-fuse-debuginfo-20.2.0-626.g1279775f.el9.x86 5.6 MB/s | 1.5 MB 00:00 2026-02-12T03:56:46.401 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:56:46.401 INFO:teuthology.orchestra.run.trial111.stdout:Total 5.5 MB/s | 1.5 MB 00:00 2026-02-12T03:56:46.401 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T03:56:46.402 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T03:56:46.402 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T03:56:46.425 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T03:56:46.426 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T03:56:46.537 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T03:56:46.555 INFO:teuthology.orchestra.run.trial111.stdout: Installing : rbd-fuse-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:56:46.615 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: rbd-fuse-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:56:46.672 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : rbd-fuse-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:56:46.672 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:46.673 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T03:56:46.673 INFO:teuthology.orchestra.run.trial111.stdout: rbd-fuse-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:56:46.673 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:46.673 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:56:46.700 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install rbd-mirror-debuginfo 2026-02-12T03:56:47.008 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:09:28 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:56:47.091 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:56:47.092 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:56:47.092 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repo Size 2026-02-12T03:56:47.092 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:56:47.092 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T03:56:47.092 INFO:teuthology.orchestra.run.trial111.stdout: rbd-mirror-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 79 M 2026-02-12T03:56:47.092 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:47.093 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T03:56:47.093 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:56:47.093 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-12T03:56:47.093 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:47.093 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 79 M 2026-02-12T03:56:47.093 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 374 M 2026-02-12T03:56:47.093 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T03:56:48.799 INFO:teuthology.orchestra.run.trial154.stdout:librbd1-debuginfo-20.2.0-626.g1279775f.el9.x86_ 20 MB/s | 80 MB 00:04 2026-02-12T03:56:48.800 INFO:teuthology.orchestra.run.trial154.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:56:48.800 INFO:teuthology.orchestra.run.trial154.stdout:Total 20 MB/s | 80 MB 00:04 2026-02-12T03:56:48.801 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction check 2026-02-12T03:56:48.802 INFO:teuthology.orchestra.run.trial154.stdout:Transaction check succeeded. 2026-02-12T03:56:48.803 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction test 2026-02-12T03:56:49.058 INFO:teuthology.orchestra.run.trial154.stdout:Transaction test succeeded. 2026-02-12T03:56:49.058 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction 2026-02-12T03:56:52.242 INFO:teuthology.orchestra.run.trial111.stdout:rbd-mirror-debuginfo-20.2.0-626.g1279775f.el9.x 15 MB/s | 79 MB 00:05 2026-02-12T03:56:52.243 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:56:52.243 INFO:teuthology.orchestra.run.trial111.stdout:Total 15 MB/s | 79 MB 00:05 2026-02-12T03:56:52.243 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T03:56:52.245 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T03:56:52.245 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T03:56:52.496 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T03:56:52.496 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T03:56:53.318 INFO:teuthology.orchestra.run.trial154.stdout: Preparing : 1/1 2026-02-12T03:56:53.336 INFO:teuthology.orchestra.run.trial154.stdout: Installing : librbd1-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:56:53.691 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: librbd1-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:56:53.750 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : librbd1-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:56:53.750 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:53.750 INFO:teuthology.orchestra.run.trial154.stdout:Installed: 2026-02-12T03:56:53.750 INFO:teuthology.orchestra.run.trial154.stdout: librbd1-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:56:53.750 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:53.751 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:56:53.784 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install python3-cephfs-debuginfo 2026-02-12T03:56:54.086 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:09:21 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:56:54.171 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:56:54.171 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:56:54.171 INFO:teuthology.orchestra.run.trial154.stdout: Package Arch Version Repo Size 2026-02-12T03:56:54.171 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:56:54.171 INFO:teuthology.orchestra.run.trial154.stdout:Installing: 2026-02-12T03:56:54.171 INFO:teuthology.orchestra.run.trial154.stdout: python3-cephfs-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 645 k 2026-02-12T03:56:54.172 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:54.172 INFO:teuthology.orchestra.run.trial154.stdout:Transaction Summary 2026-02-12T03:56:54.172 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:56:54.172 INFO:teuthology.orchestra.run.trial154.stdout:Install 1 Package 2026-02-12T03:56:54.172 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:54.172 INFO:teuthology.orchestra.run.trial154.stdout:Total download size: 645 k 2026-02-12T03:56:54.172 INFO:teuthology.orchestra.run.trial154.stdout:Installed size: 2.3 M 2026-02-12T03:56:54.172 INFO:teuthology.orchestra.run.trial154.stdout:Downloading Packages: 2026-02-12T03:56:54.279 INFO:teuthology.orchestra.run.trial154.stdout:python3-cephfs-debuginfo-20.2.0-626.g1279775f.e 5.8 MB/s | 645 kB 00:00 2026-02-12T03:56:54.280 INFO:teuthology.orchestra.run.trial154.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:56:54.281 INFO:teuthology.orchestra.run.trial154.stdout:Total 5.8 MB/s | 645 kB 00:00 2026-02-12T03:56:54.281 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction check 2026-02-12T03:56:54.282 INFO:teuthology.orchestra.run.trial154.stdout:Transaction check succeeded. 2026-02-12T03:56:54.282 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction test 2026-02-12T03:56:54.303 INFO:teuthology.orchestra.run.trial154.stdout:Transaction test succeeded. 2026-02-12T03:56:54.304 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction 2026-02-12T03:56:54.369 INFO:teuthology.orchestra.run.trial154.stdout: Preparing : 1/1 2026-02-12T03:56:54.387 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-cephfs-debuginfo-2:20.2.0-626.g1279775f.el9. 1/1 2026-02-12T03:56:54.448 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: python3-cephfs-debuginfo-2:20.2.0-626.g1279775f.el9. 1/1 2026-02-12T03:56:54.507 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-cephfs-debuginfo-2:20.2.0-626.g1279775f.el9. 1/1 2026-02-12T03:56:54.507 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:54.507 INFO:teuthology.orchestra.run.trial154.stdout:Installed: 2026-02-12T03:56:54.507 INFO:teuthology.orchestra.run.trial154.stdout: python3-cephfs-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:56:54.507 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:54.507 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:56:54.535 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install python3-rados-debuginfo 2026-02-12T03:56:54.836 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:09:21 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:56:54.919 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:56:54.919 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:56:54.920 INFO:teuthology.orchestra.run.trial154.stdout: Package Arch Version Repo Size 2026-02-12T03:56:54.920 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:56:54.920 INFO:teuthology.orchestra.run.trial154.stdout:Installing: 2026-02-12T03:56:54.920 INFO:teuthology.orchestra.run.trial154.stdout: python3-rados-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 804 k 2026-02-12T03:56:54.920 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:54.920 INFO:teuthology.orchestra.run.trial154.stdout:Transaction Summary 2026-02-12T03:56:54.920 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:56:54.920 INFO:teuthology.orchestra.run.trial154.stdout:Install 1 Package 2026-02-12T03:56:54.920 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:54.921 INFO:teuthology.orchestra.run.trial154.stdout:Total download size: 804 k 2026-02-12T03:56:54.921 INFO:teuthology.orchestra.run.trial154.stdout:Installed size: 3.1 M 2026-02-12T03:56:54.921 INFO:teuthology.orchestra.run.trial154.stdout:Downloading Packages: 2026-02-12T03:56:55.028 INFO:teuthology.orchestra.run.trial154.stdout:python3-rados-debuginfo-20.2.0-626.g1279775f.el 7.2 MB/s | 804 kB 00:00 2026-02-12T03:56:55.029 INFO:teuthology.orchestra.run.trial154.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:56:55.029 INFO:teuthology.orchestra.run.trial154.stdout:Total 7.1 MB/s | 804 kB 00:00 2026-02-12T03:56:55.029 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction check 2026-02-12T03:56:55.031 INFO:teuthology.orchestra.run.trial154.stdout:Transaction check succeeded. 2026-02-12T03:56:55.031 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction test 2026-02-12T03:56:55.052 INFO:teuthology.orchestra.run.trial154.stdout:Transaction test succeeded. 2026-02-12T03:56:55.053 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction 2026-02-12T03:56:55.129 INFO:teuthology.orchestra.run.trial154.stdout: Preparing : 1/1 2026-02-12T03:56:55.146 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-rados-debuginfo-2:20.2.0-626.g1279775f.el9.x 1/1 2026-02-12T03:56:55.203 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: python3-rados-debuginfo-2:20.2.0-626.g1279775f.el9.x 1/1 2026-02-12T03:56:55.262 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-rados-debuginfo-2:20.2.0-626.g1279775f.el9.x 1/1 2026-02-12T03:56:55.263 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:55.263 INFO:teuthology.orchestra.run.trial154.stdout:Installed: 2026-02-12T03:56:55.263 INFO:teuthology.orchestra.run.trial154.stdout: python3-rados-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:56:55.263 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:55.263 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:56:55.292 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install python3-rbd-debuginfo 2026-02-12T03:56:55.599 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:09:22 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:56:55.682 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:56:55.683 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:56:55.683 INFO:teuthology.orchestra.run.trial154.stdout: Package Arch Version Repo Size 2026-02-12T03:56:55.683 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:56:55.683 INFO:teuthology.orchestra.run.trial154.stdout:Installing: 2026-02-12T03:56:55.684 INFO:teuthology.orchestra.run.trial154.stdout: python3-rbd-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 1.2 M 2026-02-12T03:56:55.684 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:55.684 INFO:teuthology.orchestra.run.trial154.stdout:Transaction Summary 2026-02-12T03:56:55.684 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:56:55.684 INFO:teuthology.orchestra.run.trial154.stdout:Install 1 Package 2026-02-12T03:56:55.684 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:55.684 INFO:teuthology.orchestra.run.trial154.stdout:Total download size: 1.2 M 2026-02-12T03:56:55.684 INFO:teuthology.orchestra.run.trial154.stdout:Installed size: 4.7 M 2026-02-12T03:56:55.684 INFO:teuthology.orchestra.run.trial154.stdout:Downloading Packages: 2026-02-12T03:56:56.537 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T03:56:56.546 INFO:teuthology.orchestra.run.trial154.stdout:python3-rbd-debuginfo-20.2.0-626.g1279775f.el9. 1.3 MB/s | 1.2 MB 00:00 2026-02-12T03:56:56.547 INFO:teuthology.orchestra.run.trial154.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:56:56.547 INFO:teuthology.orchestra.run.trial154.stdout:Total 1.3 MB/s | 1.2 MB 00:00 2026-02-12T03:56:56.547 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction check 2026-02-12T03:56:56.549 INFO:teuthology.orchestra.run.trial154.stdout:Transaction check succeeded. 2026-02-12T03:56:56.549 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction test 2026-02-12T03:56:56.555 INFO:teuthology.orchestra.run.trial111.stdout: Installing : rbd-mirror-debuginfo-2:20.2.0-626.g1279775f.el9.x86_ 1/1 2026-02-12T03:56:56.572 INFO:teuthology.orchestra.run.trial154.stdout:Transaction test succeeded. 2026-02-12T03:56:56.572 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction 2026-02-12T03:56:56.664 INFO:teuthology.orchestra.run.trial154.stdout: Preparing : 1/1 2026-02-12T03:56:56.681 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-rbd-debuginfo-2:20.2.0-626.g1279775f.el9.x86 1/1 2026-02-12T03:56:56.741 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: python3-rbd-debuginfo-2:20.2.0-626.g1279775f.el9.x86 1/1 2026-02-12T03:56:56.801 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-rbd-debuginfo-2:20.2.0-626.g1279775f.el9.x86 1/1 2026-02-12T03:56:56.801 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:56.801 INFO:teuthology.orchestra.run.trial154.stdout:Installed: 2026-02-12T03:56:56.801 INFO:teuthology.orchestra.run.trial154.stdout: python3-rbd-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:56:56.801 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:56.801 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:56:56.829 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install python3-rgw-debuginfo 2026-02-12T03:56:56.899 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: rbd-mirror-debuginfo-2:20.2.0-626.g1279775f.el9.x86_ 1/1 2026-02-12T03:56:56.956 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : rbd-mirror-debuginfo-2:20.2.0-626.g1279775f.el9.x86_ 1/1 2026-02-12T03:56:56.957 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:56.957 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T03:56:56.957 INFO:teuthology.orchestra.run.trial111.stdout: rbd-mirror-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:56:56.957 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:56.957 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:56:56.990 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install rbd-nbd-debuginfo 2026-02-12T03:56:57.135 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:09:24 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:56:57.218 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:56:57.219 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:56:57.219 INFO:teuthology.orchestra.run.trial154.stdout: Package Arch Version Repo Size 2026-02-12T03:56:57.220 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:56:57.220 INFO:teuthology.orchestra.run.trial154.stdout:Installing: 2026-02-12T03:56:57.220 INFO:teuthology.orchestra.run.trial154.stdout: python3-rgw-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 350 k 2026-02-12T03:56:57.220 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:57.220 INFO:teuthology.orchestra.run.trial154.stdout:Transaction Summary 2026-02-12T03:56:57.220 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:56:57.220 INFO:teuthology.orchestra.run.trial154.stdout:Install 1 Package 2026-02-12T03:56:57.220 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:57.220 INFO:teuthology.orchestra.run.trial154.stdout:Total download size: 350 k 2026-02-12T03:56:57.220 INFO:teuthology.orchestra.run.trial154.stdout:Installed size: 1.1 M 2026-02-12T03:56:57.221 INFO:teuthology.orchestra.run.trial154.stdout:Downloading Packages: 2026-02-12T03:56:57.293 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:09:38 ago on Thu 12 Feb 2026 03:47:19 AM UTC. 2026-02-12T03:56:57.316 INFO:teuthology.orchestra.run.trial154.stdout:python3-rgw-debuginfo-20.2.0-626.g1279775f.el9. 3.5 MB/s | 350 kB 00:00 2026-02-12T03:56:57.317 INFO:teuthology.orchestra.run.trial154.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:56:57.317 INFO:teuthology.orchestra.run.trial154.stdout:Total 3.5 MB/s | 350 kB 00:00 2026-02-12T03:56:57.317 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction check 2026-02-12T03:56:57.319 INFO:teuthology.orchestra.run.trial154.stdout:Transaction check succeeded. 2026-02-12T03:56:57.319 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction test 2026-02-12T03:56:57.339 INFO:teuthology.orchestra.run.trial154.stdout:Transaction test succeeded. 2026-02-12T03:56:57.340 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction 2026-02-12T03:56:57.375 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T03:56:57.376 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:56:57.376 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repo Size 2026-02-12T03:56:57.376 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:56:57.376 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T03:56:57.377 INFO:teuthology.orchestra.run.trial111.stdout: rbd-nbd-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 2.4 M 2026-02-12T03:56:57.377 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:57.377 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T03:56:57.377 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T03:56:57.377 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-12T03:56:57.377 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:57.377 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 2.4 M 2026-02-12T03:56:57.377 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 12 M 2026-02-12T03:56:57.377 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T03:56:57.391 INFO:teuthology.orchestra.run.trial154.stdout: Preparing : 1/1 2026-02-12T03:56:57.408 INFO:teuthology.orchestra.run.trial154.stdout: Installing : python3-rgw-debuginfo-2:20.2.0-626.g1279775f.el9.x86 1/1 2026-02-12T03:56:57.465 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: python3-rgw-debuginfo-2:20.2.0-626.g1279775f.el9.x86 1/1 2026-02-12T03:56:57.514 INFO:teuthology.orchestra.run.trial111.stdout:rbd-nbd-debuginfo-20.2.0-626.g1279775f.el9.x86_ 18 MB/s | 2.4 MB 00:00 2026-02-12T03:56:57.514 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:56:57.515 INFO:teuthology.orchestra.run.trial111.stdout:Total 18 MB/s | 2.4 MB 00:00 2026-02-12T03:56:57.515 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T03:56:57.516 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T03:56:57.516 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T03:56:57.524 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : python3-rgw-debuginfo-2:20.2.0-626.g1279775f.el9.x86 1/1 2026-02-12T03:56:57.524 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:57.524 INFO:teuthology.orchestra.run.trial154.stdout:Installed: 2026-02-12T03:56:57.525 INFO:teuthology.orchestra.run.trial154.stdout: python3-rgw-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:56:57.525 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:57.525 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:56:57.541 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T03:56:57.541 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T03:56:57.553 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install rbd-fuse-debuginfo 2026-02-12T03:56:57.699 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T03:56:57.716 INFO:teuthology.orchestra.run.trial111.stdout: Installing : rbd-nbd-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:56:57.779 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: rbd-nbd-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:56:57.836 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : rbd-nbd-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:56:57.837 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:57.837 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T03:56:57.837 INFO:teuthology.orchestra.run.trial111.stdout: rbd-nbd-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:56:57.837 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:56:57.837 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T03:56:57.851 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:09:24 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:56:57.866 DEBUG:teuthology.parallel:result is None 2026-02-12T03:56:57.934 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:56:57.935 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:56:57.935 INFO:teuthology.orchestra.run.trial154.stdout: Package Arch Version Repo Size 2026-02-12T03:56:57.935 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:56:57.935 INFO:teuthology.orchestra.run.trial154.stdout:Installing: 2026-02-12T03:56:57.936 INFO:teuthology.orchestra.run.trial154.stdout: rbd-fuse-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 1.5 M 2026-02-12T03:56:57.936 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:57.936 INFO:teuthology.orchestra.run.trial154.stdout:Transaction Summary 2026-02-12T03:56:57.936 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:56:57.936 INFO:teuthology.orchestra.run.trial154.stdout:Install 1 Package 2026-02-12T03:56:57.936 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:57.936 INFO:teuthology.orchestra.run.trial154.stdout:Total download size: 1.5 M 2026-02-12T03:56:57.936 INFO:teuthology.orchestra.run.trial154.stdout:Installed size: 7.9 M 2026-02-12T03:56:57.936 INFO:teuthology.orchestra.run.trial154.stdout:Downloading Packages: 2026-02-12T03:56:58.056 INFO:teuthology.orchestra.run.trial154.stdout:rbd-fuse-debuginfo-20.2.0-626.g1279775f.el9.x86 13 MB/s | 1.5 MB 00:00 2026-02-12T03:56:58.056 INFO:teuthology.orchestra.run.trial154.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:56:58.056 INFO:teuthology.orchestra.run.trial154.stdout:Total 13 MB/s | 1.5 MB 00:00 2026-02-12T03:56:58.056 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction check 2026-02-12T03:56:58.058 INFO:teuthology.orchestra.run.trial154.stdout:Transaction check succeeded. 2026-02-12T03:56:58.058 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction test 2026-02-12T03:56:58.082 INFO:teuthology.orchestra.run.trial154.stdout:Transaction test succeeded. 2026-02-12T03:56:58.082 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction 2026-02-12T03:56:58.197 INFO:teuthology.orchestra.run.trial154.stdout: Preparing : 1/1 2026-02-12T03:56:58.214 INFO:teuthology.orchestra.run.trial154.stdout: Installing : rbd-fuse-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:56:58.276 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: rbd-fuse-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:56:58.334 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : rbd-fuse-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:56:58.334 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:58.334 INFO:teuthology.orchestra.run.trial154.stdout:Installed: 2026-02-12T03:56:58.334 INFO:teuthology.orchestra.run.trial154.stdout: rbd-fuse-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:56:58.334 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:58.334 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:56:58.362 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install rbd-mirror-debuginfo 2026-02-12T03:56:58.668 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:09:25 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:56:58.751 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:56:58.751 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:56:58.751 INFO:teuthology.orchestra.run.trial154.stdout: Package Arch Version Repo Size 2026-02-12T03:56:58.752 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:56:58.752 INFO:teuthology.orchestra.run.trial154.stdout:Installing: 2026-02-12T03:56:58.752 INFO:teuthology.orchestra.run.trial154.stdout: rbd-mirror-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 79 M 2026-02-12T03:56:58.752 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:58.752 INFO:teuthology.orchestra.run.trial154.stdout:Transaction Summary 2026-02-12T03:56:58.752 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:56:58.752 INFO:teuthology.orchestra.run.trial154.stdout:Install 1 Package 2026-02-12T03:56:58.752 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:56:58.752 INFO:teuthology.orchestra.run.trial154.stdout:Total download size: 79 M 2026-02-12T03:56:58.752 INFO:teuthology.orchestra.run.trial154.stdout:Installed size: 374 M 2026-02-12T03:56:58.752 INFO:teuthology.orchestra.run.trial154.stdout:Downloading Packages: 2026-02-12T03:57:01.063 INFO:teuthology.orchestra.run.trial154.stdout:rbd-mirror-debuginfo-20.2.0-626.g1279775f.el9.x 34 MB/s | 79 MB 00:02 2026-02-12T03:57:01.064 INFO:teuthology.orchestra.run.trial154.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:57:01.064 INFO:teuthology.orchestra.run.trial154.stdout:Total 34 MB/s | 79 MB 00:02 2026-02-12T03:57:01.064 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction check 2026-02-12T03:57:01.066 INFO:teuthology.orchestra.run.trial154.stdout:Transaction check succeeded. 2026-02-12T03:57:01.066 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction test 2026-02-12T03:57:01.319 INFO:teuthology.orchestra.run.trial154.stdout:Transaction test succeeded. 2026-02-12T03:57:01.319 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction 2026-02-12T03:57:05.365 INFO:teuthology.orchestra.run.trial154.stdout: Preparing : 1/1 2026-02-12T03:57:05.383 INFO:teuthology.orchestra.run.trial154.stdout: Installing : rbd-mirror-debuginfo-2:20.2.0-626.g1279775f.el9.x86_ 1/1 2026-02-12T03:57:05.705 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: rbd-mirror-debuginfo-2:20.2.0-626.g1279775f.el9.x86_ 1/1 2026-02-12T03:57:05.763 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : rbd-mirror-debuginfo-2:20.2.0-626.g1279775f.el9.x86_ 1/1 2026-02-12T03:57:05.763 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:57:05.763 INFO:teuthology.orchestra.run.trial154.stdout:Installed: 2026-02-12T03:57:05.763 INFO:teuthology.orchestra.run.trial154.stdout: rbd-mirror-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:57:05.764 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:57:05.764 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:57:05.796 DEBUG:teuthology.orchestra.run.trial154:> sudo yum -y install rbd-nbd-debuginfo 2026-02-12T03:57:06.092 INFO:teuthology.orchestra.run.trial154.stdout:Last metadata expiration check: 0:09:33 ago on Thu 12 Feb 2026 03:47:33 AM UTC. 2026-02-12T03:57:06.177 INFO:teuthology.orchestra.run.trial154.stdout:Dependencies resolved. 2026-02-12T03:57:06.177 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:57:06.178 INFO:teuthology.orchestra.run.trial154.stdout: Package Arch Version Repo Size 2026-02-12T03:57:06.178 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:57:06.178 INFO:teuthology.orchestra.run.trial154.stdout:Installing: 2026-02-12T03:57:06.178 INFO:teuthology.orchestra.run.trial154.stdout: rbd-nbd-debuginfo x86_64 2:20.2.0-626.g1279775f.el9 ceph 2.4 M 2026-02-12T03:57:06.178 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:57:06.178 INFO:teuthology.orchestra.run.trial154.stdout:Transaction Summary 2026-02-12T03:57:06.178 INFO:teuthology.orchestra.run.trial154.stdout:================================================================================ 2026-02-12T03:57:06.178 INFO:teuthology.orchestra.run.trial154.stdout:Install 1 Package 2026-02-12T03:57:06.179 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:57:06.179 INFO:teuthology.orchestra.run.trial154.stdout:Total download size: 2.4 M 2026-02-12T03:57:06.179 INFO:teuthology.orchestra.run.trial154.stdout:Installed size: 12 M 2026-02-12T03:57:06.179 INFO:teuthology.orchestra.run.trial154.stdout:Downloading Packages: 2026-02-12T03:57:06.316 INFO:teuthology.orchestra.run.trial154.stdout:rbd-nbd-debuginfo-20.2.0-626.g1279775f.el9.x86_ 18 MB/s | 2.4 MB 00:00 2026-02-12T03:57:06.316 INFO:teuthology.orchestra.run.trial154.stdout:-------------------------------------------------------------------------------- 2026-02-12T03:57:06.316 INFO:teuthology.orchestra.run.trial154.stdout:Total 18 MB/s | 2.4 MB 00:00 2026-02-12T03:57:06.316 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction check 2026-02-12T03:57:06.317 INFO:teuthology.orchestra.run.trial154.stdout:Transaction check succeeded. 2026-02-12T03:57:06.318 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction test 2026-02-12T03:57:06.343 INFO:teuthology.orchestra.run.trial154.stdout:Transaction test succeeded. 2026-02-12T03:57:06.344 INFO:teuthology.orchestra.run.trial154.stdout:Running transaction 2026-02-12T03:57:06.502 INFO:teuthology.orchestra.run.trial154.stdout: Preparing : 1/1 2026-02-12T03:57:06.520 INFO:teuthology.orchestra.run.trial154.stdout: Installing : rbd-nbd-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:57:06.587 INFO:teuthology.orchestra.run.trial154.stdout: Running scriptlet: rbd-nbd-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:57:06.646 INFO:teuthology.orchestra.run.trial154.stdout: Verifying : rbd-nbd-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 1/1 2026-02-12T03:57:06.646 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:57:06.646 INFO:teuthology.orchestra.run.trial154.stdout:Installed: 2026-02-12T03:57:06.647 INFO:teuthology.orchestra.run.trial154.stdout: rbd-nbd-debuginfo-2:20.2.0-626.g1279775f.el9.x86_64 2026-02-12T03:57:06.647 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:57:06.647 INFO:teuthology.orchestra.run.trial154.stdout:Complete! 2026-02-12T03:57:06.678 DEBUG:teuthology.parallel:result is None 2026-02-12T03:57:06.678 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1279775fef08a9169052c6dd6a10581353958aac 2026-02-12T03:57:06.843 DEBUG:teuthology.orchestra.run.trial091:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-12T03:57:06.866 INFO:teuthology.orchestra.run.trial091.stdout:20.2.0-626.g1279775f.el9 2026-02-12T03:57:06.866 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-626.g1279775f.el9 2026-02-12T03:57:06.867 INFO:teuthology.task.install:The correct ceph version 20.2.0-626.g1279775f is installed. 2026-02-12T03:57:06.870 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1279775fef08a9169052c6dd6a10581353958aac 2026-02-12T03:57:07.027 DEBUG:teuthology.orchestra.run.trial098:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-12T03:57:07.059 INFO:teuthology.orchestra.run.trial098.stdout:20.2.0-626.g1279775f.el9 2026-02-12T03:57:07.059 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-626.g1279775f.el9 2026-02-12T03:57:07.060 INFO:teuthology.task.install:The correct ceph version 20.2.0-626.g1279775f is installed. 2026-02-12T03:57:07.063 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1279775fef08a9169052c6dd6a10581353958aac 2026-02-12T03:57:07.219 DEBUG:teuthology.orchestra.run.trial111:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-12T03:57:07.241 INFO:teuthology.orchestra.run.trial111.stdout:20.2.0-626.g1279775f.el9 2026-02-12T03:57:07.241 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-626.g1279775f.el9 2026-02-12T03:57:07.241 INFO:teuthology.task.install:The correct ceph version 20.2.0-626.g1279775f is installed. 2026-02-12T03:57:07.244 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1279775fef08a9169052c6dd6a10581353958aac 2026-02-12T03:57:07.391 DEBUG:teuthology.orchestra.run.trial154:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-12T03:57:07.412 INFO:teuthology.orchestra.run.trial154.stdout:20.2.0-626.g1279775f.el9 2026-02-12T03:57:07.413 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-626.g1279775f.el9 2026-02-12T03:57:07.413 INFO:teuthology.task.install:The correct ceph version 20.2.0-626.g1279775f is installed. 2026-02-12T03:57:07.415 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-12T03:57:07.416 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-12T03:57:07.416 DEBUG:teuthology.orchestra.run.trial091:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-12T03:57:07.443 DEBUG:teuthology.orchestra.run.trial098:> set -ex 2026-02-12T03:57:07.443 DEBUG:teuthology.orchestra.run.trial098:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-12T03:57:07.469 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-12T03:57:07.470 DEBUG:teuthology.orchestra.run.trial111:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-12T03:57:07.495 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-12T03:57:07.495 DEBUG:teuthology.orchestra.run.trial154:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-12T03:57:07.521 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-12T03:57:07.522 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-12T03:57:07.522 DEBUG:teuthology.orchestra.run.trial091:> sudo dd of=/usr/bin/daemon-helper 2026-02-12T03:57:07.548 DEBUG:teuthology.orchestra.run.trial091:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-12T03:57:07.611 DEBUG:teuthology.orchestra.run.trial098:> set -ex 2026-02-12T03:57:07.611 DEBUG:teuthology.orchestra.run.trial098:> sudo dd of=/usr/bin/daemon-helper 2026-02-12T03:57:07.637 DEBUG:teuthology.orchestra.run.trial098:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-12T03:57:07.699 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-12T03:57:07.699 DEBUG:teuthology.orchestra.run.trial111:> sudo dd of=/usr/bin/daemon-helper 2026-02-12T03:57:07.725 DEBUG:teuthology.orchestra.run.trial111:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-12T03:57:07.789 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-12T03:57:07.789 DEBUG:teuthology.orchestra.run.trial154:> sudo dd of=/usr/bin/daemon-helper 2026-02-12T03:57:07.815 DEBUG:teuthology.orchestra.run.trial154:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-12T03:57:07.881 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-12T03:57:07.882 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-12T03:57:07.882 DEBUG:teuthology.orchestra.run.trial091:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-12T03:57:07.907 DEBUG:teuthology.orchestra.run.trial091:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-12T03:57:07.972 DEBUG:teuthology.orchestra.run.trial098:> set -ex 2026-02-12T03:57:07.973 DEBUG:teuthology.orchestra.run.trial098:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-12T03:57:07.998 DEBUG:teuthology.orchestra.run.trial098:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-12T03:57:08.063 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-12T03:57:08.063 DEBUG:teuthology.orchestra.run.trial111:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-12T03:57:08.088 DEBUG:teuthology.orchestra.run.trial111:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-12T03:57:08.152 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-12T03:57:08.152 DEBUG:teuthology.orchestra.run.trial154:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-12T03:57:08.179 DEBUG:teuthology.orchestra.run.trial154:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-12T03:57:08.242 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-12T03:57:08.243 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-12T03:57:08.243 DEBUG:teuthology.orchestra.run.trial091:> sudo dd of=/usr/bin/stdin-killer 2026-02-12T03:57:08.268 DEBUG:teuthology.orchestra.run.trial091:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-12T03:57:08.332 DEBUG:teuthology.orchestra.run.trial098:> set -ex 2026-02-12T03:57:08.332 DEBUG:teuthology.orchestra.run.trial098:> sudo dd of=/usr/bin/stdin-killer 2026-02-12T03:57:08.357 DEBUG:teuthology.orchestra.run.trial098:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-12T03:57:08.421 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-12T03:57:08.421 DEBUG:teuthology.orchestra.run.trial111:> sudo dd of=/usr/bin/stdin-killer 2026-02-12T03:57:08.447 DEBUG:teuthology.orchestra.run.trial111:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-12T03:57:08.511 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-12T03:57:08.511 DEBUG:teuthology.orchestra.run.trial154:> sudo dd of=/usr/bin/stdin-killer 2026-02-12T03:57:08.537 DEBUG:teuthology.orchestra.run.trial154:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-12T03:57:08.602 INFO:teuthology.run_tasks:Running task ceph... 2026-02-12T03:57:08.718 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-12T03:57:08.718 DEBUG:teuthology.orchestra.run.trial091:> sudo chmod 777 /var/log/ceph 2026-02-12T03:57:08.720 DEBUG:teuthology.orchestra.run.trial098:> sudo chmod 777 /var/log/ceph 2026-02-12T03:57:08.722 DEBUG:teuthology.orchestra.run.trial111:> sudo chmod 777 /var/log/ceph 2026-02-12T03:57:08.724 DEBUG:teuthology.orchestra.run.trial154:> sudo chmod 777 /var/log/ceph 2026-02-12T03:57:08.748 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-12T03:57:08.748 DEBUG:teuthology.orchestra.run.trial091:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-12T03:57:08.784 DEBUG:teuthology.orchestra.run.trial098:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-12T03:57:08.786 DEBUG:teuthology.orchestra.run.trial111:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-12T03:57:08.788 DEBUG:teuthology.orchestra.run.trial154:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-12T03:57:08.812 INFO:tasks.ceph:Creating extra log directories... 2026-02-12T03:57:08.813 DEBUG:teuthology.orchestra.run.trial091:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-12T03:57:08.848 DEBUG:teuthology.orchestra.run.trial098:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-12T03:57:08.850 DEBUG:teuthology.orchestra.run.trial111:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-12T03:57:08.853 DEBUG:teuthology.orchestra.run.trial154:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-12T03:57:08.897 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-12T03:57:08.897 INFO:tasks.ceph:config {'conf': {'client': {'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20, 'rados replica read policy': 'balance'}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 160, 'osd op thread timeout': 150}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'btree', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore onode segment size': '512K', 'bluestore write v2': True, 'bluestore zero block detection': True, 'crush location': 'root=default host=host-$id', 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 240, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True, 'osd_mclock_skip_benchmark': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(SLOW_OPS\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(OBJECT_MISPLACED\\)', 'slow request', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request', 'OSD bench result', 'OSD_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mon_bind_addrvec': True} 2026-02-12T03:57:08.898 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-11_20:27:55-rados-wip-yuri3-testing-2026-02-09-1550-tentacle-distro-default-trial/45766', 'branch': 'wip-yuri3-testing-2026-02-09-1550-tentacle', 'description': 'rados/verify/{centos_latest ceph clusters/fixed-4 d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/{bluestore/{alloc$/{btree} base mem$/{normal-2} onode-segment$/{512K} write$/{v2/{compr$/{yes$/{zstd}} v2}}}} rados read-affinity/balance tasks/rados_api_tests validater/valgrind}', 'email': None, 'first_in_suite': False, 'flavor': 'default', 'job_id': '45766', 'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'yuriw-2026-02-11_20:27:55-rados-wip-yuri3-testing-2026-02-09-1550-tentacle-distro-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri3-testing-2026-02-09-1550-tentacle'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20, 'rados replica read policy': 'balance'}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 160, 'osd op thread timeout': 150}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'btree', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore onode segment size': '512K', 'bluestore write v2': True, 'bluestore zero block detection': True, 'crush location': 'root=default host=host-$id', 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 240, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True, 'osd_mclock_skip_benchmark': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(SLOW_OPS\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(OBJECT_MISPLACED\\)', 'slow request', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request', 'OSD bench result', 'OSD_DOWN'], 'mon_bind_msgr2': False, 'sha1': '1279775fef08a9169052c6dd6a10581353958aac', 'stop-daemons-timeout': 1200, 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes'], 'osd': ['--tool=memcheck']}}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': '1279775fef08a9169052c6dd6a10581353958aac'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri3-testing-2026-02-09-1550-tentacle', 'sha1': '1279775fef08a9169052c6dd6a10581353958aac'}}, 'owner': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'], ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'], ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'], ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0']], 'seed': 4009, 'sha1': '1279775fef08a9169052c6dd6a10581353958aac', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-yuri3-testing-2026-02-09-1550-tentacle', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_1279775fef08a9169052c6dd6a10581353958aac/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '1279775fef08a9169052c6dd6a10581353958aac', 'targets': {'trial091.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLgUfVVo9sP7RVf5FrYm/RRiYSgEP4u6f2YjsPczL/voAxcN0Ki/NliLSPXX4uOEn3mJzKKLuACooNvbhRd4rVU=', 'trial098.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH/ZGNxGm4YVb5NKwcPoCfFuMQD5Uzd3a38gWjg4pdALOpieHEk1t6PFqRS30hITPgL7gShmdVuOpeoF/1SRJ2w=', 'trial111.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA1l48SOmf1PdrNOMICCcHGTZhexXRe/LPTckaIJGJzsHjjgweQ0HaCe59rLxJCgtEjP8zOIBa2Ax/ha2ypcP4s=', 'trial154.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGeW/kQYhKmapBRxoUDFP7L7B90We5Dkac4dnhUkXEOtzMV1uzfc+vIV3ekGf43ekJHr+R3Zq9LYZl2W6W8n5bw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'workunit': {'clients': {'client.0': ['rados/test.sh']}, 'env': {'ALLOW_TIMEOUTS': '1'}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["-- Don't run this test on tiny clusters\nif py_len(yaml.roles) < 4 then reject() end\n"]}, 'teuthology_branch': 'reimage-ssh-down', 'teuthology_sha1': '5f66ecfb34c0370410e78b3ee641753d19da653b', 'timestamp': '2026-02-11_20:27:55', 'tube': 'trial', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.2161924'} 2026-02-12T03:57:08.898 DEBUG:teuthology.orchestra.run.trial091:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-12T03:57:08.914 DEBUG:teuthology.orchestra.run.trial098:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-12T03:57:08.917 DEBUG:teuthology.orchestra.run.trial111:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-12T03:57:08.919 DEBUG:teuthology.orchestra.run.trial154:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-12T03:57:08.935 DEBUG:teuthology.orchestra.run.trial091:> sudo install -d -m0777 -- /var/run/ceph 2026-02-12T03:57:08.970 DEBUG:teuthology.orchestra.run.trial098:> sudo install -d -m0777 -- /var/run/ceph 2026-02-12T03:57:08.973 DEBUG:teuthology.orchestra.run.trial111:> sudo install -d -m0777 -- /var/run/ceph 2026-02-12T03:57:08.976 DEBUG:teuthology.orchestra.run.trial154:> sudo install -d -m0777 -- /var/run/ceph 2026-02-12T03:57:09.000 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-12T03:57:09.000 DEBUG:teuthology.orchestra.run.trial091:> dd if=/scratch_devs of=/dev/stdout 2026-02-12T03:57:09.048 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-12T03:57:09.048 DEBUG:teuthology.orchestra.run.trial091:> stat /dev/vg_nvme/lv_1 2026-02-12T03:57:09.106 INFO:teuthology.orchestra.run.trial091.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-12T03:57:09.106 INFO:teuthology.orchestra.run.trial091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T03:57:09.106 INFO:teuthology.orchestra.run.trial091.stdout:Device: 6h/6d Inode: 1304 Links: 1 2026-02-12T03:57:09.106 INFO:teuthology.orchestra.run.trial091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T03:57:09.107 INFO:teuthology.orchestra.run.trial091.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T03:57:09.107 INFO:teuthology.orchestra.run.trial091.stdout:Access: 2026-02-12 03:48:14.072073756 +0000 2026-02-12T03:57:09.107 INFO:teuthology.orchestra.run.trial091.stdout:Modify: 2026-02-12 03:47:28.913885187 +0000 2026-02-12T03:57:09.107 INFO:teuthology.orchestra.run.trial091.stdout:Change: 2026-02-12 03:47:28.913885187 +0000 2026-02-12T03:57:09.107 INFO:teuthology.orchestra.run.trial091.stdout: Birth: 2026-02-12 03:47:28.913885187 +0000 2026-02-12T03:57:09.107 DEBUG:teuthology.orchestra.run.trial091:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-12T03:57:09.170 INFO:teuthology.orchestra.run.trial091.stderr:1+0 records in 2026-02-12T03:57:09.170 INFO:teuthology.orchestra.run.trial091.stderr:1+0 records out 2026-02-12T03:57:09.170 INFO:teuthology.orchestra.run.trial091.stderr:512 bytes copied, 0.000177189 s, 2.9 MB/s 2026-02-12T03:57:09.171 DEBUG:teuthology.orchestra.run.trial091:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-12T03:57:09.229 DEBUG:teuthology.orchestra.run.trial091:> stat /dev/vg_nvme/lv_2 2026-02-12T03:57:09.287 INFO:teuthology.orchestra.run.trial091.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-12T03:57:09.287 INFO:teuthology.orchestra.run.trial091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T03:57:09.287 INFO:teuthology.orchestra.run.trial091.stdout:Device: 6h/6d Inode: 1301 Links: 1 2026-02-12T03:57:09.287 INFO:teuthology.orchestra.run.trial091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T03:57:09.287 INFO:teuthology.orchestra.run.trial091.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T03:57:09.287 INFO:teuthology.orchestra.run.trial091.stdout:Access: 2026-02-12 03:48:14.073073739 +0000 2026-02-12T03:57:09.287 INFO:teuthology.orchestra.run.trial091.stdout:Modify: 2026-02-12 03:47:28.913885187 +0000 2026-02-12T03:57:09.287 INFO:teuthology.orchestra.run.trial091.stdout:Change: 2026-02-12 03:47:28.913885187 +0000 2026-02-12T03:57:09.287 INFO:teuthology.orchestra.run.trial091.stdout: Birth: 2026-02-12 03:47:28.913885187 +0000 2026-02-12T03:57:09.288 DEBUG:teuthology.orchestra.run.trial091:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-12T03:57:09.351 INFO:teuthology.orchestra.run.trial091.stderr:1+0 records in 2026-02-12T03:57:09.351 INFO:teuthology.orchestra.run.trial091.stderr:1+0 records out 2026-02-12T03:57:09.352 INFO:teuthology.orchestra.run.trial091.stderr:512 bytes copied, 0.000146633 s, 3.5 MB/s 2026-02-12T03:57:09.353 DEBUG:teuthology.orchestra.run.trial091:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-12T03:57:09.410 DEBUG:teuthology.orchestra.run.trial091:> stat /dev/vg_nvme/lv_3 2026-02-12T03:57:09.466 INFO:teuthology.orchestra.run.trial091.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-12T03:57:09.466 INFO:teuthology.orchestra.run.trial091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T03:57:09.466 INFO:teuthology.orchestra.run.trial091.stdout:Device: 6h/6d Inode: 1309 Links: 1 2026-02-12T03:57:09.466 INFO:teuthology.orchestra.run.trial091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T03:57:09.466 INFO:teuthology.orchestra.run.trial091.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T03:57:09.466 INFO:teuthology.orchestra.run.trial091.stdout:Access: 2026-02-12 03:48:14.073073739 +0000 2026-02-12T03:57:09.466 INFO:teuthology.orchestra.run.trial091.stdout:Modify: 2026-02-12 03:47:28.914885168 +0000 2026-02-12T03:57:09.467 INFO:teuthology.orchestra.run.trial091.stdout:Change: 2026-02-12 03:47:28.914885168 +0000 2026-02-12T03:57:09.467 INFO:teuthology.orchestra.run.trial091.stdout: Birth: 2026-02-12 03:47:28.914885168 +0000 2026-02-12T03:57:09.467 DEBUG:teuthology.orchestra.run.trial091:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-12T03:57:09.528 INFO:teuthology.orchestra.run.trial091.stderr:1+0 records in 2026-02-12T03:57:09.528 INFO:teuthology.orchestra.run.trial091.stderr:1+0 records out 2026-02-12T03:57:09.528 INFO:teuthology.orchestra.run.trial091.stderr:512 bytes copied, 0.000173582 s, 2.9 MB/s 2026-02-12T03:57:09.530 DEBUG:teuthology.orchestra.run.trial091:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-12T03:57:09.587 DEBUG:teuthology.orchestra.run.trial091:> stat /dev/vg_nvme/lv_4 2026-02-12T03:57:09.643 INFO:teuthology.orchestra.run.trial091.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-12T03:57:09.643 INFO:teuthology.orchestra.run.trial091.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T03:57:09.643 INFO:teuthology.orchestra.run.trial091.stdout:Device: 6h/6d Inode: 1291 Links: 1 2026-02-12T03:57:09.644 INFO:teuthology.orchestra.run.trial091.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T03:57:09.644 INFO:teuthology.orchestra.run.trial091.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T03:57:09.644 INFO:teuthology.orchestra.run.trial091.stdout:Access: 2026-02-12 03:48:14.073073739 +0000 2026-02-12T03:57:09.644 INFO:teuthology.orchestra.run.trial091.stdout:Modify: 2026-02-12 03:47:28.913885187 +0000 2026-02-12T03:57:09.644 INFO:teuthology.orchestra.run.trial091.stdout:Change: 2026-02-12 03:47:28.913885187 +0000 2026-02-12T03:57:09.644 INFO:teuthology.orchestra.run.trial091.stdout: Birth: 2026-02-12 03:47:28.913885187 +0000 2026-02-12T03:57:09.644 DEBUG:teuthology.orchestra.run.trial091:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-12T03:57:09.708 INFO:teuthology.orchestra.run.trial091.stderr:1+0 records in 2026-02-12T03:57:09.709 INFO:teuthology.orchestra.run.trial091.stderr:1+0 records out 2026-02-12T03:57:09.709 INFO:teuthology.orchestra.run.trial091.stderr:512 bytes copied, 0.000132926 s, 3.9 MB/s 2026-02-12T03:57:09.710 DEBUG:teuthology.orchestra.run.trial091:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-12T03:57:09.767 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-12T03:57:09.767 DEBUG:teuthology.orchestra.run.trial098:> set -ex 2026-02-12T03:57:09.767 DEBUG:teuthology.orchestra.run.trial098:> dd if=/scratch_devs of=/dev/stdout 2026-02-12T03:57:09.785 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-12T03:57:09.785 DEBUG:teuthology.orchestra.run.trial098:> stat /dev/vg_nvme/lv_1 2026-02-12T03:57:09.843 INFO:teuthology.orchestra.run.trial098.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-12T03:57:09.843 INFO:teuthology.orchestra.run.trial098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T03:57:09.843 INFO:teuthology.orchestra.run.trial098.stdout:Device: 6h/6d Inode: 1315 Links: 1 2026-02-12T03:57:09.843 INFO:teuthology.orchestra.run.trial098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T03:57:09.843 INFO:teuthology.orchestra.run.trial098.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T03:57:09.843 INFO:teuthology.orchestra.run.trial098.stdout:Access: 2026-02-12 03:48:12.537378793 +0000 2026-02-12T03:57:09.843 INFO:teuthology.orchestra.run.trial098.stdout:Modify: 2026-02-12 03:47:28.610126252 +0000 2026-02-12T03:57:09.843 INFO:teuthology.orchestra.run.trial098.stdout:Change: 2026-02-12 03:47:28.610126252 +0000 2026-02-12T03:57:09.843 INFO:teuthology.orchestra.run.trial098.stdout: Birth: 2026-02-12 03:47:28.610126252 +0000 2026-02-12T03:57:09.844 DEBUG:teuthology.orchestra.run.trial098:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-12T03:57:09.908 INFO:teuthology.orchestra.run.trial098.stderr:1+0 records in 2026-02-12T03:57:09.908 INFO:teuthology.orchestra.run.trial098.stderr:1+0 records out 2026-02-12T03:57:09.908 INFO:teuthology.orchestra.run.trial098.stderr:512 bytes copied, 0.000223144 s, 2.3 MB/s 2026-02-12T03:57:09.909 DEBUG:teuthology.orchestra.run.trial098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-12T03:57:09.966 DEBUG:teuthology.orchestra.run.trial098:> stat /dev/vg_nvme/lv_2 2026-02-12T03:57:10.022 INFO:teuthology.orchestra.run.trial098.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-12T03:57:10.022 INFO:teuthology.orchestra.run.trial098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T03:57:10.023 INFO:teuthology.orchestra.run.trial098.stdout:Device: 6h/6d Inode: 1303 Links: 1 2026-02-12T03:57:10.023 INFO:teuthology.orchestra.run.trial098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T03:57:10.023 INFO:teuthology.orchestra.run.trial098.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T03:57:10.023 INFO:teuthology.orchestra.run.trial098.stdout:Access: 2026-02-12 03:48:12.538378776 +0000 2026-02-12T03:57:10.023 INFO:teuthology.orchestra.run.trial098.stdout:Modify: 2026-02-12 03:47:28.609126270 +0000 2026-02-12T03:57:10.023 INFO:teuthology.orchestra.run.trial098.stdout:Change: 2026-02-12 03:47:28.609126270 +0000 2026-02-12T03:57:10.023 INFO:teuthology.orchestra.run.trial098.stdout: Birth: 2026-02-12 03:47:28.609126270 +0000 2026-02-12T03:57:10.023 DEBUG:teuthology.orchestra.run.trial098:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-12T03:57:10.084 INFO:teuthology.orchestra.run.trial098.stderr:1+0 records in 2026-02-12T03:57:10.084 INFO:teuthology.orchestra.run.trial098.stderr:1+0 records out 2026-02-12T03:57:10.084 INFO:teuthology.orchestra.run.trial098.stderr:512 bytes copied, 0.000159916 s, 3.2 MB/s 2026-02-12T03:57:10.085 DEBUG:teuthology.orchestra.run.trial098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-12T03:57:10.144 DEBUG:teuthology.orchestra.run.trial098:> stat /dev/vg_nvme/lv_3 2026-02-12T03:57:10.200 INFO:teuthology.orchestra.run.trial098.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-12T03:57:10.200 INFO:teuthology.orchestra.run.trial098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T03:57:10.200 INFO:teuthology.orchestra.run.trial098.stdout:Device: 6h/6d Inode: 1304 Links: 1 2026-02-12T03:57:10.200 INFO:teuthology.orchestra.run.trial098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T03:57:10.200 INFO:teuthology.orchestra.run.trial098.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T03:57:10.200 INFO:teuthology.orchestra.run.trial098.stdout:Access: 2026-02-12 03:48:12.538378776 +0000 2026-02-12T03:57:10.201 INFO:teuthology.orchestra.run.trial098.stdout:Modify: 2026-02-12 03:47:28.609126270 +0000 2026-02-12T03:57:10.201 INFO:teuthology.orchestra.run.trial098.stdout:Change: 2026-02-12 03:47:28.609126270 +0000 2026-02-12T03:57:10.201 INFO:teuthology.orchestra.run.trial098.stdout: Birth: 2026-02-12 03:47:28.609126270 +0000 2026-02-12T03:57:10.201 DEBUG:teuthology.orchestra.run.trial098:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-12T03:57:10.262 INFO:teuthology.orchestra.run.trial098.stderr:1+0 records in 2026-02-12T03:57:10.262 INFO:teuthology.orchestra.run.trial098.stderr:1+0 records out 2026-02-12T03:57:10.263 INFO:teuthology.orchestra.run.trial098.stderr:512 bytes copied, 0.000134389 s, 3.8 MB/s 2026-02-12T03:57:10.264 DEBUG:teuthology.orchestra.run.trial098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-12T03:57:10.321 DEBUG:teuthology.orchestra.run.trial098:> stat /dev/vg_nvme/lv_4 2026-02-12T03:57:10.378 INFO:teuthology.orchestra.run.trial098.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-12T03:57:10.378 INFO:teuthology.orchestra.run.trial098.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T03:57:10.379 INFO:teuthology.orchestra.run.trial098.stdout:Device: 6h/6d Inode: 1296 Links: 1 2026-02-12T03:57:10.379 INFO:teuthology.orchestra.run.trial098.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T03:57:10.379 INFO:teuthology.orchestra.run.trial098.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T03:57:10.379 INFO:teuthology.orchestra.run.trial098.stdout:Access: 2026-02-12 03:48:12.538378776 +0000 2026-02-12T03:57:10.379 INFO:teuthology.orchestra.run.trial098.stdout:Modify: 2026-02-12 03:47:28.609126270 +0000 2026-02-12T03:57:10.379 INFO:teuthology.orchestra.run.trial098.stdout:Change: 2026-02-12 03:47:28.609126270 +0000 2026-02-12T03:57:10.379 INFO:teuthology.orchestra.run.trial098.stdout: Birth: 2026-02-12 03:47:28.609126270 +0000 2026-02-12T03:57:10.379 DEBUG:teuthology.orchestra.run.trial098:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-12T03:57:10.441 INFO:teuthology.orchestra.run.trial098.stderr:1+0 records in 2026-02-12T03:57:10.442 INFO:teuthology.orchestra.run.trial098.stderr:1+0 records out 2026-02-12T03:57:10.442 INFO:teuthology.orchestra.run.trial098.stderr:512 bytes copied, 0.000148736 s, 3.4 MB/s 2026-02-12T03:57:10.443 DEBUG:teuthology.orchestra.run.trial098:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-12T03:57:10.500 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-12T03:57:10.501 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-12T03:57:10.501 DEBUG:teuthology.orchestra.run.trial111:> dd if=/scratch_devs of=/dev/stdout 2026-02-12T03:57:10.519 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-12T03:57:10.520 DEBUG:teuthology.orchestra.run.trial111:> stat /dev/vg_nvme/lv_1 2026-02-12T03:57:10.577 INFO:teuthology.orchestra.run.trial111.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-12T03:57:10.577 INFO:teuthology.orchestra.run.trial111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T03:57:10.577 INFO:teuthology.orchestra.run.trial111.stdout:Device: 6h/6d Inode: 1308 Links: 1 2026-02-12T03:57:10.577 INFO:teuthology.orchestra.run.trial111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T03:57:10.577 INFO:teuthology.orchestra.run.trial111.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T03:57:10.578 INFO:teuthology.orchestra.run.trial111.stdout:Access: 2026-02-12 03:48:16.833221475 +0000 2026-02-12T03:57:10.578 INFO:teuthology.orchestra.run.trial111.stdout:Modify: 2026-02-12 03:47:26.962185429 +0000 2026-02-12T03:57:10.578 INFO:teuthology.orchestra.run.trial111.stdout:Change: 2026-02-12 03:47:26.962185429 +0000 2026-02-12T03:57:10.578 INFO:teuthology.orchestra.run.trial111.stdout: Birth: 2026-02-12 03:47:26.962185429 +0000 2026-02-12T03:57:10.578 DEBUG:teuthology.orchestra.run.trial111:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-12T03:57:10.641 INFO:teuthology.orchestra.run.trial111.stderr:1+0 records in 2026-02-12T03:57:10.642 INFO:teuthology.orchestra.run.trial111.stderr:1+0 records out 2026-02-12T03:57:10.642 INFO:teuthology.orchestra.run.trial111.stderr:512 bytes copied, 0.000146913 s, 3.5 MB/s 2026-02-12T03:57:10.643 DEBUG:teuthology.orchestra.run.trial111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-12T03:57:10.700 DEBUG:teuthology.orchestra.run.trial111:> stat /dev/vg_nvme/lv_2 2026-02-12T03:57:10.757 INFO:teuthology.orchestra.run.trial111.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-12T03:57:10.757 INFO:teuthology.orchestra.run.trial111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T03:57:10.757 INFO:teuthology.orchestra.run.trial111.stdout:Device: 6h/6d Inode: 1301 Links: 1 2026-02-12T03:57:10.757 INFO:teuthology.orchestra.run.trial111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T03:57:10.757 INFO:teuthology.orchestra.run.trial111.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T03:57:10.757 INFO:teuthology.orchestra.run.trial111.stdout:Access: 2026-02-12 03:48:16.833221475 +0000 2026-02-12T03:57:10.757 INFO:teuthology.orchestra.run.trial111.stdout:Modify: 2026-02-12 03:47:26.961185446 +0000 2026-02-12T03:57:10.757 INFO:teuthology.orchestra.run.trial111.stdout:Change: 2026-02-12 03:47:26.961185446 +0000 2026-02-12T03:57:10.758 INFO:teuthology.orchestra.run.trial111.stdout: Birth: 2026-02-12 03:47:26.961185446 +0000 2026-02-12T03:57:10.758 DEBUG:teuthology.orchestra.run.trial111:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-12T03:57:10.819 INFO:teuthology.orchestra.run.trial111.stderr:1+0 records in 2026-02-12T03:57:10.820 INFO:teuthology.orchestra.run.trial111.stderr:1+0 records out 2026-02-12T03:57:10.820 INFO:teuthology.orchestra.run.trial111.stderr:512 bytes copied, 0.000154277 s, 3.3 MB/s 2026-02-12T03:57:10.821 DEBUG:teuthology.orchestra.run.trial111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-12T03:57:10.878 DEBUG:teuthology.orchestra.run.trial111:> stat /dev/vg_nvme/lv_3 2026-02-12T03:57:10.935 INFO:teuthology.orchestra.run.trial111.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-12T03:57:10.935 INFO:teuthology.orchestra.run.trial111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T03:57:10.936 INFO:teuthology.orchestra.run.trial111.stdout:Device: 6h/6d Inode: 1304 Links: 1 2026-02-12T03:57:10.936 INFO:teuthology.orchestra.run.trial111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T03:57:10.936 INFO:teuthology.orchestra.run.trial111.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T03:57:10.936 INFO:teuthology.orchestra.run.trial111.stdout:Access: 2026-02-12 03:48:16.834221432 +0000 2026-02-12T03:57:10.936 INFO:teuthology.orchestra.run.trial111.stdout:Modify: 2026-02-12 03:47:26.961185446 +0000 2026-02-12T03:57:10.936 INFO:teuthology.orchestra.run.trial111.stdout:Change: 2026-02-12 03:47:26.961185446 +0000 2026-02-12T03:57:10.936 INFO:teuthology.orchestra.run.trial111.stdout: Birth: 2026-02-12 03:47:26.961185446 +0000 2026-02-12T03:57:10.936 DEBUG:teuthology.orchestra.run.trial111:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-12T03:57:10.997 INFO:teuthology.orchestra.run.trial111.stderr:1+0 records in 2026-02-12T03:57:10.998 INFO:teuthology.orchestra.run.trial111.stderr:1+0 records out 2026-02-12T03:57:10.998 INFO:teuthology.orchestra.run.trial111.stderr:512 bytes copied, 0.00016134 s, 3.2 MB/s 2026-02-12T03:57:10.999 DEBUG:teuthology.orchestra.run.trial111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-12T03:57:11.058 DEBUG:teuthology.orchestra.run.trial111:> stat /dev/vg_nvme/lv_4 2026-02-12T03:57:11.115 INFO:teuthology.orchestra.run.trial111.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-12T03:57:11.115 INFO:teuthology.orchestra.run.trial111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T03:57:11.115 INFO:teuthology.orchestra.run.trial111.stdout:Device: 6h/6d Inode: 1283 Links: 1 2026-02-12T03:57:11.115 INFO:teuthology.orchestra.run.trial111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T03:57:11.115 INFO:teuthology.orchestra.run.trial111.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T03:57:11.115 INFO:teuthology.orchestra.run.trial111.stdout:Access: 2026-02-12 03:48:16.834221432 +0000 2026-02-12T03:57:11.116 INFO:teuthology.orchestra.run.trial111.stdout:Modify: 2026-02-12 03:47:26.960185463 +0000 2026-02-12T03:57:11.116 INFO:teuthology.orchestra.run.trial111.stdout:Change: 2026-02-12 03:47:26.960185463 +0000 2026-02-12T03:57:11.116 INFO:teuthology.orchestra.run.trial111.stdout: Birth: 2026-02-12 03:47:26.960185463 +0000 2026-02-12T03:57:11.116 DEBUG:teuthology.orchestra.run.trial111:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-12T03:57:11.179 INFO:teuthology.orchestra.run.trial111.stderr:1+0 records in 2026-02-12T03:57:11.179 INFO:teuthology.orchestra.run.trial111.stderr:1+0 records out 2026-02-12T03:57:11.179 INFO:teuthology.orchestra.run.trial111.stderr:512 bytes copied, 0.000129942 s, 3.9 MB/s 2026-02-12T03:57:11.180 DEBUG:teuthology.orchestra.run.trial111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-12T03:57:11.238 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-12T03:57:11.238 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-12T03:57:11.238 DEBUG:teuthology.orchestra.run.trial154:> dd if=/scratch_devs of=/dev/stdout 2026-02-12T03:57:11.256 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-12T03:57:11.256 DEBUG:teuthology.orchestra.run.trial154:> stat /dev/vg_nvme/lv_1 2026-02-12T03:57:11.312 INFO:teuthology.orchestra.run.trial154.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-12T03:57:11.313 INFO:teuthology.orchestra.run.trial154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T03:57:11.313 INFO:teuthology.orchestra.run.trial154.stdout:Device: 6h/6d Inode: 1311 Links: 1 2026-02-12T03:57:11.313 INFO:teuthology.orchestra.run.trial154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T03:57:11.313 INFO:teuthology.orchestra.run.trial154.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T03:57:11.313 INFO:teuthology.orchestra.run.trial154.stdout:Access: 2026-02-12 03:48:23.289417664 +0000 2026-02-12T03:57:11.313 INFO:teuthology.orchestra.run.trial154.stdout:Modify: 2026-02-12 03:47:41.218148344 +0000 2026-02-12T03:57:11.313 INFO:teuthology.orchestra.run.trial154.stdout:Change: 2026-02-12 03:47:41.218148344 +0000 2026-02-12T03:57:11.313 INFO:teuthology.orchestra.run.trial154.stdout: Birth: 2026-02-12 03:47:41.218148344 +0000 2026-02-12T03:57:11.314 DEBUG:teuthology.orchestra.run.trial154:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-12T03:57:11.376 INFO:teuthology.orchestra.run.trial154.stderr:1+0 records in 2026-02-12T03:57:11.376 INFO:teuthology.orchestra.run.trial154.stderr:1+0 records out 2026-02-12T03:57:11.376 INFO:teuthology.orchestra.run.trial154.stderr:512 bytes copied, 0.000146033 s, 3.5 MB/s 2026-02-12T03:57:11.378 DEBUG:teuthology.orchestra.run.trial154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-12T03:57:11.434 DEBUG:teuthology.orchestra.run.trial154:> stat /dev/vg_nvme/lv_2 2026-02-12T03:57:11.492 INFO:teuthology.orchestra.run.trial154.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-12T03:57:11.492 INFO:teuthology.orchestra.run.trial154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T03:57:11.492 INFO:teuthology.orchestra.run.trial154.stdout:Device: 6h/6d Inode: 1303 Links: 1 2026-02-12T03:57:11.492 INFO:teuthology.orchestra.run.trial154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T03:57:11.492 INFO:teuthology.orchestra.run.trial154.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T03:57:11.493 INFO:teuthology.orchestra.run.trial154.stdout:Access: 2026-02-12 03:48:23.289417664 +0000 2026-02-12T03:57:11.493 INFO:teuthology.orchestra.run.trial154.stdout:Modify: 2026-02-12 03:47:41.217148361 +0000 2026-02-12T03:57:11.493 INFO:teuthology.orchestra.run.trial154.stdout:Change: 2026-02-12 03:47:41.217148361 +0000 2026-02-12T03:57:11.493 INFO:teuthology.orchestra.run.trial154.stdout: Birth: 2026-02-12 03:47:41.217148361 +0000 2026-02-12T03:57:11.494 DEBUG:teuthology.orchestra.run.trial154:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-12T03:57:11.553 INFO:teuthology.orchestra.run.trial154.stderr:1+0 records in 2026-02-12T03:57:11.554 INFO:teuthology.orchestra.run.trial154.stderr:1+0 records out 2026-02-12T03:57:11.554 INFO:teuthology.orchestra.run.trial154.stderr:512 bytes copied, 0.000146855 s, 3.5 MB/s 2026-02-12T03:57:11.555 DEBUG:teuthology.orchestra.run.trial154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-12T03:57:11.612 DEBUG:teuthology.orchestra.run.trial154:> stat /dev/vg_nvme/lv_3 2026-02-12T03:57:11.669 INFO:teuthology.orchestra.run.trial154.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-12T03:57:11.669 INFO:teuthology.orchestra.run.trial154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T03:57:11.670 INFO:teuthology.orchestra.run.trial154.stdout:Device: 6h/6d Inode: 1289 Links: 1 2026-02-12T03:57:11.670 INFO:teuthology.orchestra.run.trial154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T03:57:11.670 INFO:teuthology.orchestra.run.trial154.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T03:57:11.670 INFO:teuthology.orchestra.run.trial154.stdout:Access: 2026-02-12 03:48:23.290417645 +0000 2026-02-12T03:57:11.670 INFO:teuthology.orchestra.run.trial154.stdout:Modify: 2026-02-12 03:47:41.216148378 +0000 2026-02-12T03:57:11.671 INFO:teuthology.orchestra.run.trial154.stdout:Change: 2026-02-12 03:47:41.216148378 +0000 2026-02-12T03:57:11.671 INFO:teuthology.orchestra.run.trial154.stdout: Birth: 2026-02-12 03:47:41.216148378 +0000 2026-02-12T03:57:11.671 DEBUG:teuthology.orchestra.run.trial154:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-12T03:57:11.731 INFO:teuthology.orchestra.run.trial154.stderr:1+0 records in 2026-02-12T03:57:11.732 INFO:teuthology.orchestra.run.trial154.stderr:1+0 records out 2026-02-12T03:57:11.732 INFO:teuthology.orchestra.run.trial154.stderr:512 bytes copied, 0.000168075 s, 3.0 MB/s 2026-02-12T03:57:11.733 DEBUG:teuthology.orchestra.run.trial154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-12T03:57:11.790 DEBUG:teuthology.orchestra.run.trial154:> stat /dev/vg_nvme/lv_4 2026-02-12T03:57:11.846 INFO:teuthology.orchestra.run.trial154.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-12T03:57:11.847 INFO:teuthology.orchestra.run.trial154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T03:57:11.847 INFO:teuthology.orchestra.run.trial154.stdout:Device: 6h/6d Inode: 1293 Links: 1 2026-02-12T03:57:11.847 INFO:teuthology.orchestra.run.trial154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T03:57:11.847 INFO:teuthology.orchestra.run.trial154.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T03:57:11.847 INFO:teuthology.orchestra.run.trial154.stdout:Access: 2026-02-12 03:48:23.290417645 +0000 2026-02-12T03:57:11.847 INFO:teuthology.orchestra.run.trial154.stdout:Modify: 2026-02-12 03:47:41.216148378 +0000 2026-02-12T03:57:11.847 INFO:teuthology.orchestra.run.trial154.stdout:Change: 2026-02-12 03:47:41.216148378 +0000 2026-02-12T03:57:11.847 INFO:teuthology.orchestra.run.trial154.stdout: Birth: 2026-02-12 03:47:41.216148378 +0000 2026-02-12T03:57:11.847 DEBUG:teuthology.orchestra.run.trial154:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-12T03:57:11.911 INFO:teuthology.orchestra.run.trial154.stderr:1+0 records in 2026-02-12T03:57:11.911 INFO:teuthology.orchestra.run.trial154.stderr:1+0 records out 2026-02-12T03:57:11.911 INFO:teuthology.orchestra.run.trial154.stderr:512 bytes copied, 0.000143258 s, 3.6 MB/s 2026-02-12T03:57:11.912 DEBUG:teuthology.orchestra.run.trial154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-12T03:57:11.969 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-12T03:57:11.970 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial091.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial098.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial111.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial154.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'}} 2026-02-12T03:57:11.970 INFO:tasks.ceph:Generating config... 2026-02-12T03:57:11.972 INFO:tasks.ceph:[client] debug monc = 20 2026-02-12T03:57:11.972 INFO:tasks.ceph:[client] debug ms = 1 2026-02-12T03:57:11.972 INFO:tasks.ceph:[client] debug objecter = 20 2026-02-12T03:57:11.972 INFO:tasks.ceph:[client] debug rados = 20 2026-02-12T03:57:11.972 INFO:tasks.ceph:[client] rados replica read policy = balance 2026-02-12T03:57:11.973 INFO:tasks.ceph:[global] mon client directed command retry = 5 2026-02-12T03:57:11.973 INFO:tasks.ceph:[global] mon election default strategy = 3 2026-02-12T03:57:11.973 INFO:tasks.ceph:[global] ms bind msgr2 = False 2026-02-12T03:57:11.973 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2026-02-12T03:57:11.973 INFO:tasks.ceph:[global] ms type = async 2026-02-12T03:57:11.973 INFO:tasks.ceph:[global] osd heartbeat grace = 160 2026-02-12T03:57:11.973 INFO:tasks.ceph:[global] osd op thread timeout = 150 2026-02-12T03:57:11.973 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-12T03:57:11.973 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-12T03:57:11.973 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-12T03:57:11.973 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-12T03:57:11.974 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-12T03:57:11.974 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2026-02-12T03:57:11.974 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2026-02-12T03:57:11.974 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2026-02-12T03:57:11.974 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2026-02-12T03:57:11.974 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2026-02-12T03:57:11.974 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-12T03:57:11.974 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2026-02-12T03:57:11.974 INFO:tasks.ceph:[mon] paxos service trim min = 10 2026-02-12T03:57:11.974 INFO:tasks.ceph:[osd] bdev async discard = True 2026-02-12T03:57:11.974 INFO:tasks.ceph:[osd] bdev enable discard = True 2026-02-12T03:57:11.974 INFO:tasks.ceph:[osd] bluestore allocator = btree 2026-02-12T03:57:11.974 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-12T03:57:11.975 INFO:tasks.ceph:[osd] bluestore compression algorithm = zstd 2026-02-12T03:57:11.975 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2026-02-12T03:57:11.975 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-12T03:57:11.975 INFO:tasks.ceph:[osd] bluestore onode segment size = 512K 2026-02-12T03:57:11.975 INFO:tasks.ceph:[osd] bluestore write v2 = True 2026-02-12T03:57:11.975 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-12T03:57:11.975 INFO:tasks.ceph:[osd] crush location = root=default host=host-$id 2026-02-12T03:57:11.975 INFO:tasks.ceph:[osd] debug bluefs = 1 2026-02-12T03:57:11.975 INFO:tasks.ceph:[osd] debug bluestore = 1 2026-02-12T03:57:11.975 INFO:tasks.ceph:[osd] debug monc = 20 2026-02-12T03:57:11.975 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-12T03:57:11.975 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-12T03:57:11.975 INFO:tasks.ceph:[osd] debug rocksdb = 10 2026-02-12T03:57:11.976 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-12T03:57:11.976 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-12T03:57:11.976 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-12T03:57:11.976 INFO:tasks.ceph:[osd] osd class default list = * 2026-02-12T03:57:11.976 INFO:tasks.ceph:[osd] osd class load list = * 2026-02-12T03:57:11.976 INFO:tasks.ceph:[osd] osd client watch timeout = 240 2026-02-12T03:57:11.976 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-12T03:57:11.976 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-12T03:57:11.976 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-12T03:57:11.976 INFO:tasks.ceph:[osd] osd fast shutdown = False 2026-02-12T03:57:11.976 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-12T03:57:11.976 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-12T03:57:11.976 INFO:tasks.ceph:[osd] osd mclock skip benchmark = True 2026-02-12T03:57:11.977 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-12T03:57:11.977 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-12T03:57:11.977 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-12T03:57:11.977 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2026-02-12T03:57:11.977 INFO:tasks.ceph:[osd] osd_mclock_skip_benchmark = True 2026-02-12T03:57:11.977 INFO:tasks.ceph:Setting up mon.a... 2026-02-12T03:57:11.977 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-12T03:57:12.014 INFO:teuthology.orchestra.run.trial091.stdout:creating /etc/ceph/ceph.keyring 2026-02-12T03:57:12.017 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-12T03:57:12.094 DEBUG:teuthology.orchestra.run.trial091:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-12T03:57:12.157 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '[v1:10.20.193.91:6789]'), ('mon.b', '[v1:10.20.193.98:6789]'), ('mon.c', '[v1:10.20.193.111:6789]')] 2026-02-12T03:57:12.158 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '[v1:10.20.193.91:6789],[v1:10.20.193.98:6789],[v1:10.20.193.111:6789]', 'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 160, 'osd op thread timeout': 150}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'btree', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore onode segment size': '512K', 'bluestore write v2': True, 'bluestore zero block detection': True, 'crush location': 'root=default host=host-$id', 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd client watch timeout': 240, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True, 'osd_mclock_skip_benchmark': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug monc': 20, 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20, 'rados replica read policy': 'balance'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}} 2026-02-12T03:57:12.159 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-12T03:57:12.160 DEBUG:teuthology.orchestra.run.trial091:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-12T03:57:12.214 DEBUG:teuthology.orchestra.run.trial091:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --addv a '[v1:10.20.193.91:6789]' --addv b '[v1:10.20.193.98:6789]' --addv c '[v1:10.20.193.111:6789]' --print /home/ubuntu/cephtest/ceph.monmap 2026-02-12T03:57:12.288 INFO:teuthology.orchestra.run.trial091.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-12T03:57:12.288 INFO:teuthology.orchestra.run.trial091.stdout:monmaptool: generated fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:57:12.288 INFO:teuthology.orchestra.run.trial091.stdout:setting min_mon_release = tentacle 2026-02-12T03:57:12.288 INFO:teuthology.orchestra.run.trial091.stdout:epoch 0 2026-02-12T03:57:12.288 INFO:teuthology.orchestra.run.trial091.stdout:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:57:12.288 INFO:teuthology.orchestra.run.trial091.stdout:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:57:12.288 INFO:teuthology.orchestra.run.trial091.stdout:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:57:12.288 INFO:teuthology.orchestra.run.trial091.stdout:min_mon_release 20 (tentacle) 2026-02-12T03:57:12.288 INFO:teuthology.orchestra.run.trial091.stdout:election_strategy: 3 2026-02-12T03:57:12.289 INFO:teuthology.orchestra.run.trial091.stdout:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:57:12.289 INFO:teuthology.orchestra.run.trial091.stdout:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:57:12.289 INFO:teuthology.orchestra.run.trial091.stdout:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:57:12.289 INFO:teuthology.orchestra.run.trial091.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2026-02-12T03:57:12.290 DEBUG:teuthology.orchestra.run.trial091:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-12T03:57:12.347 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 1e356fcf-3d61-462e-a451-82f8dd01e1f3... 2026-02-12T03:57:12.349 DEBUG:teuthology.orchestra.run.trial091:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-12T03:57:12.390 DEBUG:teuthology.orchestra.run.trial098:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-12T03:57:12.393 DEBUG:teuthology.orchestra.run.trial111:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-12T03:57:12.395 DEBUG:teuthology.orchestra.run.trial154:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-12T03:57:12.426 INFO:teuthology.orchestra.run.trial091.stdout:[global] 2026-02-12T03:57:12.427 INFO:teuthology.orchestra.run.trial091.stdout: chdir = "" 2026-02-12T03:57:12.427 INFO:teuthology.orchestra.run.trial091.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-12T03:57:12.427 INFO:teuthology.orchestra.run.trial091.stdout: auth supported = cephx 2026-02-12T03:57:12.427 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:57:12.427 INFO:teuthology.orchestra.run.trial091.stdout: filestore xattr use omap = true 2026-02-12T03:57:12.427 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:57:12.427 INFO:teuthology.orchestra.run.trial091.stdout: mon clock drift allowed = 1.000 2026-02-12T03:57:12.427 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:57:12.427 INFO:teuthology.orchestra.run.trial091.stdout: osd crush chooseleaf type = 0 2026-02-12T03:57:12.428 INFO:teuthology.orchestra.run.trial091.stdout: auth debug = true 2026-02-12T03:57:12.428 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:57:12.428 INFO:teuthology.orchestra.run.trial091.stdout: ms die on old message = true 2026-02-12T03:57:12.428 INFO:teuthology.orchestra.run.trial091.stdout: ms die on bug = true 2026-02-12T03:57:12.428 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:57:12.428 INFO:teuthology.orchestra.run.trial091.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-12T03:57:12.428 INFO:teuthology.orchestra.run.trial091.stdout: mon pg warn max object skew = 0 2026-02-12T03:57:12.428 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:57:12.428 INFO:teuthology.orchestra.run.trial091.stdout: # disable pg_autoscaler by default for new pools 2026-02-12T03:57:12.428 INFO:teuthology.orchestra.run.trial091.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-12T03:57:12.428 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:57:12.429 INFO:teuthology.orchestra.run.trial091.stdout: osd pool default size = 2 2026-02-12T03:57:12.429 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:57:12.429 INFO:teuthology.orchestra.run.trial091.stdout: mon osd allow primary affinity = true 2026-02-12T03:57:12.429 INFO:teuthology.orchestra.run.trial091.stdout: mon osd allow pg remap = true 2026-02-12T03:57:12.429 INFO:teuthology.orchestra.run.trial091.stdout: mon warn on legacy crush tunables = false 2026-02-12T03:57:12.429 INFO:teuthology.orchestra.run.trial091.stdout: mon warn on crush straw calc version zero = false 2026-02-12T03:57:12.429 INFO:teuthology.orchestra.run.trial091.stdout: mon warn on no sortbitwise = false 2026-02-12T03:57:12.429 INFO:teuthology.orchestra.run.trial091.stdout: mon warn on osd down out interval zero = false 2026-02-12T03:57:12.429 INFO:teuthology.orchestra.run.trial091.stdout: mon warn on too few osds = false 2026-02-12T03:57:12.429 INFO:teuthology.orchestra.run.trial091.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-12T03:57:12.429 INFO:teuthology.orchestra.run.trial091.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-12T03:57:12.429 INFO:teuthology.orchestra.run.trial091.stdout: mon_allow_pool_size_one = true 2026-02-12T03:57:12.430 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:57:12.430 INFO:teuthology.orchestra.run.trial091.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-12T03:57:12.430 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:57:12.430 INFO:teuthology.orchestra.run.trial091.stdout: osd default data pool replay window = 5 2026-02-12T03:57:12.430 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:57:12.430 INFO:teuthology.orchestra.run.trial091.stdout: mon allow pool delete = true 2026-02-12T03:57:12.430 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:57:12.430 INFO:teuthology.orchestra.run.trial091.stdout: mon cluster log file level = debug 2026-02-12T03:57:12.430 INFO:teuthology.orchestra.run.trial091.stdout: debug asserts on shutdown = true 2026-02-12T03:57:12.430 INFO:teuthology.orchestra.run.trial091.stdout: mon health detail to clog = false 2026-02-12T03:57:12.430 INFO:teuthology.orchestra.run.trial091.stdout: mon host = "[v1:10.20.193.91:6789],[v1:10.20.193.98:6789],[v1:10.20.193.111:6789]" 2026-02-12T03:57:12.430 INFO:teuthology.orchestra.run.trial091.stdout: mon client directed command retry = 5 2026-02-12T03:57:12.431 INFO:teuthology.orchestra.run.trial091.stdout: mon election default strategy = 3 2026-02-12T03:57:12.431 INFO:teuthology.orchestra.run.trial091.stdout: ms bind msgr2 = False 2026-02-12T03:57:12.431 INFO:teuthology.orchestra.run.trial091.stdout: ms inject socket failures = 5000 2026-02-12T03:57:12.431 INFO:teuthology.orchestra.run.trial091.stdout: ms type = async 2026-02-12T03:57:12.431 INFO:teuthology.orchestra.run.trial091.stdout: osd heartbeat grace = 160 2026-02-12T03:57:12.431 INFO:teuthology.orchestra.run.trial091.stdout: osd op thread timeout = 150 2026-02-12T03:57:12.431 INFO:teuthology.orchestra.run.trial091.stdout: fsid = 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:57:12.431 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:57:12.431 INFO:teuthology.orchestra.run.trial091.stdout:[osd] 2026-02-12T03:57:12.431 INFO:teuthology.orchestra.run.trial091.stdout: osd journal size = 100 2026-02-12T03:57:12.431 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:57:12.431 INFO:teuthology.orchestra.run.trial091.stdout: osd scrub load threshold = 5.0 2026-02-12T03:57:12.432 INFO:teuthology.orchestra.run.trial091.stdout: osd scrub max interval = 600 2026-02-12T03:57:12.432 INFO:teuthology.orchestra.run.trial091.stdout: osd mclock profile = high_recovery_ops 2026-02-12T03:57:12.432 INFO:teuthology.orchestra.run.trial091.stdout: osd mclock skip benchmark = True 2026-02-12T03:57:12.432 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:57:12.432 INFO:teuthology.orchestra.run.trial091.stdout: osd recover clone overlap = true 2026-02-12T03:57:12.432 INFO:teuthology.orchestra.run.trial091.stdout: osd recovery max chunk = 1048576 2026-02-12T03:57:12.432 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:57:12.432 INFO:teuthology.orchestra.run.trial091.stdout: osd debug shutdown = true 2026-02-12T03:57:12.432 INFO:teuthology.orchestra.run.trial091.stdout: osd debug op order = true 2026-02-12T03:57:12.432 INFO:teuthology.orchestra.run.trial091.stdout: osd debug verify stray on activate = true 2026-02-12T03:57:12.432 INFO:teuthology.orchestra.run.trial091.stdout: osd debug trim objects = true 2026-02-12T03:57:12.432 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:57:12.433 INFO:teuthology.orchestra.run.trial091.stdout: osd open classes on start = true 2026-02-12T03:57:12.433 INFO:teuthology.orchestra.run.trial091.stdout: osd debug pg log writeout = true 2026-02-12T03:57:12.433 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:57:12.433 INFO:teuthology.orchestra.run.trial091.stdout: osd deep scrub update digest min age = 30 2026-02-12T03:57:12.433 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:57:12.433 INFO:teuthology.orchestra.run.trial091.stdout: osd map max advance = 10 2026-02-12T03:57:12.433 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:57:12.433 INFO:teuthology.orchestra.run.trial091.stdout: journal zero on create = true 2026-02-12T03:57:12.433 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:57:12.433 INFO:teuthology.orchestra.run.trial091.stdout: filestore ondisk finisher threads = 3 2026-02-12T03:57:12.433 INFO:teuthology.orchestra.run.trial091.stdout: filestore apply finisher threads = 3 2026-02-12T03:57:12.433 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:57:12.434 INFO:teuthology.orchestra.run.trial091.stdout: bdev debug aio = true 2026-02-12T03:57:12.434 INFO:teuthology.orchestra.run.trial091.stdout: osd debug misdirected ops = true 2026-02-12T03:57:12.434 INFO:teuthology.orchestra.run.trial091.stdout: bdev async discard = True 2026-02-12T03:57:12.434 INFO:teuthology.orchestra.run.trial091.stdout: bdev enable discard = True 2026-02-12T03:57:12.434 INFO:teuthology.orchestra.run.trial091.stdout: bluestore allocator = btree 2026-02-12T03:57:12.434 INFO:teuthology.orchestra.run.trial091.stdout: bluestore block size = 96636764160 2026-02-12T03:57:12.434 INFO:teuthology.orchestra.run.trial091.stdout: bluestore compression algorithm = zstd 2026-02-12T03:57:12.434 INFO:teuthology.orchestra.run.trial091.stdout: bluestore compression mode = aggressive 2026-02-12T03:57:12.434 INFO:teuthology.orchestra.run.trial091.stdout: bluestore fsck on mount = True 2026-02-12T03:57:12.434 INFO:teuthology.orchestra.run.trial091.stdout: bluestore onode segment size = 512K 2026-02-12T03:57:12.434 INFO:teuthology.orchestra.run.trial091.stdout: bluestore write v2 = True 2026-02-12T03:57:12.434 INFO:teuthology.orchestra.run.trial091.stdout: bluestore zero block detection = True 2026-02-12T03:57:12.434 INFO:teuthology.orchestra.run.trial091.stdout: crush location = root=default host=host-$id 2026-02-12T03:57:12.435 INFO:teuthology.orchestra.run.trial091.stdout: debug bluefs = 1 2026-02-12T03:57:12.435 INFO:teuthology.orchestra.run.trial091.stdout: debug bluestore = 1 2026-02-12T03:57:12.435 INFO:teuthology.orchestra.run.trial091.stdout: debug monc = 20 2026-02-12T03:57:12.435 INFO:teuthology.orchestra.run.trial091.stdout: debug ms = 1 2026-02-12T03:57:12.435 INFO:teuthology.orchestra.run.trial091.stdout: debug osd = 20 2026-02-12T03:57:12.435 INFO:teuthology.orchestra.run.trial091.stdout: debug rocksdb = 10 2026-02-12T03:57:12.435 INFO:teuthology.orchestra.run.trial091.stdout: mon osd backfillfull_ratio = 0.85 2026-02-12T03:57:12.435 INFO:teuthology.orchestra.run.trial091.stdout: mon osd full ratio = 0.9 2026-02-12T03:57:12.435 INFO:teuthology.orchestra.run.trial091.stdout: mon osd nearfull ratio = 0.8 2026-02-12T03:57:12.435 INFO:teuthology.orchestra.run.trial091.stdout: osd class default list = * 2026-02-12T03:57:12.435 INFO:teuthology.orchestra.run.trial091.stdout: osd class load list = * 2026-02-12T03:57:12.435 INFO:teuthology.orchestra.run.trial091.stdout: osd client watch timeout = 240 2026-02-12T03:57:12.435 INFO:teuthology.orchestra.run.trial091.stdout: osd debug verify cached snaps = True 2026-02-12T03:57:12.436 INFO:teuthology.orchestra.run.trial091.stdout: osd debug verify missing on start = True 2026-02-12T03:57:12.436 INFO:teuthology.orchestra.run.trial091.stdout: osd failsafe full ratio = 0.95 2026-02-12T03:57:12.436 INFO:teuthology.orchestra.run.trial091.stdout: osd fast shutdown = False 2026-02-12T03:57:12.436 INFO:teuthology.orchestra.run.trial091.stdout: osd mclock override recovery settings = True 2026-02-12T03:57:12.436 INFO:teuthology.orchestra.run.trial091.stdout: osd objectstore = bluestore 2026-02-12T03:57:12.436 INFO:teuthology.orchestra.run.trial091.stdout: osd op queue = debug_random 2026-02-12T03:57:12.436 INFO:teuthology.orchestra.run.trial091.stdout: osd op queue cut off = debug_random 2026-02-12T03:57:12.436 INFO:teuthology.orchestra.run.trial091.stdout: osd shutdown pgref assert = True 2026-02-12T03:57:12.436 INFO:teuthology.orchestra.run.trial091.stdout: osd_mclock_skip_benchmark = True 2026-02-12T03:57:12.436 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:57:12.436 INFO:teuthology.orchestra.run.trial091.stdout:[mgr] 2026-02-12T03:57:12.436 INFO:teuthology.orchestra.run.trial091.stdout: debug ms = 1 2026-02-12T03:57:12.436 INFO:teuthology.orchestra.run.trial091.stdout: debug mgr = 20 2026-02-12T03:57:12.437 INFO:teuthology.orchestra.run.trial091.stdout: debug mon = 20 2026-02-12T03:57:12.437 INFO:teuthology.orchestra.run.trial091.stdout: debug auth = 20 2026-02-12T03:57:12.437 INFO:teuthology.orchestra.run.trial091.stdout: mon reweight min pgs per osd = 4 2026-02-12T03:57:12.437 INFO:teuthology.orchestra.run.trial091.stdout: mon reweight min bytes per osd = 10 2026-02-12T03:57:12.437 INFO:teuthology.orchestra.run.trial091.stdout: mgr/telemetry/nag = false 2026-02-12T03:57:12.437 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:57:12.437 INFO:teuthology.orchestra.run.trial091.stdout:[mon] 2026-02-12T03:57:12.437 INFO:teuthology.orchestra.run.trial091.stdout: debug ms = 1 2026-02-12T03:57:12.437 INFO:teuthology.orchestra.run.trial091.stdout: debug mon = 20 2026-02-12T03:57:12.437 INFO:teuthology.orchestra.run.trial091.stdout: debug paxos = 20 2026-02-12T03:57:12.437 INFO:teuthology.orchestra.run.trial091.stdout: debug auth = 20 2026-02-12T03:57:12.437 INFO:teuthology.orchestra.run.trial091.stdout: mon data avail warn = 5 2026-02-12T03:57:12.438 INFO:teuthology.orchestra.run.trial091.stdout: mon mgr mkfs grace = 240 2026-02-12T03:57:12.438 INFO:teuthology.orchestra.run.trial091.stdout: mon reweight min pgs per osd = 4 2026-02-12T03:57:12.438 INFO:teuthology.orchestra.run.trial091.stdout: mon osd reporter subtree level = osd 2026-02-12T03:57:12.438 INFO:teuthology.orchestra.run.trial091.stdout: mon osd prime pg temp = true 2026-02-12T03:57:12.438 INFO:teuthology.orchestra.run.trial091.stdout: mon reweight min bytes per osd = 10 2026-02-12T03:57:12.438 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:57:12.438 INFO:teuthology.orchestra.run.trial091.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-12T03:57:12.438 INFO:teuthology.orchestra.run.trial091.stdout: auth mon ticket ttl = 660 # 11m 2026-02-12T03:57:12.438 INFO:teuthology.orchestra.run.trial091.stdout: auth service ticket ttl = 240 # 4m 2026-02-12T03:57:12.438 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:57:12.438 INFO:teuthology.orchestra.run.trial091.stdout: # don't complain about insecure global_id in the test suite 2026-02-12T03:57:12.438 INFO:teuthology.orchestra.run.trial091.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-12T03:57:12.438 INFO:teuthology.orchestra.run.trial091.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-12T03:57:12.439 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:57:12.439 INFO:teuthology.orchestra.run.trial091.stdout: # 1m isn't quite enough 2026-02-12T03:57:12.439 INFO:teuthology.orchestra.run.trial091.stdout: mon_down_mkfs_grace = 2m 2026-02-12T03:57:12.439 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:57:12.439 INFO:teuthology.orchestra.run.trial091.stdout: mon_warn_on_filestore_osds = false 2026-02-12T03:57:12.439 INFO:teuthology.orchestra.run.trial091.stdout: mon min osdmap epochs = 50 2026-02-12T03:57:12.439 INFO:teuthology.orchestra.run.trial091.stdout: mon osd crush smoke test = False 2026-02-12T03:57:12.439 INFO:teuthology.orchestra.run.trial091.stdout: mon osdmap full prune interval = 2 2026-02-12T03:57:12.439 INFO:teuthology.orchestra.run.trial091.stdout: mon osdmap full prune min = 15 2026-02-12T03:57:12.439 INFO:teuthology.orchestra.run.trial091.stdout: mon osdmap full prune txsize = 2 2026-02-12T03:57:12.439 INFO:teuthology.orchestra.run.trial091.stdout: mon scrub interval = 300 2026-02-12T03:57:12.439 INFO:teuthology.orchestra.run.trial091.stdout: mon warn on pool no app = False 2026-02-12T03:57:12.440 INFO:teuthology.orchestra.run.trial091.stdout: paxos service trim min = 10 2026-02-12T03:57:12.440 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:57:12.440 INFO:teuthology.orchestra.run.trial091.stdout:[client] 2026-02-12T03:57:12.440 INFO:teuthology.orchestra.run.trial091.stdout: rgw cache enabled = true 2026-02-12T03:57:12.440 INFO:teuthology.orchestra.run.trial091.stdout: rgw enable ops log = true 2026-02-12T03:57:12.440 INFO:teuthology.orchestra.run.trial091.stdout: rgw enable usage log = true 2026-02-12T03:57:12.440 INFO:teuthology.orchestra.run.trial091.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-12T03:57:12.440 INFO:teuthology.orchestra.run.trial091.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-12T03:57:12.440 INFO:teuthology.orchestra.run.trial091.stdout: debug monc = 20 2026-02-12T03:57:12.440 INFO:teuthology.orchestra.run.trial091.stdout: debug ms = 1 2026-02-12T03:57:12.440 INFO:teuthology.orchestra.run.trial091.stdout: debug objecter = 20 2026-02-12T03:57:12.440 INFO:teuthology.orchestra.run.trial091.stdout: debug rados = 20 2026-02-12T03:57:12.440 INFO:teuthology.orchestra.run.trial091.stdout: rados replica read policy = balance 2026-02-12T03:57:12.441 INFO:teuthology.orchestra.run.trial091.stdout:[mon.a] 2026-02-12T03:57:12.441 INFO:teuthology.orchestra.run.trial091.stdout:[mon.b] 2026-02-12T03:57:12.441 INFO:teuthology.orchestra.run.trial091.stdout:[mon.c] 2026-02-12T03:57:12.442 INFO:teuthology.orchestra.run.trial154.stdout:[global] 2026-02-12T03:57:12.442 INFO:teuthology.orchestra.run.trial154.stdout: chdir = "" 2026-02-12T03:57:12.442 INFO:teuthology.orchestra.run.trial154.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-12T03:57:12.442 INFO:teuthology.orchestra.run.trial154.stdout: auth supported = cephx 2026-02-12T03:57:12.442 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:57:12.442 INFO:teuthology.orchestra.run.trial154.stdout: filestore xattr use omap = true 2026-02-12T03:57:12.442 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:57:12.443 INFO:teuthology.orchestra.run.trial154.stdout: mon clock drift allowed = 1.000 2026-02-12T03:57:12.443 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:57:12.443 INFO:teuthology.orchestra.run.trial154.stdout: osd crush chooseleaf type = 0 2026-02-12T03:57:12.443 INFO:teuthology.orchestra.run.trial154.stdout: auth debug = true 2026-02-12T03:57:12.443 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:57:12.443 INFO:teuthology.orchestra.run.trial154.stdout: ms die on old message = true 2026-02-12T03:57:12.443 INFO:teuthology.orchestra.run.trial154.stdout: ms die on bug = true 2026-02-12T03:57:12.443 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:57:12.443 INFO:teuthology.orchestra.run.trial154.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-12T03:57:12.443 INFO:teuthology.orchestra.run.trial154.stdout: mon pg warn max object skew = 0 2026-02-12T03:57:12.443 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:57:12.444 INFO:teuthology.orchestra.run.trial154.stdout: # disable pg_autoscaler by default for new pools 2026-02-12T03:57:12.444 INFO:teuthology.orchestra.run.trial154.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-12T03:57:12.444 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:57:12.444 INFO:teuthology.orchestra.run.trial154.stdout: osd pool default size = 2 2026-02-12T03:57:12.444 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:57:12.444 INFO:teuthology.orchestra.run.trial154.stdout: mon osd allow primary affinity = true 2026-02-12T03:57:12.444 INFO:teuthology.orchestra.run.trial154.stdout: mon osd allow pg remap = true 2026-02-12T03:57:12.444 INFO:teuthology.orchestra.run.trial154.stdout: mon warn on legacy crush tunables = false 2026-02-12T03:57:12.444 INFO:teuthology.orchestra.run.trial154.stdout: mon warn on crush straw calc version zero = false 2026-02-12T03:57:12.444 INFO:teuthology.orchestra.run.trial154.stdout: mon warn on no sortbitwise = false 2026-02-12T03:57:12.444 INFO:teuthology.orchestra.run.trial154.stdout: mon warn on osd down out interval zero = false 2026-02-12T03:57:12.444 INFO:teuthology.orchestra.run.trial154.stdout: mon warn on too few osds = false 2026-02-12T03:57:12.444 INFO:teuthology.orchestra.run.trial154.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-12T03:57:12.445 INFO:teuthology.orchestra.run.trial154.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-12T03:57:12.445 INFO:teuthology.orchestra.run.trial154.stdout: mon_allow_pool_size_one = true 2026-02-12T03:57:12.445 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:57:12.445 INFO:teuthology.orchestra.run.trial154.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-12T03:57:12.445 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:57:12.445 INFO:teuthology.orchestra.run.trial154.stdout: osd default data pool replay window = 5 2026-02-12T03:57:12.445 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:57:12.445 INFO:teuthology.orchestra.run.trial154.stdout: mon allow pool delete = true 2026-02-12T03:57:12.445 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:57:12.445 INFO:teuthology.orchestra.run.trial154.stdout: mon cluster log file level = debug 2026-02-12T03:57:12.445 INFO:teuthology.orchestra.run.trial154.stdout: debug asserts on shutdown = true 2026-02-12T03:57:12.445 INFO:teuthology.orchestra.run.trial154.stdout: mon health detail to clog = false 2026-02-12T03:57:12.446 INFO:teuthology.orchestra.run.trial154.stdout: mon host = "[v1:10.20.193.91:6789],[v1:10.20.193.98:6789],[v1:10.20.193.111:6789]" 2026-02-12T03:57:12.446 INFO:teuthology.orchestra.run.trial154.stdout: mon client directed command retry = 5 2026-02-12T03:57:12.446 INFO:teuthology.orchestra.run.trial154.stdout: mon election default strategy = 3 2026-02-12T03:57:12.446 INFO:teuthology.orchestra.run.trial154.stdout: ms bind msgr2 = False 2026-02-12T03:57:12.446 INFO:teuthology.orchestra.run.trial154.stdout: ms inject socket failures = 5000 2026-02-12T03:57:12.446 INFO:teuthology.orchestra.run.trial154.stdout: ms type = async 2026-02-12T03:57:12.446 INFO:teuthology.orchestra.run.trial154.stdout: osd heartbeat grace = 160 2026-02-12T03:57:12.446 INFO:teuthology.orchestra.run.trial154.stdout: osd op thread timeout = 150 2026-02-12T03:57:12.446 INFO:teuthology.orchestra.run.trial154.stdout: fsid = 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:57:12.446 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:57:12.446 INFO:teuthology.orchestra.run.trial154.stdout:[osd] 2026-02-12T03:57:12.446 INFO:teuthology.orchestra.run.trial154.stdout: osd journal size = 100 2026-02-12T03:57:12.447 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:57:12.447 INFO:teuthology.orchestra.run.trial154.stdout: osd scrub load threshold = 5.0 2026-02-12T03:57:12.447 INFO:teuthology.orchestra.run.trial154.stdout: osd scrub max interval = 600 2026-02-12T03:57:12.447 INFO:teuthology.orchestra.run.trial154.stdout: osd mclock profile = high_recovery_ops 2026-02-12T03:57:12.447 INFO:teuthology.orchestra.run.trial154.stdout: osd mclock skip benchmark = True 2026-02-12T03:57:12.447 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:57:12.447 INFO:teuthology.orchestra.run.trial154.stdout: osd recover clone overlap = true 2026-02-12T03:57:12.447 INFO:teuthology.orchestra.run.trial154.stdout: osd recovery max chunk = 1048576 2026-02-12T03:57:12.447 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:57:12.447 INFO:teuthology.orchestra.run.trial154.stdout: osd debug shutdown = true 2026-02-12T03:57:12.447 INFO:teuthology.orchestra.run.trial154.stdout: osd debug op order = true 2026-02-12T03:57:12.447 INFO:teuthology.orchestra.run.trial154.stdout: osd debug verify stray on activate = true 2026-02-12T03:57:12.448 INFO:teuthology.orchestra.run.trial154.stdout: osd debug trim objects = true 2026-02-12T03:57:12.448 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:57:12.448 INFO:teuthology.orchestra.run.trial154.stdout: osd open classes on start = true 2026-02-12T03:57:12.448 INFO:teuthology.orchestra.run.trial154.stdout: osd debug pg log writeout = true 2026-02-12T03:57:12.448 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:57:12.448 INFO:teuthology.orchestra.run.trial154.stdout: osd deep scrub update digest min age = 30 2026-02-12T03:57:12.448 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:57:12.448 INFO:teuthology.orchestra.run.trial154.stdout: osd map max advance = 10 2026-02-12T03:57:12.448 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:57:12.448 INFO:teuthology.orchestra.run.trial154.stdout: journal zero on create = true 2026-02-12T03:57:12.448 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:57:12.448 INFO:teuthology.orchestra.run.trial154.stdout: filestore ondisk finisher threads = 3 2026-02-12T03:57:12.448 INFO:teuthology.orchestra.run.trial154.stdout: filestore apply finisher threads = 3 2026-02-12T03:57:12.449 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:57:12.449 INFO:teuthology.orchestra.run.trial154.stdout: bdev debug aio = true 2026-02-12T03:57:12.449 INFO:teuthology.orchestra.run.trial154.stdout: osd debug misdirected ops = true 2026-02-12T03:57:12.449 INFO:teuthology.orchestra.run.trial154.stdout: bdev async discard = True 2026-02-12T03:57:12.449 INFO:teuthology.orchestra.run.trial154.stdout: bdev enable discard = True 2026-02-12T03:57:12.449 INFO:teuthology.orchestra.run.trial154.stdout: bluestore allocator = btree 2026-02-12T03:57:12.449 INFO:teuthology.orchestra.run.trial154.stdout: bluestore block size = 96636764160 2026-02-12T03:57:12.449 INFO:teuthology.orchestra.run.trial154.stdout: bluestore compression algorithm = zstd 2026-02-12T03:57:12.449 INFO:teuthology.orchestra.run.trial154.stdout: bluestore compression mode = aggressive 2026-02-12T03:57:12.449 INFO:teuthology.orchestra.run.trial154.stdout: bluestore fsck on mount = True 2026-02-12T03:57:12.449 INFO:teuthology.orchestra.run.trial154.stdout: bluestore onode segment size = 512K 2026-02-12T03:57:12.449 INFO:teuthology.orchestra.run.trial154.stdout: bluestore write v2 = True 2026-02-12T03:57:12.449 INFO:teuthology.orchestra.run.trial154.stdout: bluestore zero block detection = True 2026-02-12T03:57:12.450 INFO:teuthology.orchestra.run.trial154.stdout: crush location = root=default host=host-$id 2026-02-12T03:57:12.450 INFO:teuthology.orchestra.run.trial154.stdout: debug bluefs = 1 2026-02-12T03:57:12.450 INFO:teuthology.orchestra.run.trial154.stdout: debug bluestore = 1 2026-02-12T03:57:12.450 INFO:teuthology.orchestra.run.trial154.stdout: debug monc = 20 2026-02-12T03:57:12.450 INFO:teuthology.orchestra.run.trial154.stdout: debug ms = 1 2026-02-12T03:57:12.450 INFO:teuthology.orchestra.run.trial154.stdout: debug osd = 20 2026-02-12T03:57:12.450 INFO:teuthology.orchestra.run.trial154.stdout: debug rocksdb = 10 2026-02-12T03:57:12.450 INFO:teuthology.orchestra.run.trial154.stdout: mon osd backfillfull_ratio = 0.85 2026-02-12T03:57:12.450 INFO:teuthology.orchestra.run.trial154.stdout: mon osd full ratio = 0.9 2026-02-12T03:57:12.450 INFO:teuthology.orchestra.run.trial154.stdout: mon osd nearfull ratio = 0.8 2026-02-12T03:57:12.450 INFO:teuthology.orchestra.run.trial154.stdout: osd class default list = * 2026-02-12T03:57:12.450 INFO:teuthology.orchestra.run.trial154.stdout: osd class load list = * 2026-02-12T03:57:12.450 INFO:teuthology.orchestra.run.trial154.stdout: osd client watch timeout = 240 2026-02-12T03:57:12.451 INFO:teuthology.orchestra.run.trial154.stdout: osd debug verify cached snaps = True 2026-02-12T03:57:12.451 INFO:teuthology.orchestra.run.trial154.stdout: osd debug verify missing on start = True 2026-02-12T03:57:12.451 INFO:teuthology.orchestra.run.trial154.stdout: osd failsafe full ratio = 0.95 2026-02-12T03:57:12.451 INFO:teuthology.orchestra.run.trial154.stdout: osd fast shutdown = False 2026-02-12T03:57:12.451 INFO:teuthology.orchestra.run.trial154.stdout: osd mclock override recovery settings = True 2026-02-12T03:57:12.451 INFO:teuthology.orchestra.run.trial154.stdout: osd objectstore = bluestore 2026-02-12T03:57:12.451 INFO:teuthology.orchestra.run.trial154.stdout: osd op queue = debug_random 2026-02-12T03:57:12.451 INFO:teuthology.orchestra.run.trial154.stdout: osd op queue cut off = debug_random 2026-02-12T03:57:12.451 INFO:teuthology.orchestra.run.trial154.stdout: osd shutdown pgref assert = True 2026-02-12T03:57:12.451 INFO:teuthology.orchestra.run.trial154.stdout: osd_mclock_skip_benchmark = True 2026-02-12T03:57:12.451 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:57:12.451 INFO:teuthology.orchestra.run.trial154.stdout:[mgr] 2026-02-12T03:57:12.452 INFO:teuthology.orchestra.run.trial154.stdout: debug ms = 1 2026-02-12T03:57:12.452 INFO:teuthology.orchestra.run.trial154.stdout: debug mgr = 20 2026-02-12T03:57:12.452 INFO:teuthology.orchestra.run.trial154.stdout: debug mon = 20 2026-02-12T03:57:12.452 INFO:teuthology.orchestra.run.trial154.stdout: debug auth = 20 2026-02-12T03:57:12.452 INFO:teuthology.orchestra.run.trial154.stdout: mon reweight min pgs per osd = 4 2026-02-12T03:57:12.452 INFO:teuthology.orchestra.run.trial154.stdout: mon reweight min bytes per osd = 10 2026-02-12T03:57:12.452 INFO:teuthology.orchestra.run.trial154.stdout: mgr/telemetry/nag = false 2026-02-12T03:57:12.452 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:57:12.452 INFO:teuthology.orchestra.run.trial154.stdout:[mon] 2026-02-12T03:57:12.452 INFO:teuthology.orchestra.run.trial154.stdout: debug ms = 1 2026-02-12T03:57:12.452 INFO:teuthology.orchestra.run.trial154.stdout: debug mon = 20 2026-02-12T03:57:12.452 INFO:teuthology.orchestra.run.trial154.stdout: debug paxos = 20 2026-02-12T03:57:12.453 INFO:teuthology.orchestra.run.trial154.stdout: debug auth = 20 2026-02-12T03:57:12.453 INFO:teuthology.orchestra.run.trial154.stdout: mon data avail warn = 5 2026-02-12T03:57:12.453 INFO:teuthology.orchestra.run.trial154.stdout: mon mgr mkfs grace = 240 2026-02-12T03:57:12.453 INFO:teuthology.orchestra.run.trial154.stdout: mon reweight min pgs per osd = 4 2026-02-12T03:57:12.453 INFO:teuthology.orchestra.run.trial154.stdout: mon osd reporter subtree level = osd 2026-02-12T03:57:12.453 INFO:teuthology.orchestra.run.trial154.stdout: mon osd prime pg temp = true 2026-02-12T03:57:12.453 INFO:teuthology.orchestra.run.trial154.stdout: mon reweight min bytes per osd = 10 2026-02-12T03:57:12.453 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:57:12.453 INFO:teuthology.orchestra.run.trial154.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-12T03:57:12.453 INFO:teuthology.orchestra.run.trial154.stdout: auth mon ticket ttl = 660 # 11m 2026-02-12T03:57:12.453 INFO:teuthology.orchestra.run.trial154.stdout: auth service ticket ttl = 240 # 4m 2026-02-12T03:57:12.453 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:57:12.453 INFO:teuthology.orchestra.run.trial154.stdout: # don't complain about insecure global_id in the test suite 2026-02-12T03:57:12.454 INFO:teuthology.orchestra.run.trial154.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-12T03:57:12.454 INFO:teuthology.orchestra.run.trial154.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-12T03:57:12.454 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:57:12.454 INFO:teuthology.orchestra.run.trial154.stdout: # 1m isn't quite enough 2026-02-12T03:57:12.454 INFO:teuthology.orchestra.run.trial154.stdout: mon_down_mkfs_grace = 2m 2026-02-12T03:57:12.454 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:57:12.454 INFO:teuthology.orchestra.run.trial154.stdout: mon_warn_on_filestore_osds = false 2026-02-12T03:57:12.454 INFO:teuthology.orchestra.run.trial154.stdout: mon min osdmap epochs = 50 2026-02-12T03:57:12.454 INFO:teuthology.orchestra.run.trial154.stdout: mon osd crush smoke test = False 2026-02-12T03:57:12.454 INFO:teuthology.orchestra.run.trial154.stdout: mon osdmap full prune interval = 2 2026-02-12T03:57:12.454 INFO:teuthology.orchestra.run.trial154.stdout: mon osdmap full prune min = 15 2026-02-12T03:57:12.454 INFO:teuthology.orchestra.run.trial154.stdout: mon osdmap full prune txsize = 2 2026-02-12T03:57:12.454 INFO:teuthology.orchestra.run.trial154.stdout: mon scrub interval = 300 2026-02-12T03:57:12.455 INFO:teuthology.orchestra.run.trial154.stdout: mon warn on pool no app = False 2026-02-12T03:57:12.455 INFO:teuthology.orchestra.run.trial154.stdout: paxos service trim min = 10 2026-02-12T03:57:12.455 INFO:teuthology.orchestra.run.trial154.stdout: 2026-02-12T03:57:12.455 INFO:teuthology.orchestra.run.trial154.stdout:[client] 2026-02-12T03:57:12.455 INFO:teuthology.orchestra.run.trial154.stdout: rgw cache enabled = true 2026-02-12T03:57:12.455 INFO:teuthology.orchestra.run.trial154.stdout: rgw enable ops log = true 2026-02-12T03:57:12.455 INFO:teuthology.orchestra.run.trial154.stdout: rgw enable usage log = true 2026-02-12T03:57:12.455 INFO:teuthology.orchestra.run.trial154.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-12T03:57:12.455 INFO:teuthology.orchestra.run.trial154.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-12T03:57:12.455 INFO:teuthology.orchestra.run.trial154.stdout: debug monc = 20 2026-02-12T03:57:12.455 INFO:teuthology.orchestra.run.trial154.stdout: debug ms = 1 2026-02-12T03:57:12.455 INFO:teuthology.orchestra.run.trial154.stdout: debug objecter = 20 2026-02-12T03:57:12.456 INFO:teuthology.orchestra.run.trial154.stdout: debug rados = 20 2026-02-12T03:57:12.456 INFO:teuthology.orchestra.run.trial154.stdout: rados replica read policy = balance 2026-02-12T03:57:12.456 INFO:teuthology.orchestra.run.trial154.stdout:[mon.a] 2026-02-12T03:57:12.456 INFO:teuthology.orchestra.run.trial154.stdout:[mon.b] 2026-02-12T03:57:12.456 INFO:teuthology.orchestra.run.trial154.stdout:[mon.c] 2026-02-12T03:57:12.456 INFO:teuthology.orchestra.run.trial111.stdout:[global] 2026-02-12T03:57:12.456 INFO:teuthology.orchestra.run.trial111.stdout: chdir = "" 2026-02-12T03:57:12.456 INFO:teuthology.orchestra.run.trial111.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-12T03:57:12.456 INFO:teuthology.orchestra.run.trial111.stdout: auth supported = cephx 2026-02-12T03:57:12.456 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:57:12.456 INFO:teuthology.orchestra.run.trial111.stdout: filestore xattr use omap = true 2026-02-12T03:57:12.457 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:57:12.457 INFO:teuthology.orchestra.run.trial111.stdout: mon clock drift allowed = 1.000 2026-02-12T03:57:12.457 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:57:12.457 INFO:teuthology.orchestra.run.trial111.stdout: osd crush chooseleaf type = 0 2026-02-12T03:57:12.457 INFO:teuthology.orchestra.run.trial111.stdout: auth debug = true 2026-02-12T03:57:12.457 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:57:12.457 INFO:teuthology.orchestra.run.trial111.stdout: ms die on old message = true 2026-02-12T03:57:12.457 INFO:teuthology.orchestra.run.trial111.stdout: ms die on bug = true 2026-02-12T03:57:12.457 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:57:12.457 INFO:teuthology.orchestra.run.trial111.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-12T03:57:12.457 INFO:teuthology.orchestra.run.trial111.stdout: mon pg warn max object skew = 0 2026-02-12T03:57:12.457 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:57:12.458 INFO:teuthology.orchestra.run.trial111.stdout: # disable pg_autoscaler by default for new pools 2026-02-12T03:57:12.458 INFO:teuthology.orchestra.run.trial111.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-12T03:57:12.458 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:57:12.458 INFO:teuthology.orchestra.run.trial111.stdout: osd pool default size = 2 2026-02-12T03:57:12.458 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:57:12.458 INFO:teuthology.orchestra.run.trial111.stdout: mon osd allow primary affinity = true 2026-02-12T03:57:12.458 INFO:teuthology.orchestra.run.trial111.stdout: mon osd allow pg remap = true 2026-02-12T03:57:12.458 INFO:teuthology.orchestra.run.trial111.stdout: mon warn on legacy crush tunables = false 2026-02-12T03:57:12.458 INFO:teuthology.orchestra.run.trial111.stdout: mon warn on crush straw calc version zero = false 2026-02-12T03:57:12.458 INFO:teuthology.orchestra.run.trial111.stdout: mon warn on no sortbitwise = false 2026-02-12T03:57:12.458 INFO:teuthology.orchestra.run.trial111.stdout: mon warn on osd down out interval zero = false 2026-02-12T03:57:12.458 INFO:teuthology.orchestra.run.trial111.stdout: mon warn on too few osds = false 2026-02-12T03:57:12.458 INFO:teuthology.orchestra.run.trial111.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-12T03:57:12.459 INFO:teuthology.orchestra.run.trial111.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-12T03:57:12.459 INFO:teuthology.orchestra.run.trial111.stdout: mon_allow_pool_size_one = true 2026-02-12T03:57:12.459 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:57:12.459 INFO:teuthology.orchestra.run.trial111.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-12T03:57:12.459 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:57:12.459 INFO:teuthology.orchestra.run.trial111.stdout: osd default data pool replay window = 5 2026-02-12T03:57:12.459 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:57:12.459 INFO:teuthology.orchestra.run.trial111.stdout: mon allow pool delete = true 2026-02-12T03:57:12.459 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:57:12.459 INFO:teuthology.orchestra.run.trial111.stdout: mon cluster log file level = debug 2026-02-12T03:57:12.459 INFO:teuthology.orchestra.run.trial111.stdout: debug asserts on shutdown = true 2026-02-12T03:57:12.459 INFO:teuthology.orchestra.run.trial111.stdout: mon health detail to clog = false 2026-02-12T03:57:12.459 INFO:teuthology.orchestra.run.trial111.stdout: mon host = "[v1:10.20.193.91:6789],[v1:10.20.193.98:6789],[v1:10.20.193.111:6789]" 2026-02-12T03:57:12.460 INFO:teuthology.orchestra.run.trial111.stdout: mon client directed command retry = 5 2026-02-12T03:57:12.460 INFO:teuthology.orchestra.run.trial111.stdout: mon election default strategy = 3 2026-02-12T03:57:12.460 INFO:teuthology.orchestra.run.trial111.stdout: ms bind msgr2 = False 2026-02-12T03:57:12.460 INFO:teuthology.orchestra.run.trial111.stdout: ms inject socket failures = 5000 2026-02-12T03:57:12.460 INFO:teuthology.orchestra.run.trial111.stdout: ms type = async 2026-02-12T03:57:12.460 INFO:teuthology.orchestra.run.trial111.stdout: osd heartbeat grace = 160 2026-02-12T03:57:12.460 INFO:teuthology.orchestra.run.trial111.stdout: osd op thread timeout = 150 2026-02-12T03:57:12.460 INFO:teuthology.orchestra.run.trial111.stdout: fsid = 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:57:12.460 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:57:12.460 INFO:teuthology.orchestra.run.trial111.stdout:[osd] 2026-02-12T03:57:12.460 INFO:teuthology.orchestra.run.trial111.stdout: osd journal size = 100 2026-02-12T03:57:12.460 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:57:12.460 INFO:teuthology.orchestra.run.trial111.stdout: osd scrub load threshold = 5.0 2026-02-12T03:57:12.461 INFO:teuthology.orchestra.run.trial111.stdout: osd scrub max interval = 600 2026-02-12T03:57:12.461 INFO:teuthology.orchestra.run.trial111.stdout: osd mclock profile = high_recovery_ops 2026-02-12T03:57:12.461 INFO:teuthology.orchestra.run.trial111.stdout: osd mclock skip benchmark = True 2026-02-12T03:57:12.461 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:57:12.461 INFO:teuthology.orchestra.run.trial111.stdout: osd recover clone overlap = true 2026-02-12T03:57:12.461 INFO:teuthology.orchestra.run.trial111.stdout: osd recovery max chunk = 1048576 2026-02-12T03:57:12.461 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:57:12.461 INFO:teuthology.orchestra.run.trial111.stdout: osd debug shutdown = true 2026-02-12T03:57:12.461 INFO:teuthology.orchestra.run.trial111.stdout: osd debug op order = true 2026-02-12T03:57:12.461 INFO:teuthology.orchestra.run.trial111.stdout: osd debug verify stray on activate = true 2026-02-12T03:57:12.461 INFO:teuthology.orchestra.run.trial111.stdout: osd debug trim objects = true 2026-02-12T03:57:12.461 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:57:12.461 INFO:teuthology.orchestra.run.trial111.stdout: osd open classes on start = true 2026-02-12T03:57:12.461 INFO:teuthology.orchestra.run.trial111.stdout: osd debug pg log writeout = true 2026-02-12T03:57:12.461 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:57:12.462 INFO:teuthology.orchestra.run.trial111.stdout: osd deep scrub update digest min age = 30 2026-02-12T03:57:12.462 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:57:12.462 INFO:teuthology.orchestra.run.trial111.stdout: osd map max advance = 10 2026-02-12T03:57:12.462 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:57:12.462 INFO:teuthology.orchestra.run.trial111.stdout: journal zero on create = true 2026-02-12T03:57:12.462 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:57:12.462 INFO:teuthology.orchestra.run.trial111.stdout: filestore ondisk finisher threads = 3 2026-02-12T03:57:12.462 INFO:teuthology.orchestra.run.trial111.stdout: filestore apply finisher threads = 3 2026-02-12T03:57:12.462 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:57:12.462 INFO:teuthology.orchestra.run.trial111.stdout: bdev debug aio = true 2026-02-12T03:57:12.462 INFO:teuthology.orchestra.run.trial111.stdout: osd debug misdirected ops = true 2026-02-12T03:57:12.462 INFO:teuthology.orchestra.run.trial111.stdout: bdev async discard = True 2026-02-12T03:57:12.462 INFO:teuthology.orchestra.run.trial111.stdout: bdev enable discard = True 2026-02-12T03:57:12.462 INFO:teuthology.orchestra.run.trial111.stdout: bluestore allocator = btree 2026-02-12T03:57:12.463 INFO:teuthology.orchestra.run.trial111.stdout: bluestore block size = 96636764160 2026-02-12T03:57:12.463 INFO:teuthology.orchestra.run.trial111.stdout: bluestore compression algorithm = zstd 2026-02-12T03:57:12.463 INFO:teuthology.orchestra.run.trial111.stdout: bluestore compression mode = aggressive 2026-02-12T03:57:12.463 INFO:teuthology.orchestra.run.trial111.stdout: bluestore fsck on mount = True 2026-02-12T03:57:12.463 INFO:teuthology.orchestra.run.trial111.stdout: bluestore onode segment size = 512K 2026-02-12T03:57:12.463 INFO:teuthology.orchestra.run.trial111.stdout: bluestore write v2 = True 2026-02-12T03:57:12.463 INFO:teuthology.orchestra.run.trial111.stdout: bluestore zero block detection = True 2026-02-12T03:57:12.463 INFO:teuthology.orchestra.run.trial111.stdout: crush location = root=default host=host-$id 2026-02-12T03:57:12.463 INFO:teuthology.orchestra.run.trial111.stdout: debug bluefs = 1 2026-02-12T03:57:12.463 INFO:teuthology.orchestra.run.trial111.stdout: debug bluestore = 1 2026-02-12T03:57:12.463 INFO:teuthology.orchestra.run.trial111.stdout: debug monc = 20 2026-02-12T03:57:12.463 INFO:teuthology.orchestra.run.trial111.stdout: debug ms = 1 2026-02-12T03:57:12.463 INFO:teuthology.orchestra.run.trial111.stdout: debug osd = 20 2026-02-12T03:57:12.463 INFO:teuthology.orchestra.run.trial111.stdout: debug rocksdb = 10 2026-02-12T03:57:12.463 INFO:teuthology.orchestra.run.trial111.stdout: mon osd backfillfull_ratio = 0.85 2026-02-12T03:57:12.464 INFO:teuthology.orchestra.run.trial111.stdout: mon osd full ratio = 0.9 2026-02-12T03:57:12.464 INFO:teuthology.orchestra.run.trial111.stdout: mon osd nearfull ratio = 0.8 2026-02-12T03:57:12.464 INFO:teuthology.orchestra.run.trial111.stdout: osd class default list = * 2026-02-12T03:57:12.464 INFO:teuthology.orchestra.run.trial111.stdout: osd class load list = * 2026-02-12T03:57:12.464 INFO:teuthology.orchestra.run.trial111.stdout: osd client watch timeout = 240 2026-02-12T03:57:12.464 INFO:teuthology.orchestra.run.trial111.stdout: osd debug verify cached snaps = True 2026-02-12T03:57:12.464 INFO:teuthology.orchestra.run.trial111.stdout: osd debug verify missing on start = True 2026-02-12T03:57:12.464 INFO:teuthology.orchestra.run.trial111.stdout: osd failsafe full ratio = 0.95 2026-02-12T03:57:12.464 INFO:teuthology.orchestra.run.trial111.stdout: osd fast shutdown = False 2026-02-12T03:57:12.464 INFO:teuthology.orchestra.run.trial111.stdout: osd mclock override recovery settings = True 2026-02-12T03:57:12.464 INFO:teuthology.orchestra.run.trial111.stdout: osd objectstore = bluestore 2026-02-12T03:57:12.464 INFO:teuthology.orchestra.run.trial111.stdout: osd op queue = debug_random 2026-02-12T03:57:12.464 INFO:teuthology.orchestra.run.trial111.stdout: osd op queue cut off = debug_random 2026-02-12T03:57:12.464 INFO:teuthology.orchestra.run.trial111.stdout: osd shutdown pgref assert = True 2026-02-12T03:57:12.464 INFO:teuthology.orchestra.run.trial111.stdout: osd_mclock_skip_benchmark = True 2026-02-12T03:57:12.465 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:57:12.465 INFO:teuthology.orchestra.run.trial111.stdout:[mgr] 2026-02-12T03:57:12.465 INFO:teuthology.orchestra.run.trial111.stdout: debug ms = 1 2026-02-12T03:57:12.465 INFO:teuthology.orchestra.run.trial111.stdout: debug mgr = 20 2026-02-12T03:57:12.465 INFO:teuthology.orchestra.run.trial111.stdout: debug mon = 20 2026-02-12T03:57:12.465 INFO:teuthology.orchestra.run.trial111.stdout: debug auth = 20 2026-02-12T03:57:12.465 INFO:teuthology.orchestra.run.trial111.stdout: mon reweight min pgs per osd = 4 2026-02-12T03:57:12.465 INFO:teuthology.orchestra.run.trial111.stdout: mon reweight min bytes per osd = 10 2026-02-12T03:57:12.465 INFO:teuthology.orchestra.run.trial111.stdout: mgr/telemetry/nag = false 2026-02-12T03:57:12.465 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:57:12.465 INFO:teuthology.orchestra.run.trial111.stdout:[mon] 2026-02-12T03:57:12.465 INFO:teuthology.orchestra.run.trial111.stdout: debug ms = 1 2026-02-12T03:57:12.465 INFO:teuthology.orchestra.run.trial111.stdout: debug mon = 20 2026-02-12T03:57:12.465 INFO:teuthology.orchestra.run.trial111.stdout: debug paxos = 20 2026-02-12T03:57:12.465 INFO:teuthology.orchestra.run.trial111.stdout: debug auth = 20 2026-02-12T03:57:12.465 INFO:teuthology.orchestra.run.trial111.stdout: mon data avail warn = 5 2026-02-12T03:57:12.466 INFO:teuthology.orchestra.run.trial111.stdout: mon mgr mkfs grace = 240 2026-02-12T03:57:12.466 INFO:teuthology.orchestra.run.trial111.stdout: mon reweight min pgs per osd = 4 2026-02-12T03:57:12.466 INFO:teuthology.orchestra.run.trial111.stdout: mon osd reporter subtree level = osd 2026-02-12T03:57:12.466 INFO:teuthology.orchestra.run.trial111.stdout: mon osd prime pg temp = true 2026-02-12T03:57:12.466 INFO:teuthology.orchestra.run.trial111.stdout: mon reweight min bytes per osd = 10 2026-02-12T03:57:12.466 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:57:12.466 INFO:teuthology.orchestra.run.trial111.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-12T03:57:12.466 INFO:teuthology.orchestra.run.trial111.stdout: auth mon ticket ttl = 660 # 11m 2026-02-12T03:57:12.466 INFO:teuthology.orchestra.run.trial111.stdout: auth service ticket ttl = 240 # 4m 2026-02-12T03:57:12.466 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:57:12.466 INFO:teuthology.orchestra.run.trial111.stdout: # don't complain about insecure global_id in the test suite 2026-02-12T03:57:12.466 INFO:teuthology.orchestra.run.trial111.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-12T03:57:12.466 INFO:teuthology.orchestra.run.trial111.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-12T03:57:12.466 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:57:12.466 INFO:teuthology.orchestra.run.trial111.stdout: # 1m isn't quite enough 2026-02-12T03:57:12.466 INFO:teuthology.orchestra.run.trial111.stdout: mon_down_mkfs_grace = 2m 2026-02-12T03:57:12.467 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:57:12.467 INFO:teuthology.orchestra.run.trial111.stdout: mon_warn_on_filestore_osds = false 2026-02-12T03:57:12.467 INFO:teuthology.orchestra.run.trial111.stdout: mon min osdmap epochs = 50 2026-02-12T03:57:12.467 INFO:teuthology.orchestra.run.trial111.stdout: mon osd crush smoke test = False 2026-02-12T03:57:12.467 INFO:teuthology.orchestra.run.trial111.stdout: mon osdmap full prune interval = 2 2026-02-12T03:57:12.467 INFO:teuthology.orchestra.run.trial111.stdout: mon osdmap full prune min = 15 2026-02-12T03:57:12.467 INFO:teuthology.orchestra.run.trial111.stdout: mon osdmap full prune txsize = 2 2026-02-12T03:57:12.467 INFO:teuthology.orchestra.run.trial111.stdout: mon scrub interval = 300 2026-02-12T03:57:12.467 INFO:teuthology.orchestra.run.trial111.stdout: mon warn on pool no app = False 2026-02-12T03:57:12.467 INFO:teuthology.orchestra.run.trial111.stdout: paxos service trim min = 10 2026-02-12T03:57:12.467 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T03:57:12.467 INFO:teuthology.orchestra.run.trial111.stdout:[client] 2026-02-12T03:57:12.467 INFO:teuthology.orchestra.run.trial111.stdout: rgw cache enabled = true 2026-02-12T03:57:12.467 INFO:teuthology.orchestra.run.trial111.stdout: rgw enable ops log = true 2026-02-12T03:57:12.467 INFO:teuthology.orchestra.run.trial111.stdout: rgw enable usage log = true 2026-02-12T03:57:12.467 INFO:teuthology.orchestra.run.trial111.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-12T03:57:12.467 INFO:teuthology.orchestra.run.trial111.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-12T03:57:12.468 INFO:teuthology.orchestra.run.trial111.stdout: debug monc = 20 2026-02-12T03:57:12.468 INFO:teuthology.orchestra.run.trial111.stdout: debug ms = 1 2026-02-12T03:57:12.468 INFO:teuthology.orchestra.run.trial111.stdout: debug objecter = 20 2026-02-12T03:57:12.468 INFO:teuthology.orchestra.run.trial111.stdout: debug rados = 20 2026-02-12T03:57:12.468 INFO:teuthology.orchestra.run.trial111.stdout: rados replica read policy = balance 2026-02-12T03:57:12.468 INFO:teuthology.orchestra.run.trial111.stdout:[mon.a] 2026-02-12T03:57:12.468 INFO:teuthology.orchestra.run.trial111.stdout:[mon.b] 2026-02-12T03:57:12.468 INFO:teuthology.orchestra.run.trial111.stdout:[mon.c] 2026-02-12T03:57:12.469 INFO:teuthology.orchestra.run.trial098.stdout:[global] 2026-02-12T03:57:12.469 INFO:teuthology.orchestra.run.trial098.stdout: chdir = "" 2026-02-12T03:57:12.469 INFO:teuthology.orchestra.run.trial098.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-12T03:57:12.469 INFO:teuthology.orchestra.run.trial098.stdout: auth supported = cephx 2026-02-12T03:57:12.469 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:57:12.469 INFO:teuthology.orchestra.run.trial098.stdout: filestore xattr use omap = true 2026-02-12T03:57:12.469 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:57:12.469 INFO:teuthology.orchestra.run.trial098.stdout: mon clock drift allowed = 1.000 2026-02-12T03:57:12.470 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:57:12.470 INFO:teuthology.orchestra.run.trial098.stdout: osd crush chooseleaf type = 0 2026-02-12T03:57:12.470 INFO:teuthology.orchestra.run.trial098.stdout: auth debug = true 2026-02-12T03:57:12.470 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:57:12.470 INFO:teuthology.orchestra.run.trial098.stdout: ms die on old message = true 2026-02-12T03:57:12.470 INFO:teuthology.orchestra.run.trial098.stdout: ms die on bug = true 2026-02-12T03:57:12.470 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:57:12.470 INFO:teuthology.orchestra.run.trial098.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-12T03:57:12.470 INFO:teuthology.orchestra.run.trial098.stdout: mon pg warn max object skew = 0 2026-02-12T03:57:12.470 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:57:12.470 INFO:teuthology.orchestra.run.trial098.stdout: # disable pg_autoscaler by default for new pools 2026-02-12T03:57:12.470 INFO:teuthology.orchestra.run.trial098.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-12T03:57:12.470 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:57:12.470 INFO:teuthology.orchestra.run.trial098.stdout: osd pool default size = 2 2026-02-12T03:57:12.470 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:57:12.470 INFO:teuthology.orchestra.run.trial098.stdout: mon osd allow primary affinity = true 2026-02-12T03:57:12.470 INFO:teuthology.orchestra.run.trial098.stdout: mon osd allow pg remap = true 2026-02-12T03:57:12.471 INFO:teuthology.orchestra.run.trial098.stdout: mon warn on legacy crush tunables = false 2026-02-12T03:57:12.471 INFO:teuthology.orchestra.run.trial098.stdout: mon warn on crush straw calc version zero = false 2026-02-12T03:57:12.471 INFO:teuthology.orchestra.run.trial098.stdout: mon warn on no sortbitwise = false 2026-02-12T03:57:12.471 INFO:teuthology.orchestra.run.trial098.stdout: mon warn on osd down out interval zero = false 2026-02-12T03:57:12.471 INFO:teuthology.orchestra.run.trial098.stdout: mon warn on too few osds = false 2026-02-12T03:57:12.471 INFO:teuthology.orchestra.run.trial098.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-12T03:57:12.471 INFO:teuthology.orchestra.run.trial098.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-12T03:57:12.471 INFO:teuthology.orchestra.run.trial098.stdout: mon_allow_pool_size_one = true 2026-02-12T03:57:12.471 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:57:12.471 INFO:teuthology.orchestra.run.trial098.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-12T03:57:12.471 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:57:12.471 INFO:teuthology.orchestra.run.trial098.stdout: osd default data pool replay window = 5 2026-02-12T03:57:12.471 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:57:12.471 INFO:teuthology.orchestra.run.trial098.stdout: mon allow pool delete = true 2026-02-12T03:57:12.471 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:57:12.471 INFO:teuthology.orchestra.run.trial098.stdout: mon cluster log file level = debug 2026-02-12T03:57:12.471 INFO:teuthology.orchestra.run.trial098.stdout: debug asserts on shutdown = true 2026-02-12T03:57:12.471 INFO:teuthology.orchestra.run.trial098.stdout: mon health detail to clog = false 2026-02-12T03:57:12.472 INFO:teuthology.orchestra.run.trial098.stdout: mon host = "[v1:10.20.193.91:6789],[v1:10.20.193.98:6789],[v1:10.20.193.111:6789]" 2026-02-12T03:57:12.472 INFO:teuthology.orchestra.run.trial098.stdout: mon client directed command retry = 5 2026-02-12T03:57:12.472 INFO:teuthology.orchestra.run.trial098.stdout: mon election default strategy = 3 2026-02-12T03:57:12.472 INFO:teuthology.orchestra.run.trial098.stdout: ms bind msgr2 = False 2026-02-12T03:57:12.472 INFO:teuthology.orchestra.run.trial098.stdout: ms inject socket failures = 5000 2026-02-12T03:57:12.472 INFO:teuthology.orchestra.run.trial098.stdout: ms type = async 2026-02-12T03:57:12.472 INFO:teuthology.orchestra.run.trial098.stdout: osd heartbeat grace = 160 2026-02-12T03:57:12.472 INFO:teuthology.orchestra.run.trial098.stdout: osd op thread timeout = 150 2026-02-12T03:57:12.472 INFO:teuthology.orchestra.run.trial098.stdout: fsid = 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:57:12.472 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:57:12.472 INFO:teuthology.orchestra.run.trial098.stdout:[osd] 2026-02-12T03:57:12.472 INFO:teuthology.orchestra.run.trial098.stdout: osd journal size = 100 2026-02-12T03:57:12.472 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:57:12.472 INFO:teuthology.orchestra.run.trial098.stdout: osd scrub load threshold = 5.0 2026-02-12T03:57:12.472 INFO:teuthology.orchestra.run.trial098.stdout: osd scrub max interval = 600 2026-02-12T03:57:12.472 INFO:teuthology.orchestra.run.trial098.stdout: osd mclock profile = high_recovery_ops 2026-02-12T03:57:12.472 INFO:teuthology.orchestra.run.trial098.stdout: osd mclock skip benchmark = True 2026-02-12T03:57:12.472 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:57:12.473 INFO:teuthology.orchestra.run.trial098.stdout: osd recover clone overlap = true 2026-02-12T03:57:12.473 INFO:teuthology.orchestra.run.trial098.stdout: osd recovery max chunk = 1048576 2026-02-12T03:57:12.473 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:57:12.473 INFO:teuthology.orchestra.run.trial098.stdout: osd debug shutdown = true 2026-02-12T03:57:12.473 INFO:teuthology.orchestra.run.trial098.stdout: osd debug op order = true 2026-02-12T03:57:12.473 INFO:teuthology.orchestra.run.trial098.stdout: osd debug verify stray on activate = true 2026-02-12T03:57:12.473 INFO:teuthology.orchestra.run.trial098.stdout: osd debug trim objects = true 2026-02-12T03:57:12.473 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:57:12.473 INFO:teuthology.orchestra.run.trial098.stdout: osd open classes on start = true 2026-02-12T03:57:12.473 INFO:teuthology.orchestra.run.trial098.stdout: osd debug pg log writeout = true 2026-02-12T03:57:12.473 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:57:12.473 INFO:teuthology.orchestra.run.trial098.stdout: osd deep scrub update digest min age = 30 2026-02-12T03:57:12.473 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:57:12.473 INFO:teuthology.orchestra.run.trial098.stdout: osd map max advance = 10 2026-02-12T03:57:12.473 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:57:12.473 INFO:teuthology.orchestra.run.trial098.stdout: journal zero on create = true 2026-02-12T03:57:12.473 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:57:12.473 INFO:teuthology.orchestra.run.trial098.stdout: filestore ondisk finisher threads = 3 2026-02-12T03:57:12.474 INFO:teuthology.orchestra.run.trial098.stdout: filestore apply finisher threads = 3 2026-02-12T03:57:12.474 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:57:12.474 INFO:teuthology.orchestra.run.trial098.stdout: bdev debug aio = true 2026-02-12T03:57:12.474 INFO:teuthology.orchestra.run.trial098.stdout: osd debug misdirected ops = true 2026-02-12T03:57:12.474 INFO:teuthology.orchestra.run.trial098.stdout: bdev async discard = True 2026-02-12T03:57:12.474 INFO:teuthology.orchestra.run.trial098.stdout: bdev enable discard = True 2026-02-12T03:57:12.474 INFO:teuthology.orchestra.run.trial098.stdout: bluestore allocator = btree 2026-02-12T03:57:12.474 INFO:teuthology.orchestra.run.trial098.stdout: bluestore block size = 96636764160 2026-02-12T03:57:12.474 INFO:teuthology.orchestra.run.trial098.stdout: bluestore compression algorithm = zstd 2026-02-12T03:57:12.474 INFO:teuthology.orchestra.run.trial098.stdout: bluestore compression mode = aggressive 2026-02-12T03:57:12.474 INFO:teuthology.orchestra.run.trial098.stdout: bluestore fsck on mount = True 2026-02-12T03:57:12.474 INFO:teuthology.orchestra.run.trial098.stdout: bluestore onode segment size = 512K 2026-02-12T03:57:12.474 INFO:teuthology.orchestra.run.trial098.stdout: bluestore write v2 = True 2026-02-12T03:57:12.474 INFO:teuthology.orchestra.run.trial098.stdout: bluestore zero block detection = True 2026-02-12T03:57:12.474 INFO:teuthology.orchestra.run.trial098.stdout: crush location = root=default host=host-$id 2026-02-12T03:57:12.474 INFO:teuthology.orchestra.run.trial098.stdout: debug bluefs = 1 2026-02-12T03:57:12.474 INFO:teuthology.orchestra.run.trial098.stdout: debug bluestore = 1 2026-02-12T03:57:12.474 INFO:teuthology.orchestra.run.trial098.stdout: debug monc = 20 2026-02-12T03:57:12.474 INFO:teuthology.orchestra.run.trial098.stdout: debug ms = 1 2026-02-12T03:57:12.475 INFO:teuthology.orchestra.run.trial098.stdout: debug osd = 20 2026-02-12T03:57:12.475 INFO:teuthology.orchestra.run.trial098.stdout: debug rocksdb = 10 2026-02-12T03:57:12.475 INFO:teuthology.orchestra.run.trial098.stdout: mon osd backfillfull_ratio = 0.85 2026-02-12T03:57:12.475 INFO:teuthology.orchestra.run.trial098.stdout: mon osd full ratio = 0.9 2026-02-12T03:57:12.475 INFO:teuthology.orchestra.run.trial098.stdout: mon osd nearfull ratio = 0.8 2026-02-12T03:57:12.475 INFO:teuthology.orchestra.run.trial098.stdout: osd class default list = * 2026-02-12T03:57:12.475 INFO:teuthology.orchestra.run.trial098.stdout: osd class load list = * 2026-02-12T03:57:12.475 INFO:teuthology.orchestra.run.trial098.stdout: osd client watch timeout = 240 2026-02-12T03:57:12.475 INFO:teuthology.orchestra.run.trial098.stdout: osd debug verify cached snaps = True 2026-02-12T03:57:12.475 INFO:teuthology.orchestra.run.trial098.stdout: osd debug verify missing on start = True 2026-02-12T03:57:12.475 INFO:teuthology.orchestra.run.trial098.stdout: osd failsafe full ratio = 0.95 2026-02-12T03:57:12.475 INFO:teuthology.orchestra.run.trial098.stdout: osd fast shutdown = False 2026-02-12T03:57:12.475 INFO:teuthology.orchestra.run.trial098.stdout: osd mclock override recovery settings = True 2026-02-12T03:57:12.475 INFO:teuthology.orchestra.run.trial098.stdout: osd objectstore = bluestore 2026-02-12T03:57:12.475 INFO:teuthology.orchestra.run.trial098.stdout: osd op queue = debug_random 2026-02-12T03:57:12.475 INFO:teuthology.orchestra.run.trial098.stdout: osd op queue cut off = debug_random 2026-02-12T03:57:12.475 INFO:teuthology.orchestra.run.trial098.stdout: osd shutdown pgref assert = True 2026-02-12T03:57:12.475 INFO:teuthology.orchestra.run.trial098.stdout: osd_mclock_skip_benchmark = True 2026-02-12T03:57:12.475 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:57:12.475 INFO:teuthology.orchestra.run.trial098.stdout:[mgr] 2026-02-12T03:57:12.476 INFO:teuthology.orchestra.run.trial098.stdout: debug ms = 1 2026-02-12T03:57:12.476 INFO:teuthology.orchestra.run.trial098.stdout: debug mgr = 20 2026-02-12T03:57:12.476 INFO:teuthology.orchestra.run.trial098.stdout: debug mon = 20 2026-02-12T03:57:12.476 INFO:teuthology.orchestra.run.trial098.stdout: debug auth = 20 2026-02-12T03:57:12.476 INFO:teuthology.orchestra.run.trial098.stdout: mon reweight min pgs per osd = 4 2026-02-12T03:57:12.476 INFO:teuthology.orchestra.run.trial098.stdout: mon reweight min bytes per osd = 10 2026-02-12T03:57:12.476 INFO:teuthology.orchestra.run.trial098.stdout: mgr/telemetry/nag = false 2026-02-12T03:57:12.476 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:57:12.476 INFO:teuthology.orchestra.run.trial098.stdout:[mon] 2026-02-12T03:57:12.476 INFO:teuthology.orchestra.run.trial098.stdout: debug ms = 1 2026-02-12T03:57:12.476 INFO:teuthology.orchestra.run.trial098.stdout: debug mon = 20 2026-02-12T03:57:12.476 INFO:teuthology.orchestra.run.trial098.stdout: debug paxos = 20 2026-02-12T03:57:12.476 INFO:teuthology.orchestra.run.trial098.stdout: debug auth = 20 2026-02-12T03:57:12.476 INFO:teuthology.orchestra.run.trial098.stdout: mon data avail warn = 5 2026-02-12T03:57:12.476 INFO:teuthology.orchestra.run.trial098.stdout: mon mgr mkfs grace = 240 2026-02-12T03:57:12.476 INFO:teuthology.orchestra.run.trial098.stdout: mon reweight min pgs per osd = 4 2026-02-12T03:57:12.476 INFO:teuthology.orchestra.run.trial098.stdout: mon osd reporter subtree level = osd 2026-02-12T03:57:12.476 INFO:teuthology.orchestra.run.trial098.stdout: mon osd prime pg temp = true 2026-02-12T03:57:12.476 INFO:teuthology.orchestra.run.trial098.stdout: mon reweight min bytes per osd = 10 2026-02-12T03:57:12.476 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:57:12.477 INFO:teuthology.orchestra.run.trial098.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-12T03:57:12.477 INFO:teuthology.orchestra.run.trial098.stdout: auth mon ticket ttl = 660 # 11m 2026-02-12T03:57:12.477 INFO:teuthology.orchestra.run.trial098.stdout: auth service ticket ttl = 240 # 4m 2026-02-12T03:57:12.477 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:57:12.477 INFO:teuthology.orchestra.run.trial098.stdout: # don't complain about insecure global_id in the test suite 2026-02-12T03:57:12.477 INFO:teuthology.orchestra.run.trial098.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-12T03:57:12.477 INFO:teuthology.orchestra.run.trial098.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-12T03:57:12.477 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:57:12.477 INFO:teuthology.orchestra.run.trial098.stdout: # 1m isn't quite enough 2026-02-12T03:57:12.477 INFO:teuthology.orchestra.run.trial098.stdout: mon_down_mkfs_grace = 2m 2026-02-12T03:57:12.477 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:57:12.477 INFO:teuthology.orchestra.run.trial098.stdout: mon_warn_on_filestore_osds = false 2026-02-12T03:57:12.477 INFO:teuthology.orchestra.run.trial098.stdout: mon min osdmap epochs = 50 2026-02-12T03:57:12.477 INFO:teuthology.orchestra.run.trial098.stdout: mon osd crush smoke test = False 2026-02-12T03:57:12.477 INFO:teuthology.orchestra.run.trial098.stdout: mon osdmap full prune interval = 2 2026-02-12T03:57:12.477 INFO:teuthology.orchestra.run.trial098.stdout: mon osdmap full prune min = 15 2026-02-12T03:57:12.477 INFO:teuthology.orchestra.run.trial098.stdout: mon osdmap full prune txsize = 2 2026-02-12T03:57:12.477 INFO:teuthology.orchestra.run.trial098.stdout: mon scrub interval = 300 2026-02-12T03:57:12.477 INFO:teuthology.orchestra.run.trial098.stdout: mon warn on pool no app = False 2026-02-12T03:57:12.478 INFO:teuthology.orchestra.run.trial098.stdout: paxos service trim min = 10 2026-02-12T03:57:12.478 INFO:teuthology.orchestra.run.trial098.stdout: 2026-02-12T03:57:12.478 INFO:teuthology.orchestra.run.trial098.stdout:[client] 2026-02-12T03:57:12.478 INFO:teuthology.orchestra.run.trial098.stdout: rgw cache enabled = true 2026-02-12T03:57:12.478 INFO:teuthology.orchestra.run.trial098.stdout: rgw enable ops log = true 2026-02-12T03:57:12.478 INFO:teuthology.orchestra.run.trial098.stdout: rgw enable usage log = true 2026-02-12T03:57:12.478 INFO:teuthology.orchestra.run.trial098.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-12T03:57:12.478 INFO:teuthology.orchestra.run.trial098.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-12T03:57:12.478 INFO:teuthology.orchestra.run.trial098.stdout: debug monc = 20 2026-02-12T03:57:12.478 INFO:teuthology.orchestra.run.trial098.stdout: debug ms = 1 2026-02-12T03:57:12.478 INFO:teuthology.orchestra.run.trial098.stdout: debug objecter = 20 2026-02-12T03:57:12.478 INFO:teuthology.orchestra.run.trial098.stdout: debug rados = 20 2026-02-12T03:57:12.478 INFO:teuthology.orchestra.run.trial098.stdout: rados replica read policy = balance 2026-02-12T03:57:12.478 INFO:teuthology.orchestra.run.trial098.stdout:[mon.a] 2026-02-12T03:57:12.478 INFO:teuthology.orchestra.run.trial098.stdout:[mon.b] 2026-02-12T03:57:12.478 INFO:teuthology.orchestra.run.trial098.stdout:[mon.c] 2026-02-12T03:57:12.479 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-12T03:57:12.479 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-12T03:57:12.552 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-12T03:57:12.552 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-12T03:57:12.552 DEBUG:teuthology.orchestra.run.trial091:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-12T03:57:12.610 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-12T03:57:12.610 DEBUG:teuthology.orchestra.run.trial091:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-12T03:57:12.668 INFO:tasks.ceph:Sending monmap to node ubuntu@trial091.front.sepia.ceph.com 2026-02-12T03:57:12.668 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-12T03:57:12.668 DEBUG:teuthology.orchestra.run.trial091:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-12T03:57:12.668 DEBUG:teuthology.orchestra.run.trial091:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-12T03:57:12.741 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-12T03:57:12.741 DEBUG:teuthology.orchestra.run.trial091:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-12T03:57:12.797 INFO:tasks.ceph:Sending monmap to node ubuntu@trial098.front.sepia.ceph.com 2026-02-12T03:57:12.797 DEBUG:teuthology.orchestra.run.trial098:> set -ex 2026-02-12T03:57:12.797 DEBUG:teuthology.orchestra.run.trial098:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-12T03:57:12.798 DEBUG:teuthology.orchestra.run.trial098:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-12T03:57:12.831 DEBUG:teuthology.orchestra.run.trial098:> set -ex 2026-02-12T03:57:12.831 DEBUG:teuthology.orchestra.run.trial098:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-12T03:57:12.889 INFO:tasks.ceph:Sending monmap to node ubuntu@trial111.front.sepia.ceph.com 2026-02-12T03:57:12.889 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-12T03:57:12.889 DEBUG:teuthology.orchestra.run.trial111:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-12T03:57:12.889 DEBUG:teuthology.orchestra.run.trial111:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-12T03:57:12.922 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-12T03:57:12.923 DEBUG:teuthology.orchestra.run.trial111:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-12T03:57:12.979 INFO:tasks.ceph:Sending monmap to node ubuntu@trial154.front.sepia.ceph.com 2026-02-12T03:57:12.979 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-12T03:57:12.979 DEBUG:teuthology.orchestra.run.trial154:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-12T03:57:12.979 DEBUG:teuthology.orchestra.run.trial154:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-12T03:57:13.013 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-12T03:57:13.014 DEBUG:teuthology.orchestra.run.trial154:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-12T03:57:13.069 INFO:tasks.ceph:Setting up mon nodes... 2026-02-12T03:57:13.069 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-12T03:57:13.070 DEBUG:teuthology.orchestra.run.trial091:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2026-02-12T03:57:13.115 INFO:teuthology.orchestra.run.trial091.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2026-02-12T03:57:13.117 DEBUG:teuthology.orchestra.run.trial154:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-12T03:57:13.163 INFO:teuthology.orchestra.run.trial154.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-12T03:57:13.165 INFO:tasks.ceph:Setting up mds nodes... 2026-02-12T03:57:13.166 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-12T03:57:13.166 DEBUG:teuthology.orchestra.run.trial154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-12T03:57:13.199 INFO:teuthology.orchestra.run.trial154.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-12T03:57:13.209 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-12T03:57:13.210 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial091.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial098.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial111.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@trial154.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'}} 2026-02-12T03:57:13.210 DEBUG:teuthology.orchestra.run.trial091:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-12T03:57:13.235 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-12T03:57:13.235 INFO:tasks.ceph:role: osd.0 2026-02-12T03:57:13.235 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial091.front.sepia.ceph.com 2026-02-12T03:57:13.236 DEBUG:teuthology.orchestra.run.trial091:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-12T03:57:13.302 INFO:teuthology.orchestra.run.trial091.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T03:57:13.302 INFO:teuthology.orchestra.run.trial091.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T03:57:13.303 INFO:teuthology.orchestra.run.trial091.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T03:57:13.303 INFO:teuthology.orchestra.run.trial091.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T03:57:13.303 INFO:teuthology.orchestra.run.trial091.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T03:57:13.303 INFO:teuthology.orchestra.run.trial091.stdout: = sunit=0 swidth=0 blks 2026-02-12T03:57:13.303 INFO:teuthology.orchestra.run.trial091.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T03:57:13.303 INFO:teuthology.orchestra.run.trial091.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T03:57:13.303 INFO:teuthology.orchestra.run.trial091.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T03:57:13.303 INFO:teuthology.orchestra.run.trial091.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T03:57:13.871 INFO:teuthology.orchestra.run.trial091.stdout:Discarding blocks...Done. 2026-02-12T03:57:13.873 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial091.front.sepia.ceph.com -o noatime 2026-02-12T03:57:13.873 DEBUG:teuthology.orchestra.run.trial091:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-12T03:57:13.942 DEBUG:teuthology.orchestra.run.trial091:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-12T03:57:14.010 DEBUG:teuthology.orchestra.run.trial091:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2026-02-12T03:57:14.075 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-12T03:57:14.075 INFO:tasks.ceph:role: osd.4 2026-02-12T03:57:14.076 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial091.front.sepia.ceph.com 2026-02-12T03:57:14.076 DEBUG:teuthology.orchestra.run.trial091:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-12T03:57:14.142 INFO:teuthology.orchestra.run.trial091.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T03:57:14.142 INFO:teuthology.orchestra.run.trial091.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T03:57:14.142 INFO:teuthology.orchestra.run.trial091.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T03:57:14.143 INFO:teuthology.orchestra.run.trial091.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T03:57:14.143 INFO:teuthology.orchestra.run.trial091.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T03:57:14.143 INFO:teuthology.orchestra.run.trial091.stdout: = sunit=0 swidth=0 blks 2026-02-12T03:57:14.143 INFO:teuthology.orchestra.run.trial091.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T03:57:14.143 INFO:teuthology.orchestra.run.trial091.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T03:57:14.143 INFO:teuthology.orchestra.run.trial091.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T03:57:14.143 INFO:teuthology.orchestra.run.trial091.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T03:57:14.709 INFO:teuthology.orchestra.run.trial091.stdout:Discarding blocks...Done. 2026-02-12T03:57:14.711 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial091.front.sepia.ceph.com -o noatime 2026-02-12T03:57:14.712 DEBUG:teuthology.orchestra.run.trial091:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2026-02-12T03:57:14.780 DEBUG:teuthology.orchestra.run.trial091:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2026-02-12T03:57:14.847 DEBUG:teuthology.orchestra.run.trial091:> sudo mkdir -p /var/lib/ceph/osd/ceph-8 2026-02-12T03:57:14.913 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-12T03:57:14.913 INFO:tasks.ceph:role: osd.8 2026-02-12T03:57:14.913 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial091.front.sepia.ceph.com 2026-02-12T03:57:14.914 DEBUG:teuthology.orchestra.run.trial091:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-12T03:57:14.978 INFO:teuthology.orchestra.run.trial091.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T03:57:14.978 INFO:teuthology.orchestra.run.trial091.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T03:57:14.978 INFO:teuthology.orchestra.run.trial091.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T03:57:14.978 INFO:teuthology.orchestra.run.trial091.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T03:57:14.978 INFO:teuthology.orchestra.run.trial091.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T03:57:14.978 INFO:teuthology.orchestra.run.trial091.stdout: = sunit=0 swidth=0 blks 2026-02-12T03:57:14.978 INFO:teuthology.orchestra.run.trial091.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T03:57:14.978 INFO:teuthology.orchestra.run.trial091.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T03:57:14.979 INFO:teuthology.orchestra.run.trial091.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T03:57:14.979 INFO:teuthology.orchestra.run.trial091.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T03:57:15.535 INFO:teuthology.orchestra.run.trial091.stdout:Discarding blocks...Done. 2026-02-12T03:57:15.537 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial091.front.sepia.ceph.com -o noatime 2026-02-12T03:57:15.537 DEBUG:teuthology.orchestra.run.trial091:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-8 2026-02-12T03:57:15.605 DEBUG:teuthology.orchestra.run.trial091:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-8 2026-02-12T03:57:15.672 DEBUG:teuthology.orchestra.run.trial091:> sudo mkdir -p /var/lib/ceph/osd/ceph-12 2026-02-12T03:57:15.735 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.12': '/dev/vg_nvme/lv_4'} 2026-02-12T03:57:15.735 INFO:tasks.ceph:role: osd.12 2026-02-12T03:57:15.736 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial091.front.sepia.ceph.com 2026-02-12T03:57:15.736 DEBUG:teuthology.orchestra.run.trial091:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-12T03:57:15.802 INFO:teuthology.orchestra.run.trial091.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T03:57:15.802 INFO:teuthology.orchestra.run.trial091.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T03:57:15.802 INFO:teuthology.orchestra.run.trial091.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T03:57:15.803 INFO:teuthology.orchestra.run.trial091.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T03:57:15.803 INFO:teuthology.orchestra.run.trial091.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T03:57:15.803 INFO:teuthology.orchestra.run.trial091.stdout: = sunit=0 swidth=0 blks 2026-02-12T03:57:15.803 INFO:teuthology.orchestra.run.trial091.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T03:57:15.803 INFO:teuthology.orchestra.run.trial091.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T03:57:15.803 INFO:teuthology.orchestra.run.trial091.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T03:57:15.803 INFO:teuthology.orchestra.run.trial091.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T03:57:16.359 INFO:teuthology.orchestra.run.trial091.stdout:Discarding blocks...Done. 2026-02-12T03:57:16.361 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial091.front.sepia.ceph.com -o noatime 2026-02-12T03:57:16.362 DEBUG:teuthology.orchestra.run.trial091:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-12 2026-02-12T03:57:16.438 DEBUG:teuthology.orchestra.run.trial091:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-12 2026-02-12T03:57:16.504 DEBUG:teuthology.orchestra.run.trial091:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T03:57:16.584 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:16.581+0000 7f9ea872d900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-12T03:57:16.585 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:16.582+0000 7f9ea872d900 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-12T03:57:16.585 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:16.582+0000 7f9ea872d900 -1 bdev(0x559d2acbd800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-12T03:57:16.585 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:16.582+0000 7f9ea872d900 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-12T03:57:17.031 DEBUG:teuthology.orchestra.run.trial091:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-12T03:57:17.097 DEBUG:teuthology.orchestra.run.trial091:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T03:57:17.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:17.173+0000 7fd739ba1900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2026-02-12T03:57:17.177 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:17.173+0000 7fd739ba1900 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2026-02-12T03:57:17.177 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:17.173+0000 7fd739ba1900 -1 bdev(0x558236829800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2026-02-12T03:57:17.177 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:17.173+0000 7fd739ba1900 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2026-02-12T03:57:17.628 DEBUG:teuthology.orchestra.run.trial091:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2026-02-12T03:57:17.693 DEBUG:teuthology.orchestra.run.trial091:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 8 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T03:57:17.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:17.767+0000 7fdb77dcf900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-8/keyring: can't open /var/lib/ceph/osd/ceph-8/keyring: (2) No such file or directory 2026-02-12T03:57:17.771 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:17.767+0000 7fdb77dcf900 -1 created new key in keyring /var/lib/ceph/osd/ceph-8/keyring 2026-02-12T03:57:17.771 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:17.767+0000 7fdb77dcf900 -1 bdev(0x5595b474d800 /var/lib/ceph/osd/ceph-8/block) open stat got: (1) Operation not permitted 2026-02-12T03:57:17.771 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:17.768+0000 7fdb77dcf900 -1 bluestore(/var/lib/ceph/osd/ceph-8) _read_fsid unparsable uuid 2026-02-12T03:57:18.218 DEBUG:teuthology.orchestra.run.trial091:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2026-02-12T03:57:18.283 DEBUG:teuthology.orchestra.run.trial091:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 12 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T03:57:18.360 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:18.357+0000 7feba4b97900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-12/keyring: can't open /var/lib/ceph/osd/ceph-12/keyring: (2) No such file or directory 2026-02-12T03:57:18.360 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:18.357+0000 7feba4b97900 -1 created new key in keyring /var/lib/ceph/osd/ceph-12/keyring 2026-02-12T03:57:18.361 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:18.357+0000 7feba4b97900 -1 bdev(0x55a3abb69800 /var/lib/ceph/osd/ceph-12/block) open stat got: (1) Operation not permitted 2026-02-12T03:57:18.361 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:18.357+0000 7feba4b97900 -1 bluestore(/var/lib/ceph/osd/ceph-12) _read_fsid unparsable uuid 2026-02-12T03:57:18.816 DEBUG:teuthology.orchestra.run.trial091:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-12 2026-02-12T03:57:18.881 DEBUG:teuthology.orchestra.run.trial098:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-12T03:57:18.907 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-12T03:57:18.907 INFO:tasks.ceph:role: osd.1 2026-02-12T03:57:18.907 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial098.front.sepia.ceph.com 2026-02-12T03:57:18.907 DEBUG:teuthology.orchestra.run.trial098:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-12T03:57:18.971 INFO:teuthology.orchestra.run.trial098.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T03:57:18.971 INFO:teuthology.orchestra.run.trial098.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T03:57:18.971 INFO:teuthology.orchestra.run.trial098.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T03:57:18.971 INFO:teuthology.orchestra.run.trial098.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T03:57:18.971 INFO:teuthology.orchestra.run.trial098.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T03:57:18.971 INFO:teuthology.orchestra.run.trial098.stdout: = sunit=0 swidth=0 blks 2026-02-12T03:57:18.972 INFO:teuthology.orchestra.run.trial098.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T03:57:18.972 INFO:teuthology.orchestra.run.trial098.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T03:57:18.972 INFO:teuthology.orchestra.run.trial098.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T03:57:18.972 INFO:teuthology.orchestra.run.trial098.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T03:57:19.539 INFO:teuthology.orchestra.run.trial098.stdout:Discarding blocks...Done. 2026-02-12T03:57:19.541 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial098.front.sepia.ceph.com -o noatime 2026-02-12T03:57:19.542 DEBUG:teuthology.orchestra.run.trial098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2026-02-12T03:57:19.609 DEBUG:teuthology.orchestra.run.trial098:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-12T03:57:19.676 DEBUG:teuthology.orchestra.run.trial098:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2026-02-12T03:57:19.739 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-12T03:57:19.739 INFO:tasks.ceph:role: osd.5 2026-02-12T03:57:19.739 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial098.front.sepia.ceph.com 2026-02-12T03:57:19.739 DEBUG:teuthology.orchestra.run.trial098:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-12T03:57:19.804 INFO:teuthology.orchestra.run.trial098.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T03:57:19.804 INFO:teuthology.orchestra.run.trial098.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T03:57:19.804 INFO:teuthology.orchestra.run.trial098.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T03:57:19.804 INFO:teuthology.orchestra.run.trial098.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T03:57:19.804 INFO:teuthology.orchestra.run.trial098.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T03:57:19.804 INFO:teuthology.orchestra.run.trial098.stdout: = sunit=0 swidth=0 blks 2026-02-12T03:57:19.805 INFO:teuthology.orchestra.run.trial098.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T03:57:19.805 INFO:teuthology.orchestra.run.trial098.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T03:57:19.805 INFO:teuthology.orchestra.run.trial098.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T03:57:19.805 INFO:teuthology.orchestra.run.trial098.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T03:57:20.371 INFO:teuthology.orchestra.run.trial098.stdout:Discarding blocks...Done. 2026-02-12T03:57:20.374 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial098.front.sepia.ceph.com -o noatime 2026-02-12T03:57:20.374 DEBUG:teuthology.orchestra.run.trial098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2026-02-12T03:57:20.444 DEBUG:teuthology.orchestra.run.trial098:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2026-02-12T03:57:20.510 DEBUG:teuthology.orchestra.run.trial098:> sudo mkdir -p /var/lib/ceph/osd/ceph-9 2026-02-12T03:57:20.573 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-12T03:57:20.573 INFO:tasks.ceph:role: osd.9 2026-02-12T03:57:20.573 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial098.front.sepia.ceph.com 2026-02-12T03:57:20.574 DEBUG:teuthology.orchestra.run.trial098:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-12T03:57:20.638 INFO:teuthology.orchestra.run.trial098.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T03:57:20.638 INFO:teuthology.orchestra.run.trial098.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T03:57:20.638 INFO:teuthology.orchestra.run.trial098.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T03:57:20.638 INFO:teuthology.orchestra.run.trial098.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T03:57:20.638 INFO:teuthology.orchestra.run.trial098.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T03:57:20.638 INFO:teuthology.orchestra.run.trial098.stdout: = sunit=0 swidth=0 blks 2026-02-12T03:57:20.638 INFO:teuthology.orchestra.run.trial098.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T03:57:20.638 INFO:teuthology.orchestra.run.trial098.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T03:57:20.639 INFO:teuthology.orchestra.run.trial098.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T03:57:20.639 INFO:teuthology.orchestra.run.trial098.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T03:57:21.193 INFO:teuthology.orchestra.run.trial098.stdout:Discarding blocks...Done. 2026-02-12T03:57:21.196 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial098.front.sepia.ceph.com -o noatime 2026-02-12T03:57:21.196 DEBUG:teuthology.orchestra.run.trial098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-9 2026-02-12T03:57:21.263 DEBUG:teuthology.orchestra.run.trial098:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-9 2026-02-12T03:57:21.330 DEBUG:teuthology.orchestra.run.trial098:> sudo mkdir -p /var/lib/ceph/osd/ceph-13 2026-02-12T03:57:21.394 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.9': '/dev/vg_nvme/lv_3', 'osd.13': '/dev/vg_nvme/lv_4'} 2026-02-12T03:57:21.394 INFO:tasks.ceph:role: osd.13 2026-02-12T03:57:21.394 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial098.front.sepia.ceph.com 2026-02-12T03:57:21.395 DEBUG:teuthology.orchestra.run.trial098:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-12T03:57:21.461 INFO:teuthology.orchestra.run.trial098.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T03:57:21.461 INFO:teuthology.orchestra.run.trial098.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T03:57:21.461 INFO:teuthology.orchestra.run.trial098.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T03:57:21.462 INFO:teuthology.orchestra.run.trial098.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T03:57:21.462 INFO:teuthology.orchestra.run.trial098.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T03:57:21.462 INFO:teuthology.orchestra.run.trial098.stdout: = sunit=0 swidth=0 blks 2026-02-12T03:57:21.462 INFO:teuthology.orchestra.run.trial098.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T03:57:21.462 INFO:teuthology.orchestra.run.trial098.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T03:57:21.462 INFO:teuthology.orchestra.run.trial098.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T03:57:21.462 INFO:teuthology.orchestra.run.trial098.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T03:57:22.016 INFO:teuthology.orchestra.run.trial098.stdout:Discarding blocks...Done. 2026-02-12T03:57:22.018 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial098.front.sepia.ceph.com -o noatime 2026-02-12T03:57:22.019 DEBUG:teuthology.orchestra.run.trial098:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-13 2026-02-12T03:57:22.095 DEBUG:teuthology.orchestra.run.trial098:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-13 2026-02-12T03:57:22.161 DEBUG:teuthology.orchestra.run.trial098:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T03:57:22.240 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-12T03:57:22.237+0000 7f1169810900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-12T03:57:22.240 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-12T03:57:22.237+0000 7f1169810900 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-12T03:57:22.240 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-12T03:57:22.237+0000 7f1169810900 -1 bdev(0x55fee0e35800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-12T03:57:22.240 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-12T03:57:22.238+0000 7f1169810900 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-12T03:57:22.705 DEBUG:teuthology.orchestra.run.trial098:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-12T03:57:22.769 DEBUG:teuthology.orchestra.run.trial098:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T03:57:22.847 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-12T03:57:22.844+0000 7f39f5a0f900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2026-02-12T03:57:22.847 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-12T03:57:22.844+0000 7f39f5a0f900 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2026-02-12T03:57:22.847 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-12T03:57:22.844+0000 7f39f5a0f900 -1 bdev(0x562510775800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2026-02-12T03:57:22.847 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-12T03:57:22.845+0000 7f39f5a0f900 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2026-02-12T03:57:23.286 DEBUG:teuthology.orchestra.run.trial098:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2026-02-12T03:57:23.349 DEBUG:teuthology.orchestra.run.trial098:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 9 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T03:57:23.427 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-12T03:57:23.424+0000 7f98b87dc900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-9/keyring: can't open /var/lib/ceph/osd/ceph-9/keyring: (2) No such file or directory 2026-02-12T03:57:23.427 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-12T03:57:23.424+0000 7f98b87dc900 -1 created new key in keyring /var/lib/ceph/osd/ceph-9/keyring 2026-02-12T03:57:23.427 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-12T03:57:23.424+0000 7f98b87dc900 -1 bdev(0x55d4b6b6b800 /var/lib/ceph/osd/ceph-9/block) open stat got: (1) Operation not permitted 2026-02-12T03:57:23.427 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-12T03:57:23.425+0000 7f98b87dc900 -1 bluestore(/var/lib/ceph/osd/ceph-9) _read_fsid unparsable uuid 2026-02-12T03:57:23.899 DEBUG:teuthology.orchestra.run.trial098:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-9 2026-02-12T03:57:23.964 DEBUG:teuthology.orchestra.run.trial098:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 13 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T03:57:24.044 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-12T03:57:24.041+0000 7fdb38051900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-13/keyring: can't open /var/lib/ceph/osd/ceph-13/keyring: (2) No such file or directory 2026-02-12T03:57:24.044 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-12T03:57:24.041+0000 7fdb38051900 -1 created new key in keyring /var/lib/ceph/osd/ceph-13/keyring 2026-02-12T03:57:24.044 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-12T03:57:24.041+0000 7fdb38051900 -1 bdev(0x55633317b800 /var/lib/ceph/osd/ceph-13/block) open stat got: (1) Operation not permitted 2026-02-12T03:57:24.044 INFO:teuthology.orchestra.run.trial098.stderr:2026-02-12T03:57:24.041+0000 7fdb38051900 -1 bluestore(/var/lib/ceph/osd/ceph-13) _read_fsid unparsable uuid 2026-02-12T03:57:24.500 DEBUG:teuthology.orchestra.run.trial098:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-13 2026-02-12T03:57:24.565 DEBUG:teuthology.orchestra.run.trial111:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-12T03:57:24.591 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-12T03:57:24.591 INFO:tasks.ceph:role: osd.2 2026-02-12T03:57:24.591 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial111.front.sepia.ceph.com 2026-02-12T03:57:24.591 DEBUG:teuthology.orchestra.run.trial111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-12T03:57:24.656 INFO:teuthology.orchestra.run.trial111.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T03:57:24.656 INFO:teuthology.orchestra.run.trial111.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T03:57:24.656 INFO:teuthology.orchestra.run.trial111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T03:57:24.656 INFO:teuthology.orchestra.run.trial111.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T03:57:24.656 INFO:teuthology.orchestra.run.trial111.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T03:57:24.656 INFO:teuthology.orchestra.run.trial111.stdout: = sunit=0 swidth=0 blks 2026-02-12T03:57:24.657 INFO:teuthology.orchestra.run.trial111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T03:57:24.657 INFO:teuthology.orchestra.run.trial111.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T03:57:24.657 INFO:teuthology.orchestra.run.trial111.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T03:57:24.657 INFO:teuthology.orchestra.run.trial111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T03:57:25.226 INFO:teuthology.orchestra.run.trial111.stdout:Discarding blocks...Done. 2026-02-12T03:57:25.229 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial111.front.sepia.ceph.com -o noatime 2026-02-12T03:57:25.229 DEBUG:teuthology.orchestra.run.trial111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2026-02-12T03:57:25.298 DEBUG:teuthology.orchestra.run.trial111:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-12T03:57:25.364 DEBUG:teuthology.orchestra.run.trial111:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2026-02-12T03:57:25.428 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-12T03:57:25.428 INFO:tasks.ceph:role: osd.6 2026-02-12T03:57:25.429 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial111.front.sepia.ceph.com 2026-02-12T03:57:25.429 DEBUG:teuthology.orchestra.run.trial111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-12T03:57:25.492 INFO:teuthology.orchestra.run.trial111.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T03:57:25.493 INFO:teuthology.orchestra.run.trial111.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T03:57:25.493 INFO:teuthology.orchestra.run.trial111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T03:57:25.493 INFO:teuthology.orchestra.run.trial111.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T03:57:25.493 INFO:teuthology.orchestra.run.trial111.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T03:57:25.493 INFO:teuthology.orchestra.run.trial111.stdout: = sunit=0 swidth=0 blks 2026-02-12T03:57:25.493 INFO:teuthology.orchestra.run.trial111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T03:57:25.493 INFO:teuthology.orchestra.run.trial111.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T03:57:25.493 INFO:teuthology.orchestra.run.trial111.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T03:57:25.493 INFO:teuthology.orchestra.run.trial111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T03:57:26.059 INFO:teuthology.orchestra.run.trial111.stdout:Discarding blocks...Done. 2026-02-12T03:57:26.061 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial111.front.sepia.ceph.com -o noatime 2026-02-12T03:57:26.061 DEBUG:teuthology.orchestra.run.trial111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2026-02-12T03:57:26.135 DEBUG:teuthology.orchestra.run.trial111:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2026-02-12T03:57:26.203 DEBUG:teuthology.orchestra.run.trial111:> sudo mkdir -p /var/lib/ceph/osd/ceph-10 2026-02-12T03:57:26.266 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-12T03:57:26.266 INFO:tasks.ceph:role: osd.10 2026-02-12T03:57:26.266 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial111.front.sepia.ceph.com 2026-02-12T03:57:26.266 DEBUG:teuthology.orchestra.run.trial111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-12T03:57:26.332 INFO:teuthology.orchestra.run.trial111.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T03:57:26.332 INFO:teuthology.orchestra.run.trial111.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T03:57:26.332 INFO:teuthology.orchestra.run.trial111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T03:57:26.333 INFO:teuthology.orchestra.run.trial111.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T03:57:26.333 INFO:teuthology.orchestra.run.trial111.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T03:57:26.333 INFO:teuthology.orchestra.run.trial111.stdout: = sunit=0 swidth=0 blks 2026-02-12T03:57:26.333 INFO:teuthology.orchestra.run.trial111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T03:57:26.333 INFO:teuthology.orchestra.run.trial111.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T03:57:26.333 INFO:teuthology.orchestra.run.trial111.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T03:57:26.333 INFO:teuthology.orchestra.run.trial111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T03:57:26.887 INFO:teuthology.orchestra.run.trial111.stdout:Discarding blocks...Done. 2026-02-12T03:57:26.889 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial111.front.sepia.ceph.com -o noatime 2026-02-12T03:57:26.890 DEBUG:teuthology.orchestra.run.trial111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-10 2026-02-12T03:57:26.960 DEBUG:teuthology.orchestra.run.trial111:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-10 2026-02-12T03:57:27.027 DEBUG:teuthology.orchestra.run.trial111:> sudo mkdir -p /var/lib/ceph/osd/ceph-14 2026-02-12T03:57:27.090 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.6': '/dev/vg_nvme/lv_2', 'osd.10': '/dev/vg_nvme/lv_3', 'osd.14': '/dev/vg_nvme/lv_4'} 2026-02-12T03:57:27.090 INFO:tasks.ceph:role: osd.14 2026-02-12T03:57:27.090 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial111.front.sepia.ceph.com 2026-02-12T03:57:27.090 DEBUG:teuthology.orchestra.run.trial111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-12T03:57:27.155 INFO:teuthology.orchestra.run.trial111.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T03:57:27.155 INFO:teuthology.orchestra.run.trial111.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T03:57:27.155 INFO:teuthology.orchestra.run.trial111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T03:57:27.155 INFO:teuthology.orchestra.run.trial111.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T03:57:27.155 INFO:teuthology.orchestra.run.trial111.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T03:57:27.155 INFO:teuthology.orchestra.run.trial111.stdout: = sunit=0 swidth=0 blks 2026-02-12T03:57:27.155 INFO:teuthology.orchestra.run.trial111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T03:57:27.155 INFO:teuthology.orchestra.run.trial111.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T03:57:27.156 INFO:teuthology.orchestra.run.trial111.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T03:57:27.156 INFO:teuthology.orchestra.run.trial111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T03:57:27.710 INFO:teuthology.orchestra.run.trial111.stdout:Discarding blocks...Done. 2026-02-12T03:57:27.712 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial111.front.sepia.ceph.com -o noatime 2026-02-12T03:57:27.713 DEBUG:teuthology.orchestra.run.trial111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-14 2026-02-12T03:57:27.789 DEBUG:teuthology.orchestra.run.trial111:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-14 2026-02-12T03:57:27.856 DEBUG:teuthology.orchestra.run.trial111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T03:57:27.935 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T03:57:27.932+0000 7f127cce0900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-12T03:57:27.935 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T03:57:27.933+0000 7f127cce0900 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-12T03:57:27.936 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T03:57:27.933+0000 7f127cce0900 -1 bdev(0x561af797b800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-12T03:57:27.936 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T03:57:27.933+0000 7f127cce0900 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-12T03:57:28.375 DEBUG:teuthology.orchestra.run.trial111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-12T03:57:28.441 DEBUG:teuthology.orchestra.run.trial111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T03:57:28.518 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T03:57:28.516+0000 7f847dae4900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2026-02-12T03:57:28.519 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T03:57:28.516+0000 7f847dae4900 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2026-02-12T03:57:28.519 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T03:57:28.516+0000 7f847dae4900 -1 bdev(0x55a6bb403800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2026-02-12T03:57:28.519 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T03:57:28.516+0000 7f847dae4900 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2026-02-12T03:57:28.978 DEBUG:teuthology.orchestra.run.trial111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2026-02-12T03:57:29.043 DEBUG:teuthology.orchestra.run.trial111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 10 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T03:57:29.119 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T03:57:29.117+0000 7f963fe17900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-10/keyring: can't open /var/lib/ceph/osd/ceph-10/keyring: (2) No such file or directory 2026-02-12T03:57:29.120 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T03:57:29.117+0000 7f963fe17900 -1 created new key in keyring /var/lib/ceph/osd/ceph-10/keyring 2026-02-12T03:57:29.120 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T03:57:29.117+0000 7f963fe17900 -1 bdev(0x55e0021e9800 /var/lib/ceph/osd/ceph-10/block) open stat got: (1) Operation not permitted 2026-02-12T03:57:29.120 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T03:57:29.117+0000 7f963fe17900 -1 bluestore(/var/lib/ceph/osd/ceph-10) _read_fsid unparsable uuid 2026-02-12T03:57:29.563 DEBUG:teuthology.orchestra.run.trial111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-10 2026-02-12T03:57:29.630 DEBUG:teuthology.orchestra.run.trial111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 14 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T03:57:29.708 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T03:57:29.705+0000 7fdc0221c900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-14/keyring: can't open /var/lib/ceph/osd/ceph-14/keyring: (2) No such file or directory 2026-02-12T03:57:29.708 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T03:57:29.705+0000 7fdc0221c900 -1 created new key in keyring /var/lib/ceph/osd/ceph-14/keyring 2026-02-12T03:57:29.708 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T03:57:29.705+0000 7fdc0221c900 -1 bdev(0x562c0df5f800 /var/lib/ceph/osd/ceph-14/block) open stat got: (1) Operation not permitted 2026-02-12T03:57:29.708 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T03:57:29.705+0000 7fdc0221c900 -1 bluestore(/var/lib/ceph/osd/ceph-14) _read_fsid unparsable uuid 2026-02-12T03:57:30.169 DEBUG:teuthology.orchestra.run.trial111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-14 2026-02-12T03:57:30.234 DEBUG:teuthology.orchestra.run.trial154:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-12T03:57:30.259 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-12T03:57:30.259 INFO:tasks.ceph:role: osd.3 2026-02-12T03:57:30.260 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial154.front.sepia.ceph.com 2026-02-12T03:57:30.260 DEBUG:teuthology.orchestra.run.trial154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-12T03:57:30.325 INFO:teuthology.orchestra.run.trial154.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T03:57:30.326 INFO:teuthology.orchestra.run.trial154.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T03:57:30.326 INFO:teuthology.orchestra.run.trial154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T03:57:30.326 INFO:teuthology.orchestra.run.trial154.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T03:57:30.326 INFO:teuthology.orchestra.run.trial154.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T03:57:30.326 INFO:teuthology.orchestra.run.trial154.stdout: = sunit=0 swidth=0 blks 2026-02-12T03:57:30.326 INFO:teuthology.orchestra.run.trial154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T03:57:30.326 INFO:teuthology.orchestra.run.trial154.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T03:57:30.326 INFO:teuthology.orchestra.run.trial154.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T03:57:30.326 INFO:teuthology.orchestra.run.trial154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T03:57:30.894 INFO:teuthology.orchestra.run.trial154.stdout:Discarding blocks...Done. 2026-02-12T03:57:30.896 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial154.front.sepia.ceph.com -o noatime 2026-02-12T03:57:30.896 DEBUG:teuthology.orchestra.run.trial154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2026-02-12T03:57:30.965 DEBUG:teuthology.orchestra.run.trial154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-12T03:57:31.031 DEBUG:teuthology.orchestra.run.trial154:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2026-02-12T03:57:31.094 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-12T03:57:31.094 INFO:tasks.ceph:role: osd.7 2026-02-12T03:57:31.094 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial154.front.sepia.ceph.com 2026-02-12T03:57:31.095 DEBUG:teuthology.orchestra.run.trial154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-12T03:57:31.161 INFO:teuthology.orchestra.run.trial154.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T03:57:31.161 INFO:teuthology.orchestra.run.trial154.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T03:57:31.161 INFO:teuthology.orchestra.run.trial154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T03:57:31.161 INFO:teuthology.orchestra.run.trial154.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T03:57:31.162 INFO:teuthology.orchestra.run.trial154.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T03:57:31.162 INFO:teuthology.orchestra.run.trial154.stdout: = sunit=0 swidth=0 blks 2026-02-12T03:57:31.162 INFO:teuthology.orchestra.run.trial154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T03:57:31.162 INFO:teuthology.orchestra.run.trial154.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T03:57:31.162 INFO:teuthology.orchestra.run.trial154.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T03:57:31.162 INFO:teuthology.orchestra.run.trial154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T03:57:31.718 INFO:teuthology.orchestra.run.trial154.stdout:Discarding blocks...Done. 2026-02-12T03:57:31.720 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial154.front.sepia.ceph.com -o noatime 2026-02-12T03:57:31.721 DEBUG:teuthology.orchestra.run.trial154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-7 2026-02-12T03:57:31.789 DEBUG:teuthology.orchestra.run.trial154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2026-02-12T03:57:31.856 DEBUG:teuthology.orchestra.run.trial154:> sudo mkdir -p /var/lib/ceph/osd/ceph-11 2026-02-12T03:57:31.920 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-12T03:57:31.921 INFO:tasks.ceph:role: osd.11 2026-02-12T03:57:31.921 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial154.front.sepia.ceph.com 2026-02-12T03:57:31.921 DEBUG:teuthology.orchestra.run.trial154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-12T03:57:31.984 INFO:teuthology.orchestra.run.trial154.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T03:57:31.984 INFO:teuthology.orchestra.run.trial154.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T03:57:31.985 INFO:teuthology.orchestra.run.trial154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T03:57:31.985 INFO:teuthology.orchestra.run.trial154.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T03:57:31.985 INFO:teuthology.orchestra.run.trial154.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T03:57:31.985 INFO:teuthology.orchestra.run.trial154.stdout: = sunit=0 swidth=0 blks 2026-02-12T03:57:31.985 INFO:teuthology.orchestra.run.trial154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T03:57:31.985 INFO:teuthology.orchestra.run.trial154.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T03:57:31.985 INFO:teuthology.orchestra.run.trial154.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T03:57:31.985 INFO:teuthology.orchestra.run.trial154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T03:57:32.542 INFO:teuthology.orchestra.run.trial154.stdout:Discarding blocks...Done. 2026-02-12T03:57:32.544 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial154.front.sepia.ceph.com -o noatime 2026-02-12T03:57:32.545 DEBUG:teuthology.orchestra.run.trial154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-11 2026-02-12T03:57:32.618 DEBUG:teuthology.orchestra.run.trial154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-11 2026-02-12T03:57:32.683 DEBUG:teuthology.orchestra.run.trial154:> sudo mkdir -p /var/lib/ceph/osd/ceph-15 2026-02-12T03:57:32.747 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.7': '/dev/vg_nvme/lv_2', 'osd.11': '/dev/vg_nvme/lv_3', 'osd.15': '/dev/vg_nvme/lv_4'} 2026-02-12T03:57:32.747 INFO:tasks.ceph:role: osd.15 2026-02-12T03:57:32.747 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@trial154.front.sepia.ceph.com 2026-02-12T03:57:32.748 DEBUG:teuthology.orchestra.run.trial154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2026-02-12T03:57:32.813 INFO:teuthology.orchestra.run.trial154.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T03:57:32.813 INFO:teuthology.orchestra.run.trial154.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T03:57:32.813 INFO:teuthology.orchestra.run.trial154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T03:57:32.813 INFO:teuthology.orchestra.run.trial154.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T03:57:32.813 INFO:teuthology.orchestra.run.trial154.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T03:57:32.813 INFO:teuthology.orchestra.run.trial154.stdout: = sunit=0 swidth=0 blks 2026-02-12T03:57:32.813 INFO:teuthology.orchestra.run.trial154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T03:57:32.813 INFO:teuthology.orchestra.run.trial154.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T03:57:32.814 INFO:teuthology.orchestra.run.trial154.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T03:57:32.814 INFO:teuthology.orchestra.run.trial154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T03:57:33.369 INFO:teuthology.orchestra.run.trial154.stdout:Discarding blocks...Done. 2026-02-12T03:57:33.371 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@trial154.front.sepia.ceph.com -o noatime 2026-02-12T03:57:33.372 DEBUG:teuthology.orchestra.run.trial154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-15 2026-02-12T03:57:33.448 DEBUG:teuthology.orchestra.run.trial154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-15 2026-02-12T03:57:33.515 DEBUG:teuthology.orchestra.run.trial154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T03:57:33.593 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:57:33.591+0000 7f359a997900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-12T03:57:33.594 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:57:33.591+0000 7f359a997900 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-12T03:57:33.594 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:57:33.591+0000 7f359a997900 -1 bdev(0x5577f96df800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2026-02-12T03:57:33.594 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:57:33.591+0000 7f359a997900 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-12T03:57:34.048 DEBUG:teuthology.orchestra.run.trial154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-12T03:57:34.113 DEBUG:teuthology.orchestra.run.trial154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T03:57:34.194 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:57:34.191+0000 7f0389573900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2026-02-12T03:57:34.194 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:57:34.191+0000 7f0389573900 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2026-02-12T03:57:34.194 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:57:34.191+0000 7f0389573900 -1 bdev(0x55c727901800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2026-02-12T03:57:34.194 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:57:34.191+0000 7f0389573900 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2026-02-12T03:57:34.654 DEBUG:teuthology.orchestra.run.trial154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2026-02-12T03:57:34.720 DEBUG:teuthology.orchestra.run.trial154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 11 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T03:57:34.802 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:57:34.799+0000 7f4eedc16900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-11/keyring: can't open /var/lib/ceph/osd/ceph-11/keyring: (2) No such file or directory 2026-02-12T03:57:34.802 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:57:34.799+0000 7f4eedc16900 -1 created new key in keyring /var/lib/ceph/osd/ceph-11/keyring 2026-02-12T03:57:34.802 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:57:34.799+0000 7f4eedc16900 -1 bdev(0x556be9ee7800 /var/lib/ceph/osd/ceph-11/block) open stat got: (1) Operation not permitted 2026-02-12T03:57:34.802 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:57:34.799+0000 7f4eedc16900 -1 bluestore(/var/lib/ceph/osd/ceph-11) _read_fsid unparsable uuid 2026-02-12T03:57:35.266 DEBUG:teuthology.orchestra.run.trial154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-11 2026-02-12T03:57:35.332 DEBUG:teuthology.orchestra.run.trial154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 15 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T03:57:35.410 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:57:35.407+0000 7fd92ac1b900 -1 auth: error reading file: /var/lib/ceph/osd/ceph-15/keyring: can't open /var/lib/ceph/osd/ceph-15/keyring: (2) No such file or directory 2026-02-12T03:57:35.410 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:57:35.407+0000 7fd92ac1b900 -1 created new key in keyring /var/lib/ceph/osd/ceph-15/keyring 2026-02-12T03:57:35.410 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:57:35.407+0000 7fd92ac1b900 -1 bdev(0x55d49985b800 /var/lib/ceph/osd/ceph-15/block) open stat got: (1) Operation not permitted 2026-02-12T03:57:35.410 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:57:35.407+0000 7fd92ac1b900 -1 bluestore(/var/lib/ceph/osd/ceph-15) _read_fsid unparsable uuid 2026-02-12T03:57:35.882 DEBUG:teuthology.orchestra.run.trial154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-15 2026-02-12T03:57:35.948 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-12T03:57:35.948 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-12T03:57:35.948 DEBUG:teuthology.orchestra.run.trial091:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2026-02-12T03:57:35.976 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-12T03:57:35.976 DEBUG:teuthology.orchestra.run.trial091:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-12T03:57:36.039 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-12T03:57:36.040 DEBUG:teuthology.orchestra.run.trial091:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2026-02-12T03:57:36.104 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-12T03:57:36.104 DEBUG:teuthology.orchestra.run.trial091:> sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2026-02-12T03:57:36.167 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-12T03:57:36.168 DEBUG:teuthology.orchestra.run.trial091:> sudo dd if=/var/lib/ceph/osd/ceph-12/keyring of=/dev/stdout 2026-02-12T03:57:36.231 DEBUG:teuthology.orchestra.run.trial098:> set -ex 2026-02-12T03:57:36.231 DEBUG:teuthology.orchestra.run.trial098:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-12T03:57:36.257 DEBUG:teuthology.orchestra.run.trial098:> set -ex 2026-02-12T03:57:36.257 DEBUG:teuthology.orchestra.run.trial098:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2026-02-12T03:57:36.321 DEBUG:teuthology.orchestra.run.trial098:> set -ex 2026-02-12T03:57:36.321 DEBUG:teuthology.orchestra.run.trial098:> sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2026-02-12T03:57:36.383 DEBUG:teuthology.orchestra.run.trial098:> set -ex 2026-02-12T03:57:36.384 DEBUG:teuthology.orchestra.run.trial098:> sudo dd if=/var/lib/ceph/osd/ceph-13/keyring of=/dev/stdout 2026-02-12T03:57:36.447 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-12T03:57:36.447 DEBUG:teuthology.orchestra.run.trial111:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-12T03:57:36.474 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-12T03:57:36.474 DEBUG:teuthology.orchestra.run.trial111:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2026-02-12T03:57:36.536 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-12T03:57:36.537 DEBUG:teuthology.orchestra.run.trial111:> sudo dd if=/var/lib/ceph/osd/ceph-10/keyring of=/dev/stdout 2026-02-12T03:57:36.599 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-12T03:57:36.599 DEBUG:teuthology.orchestra.run.trial111:> sudo dd if=/var/lib/ceph/osd/ceph-14/keyring of=/dev/stdout 2026-02-12T03:57:36.662 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-12T03:57:36.663 DEBUG:teuthology.orchestra.run.trial154:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-12T03:57:36.688 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-12T03:57:36.688 DEBUG:teuthology.orchestra.run.trial154:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-12T03:57:36.753 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-12T03:57:36.754 DEBUG:teuthology.orchestra.run.trial154:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2026-02-12T03:57:36.818 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-12T03:57:36.818 DEBUG:teuthology.orchestra.run.trial154:> sudo dd if=/var/lib/ceph/osd/ceph-11/keyring of=/dev/stdout 2026-02-12T03:57:36.882 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-12T03:57:36.882 DEBUG:teuthology.orchestra.run.trial154:> sudo dd if=/var/lib/ceph/osd/ceph-15/keyring of=/dev/stdout 2026-02-12T03:57:36.946 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-12T03:57:36.946 DEBUG:teuthology.orchestra.run.trial154:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-12T03:57:37.003 INFO:tasks.ceph:Adding keys to all mons... 2026-02-12T03:57:37.003 DEBUG:teuthology.orchestra.run.trial091:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-12T03:57:37.006 DEBUG:teuthology.orchestra.run.trial098:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-12T03:57:37.008 DEBUG:teuthology.orchestra.run.trial111:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-12T03:57:37.027 INFO:teuthology.orchestra.run.trial091.stdout:[mgr.y] 2026-02-12T03:57:37.027 INFO:teuthology.orchestra.run.trial091.stdout: key = AQCZT41pgmfMBhAANvnrOkb+/n6K3KjQGqSmHQ== 2026-02-12T03:57:37.027 INFO:teuthology.orchestra.run.trial091.stdout:[osd.0] 2026-02-12T03:57:37.027 INFO:teuthology.orchestra.run.trial091.stdout: key = AQCcT41p4hjFIhAApRFFoCByP1tR3p2v48AXGw== 2026-02-12T03:57:37.027 INFO:teuthology.orchestra.run.trial091.stdout:[osd.4] 2026-02-12T03:57:37.028 INFO:teuthology.orchestra.run.trial091.stdout: key = AQCdT41p/c1vChAAS+sfzTTNhLa3xqb4LtZwkQ== 2026-02-12T03:57:37.028 INFO:teuthology.orchestra.run.trial091.stdout:[osd.8] 2026-02-12T03:57:37.028 INFO:teuthology.orchestra.run.trial091.stdout: key = AQCdT41p3+rZLRAAdEptJdq/pn38FQpngroUwQ== 2026-02-12T03:57:37.028 INFO:teuthology.orchestra.run.trial091.stdout:[osd.12] 2026-02-12T03:57:37.028 INFO:teuthology.orchestra.run.trial091.stdout: key = AQCeT41pb5xlFRAAOazfnurf1vQ0Q517VKMMeg== 2026-02-12T03:57:37.028 INFO:teuthology.orchestra.run.trial091.stdout:[osd.1] 2026-02-12T03:57:37.028 INFO:teuthology.orchestra.run.trial091.stdout: key = AQCiT41pcuk/DhAA4iLaqsrnABINOCQwRF5qoA== 2026-02-12T03:57:37.028 INFO:teuthology.orchestra.run.trial091.stdout:[osd.5] 2026-02-12T03:57:37.028 INFO:teuthology.orchestra.run.trial091.stdout: key = AQCiT41pn+psMhAASLYQecF8IbZijWs1GioThw== 2026-02-12T03:57:37.028 INFO:teuthology.orchestra.run.trial091.stdout:[osd.9] 2026-02-12T03:57:37.028 INFO:teuthology.orchestra.run.trial091.stdout: key = AQCjT41pO79lGRAATGRpMuX+t2UpYhST5ISECA== 2026-02-12T03:57:37.029 INFO:teuthology.orchestra.run.trial091.stdout:[osd.13] 2026-02-12T03:57:37.029 INFO:teuthology.orchestra.run.trial091.stdout: key = AQCkT41pwpGLAhAAUmXFCsEL4BKg0cPUS/XtDg== 2026-02-12T03:57:37.029 INFO:teuthology.orchestra.run.trial091.stdout:[osd.2] 2026-02-12T03:57:37.029 INFO:teuthology.orchestra.run.trial091.stdout: key = AQCnT41pCJ2rNxAAyTIqCqcmXmPj7iOzbM+E4A== 2026-02-12T03:57:37.029 INFO:teuthology.orchestra.run.trial091.stdout:[osd.6] 2026-02-12T03:57:37.029 INFO:teuthology.orchestra.run.trial091.stdout: key = AQCoT41pjnvVHhAAnp7EQcW9sH2+o+eGipSLHg== 2026-02-12T03:57:37.029 INFO:teuthology.orchestra.run.trial091.stdout:[osd.10] 2026-02-12T03:57:37.029 INFO:teuthology.orchestra.run.trial091.stdout: key = AQCpT41pxjARBxAArztpJzXn0JnHMEpPaldabw== 2026-02-12T03:57:37.029 INFO:teuthology.orchestra.run.trial091.stdout:[osd.14] 2026-02-12T03:57:37.029 INFO:teuthology.orchestra.run.trial091.stdout: key = AQCpT41pBJ0fKhAA88ezRNma3hABXCMlzB/Itg== 2026-02-12T03:57:37.029 INFO:teuthology.orchestra.run.trial091.stdout:[mgr.x] 2026-02-12T03:57:37.029 INFO:teuthology.orchestra.run.trial091.stdout: key = AQCZT41pla+uCRAA6TuqmFMEJxPB8+Lj4oGj+w== 2026-02-12T03:57:37.030 INFO:teuthology.orchestra.run.trial091.stdout:[osd.3] 2026-02-12T03:57:37.030 INFO:teuthology.orchestra.run.trial091.stdout: key = AQCtT41pV0tRIxAAJtlXaaKqptIFXeVXGyaQlA== 2026-02-12T03:57:37.030 INFO:teuthology.orchestra.run.trial091.stdout:[osd.7] 2026-02-12T03:57:37.030 INFO:teuthology.orchestra.run.trial091.stdout: key = AQCuT41pQJ58CxAAqOcuz/B/I9YqwDm1j/ty3A== 2026-02-12T03:57:37.030 INFO:teuthology.orchestra.run.trial091.stdout:[osd.11] 2026-02-12T03:57:37.030 INFO:teuthology.orchestra.run.trial091.stdout: key = AQCuT41pyS27LxAAcD54A7YuK/0aTdw/UITfdg== 2026-02-12T03:57:37.030 INFO:teuthology.orchestra.run.trial091.stdout:[osd.15] 2026-02-12T03:57:37.030 INFO:teuthology.orchestra.run.trial091.stdout: key = AQCvT41pmwJdGBAABBoIGyHg50qBLS0epuf7nw== 2026-02-12T03:57:37.030 INFO:teuthology.orchestra.run.trial091.stdout:[client.0] 2026-02-12T03:57:37.030 INFO:teuthology.orchestra.run.trial091.stdout: key = AQCZT41pl6XUCxAAFdvZ5YEtzVspjS50Xtqq4A== 2026-02-12T03:57:37.032 INFO:teuthology.orchestra.run.trial098.stdout:[mgr.y] 2026-02-12T03:57:37.032 INFO:teuthology.orchestra.run.trial098.stdout: key = AQCZT41pgmfMBhAANvnrOkb+/n6K3KjQGqSmHQ== 2026-02-12T03:57:37.032 INFO:teuthology.orchestra.run.trial098.stdout:[osd.0] 2026-02-12T03:57:37.032 INFO:teuthology.orchestra.run.trial098.stdout: key = AQCcT41p4hjFIhAApRFFoCByP1tR3p2v48AXGw== 2026-02-12T03:57:37.032 INFO:teuthology.orchestra.run.trial098.stdout:[osd.4] 2026-02-12T03:57:37.033 INFO:teuthology.orchestra.run.trial098.stdout: key = AQCdT41p/c1vChAAS+sfzTTNhLa3xqb4LtZwkQ== 2026-02-12T03:57:37.033 INFO:teuthology.orchestra.run.trial098.stdout:[osd.8] 2026-02-12T03:57:37.033 INFO:teuthology.orchestra.run.trial098.stdout: key = AQCdT41p3+rZLRAAdEptJdq/pn38FQpngroUwQ== 2026-02-12T03:57:37.033 INFO:teuthology.orchestra.run.trial098.stdout:[osd.12] 2026-02-12T03:57:37.033 INFO:teuthology.orchestra.run.trial098.stdout: key = AQCeT41pb5xlFRAAOazfnurf1vQ0Q517VKMMeg== 2026-02-12T03:57:37.033 INFO:teuthology.orchestra.run.trial098.stdout:[osd.1] 2026-02-12T03:57:37.033 INFO:teuthology.orchestra.run.trial098.stdout: key = AQCiT41pcuk/DhAA4iLaqsrnABINOCQwRF5qoA== 2026-02-12T03:57:37.033 INFO:teuthology.orchestra.run.trial098.stdout:[osd.5] 2026-02-12T03:57:37.033 INFO:teuthology.orchestra.run.trial098.stdout: key = AQCiT41pn+psMhAASLYQecF8IbZijWs1GioThw== 2026-02-12T03:57:37.033 INFO:teuthology.orchestra.run.trial098.stdout:[osd.9] 2026-02-12T03:57:37.033 INFO:teuthology.orchestra.run.trial098.stdout: key = AQCjT41pO79lGRAATGRpMuX+t2UpYhST5ISECA== 2026-02-12T03:57:37.034 INFO:teuthology.orchestra.run.trial098.stdout:[osd.13] 2026-02-12T03:57:37.034 INFO:teuthology.orchestra.run.trial098.stdout: key = AQCkT41pwpGLAhAAUmXFCsEL4BKg0cPUS/XtDg== 2026-02-12T03:57:37.034 INFO:teuthology.orchestra.run.trial098.stdout:[osd.2] 2026-02-12T03:57:37.034 INFO:teuthology.orchestra.run.trial098.stdout: key = AQCnT41pCJ2rNxAAyTIqCqcmXmPj7iOzbM+E4A== 2026-02-12T03:57:37.034 INFO:teuthology.orchestra.run.trial098.stdout:[osd.6] 2026-02-12T03:57:37.034 INFO:teuthology.orchestra.run.trial098.stdout: key = AQCoT41pjnvVHhAAnp7EQcW9sH2+o+eGipSLHg== 2026-02-12T03:57:37.034 INFO:teuthology.orchestra.run.trial098.stdout:[osd.10] 2026-02-12T03:57:37.034 INFO:teuthology.orchestra.run.trial098.stdout: key = AQCpT41pxjARBxAArztpJzXn0JnHMEpPaldabw== 2026-02-12T03:57:37.034 INFO:teuthology.orchestra.run.trial098.stdout:[osd.14] 2026-02-12T03:57:37.034 INFO:teuthology.orchestra.run.trial098.stdout: key = AQCpT41pBJ0fKhAA88ezRNma3hABXCMlzB/Itg== 2026-02-12T03:57:37.034 INFO:teuthology.orchestra.run.trial098.stdout:[mgr.x] 2026-02-12T03:57:37.034 INFO:teuthology.orchestra.run.trial098.stdout: key = AQCZT41pla+uCRAA6TuqmFMEJxPB8+Lj4oGj+w== 2026-02-12T03:57:37.034 INFO:teuthology.orchestra.run.trial098.stdout:[osd.3] 2026-02-12T03:57:37.034 INFO:teuthology.orchestra.run.trial098.stdout: key = AQCtT41pV0tRIxAAJtlXaaKqptIFXeVXGyaQlA== 2026-02-12T03:57:37.035 INFO:teuthology.orchestra.run.trial098.stdout:[osd.7] 2026-02-12T03:57:37.035 INFO:teuthology.orchestra.run.trial098.stdout: key = AQCuT41pQJ58CxAAqOcuz/B/I9YqwDm1j/ty3A== 2026-02-12T03:57:37.035 INFO:teuthology.orchestra.run.trial098.stdout:[osd.11] 2026-02-12T03:57:37.035 INFO:teuthology.orchestra.run.trial098.stdout: key = AQCuT41pyS27LxAAcD54A7YuK/0aTdw/UITfdg== 2026-02-12T03:57:37.035 INFO:teuthology.orchestra.run.trial098.stdout:[osd.15] 2026-02-12T03:57:37.035 INFO:teuthology.orchestra.run.trial098.stdout: key = AQCvT41pmwJdGBAABBoIGyHg50qBLS0epuf7nw== 2026-02-12T03:57:37.035 INFO:teuthology.orchestra.run.trial098.stdout:[client.0] 2026-02-12T03:57:37.035 INFO:teuthology.orchestra.run.trial098.stdout: key = AQCZT41pl6XUCxAAFdvZ5YEtzVspjS50Xtqq4A== 2026-02-12T03:57:37.036 INFO:teuthology.orchestra.run.trial111.stdout:[mgr.y] 2026-02-12T03:57:37.036 INFO:teuthology.orchestra.run.trial111.stdout: key = AQCZT41pgmfMBhAANvnrOkb+/n6K3KjQGqSmHQ== 2026-02-12T03:57:37.037 INFO:teuthology.orchestra.run.trial111.stdout:[osd.0] 2026-02-12T03:57:37.037 INFO:teuthology.orchestra.run.trial111.stdout: key = AQCcT41p4hjFIhAApRFFoCByP1tR3p2v48AXGw== 2026-02-12T03:57:37.037 INFO:teuthology.orchestra.run.trial111.stdout:[osd.4] 2026-02-12T03:57:37.037 INFO:teuthology.orchestra.run.trial111.stdout: key = AQCdT41p/c1vChAAS+sfzTTNhLa3xqb4LtZwkQ== 2026-02-12T03:57:37.037 INFO:teuthology.orchestra.run.trial111.stdout:[osd.8] 2026-02-12T03:57:37.037 INFO:teuthology.orchestra.run.trial111.stdout: key = AQCdT41p3+rZLRAAdEptJdq/pn38FQpngroUwQ== 2026-02-12T03:57:37.037 INFO:teuthology.orchestra.run.trial111.stdout:[osd.12] 2026-02-12T03:57:37.037 INFO:teuthology.orchestra.run.trial111.stdout: key = AQCeT41pb5xlFRAAOazfnurf1vQ0Q517VKMMeg== 2026-02-12T03:57:37.037 INFO:teuthology.orchestra.run.trial111.stdout:[osd.1] 2026-02-12T03:57:37.037 INFO:teuthology.orchestra.run.trial111.stdout: key = AQCiT41pcuk/DhAA4iLaqsrnABINOCQwRF5qoA== 2026-02-12T03:57:37.037 INFO:teuthology.orchestra.run.trial111.stdout:[osd.5] 2026-02-12T03:57:37.037 INFO:teuthology.orchestra.run.trial111.stdout: key = AQCiT41pn+psMhAASLYQecF8IbZijWs1GioThw== 2026-02-12T03:57:37.038 INFO:teuthology.orchestra.run.trial111.stdout:[osd.9] 2026-02-12T03:57:37.038 INFO:teuthology.orchestra.run.trial111.stdout: key = AQCjT41pO79lGRAATGRpMuX+t2UpYhST5ISECA== 2026-02-12T03:57:37.038 INFO:teuthology.orchestra.run.trial111.stdout:[osd.13] 2026-02-12T03:57:37.038 INFO:teuthology.orchestra.run.trial111.stdout: key = AQCkT41pwpGLAhAAUmXFCsEL4BKg0cPUS/XtDg== 2026-02-12T03:57:37.038 INFO:teuthology.orchestra.run.trial111.stdout:[osd.2] 2026-02-12T03:57:37.038 INFO:teuthology.orchestra.run.trial111.stdout: key = AQCnT41pCJ2rNxAAyTIqCqcmXmPj7iOzbM+E4A== 2026-02-12T03:57:37.038 INFO:teuthology.orchestra.run.trial111.stdout:[osd.6] 2026-02-12T03:57:37.038 INFO:teuthology.orchestra.run.trial111.stdout: key = AQCoT41pjnvVHhAAnp7EQcW9sH2+o+eGipSLHg== 2026-02-12T03:57:37.038 INFO:teuthology.orchestra.run.trial111.stdout:[osd.10] 2026-02-12T03:57:37.038 INFO:teuthology.orchestra.run.trial111.stdout: key = AQCpT41pxjARBxAArztpJzXn0JnHMEpPaldabw== 2026-02-12T03:57:37.038 INFO:teuthology.orchestra.run.trial111.stdout:[osd.14] 2026-02-12T03:57:37.038 INFO:teuthology.orchestra.run.trial111.stdout: key = AQCpT41pBJ0fKhAA88ezRNma3hABXCMlzB/Itg== 2026-02-12T03:57:37.039 INFO:teuthology.orchestra.run.trial111.stdout:[mgr.x] 2026-02-12T03:57:37.039 INFO:teuthology.orchestra.run.trial111.stdout: key = AQCZT41pla+uCRAA6TuqmFMEJxPB8+Lj4oGj+w== 2026-02-12T03:57:37.039 INFO:teuthology.orchestra.run.trial111.stdout:[osd.3] 2026-02-12T03:57:37.039 INFO:teuthology.orchestra.run.trial111.stdout: key = AQCtT41pV0tRIxAAJtlXaaKqptIFXeVXGyaQlA== 2026-02-12T03:57:37.039 INFO:teuthology.orchestra.run.trial111.stdout:[osd.7] 2026-02-12T03:57:37.039 INFO:teuthology.orchestra.run.trial111.stdout: key = AQCuT41pQJ58CxAAqOcuz/B/I9YqwDm1j/ty3A== 2026-02-12T03:57:37.039 INFO:teuthology.orchestra.run.trial111.stdout:[osd.11] 2026-02-12T03:57:37.039 INFO:teuthology.orchestra.run.trial111.stdout: key = AQCuT41pyS27LxAAcD54A7YuK/0aTdw/UITfdg== 2026-02-12T03:57:37.039 INFO:teuthology.orchestra.run.trial111.stdout:[osd.15] 2026-02-12T03:57:37.039 INFO:teuthology.orchestra.run.trial111.stdout: key = AQCvT41pmwJdGBAABBoIGyHg50qBLS0epuf7nw== 2026-02-12T03:57:37.039 INFO:teuthology.orchestra.run.trial111.stdout:[client.0] 2026-02-12T03:57:37.039 INFO:teuthology.orchestra.run.trial111.stdout: key = AQCZT41pl6XUCxAAFdvZ5YEtzVspjS50Xtqq4A== 2026-02-12T03:57:37.040 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-12T03:57:37.074 DEBUG:teuthology.orchestra.run.trial098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-12T03:57:37.077 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-12T03:57:37.122 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:37.154 DEBUG:teuthology.orchestra.run.trial098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:37.157 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:37.202 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:37.234 DEBUG:teuthology.orchestra.run.trial098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:37.236 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:37.281 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:37.314 DEBUG:teuthology.orchestra.run.trial098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:37.316 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:37.360 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:37.395 DEBUG:teuthology.orchestra.run.trial098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:37.397 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.12 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:37.440 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:37.475 DEBUG:teuthology.orchestra.run.trial098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:37.477 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:37.521 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:37.556 DEBUG:teuthology.orchestra.run.trial098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:37.558 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:37.599 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:37.635 DEBUG:teuthology.orchestra.run.trial098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:37.637 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:37.678 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:37.714 DEBUG:teuthology.orchestra.run.trial098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:37.717 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.13 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:37.758 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:37.793 DEBUG:teuthology.orchestra.run.trial098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:37.795 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:37.838 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:37.873 DEBUG:teuthology.orchestra.run.trial098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:37.876 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:37.917 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:37.953 DEBUG:teuthology.orchestra.run.trial098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:37.956 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:37.997 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:38.033 DEBUG:teuthology.orchestra.run.trial098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:38.035 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.14 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:38.077 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-12T03:57:38.113 DEBUG:teuthology.orchestra.run.trial098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-12T03:57:38.116 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-12T03:57:38.156 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:38.192 DEBUG:teuthology.orchestra.run.trial098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:38.195 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:38.235 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:38.273 DEBUG:teuthology.orchestra.run.trial098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:38.275 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:38.314 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:38.353 DEBUG:teuthology.orchestra.run.trial098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:38.356 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:38.397 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:38.434 DEBUG:teuthology.orchestra.run.trial098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:38.437 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.15 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T03:57:38.477 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-12T03:57:38.514 DEBUG:teuthology.orchestra.run.trial098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-12T03:57:38.517 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-12T03:57:38.558 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-12T03:57:38.558 DEBUG:teuthology.orchestra.run.trial091:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-12T03:57:38.617 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-12T03:57:38.706 DEBUG:teuthology.orchestra.run.trial091:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-12T03:57:38.731 DEBUG:teuthology.orchestra.run.trial098:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2026-02-12T03:57:38.756 DEBUG:teuthology.orchestra.run.trial098:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-12T03:57:38.843 DEBUG:teuthology.orchestra.run.trial098:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2026-02-12T03:57:38.868 DEBUG:teuthology.orchestra.run.trial111:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2026-02-12T03:57:38.893 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-12T03:57:38.980 DEBUG:teuthology.orchestra.run.trial111:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2026-02-12T03:57:39.005 DEBUG:teuthology.orchestra.run.trial091:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-12T03:57:39.007 DEBUG:teuthology.orchestra.run.trial098:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-12T03:57:39.010 DEBUG:teuthology.orchestra.run.trial111:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-12T03:57:39.062 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-12T03:57:39.063 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2026-02-12T03:57:39.063 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-12T03:57:39.064 DEBUG:teuthology.orchestra.run.trial091:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2026-02-12T03:57:39.066 INFO:tasks.ceph.mon.a:Started 2026-02-12T03:57:39.067 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2026-02-12T03:57:39.067 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-12T03:57:39.067 DEBUG:teuthology.orchestra.run.trial098:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2026-02-12T03:57:39.071 INFO:tasks.ceph.mon.b:Started 2026-02-12T03:57:39.071 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2026-02-12T03:57:39.071 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-12T03:57:39.072 DEBUG:teuthology.orchestra.run.trial111:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2026-02-12T03:57:39.105 INFO:tasks.ceph.mon.c:Started 2026-02-12T03:57:39.105 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-12T03:57:39.105 INFO:tasks.ceph.mgr.y:Restarting daemon 2026-02-12T03:57:39.106 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2026-02-12T03:57:39.108 INFO:tasks.ceph.mgr.y:Started 2026-02-12T03:57:39.108 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-12T03:57:39.108 DEBUG:teuthology.orchestra.run.trial154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2026-02-12T03:57:39.111 INFO:tasks.ceph.mgr.x:Started 2026-02-12T03:57:39.112 DEBUG:tasks.ceph:set 0 configs 2026-02-12T03:57:39.112 DEBUG:teuthology.orchestra.run.trial091:> sudo ceph --cluster ceph config dump 2026-02-12T03:57:39.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:39.177+0000 7f67e21d3640 10 monclient: get_monmap_and_config 2026-02-12T03:57:39.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:39.177+0000 7f67e21d3640 10 monclient: build_initial_monmap 2026-02-12T03:57:39.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:39.177+0000 7f67e21d3640 10 monclient: monmap: 2026-02-12T03:57:39.179 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:57:39.179 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:57:39.179 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:39.177794+0000 2026-02-12T03:57:39.179 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:39.177794+0000 2026-02-12T03:57:39.179 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:57:39.179 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:57:39.179 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:57:39.179 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:57:39.180 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:57:39.180 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:57:39.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:39.177+0000 7f67e21d3640 1 Processor -- start 2026-02-12T03:57:39.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:39.177+0000 7f67e21d3640 1 -- start start 2026-02-12T03:57:39.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:39.177+0000 7f67e21d3640 10 monclient: init 2026-02-12T03:57:39.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:39.178+0000 7f67e21d3640 10 monclient: _reopen_session rank -1 2026-02-12T03:57:39.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:39.178+0000 7f67e21d3640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T03:57:39.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:39.178+0000 7f67e21d3640 10 monclient(hunting): picked mon.noname-b con 0x7f67dc0b57a0 addr v1:10.20.193.98:6789/0 2026-02-12T03:57:39.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:39.178+0000 7f67e21d3640 10 monclient(hunting): picked mon.noname-a con 0x7f67dc0b7180 addr v1:10.20.193.91:6789/0 2026-02-12T03:57:39.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:39.178+0000 7f67e21d3640 10 monclient(hunting): picked mon.noname-c con 0x7f67dc0b5b70 addr v1:10.20.193.111:6789/0 2026-02-12T03:57:39.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:39.178+0000 7f67e21d3640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67dc163f30 con 0x7f67dc0b7180 2026-02-12T03:57:39.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:39.178+0000 7f67e21d3640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67dc0b63c0 con 0x7f67dc0b57a0 2026-02-12T03:57:39.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:39.178+0000 7f67e21d3640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67dc0b66a0 con 0x7f67dc0b5b70 2026-02-12T03:57:39.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:39.178+0000 7f67e21d3640 10 monclient(hunting): _renew_subs 2026-02-12T03:57:39.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:39.178+0000 7f67e21d3640 10 monclient(hunting): authenticate will time out at 1061.921415s 2026-02-12T03:57:39.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:39.178+0000 7f67daffd640 1 -- >> v1:10.20.193.91:6789/0 conn(0x7f67dc0b7180 legacy=0x7f67dc0565b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.91:6789/0 2026-02-12T03:57:39.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:39.178+0000 7f67db7fe640 1 -- >> v1:10.20.193.98:6789/0 conn(0x7f67dc0b57a0 legacy=0x7f67dc0b3990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.98:6789/0 2026-02-12T03:57:39.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:39.178+0000 7f67dbfff640 1 -- >> v1:10.20.193.111:6789/0 conn(0x7f67dc0b5b70 legacy=0x7f67dc1633b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.111:6789/0 2026-02-12T03:57:39.381 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:39.379+0000 7f67daffd640 1 -- >> v1:10.20.193.91:6789/0 conn(0x7f67dc0b7180 legacy=0x7f67dc0565b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.91:6789/0 2026-02-12T03:57:39.382 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:39.379+0000 7f67db7fe640 1 -- >> v1:10.20.193.98:6789/0 conn(0x7f67dc0b57a0 legacy=0x7f67dc0b3990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.98:6789/0 2026-02-12T03:57:39.382 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:39.379+0000 7f67dbfff640 1 -- >> v1:10.20.193.111:6789/0 conn(0x7f67dc0b5b70 legacy=0x7f67dc1633b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.111:6789/0 2026-02-12T03:57:39.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:39.780+0000 7f67dbfff640 1 -- >> v1:10.20.193.111:6789/0 conn(0x7f67dc0b5b70 legacy=0x7f67dc1633b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.111:6789/0 2026-02-12T03:57:39.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:39.780+0000 7f67db7fe640 1 -- >> v1:10.20.193.98:6789/0 conn(0x7f67dc0b57a0 legacy=0x7f67dc0b3990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.98:6789/0 2026-02-12T03:57:39.783 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:39.781+0000 7f67daffd640 1 -- >> v1:10.20.193.91:6789/0 conn(0x7f67dc0b7180 legacy=0x7f67dc0565b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.91:6789/0 2026-02-12T03:57:40.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:40.581+0000 7f67dbfff640 1 -- >> v1:10.20.193.111:6789/0 conn(0x7f67dc0b5b70 legacy=0x7f67dc1633b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.111:6789/0 2026-02-12T03:57:40.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:40.581+0000 7f67db7fe640 1 -- >> v1:10.20.193.98:6789/0 conn(0x7f67dc0b57a0 legacy=0x7f67dc0b3990 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.98:6789/0 2026-02-12T03:57:40.584 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:40.582+0000 7f67daffd640 1 -- >> v1:10.20.193.91:6789/0 conn(0x7f67dc0b7180 legacy=0x7f67dc0565b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.91:6789/0 2026-02-12T03:57:41.194 INFO:tasks.ceph.mon.a.trial091.stderr:--00:00:00:02.078 26771-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/43/01dfb4e8841e01e0f159705af3e218c9ff2187.debug 2026-02-12T03:57:41.203 INFO:tasks.ceph.mon.b.trial098.stderr:--00:00:00:02.084 26314-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/43/01dfb4e8841e01e0f159705af3e218c9ff2187.debug 2026-02-12T03:57:41.237 INFO:tasks.ceph.mon.c.trial111.stderr:--00:00:00:02.084 26248-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/43/01dfb4e8841e01e0f159705af3e218c9ff2187.debug 2026-02-12T03:57:42.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:42.178+0000 7f67d97fa640 10 monclient(hunting): tick 2026-02-12T03:57:42.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:42.178+0000 7f67d97fa640 10 monclient(hunting): _check_auth_tickets 2026-02-12T03:57:42.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:42.178+0000 7f67d97fa640 1 monclient(hunting): continuing hunt 2026-02-12T03:57:42.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:42.178+0000 7f67d97fa640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T03:57:42.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:42.178+0000 7f67d97fa640 1 -- >> v1:10.20.193.111:6789/0 conn(0x7f67dc0b5b70 legacy=0x7f67dc1633b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T03:57:42.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:42.178+0000 7f67d97fa640 1 -- >> v1:10.20.193.98:6789/0 conn(0x7f67dc0b57a0 legacy=0x7f67dc0b3990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T03:57:42.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:42.178+0000 7f67d97fa640 1 -- >> v1:10.20.193.91:6789/0 conn(0x7f67dc0b7180 legacy=0x7f67dc0565b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T03:57:42.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:42.178+0000 7f67d97fa640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T03:57:42.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:42.178+0000 7f67d97fa640 10 monclient(hunting): picked mon.noname-c con 0x7f67dc0b5b70 addr v1:10.20.193.111:6789/0 2026-02-12T03:57:42.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:42.178+0000 7f67d97fa640 10 monclient(hunting): picked mon.noname-a con 0x7f67dc0b7180 addr v1:10.20.193.91:6789/0 2026-02-12T03:57:42.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:42.178+0000 7f67d97fa640 10 monclient(hunting): picked mon.noname-b con 0x7f67dc0b57a0 addr v1:10.20.193.98:6789/0 2026-02-12T03:57:42.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:42.178+0000 7f67daffd640 1 -- >> v1:10.20.193.91:6789/0 conn(0x7f67dc0b7180 legacy=0x7f67b8045050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.91:6789/0 2026-02-12T03:57:42.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:42.178+0000 7f67d97fa640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67dc0b6980 con 0x7f67dc0b7180 2026-02-12T03:57:42.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:42.178+0000 7f67d97fa640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67dc163f30 con 0x7f67dc0b57a0 2026-02-12T03:57:42.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:42.178+0000 7f67d97fa640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67dc0b63c0 con 0x7f67dc0b5b70 2026-02-12T03:57:42.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:42.178+0000 7f67d97fa640 10 monclient(hunting): _renew_subs 2026-02-12T03:57:42.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:42.178+0000 7f67db7fe640 1 -- >> v1:10.20.193.111:6789/0 conn(0x7f67dc0b5b70 legacy=0x7f67b80237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.111:6789/0 2026-02-12T03:57:42.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:42.178+0000 7f67dbfff640 1 -- >> v1:10.20.193.98:6789/0 conn(0x7f67dc0b57a0 legacy=0x7f67b8066910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.98:6789/0 2026-02-12T03:57:42.382 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:42.379+0000 7f67daffd640 1 -- >> v1:10.20.193.91:6789/0 conn(0x7f67dc0b7180 legacy=0x7f67b8045050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.91:6789/0 2026-02-12T03:57:42.382 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:42.379+0000 7f67dbfff640 1 -- >> v1:10.20.193.98:6789/0 conn(0x7f67dc0b57a0 legacy=0x7f67b8066910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.98:6789/0 2026-02-12T03:57:42.382 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:42.379+0000 7f67db7fe640 1 -- >> v1:10.20.193.111:6789/0 conn(0x7f67dc0b5b70 legacy=0x7f67b80237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.111:6789/0 2026-02-12T03:57:42.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:42.780+0000 7f67daffd640 1 -- >> v1:10.20.193.91:6789/0 conn(0x7f67dc0b7180 legacy=0x7f67b8045050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.91:6789/0 2026-02-12T03:57:42.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:42.780+0000 7f67dbfff640 1 -- >> v1:10.20.193.98:6789/0 conn(0x7f67dc0b57a0 legacy=0x7f67b8066910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.98:6789/0 2026-02-12T03:57:42.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:42.780+0000 7f67db7fe640 1 -- >> v1:10.20.193.111:6789/0 conn(0x7f67dc0b5b70 legacy=0x7f67b80237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.111:6789/0 2026-02-12T03:57:43.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:43.581+0000 7f67dbfff640 1 -- >> v1:10.20.193.98:6789/0 conn(0x7f67dc0b57a0 legacy=0x7f67b8066910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.98:6789/0 2026-02-12T03:57:43.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:43.581+0000 7f67db7fe640 1 -- >> v1:10.20.193.111:6789/0 conn(0x7f67dc0b5b70 legacy=0x7f67b80237c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.111:6789/0 2026-02-12T03:57:43.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:43.581+0000 7f67daffd640 1 -- >> v1:10.20.193.91:6789/0 conn(0x7f67dc0b7180 legacy=0x7f67b8045050 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.91:6789/0 2026-02-12T03:57:45.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:45.178+0000 7f67d97fa640 10 monclient(hunting): tick 2026-02-12T03:57:45.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:45.178+0000 7f67d97fa640 10 monclient(hunting): _check_auth_tickets 2026-02-12T03:57:45.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:45.178+0000 7f67d97fa640 1 monclient(hunting): continuing hunt 2026-02-12T03:57:45.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:45.178+0000 7f67d97fa640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T03:57:45.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:45.178+0000 7f67d97fa640 1 -- >> v1:10.20.193.111:6789/0 conn(0x7f67dc0b5b70 legacy=0x7f67b80237c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T03:57:45.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:45.178+0000 7f67d97fa640 1 -- >> v1:10.20.193.98:6789/0 conn(0x7f67dc0b57a0 legacy=0x7f67b8066910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T03:57:45.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:45.178+0000 7f67d97fa640 1 -- >> v1:10.20.193.91:6789/0 conn(0x7f67dc0b7180 legacy=0x7f67b8045050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T03:57:45.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:45.178+0000 7f67d97fa640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T03:57:45.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:45.178+0000 7f67d97fa640 10 monclient(hunting): picked mon.noname-a con 0x7f67dc0b7180 addr v1:10.20.193.91:6789/0 2026-02-12T03:57:45.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:45.178+0000 7f67d97fa640 10 monclient(hunting): picked mon.noname-c con 0x7f67dc0b5b70 addr v1:10.20.193.111:6789/0 2026-02-12T03:57:45.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:45.178+0000 7f67d97fa640 10 monclient(hunting): picked mon.noname-b con 0x7f67dc0b57a0 addr v1:10.20.193.98:6789/0 2026-02-12T03:57:45.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:45.178+0000 7f67d97fa640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67dc0b66a0 con 0x7f67dc0b7180 2026-02-12T03:57:45.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:45.178+0000 7f67d97fa640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67dc0b6980 con 0x7f67dc0b57a0 2026-02-12T03:57:45.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:45.178+0000 7f67d97fa640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67dc163f30 con 0x7f67dc0b5b70 2026-02-12T03:57:45.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:45.178+0000 7f67d97fa640 10 monclient(hunting): _renew_subs 2026-02-12T03:57:45.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:45.178+0000 7f67db7fe640 1 -- >> v1:10.20.193.91:6789/0 conn(0x7f67dc0b7180 legacy=0x7f67b8044fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.91:6789/0 2026-02-12T03:57:45.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:45.178+0000 7f67daffd640 1 -- >> v1:10.20.193.111:6789/0 conn(0x7f67dc0b5b70 legacy=0x7f67b8023720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.111:6789/0 2026-02-12T03:57:45.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:45.178+0000 7f67dbfff640 1 -- >> v1:10.20.193.98:6789/0 conn(0x7f67dc0b57a0 legacy=0x7f67b8066910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.98:6789/0 2026-02-12T03:57:45.382 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:45.379+0000 7f67db7fe640 1 -- >> v1:10.20.193.91:6789/0 conn(0x7f67dc0b7180 legacy=0x7f67b8044fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.91:6789/0 2026-02-12T03:57:45.382 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:45.379+0000 7f67daffd640 1 -- >> v1:10.20.193.111:6789/0 conn(0x7f67dc0b5b70 legacy=0x7f67b8023720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.111:6789/0 2026-02-12T03:57:45.382 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:45.380+0000 7f67dbfff640 1 -- >> v1:10.20.193.98:6789/0 conn(0x7f67dc0b57a0 legacy=0x7f67b8066910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.98:6789/0 2026-02-12T03:57:45.494 INFO:tasks.ceph.mon.a.trial091.stderr:--00:00:00:06.378 26771-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/b5/1de9b7b31e49de51adf283321980c125eac514.debug 2026-02-12T03:57:45.510 INFO:tasks.ceph.mon.b.trial098.stderr:--00:00:00:06.390 26314-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/b5/1de9b7b31e49de51adf283321980c125eac514.debug 2026-02-12T03:57:45.560 INFO:tasks.ceph.mon.c.trial111.stderr:--00:00:00:06.407 26248-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/b5/1de9b7b31e49de51adf283321980c125eac514.debug 2026-02-12T03:57:45.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:45.780+0000 7f67db7fe640 1 -- >> v1:10.20.193.91:6789/0 conn(0x7f67dc0b7180 legacy=0x7f67b8044fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.91:6789/0 2026-02-12T03:57:45.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:45.780+0000 7f67daffd640 1 -- >> v1:10.20.193.111:6789/0 conn(0x7f67dc0b5b70 legacy=0x7f67b8023720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.111:6789/0 2026-02-12T03:57:45.783 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:45.781+0000 7f67dbfff640 1 -- >> v1:10.20.193.98:6789/0 conn(0x7f67dc0b57a0 legacy=0x7f67b8066910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.98:6789/0 2026-02-12T03:57:46.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:46.581+0000 7f67db7fe640 1 -- >> v1:10.20.193.91:6789/0 conn(0x7f67dc0b7180 legacy=0x7f67b8044fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.91:6789/0 2026-02-12T03:57:46.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:46.582+0000 7f67daffd640 1 -- >> v1:10.20.193.111:6789/0 conn(0x7f67dc0b5b70 legacy=0x7f67b8023720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.111:6789/0 2026-02-12T03:57:46.584 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:46.582+0000 7f67dbfff640 1 -- >> v1:10.20.193.98:6789/0 conn(0x7f67dc0b57a0 legacy=0x7f67b8066910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.98:6789/0 2026-02-12T03:57:47.006 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:00:07.890 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T03:57:47.023 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:00:07.904 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T03:57:47.078 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:00:07.925 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T03:57:47.154 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:00:08.038 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T03:57:47.172 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:00:08.053 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T03:57:47.227 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:00:08.074 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T03:57:48.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:48.178+0000 7f67d97fa640 10 monclient(hunting): tick 2026-02-12T03:57:48.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:48.178+0000 7f67d97fa640 10 monclient(hunting): _check_auth_tickets 2026-02-12T03:57:48.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:48.178+0000 7f67d97fa640 1 monclient(hunting): continuing hunt 2026-02-12T03:57:48.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:48.178+0000 7f67d97fa640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T03:57:48.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:48.178+0000 7f67d97fa640 1 -- >> v1:10.20.193.111:6789/0 conn(0x7f67dc0b5b70 legacy=0x7f67b8023720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T03:57:48.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:48.178+0000 7f67d97fa640 1 -- >> v1:10.20.193.98:6789/0 conn(0x7f67dc0b57a0 legacy=0x7f67b8066910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T03:57:48.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:48.178+0000 7f67d97fa640 1 -- >> v1:10.20.193.91:6789/0 conn(0x7f67dc0b7180 legacy=0x7f67b8044fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T03:57:48.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:48.178+0000 7f67d97fa640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T03:57:48.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:48.178+0000 7f67d97fa640 10 monclient(hunting): picked mon.noname-a con 0x7f67b806a220 addr v1:10.20.193.91:6789/0 2026-02-12T03:57:48.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:48.178+0000 7f67d97fa640 10 monclient(hunting): picked mon.noname-c con 0x7f67dc0b5b70 addr v1:10.20.193.111:6789/0 2026-02-12T03:57:48.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:48.178+0000 7f67d97fa640 10 monclient(hunting): picked mon.noname-b con 0x7f67dc0b57a0 addr v1:10.20.193.98:6789/0 2026-02-12T03:57:48.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:48.178+0000 7f67d97fa640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67dc0b63c0 con 0x7f67b806a220 2026-02-12T03:57:48.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:48.178+0000 7f67d97fa640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67dc0b66a0 con 0x7f67dc0b57a0 2026-02-12T03:57:48.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:48.178+0000 7f67d97fa640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67dc0b6980 con 0x7f67dc0b5b70 2026-02-12T03:57:48.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:48.178+0000 7f67d97fa640 10 monclient(hunting): _renew_subs 2026-02-12T03:57:48.195 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:48.194+0000 7f67daffd640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f67dc0b5b70 0x7f67b8023720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:56132/0 (socket says 10.20.193.91:56132) 2026-02-12T03:57:48.196 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:48.194+0000 7f67daffd640 1 -- 10.20.193.91:0/872668380 learned_addr learned my addr 10.20.193.91:0/872668380 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:57:51.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:51.178+0000 7f67d97fa640 10 monclient(hunting): tick 2026-02-12T03:57:51.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:51.178+0000 7f67d97fa640 10 monclient(hunting): _check_auth_tickets 2026-02-12T03:57:51.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:51.178+0000 7f67d97fa640 1 monclient(hunting): continuing hunt 2026-02-12T03:57:51.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:51.178+0000 7f67d97fa640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T03:57:51.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:51.178+0000 7f67d97fa640 1 -- 10.20.193.91:0/872668380 >> v1:10.20.193.111:6789/0 conn(0x7f67dc0b5b70 legacy=0x7f67b8023720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:57:51.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:51.178+0000 7f67d97fa640 1 -- 10.20.193.91:0/872668380 >> v1:10.20.193.98:6789/0 conn(0x7f67dc0b57a0 legacy=0x7f67b8066910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:57:51.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:51.178+0000 7f67d97fa640 1 -- 10.20.193.91:0/872668380 >> v1:10.20.193.91:6789/0 conn(0x7f67b806a220 legacy=0x7f67b806a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:57:51.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:51.178+0000 7f67d97fa640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T03:57:51.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:51.178+0000 7f67d97fa640 10 monclient(hunting): picked mon.noname-a con 0x7f67b8023ed0 addr v1:10.20.193.91:6789/0 2026-02-12T03:57:51.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:51.178+0000 7f67d97fa640 10 monclient(hunting): picked mon.noname-c con 0x7f67dc0b5b70 addr v1:10.20.193.111:6789/0 2026-02-12T03:57:51.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:51.178+0000 7f67d97fa640 10 monclient(hunting): picked mon.noname-b con 0x7f67dc0b57a0 addr v1:10.20.193.98:6789/0 2026-02-12T03:57:51.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:51.178+0000 7f67d97fa640 1 -- 10.20.193.91:0/872668380 --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67dc163f30 con 0x7f67b8023ed0 2026-02-12T03:57:51.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:51.178+0000 7f67d97fa640 1 -- 10.20.193.91:0/872668380 --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67b806a5f0 con 0x7f67dc0b57a0 2026-02-12T03:57:51.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:51.178+0000 7f67d97fa640 1 -- 10.20.193.91:0/872668380 --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67b806a7c0 con 0x7f67dc0b5b70 2026-02-12T03:57:51.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:51.178+0000 7f67d97fa640 10 monclient(hunting): _renew_subs 2026-02-12T03:57:54.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:54.179+0000 7f67d97fa640 10 monclient(hunting): tick 2026-02-12T03:57:54.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:54.179+0000 7f67d97fa640 10 monclient(hunting): _check_auth_tickets 2026-02-12T03:57:54.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:54.179+0000 7f67d97fa640 1 monclient(hunting): continuing hunt 2026-02-12T03:57:54.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:54.179+0000 7f67d97fa640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T03:57:54.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:54.179+0000 7f67d97fa640 1 -- 10.20.193.91:0/872668380 >> v1:10.20.193.111:6789/0 conn(0x7f67dc0b5b70 legacy=0x7f67b8023720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:57:54.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:54.179+0000 7f67d97fa640 1 -- 10.20.193.91:0/872668380 >> v1:10.20.193.98:6789/0 conn(0x7f67dc0b57a0 legacy=0x7f67b8066910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:57:54.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:54.179+0000 7f67d97fa640 1 -- 10.20.193.91:0/872668380 >> v1:10.20.193.91:6789/0 conn(0x7f67b8023ed0 legacy=0x7f67b8044fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:57:54.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:54.179+0000 7f67d97fa640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T03:57:54.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:54.179+0000 7f67d97fa640 10 monclient(hunting): picked mon.noname-b con 0x7f67dc0b57a0 addr v1:10.20.193.98:6789/0 2026-02-12T03:57:54.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:54.179+0000 7f67d97fa640 10 monclient(hunting): picked mon.noname-c con 0x7f67dc0b5b70 addr v1:10.20.193.111:6789/0 2026-02-12T03:57:54.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:54.179+0000 7f67d97fa640 10 monclient(hunting): picked mon.noname-a con 0x7f67b80249b0 addr v1:10.20.193.91:6789/0 2026-02-12T03:57:54.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:54.179+0000 7f67d97fa640 1 -- 10.20.193.91:0/872668380 --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67b806aa30 con 0x7f67b80249b0 2026-02-12T03:57:54.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:54.179+0000 7f67d97fa640 1 -- 10.20.193.91:0/872668380 --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67b808c270 con 0x7f67dc0b57a0 2026-02-12T03:57:54.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:54.179+0000 7f67d97fa640 1 -- 10.20.193.91:0/872668380 --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67b80691c0 con 0x7f67dc0b5b70 2026-02-12T03:57:54.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:54.179+0000 7f67d97fa640 10 monclient(hunting): _renew_subs 2026-02-12T03:57:57.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:57.178+0000 7f67d97fa640 10 monclient(hunting): tick 2026-02-12T03:57:57.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:57.178+0000 7f67d97fa640 10 monclient(hunting): _check_auth_tickets 2026-02-12T03:57:57.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:57.178+0000 7f67d97fa640 1 monclient(hunting): continuing hunt 2026-02-12T03:57:57.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:57.178+0000 7f67d97fa640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T03:57:57.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:57.178+0000 7f67d97fa640 1 -- 10.20.193.91:0/872668380 >> v1:10.20.193.111:6789/0 conn(0x7f67dc0b5b70 legacy=0x7f67b8023720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:57:57.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:57.178+0000 7f67d97fa640 1 -- 10.20.193.91:0/872668380 >> v1:10.20.193.98:6789/0 conn(0x7f67dc0b57a0 legacy=0x7f67b80242a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:57:57.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:57.178+0000 7f67d97fa640 1 -- 10.20.193.91:0/872668380 >> v1:10.20.193.91:6789/0 conn(0x7f67b80249b0 legacy=0x7f67b8066910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:57:57.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:57.178+0000 7f67d97fa640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T03:57:57.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:57.178+0000 7f67d97fa640 10 monclient(hunting): picked mon.noname-b con 0x7f67b8069600 addr v1:10.20.193.98:6789/0 2026-02-12T03:57:57.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:57.178+0000 7f67d97fa640 10 monclient(hunting): picked mon.noname-a con 0x7f67b8045020 addr v1:10.20.193.91:6789/0 2026-02-12T03:57:57.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:57.178+0000 7f67d97fa640 10 monclient(hunting): picked mon.noname-c con 0x7f67dc0b5b70 addr v1:10.20.193.111:6789/0 2026-02-12T03:57:57.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:57.178+0000 7f67d97fa640 1 -- 10.20.193.91:0/872668380 --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67b8069430 con 0x7f67b8045020 2026-02-12T03:57:57.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:57.178+0000 7f67d97fa640 1 -- 10.20.193.91:0/872668380 --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67b8067920 con 0x7f67b8069600 2026-02-12T03:57:57.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:57.178+0000 7f67d97fa640 1 -- 10.20.193.91:0/872668380 --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67b8067af0 con 0x7f67dc0b5b70 2026-02-12T03:57:57.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:57.178+0000 7f67d97fa640 10 monclient(hunting): _renew_subs 2026-02-12T03:57:59.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.607+0000 7f67da7fc640 1 -- 10.20.193.91:0/872668380 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 805214103 0 0) 0x7f67b8067920 con 0x7f67b8069600 2026-02-12T03:57:59.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.607+0000 7f67da7fc640 10 monclient(hunting): _negotiate 2026-02-12T03:57:59.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.607+0000 7f67da7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:57:59.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.607+0000 7f67da7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:57:59.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.607+0000 7f67da7fc640 10 monclient(hunting): my global_id is 4105 2026-02-12T03:57:59.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.607+0000 7f67da7fc640 1 -- 10.20.193.91:0/872668380 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67c0003610 con 0x7f67b8069600 2026-02-12T03:57:59.624 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.621+0000 7f67da7fc640 1 -- 10.20.193.91:0/872668380 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3932145662 0 0) 0x7f67b8069430 con 0x7f67b8045020 2026-02-12T03:57:59.624 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.621+0000 7f67da7fc640 10 monclient(hunting): _negotiate 2026-02-12T03:57:59.624 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.621+0000 7f67da7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:57:59.624 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.621+0000 7f67da7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:57:59.624 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.621+0000 7f67da7fc640 10 monclient(hunting): my global_id is 4101 2026-02-12T03:57:59.624 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.621+0000 7f67da7fc640 1 -- 10.20.193.91:0/872668380 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67b8067920 con 0x7f67b8045020 2026-02-12T03:57:59.633 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.630+0000 7f67da7fc640 1 -- 10.20.193.91:0/872668380 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 944165558 0 0) 0x7f67b8067af0 con 0x7f67dc0b5b70 2026-02-12T03:57:59.633 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.630+0000 7f67da7fc640 10 monclient(hunting): _negotiate 2026-02-12T03:57:59.633 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.630+0000 7f67da7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:57:59.633 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.630+0000 7f67da7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:57:59.633 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.630+0000 7f67da7fc640 10 monclient(hunting): my global_id is 4106 2026-02-12T03:57:59.633 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.630+0000 7f67da7fc640 1 -- 10.20.193.91:0/872668380 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67b8069430 con 0x7f67dc0b5b70 2026-02-12T03:57:59.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.647+0000 7f67da7fc640 1 -- 10.20.193.91:0/872668380 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1282304727 0 0) 0x7f67b8067920 con 0x7f67b8045020 2026-02-12T03:57:59.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.647+0000 7f67da7fc640 1 -- 10.20.193.91:0/872668380 >> v1:10.20.193.111:6789/0 conn(0x7f67dc0b5b70 legacy=0x7f67b80242a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:57:59.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.647+0000 7f67da7fc640 1 -- 10.20.193.91:0/872668380 >> v1:10.20.193.98:6789/0 conn(0x7f67b8069600 legacy=0x7f67b80699d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:57:59.651 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.647+0000 7f67da7fc640 10 monclient: _finish_hunting 0 2026-02-12T03:57:59.651 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.647+0000 7f67da7fc640 1 monclient: found mon.noname-a 2026-02-12T03:57:59.651 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.647+0000 7f67da7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:57:59.651 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.647+0000 7f67da7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.91:6789/0 2026-02-12T03:57:59.651 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.647+0000 7f67da7fc640 1 -- 10.20.193.91:0/872668380 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b8067d10 con 0x7f67b8045020 2026-02-12T03:57:59.651 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.647+0000 7f67da7fc640 10 monclient: _finish_auth 0 2026-02-12T03:57:59.651 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.647+0000 7f67da7fc640 10 monclient: _check_auth_tickets 2026-02-12T03:57:59.651 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.647+0000 7f67da7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:57:59.651 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.647+0000 7f67da7fc640 1 -- 10.20.193.91:0/872668380 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f67cc0040a0 con 0x7f67b8045020 2026-02-12T03:57:59.651 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.647+0000 7f67e21d3640 5 monclient: authenticate success, global_id 4101 2026-02-12T03:57:59.651 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.647+0000 7f67e21d3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:57:59.652 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.647+0000 7f67da7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:57:59.652 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.647+0000 7f67da7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:57:59.652 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.647+0000 7f67da7fc640 10 monclient: dump: 2026-02-12T03:57:59.652 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:57:59.652 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:57:59.652 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:57:59.652 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:57:59.652 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:57:59.652 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:57:59.652 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:57:59.652 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:57:59.653 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:57:59.653 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:57:59.653 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.647+0000 7f67e21d3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:57:59.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.652+0000 7f67da7fc640 1 -- 10.20.193.91:0/872668380 <== mon.0 v1:10.20.193.91:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f67cc0042e0 con 0x7f67b8045020 2026-02-12T03:57:59.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.652+0000 7f67da7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T03:57:59.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.652+0000 7f67da7fc640 1 -- 10.20.193.91:0/872668380 <== mon.0 v1:10.20.193.91:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f67cc004720 con 0x7f67b8045020 2026-02-12T03:57:59.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.652+0000 7f67da7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:57:59.659 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.652+0000 7f67da7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:57:59.659 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.652+0000 7f67da7fc640 10 monclient: dump: 2026-02-12T03:57:59.659 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:57:59.659 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:57:59.659 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:57:59.659 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:57:59.659 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:57:59.659 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:57:59.659 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:57:59.659 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:57:59.659 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:57:59.660 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:57:59.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.652+0000 7f67e21d3640 10 monclient: get_monmap_and_config success 2026-02-12T03:57:59.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.652+0000 7f67e21d3640 4 set_mon_vals no callback set 2026-02-12T03:57:59.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.653+0000 7f67e21d3640 10 monclient: shutdown 2026-02-12T03:57:59.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.653+0000 7f67e21d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:57:59.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.653+0000 7f67e21d3640 1 -- 10.20.193.91:0/872668380 >> v1:10.20.193.91:6789/0 conn(0x7f67b8045020 legacy=0x7f67b80680e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:57:59.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.653+0000 7f67e21d3640 1 -- 10.20.193.91:0/872668380 shutdown_connections 2026-02-12T03:57:59.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.653+0000 7f67e21d3640 1 -- 10.20.193.91:0/872668380 >> 10.20.193.91:0/872668380 conn(0x7f67dc0559c0 msgr2=0x7f67dc055dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:57:59.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.653+0000 7f67e21d3640 1 -- 10.20.193.91:0/872668380 shutdown_connections 2026-02-12T03:57:59.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.653+0000 7f67e21d3640 1 -- 10.20.193.91:0/872668380 wait complete. 2026-02-12T03:57:59.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.653+0000 7f67e21d3640 10 monclient: build_initial_monmap 2026-02-12T03:57:59.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.653+0000 7f67e21d3640 10 monclient: monmap: 2026-02-12T03:57:59.661 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:57:59.661 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:57:59.661 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:57:59.661 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:57:59.661 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:57:59.661 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:57:59.661 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:57:59.661 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:57:59.661 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:57:59.661 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:57:59.661 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.653+0000 7f67e21d3640 1 librados: starting msgr at 2026-02-12T03:57:59.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.653+0000 7f67e21d3640 1 librados: starting objecter 2026-02-12T03:57:59.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.653+0000 7f67e21d3640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:57:59.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.653+0000 7f67e21d3640 1 Processor -- start 2026-02-12T03:57:59.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.654+0000 7f67e21d3640 1 -- start start 2026-02-12T03:57:59.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.654+0000 7f67e21d3640 1 librados: setting wanted keys 2026-02-12T03:57:59.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.654+0000 7f67e21d3640 1 librados: calling monclient init 2026-02-12T03:57:59.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.654+0000 7f67e21d3640 10 monclient: init 2026-02-12T03:57:59.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.654+0000 7f67e21d3640 10 monclient: _reopen_session rank -1 2026-02-12T03:57:59.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.654+0000 7f67e21d3640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T03:57:59.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.654+0000 7f67e21d3640 10 monclient(hunting): picked mon.noname-a con 0x7f67b8045020 addr v1:10.20.193.91:6789/0 2026-02-12T03:57:59.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.654+0000 7f67e21d3640 10 monclient(hunting): picked mon.noname-c con 0x7f67b8069600 addr v1:10.20.193.111:6789/0 2026-02-12T03:57:59.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.654+0000 7f67e21d3640 10 monclient(hunting): picked mon.noname-b con 0x7f67dc0b5b70 addr v1:10.20.193.98:6789/0 2026-02-12T03:57:59.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.654+0000 7f67e21d3640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67dc1416f0 con 0x7f67b8045020 2026-02-12T03:57:59.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.654+0000 7f67e21d3640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67dc15d760 con 0x7f67dc0b5b70 2026-02-12T03:57:59.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.654+0000 7f67e21d3640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67dc144290 con 0x7f67b8069600 2026-02-12T03:57:59.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.654+0000 7f67e21d3640 10 monclient(hunting): _renew_subs 2026-02-12T03:57:59.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.654+0000 7f67e21d3640 10 monclient(hunting): authenticate will time out at 1082.398416s 2026-02-12T03:57:59.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.654+0000 7f67dbfff640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f67dc0b5b70 0x7f67dc15d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:42648/0 (socket says 10.20.193.91:42648) 2026-02-12T03:57:59.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.654+0000 7f67dbfff640 1 -- 10.20.193.91:0/4092429012 learned_addr learned my addr 10.20.193.91:0/4092429012 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:57:59.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.655+0000 7f67b7fff640 10 client.?.objecter ms_handle_connect 0x7f67dc0b5b70 2026-02-12T03:57:59.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.655+0000 7f67b7fff640 10 client.?.objecter resend_mon_ops 2026-02-12T03:57:59.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.655+0000 7f67dbfff640 1 -- 10.20.193.91:0/4092429012 >> v1:10.20.193.98:6789/0 conn(0x7f67dc0b5b70 legacy=0x7f67dc15d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-12T03:57:59.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.655+0000 7f67dbfff640 1 -- 10.20.193.91:0/4092429012 >> v1:10.20.193.98:6789/0 conn(0x7f67dc0b5b70 legacy=0x7f67dc15d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T03:57:59.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.655+0000 7f67dbfff640 1 --1- 10.20.193.91:0/4092429012 >> v1:10.20.193.98:6789/0 conn(0x7f67dc0b5b70 0x7f67dc15d050 :-1 s=OPENED pgs=22 cs=1 l=1).handle_message read tag failed 2026-02-12T03:57:59.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.655+0000 7f67dbfff640 1 --1- 10.20.193.91:0/4092429012 >> v1:10.20.193.98:6789/0 conn(0x7f67dc0b5b70 0x7f67dc15d050 :-1 s=OPENED pgs=22 cs=1 l=1).fault on lossy channel, failing 2026-02-12T03:57:59.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.655+0000 7f67b7fff640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.98:6789/0 2026-02-12T03:57:59.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.655+0000 7f67b7fff640 10 client.?.objecter ms_handle_connect 0x7f67b8069600 2026-02-12T03:57:59.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.655+0000 7f67b7fff640 10 client.?.objecter resend_mon_ops 2026-02-12T03:57:59.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.657+0000 7f67b7fff640 10 client.?.objecter ms_handle_connect 0x7f67b8045020 2026-02-12T03:57:59.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.657+0000 7f67b7fff640 10 client.?.objecter resend_mon_ops 2026-02-12T03:57:59.671 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.667+0000 7f67b7fff640 1 -- 10.20.193.91:0/4092429012 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2041517358 0 0) 0x7f67dc1416f0 con 0x7f67b8045020 2026-02-12T03:57:59.671 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.667+0000 7f67b7fff640 10 monclient(hunting): _negotiate 2026-02-12T03:57:59.671 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.667+0000 7f67b7fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:57:59.671 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.667+0000 7f67b7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:57:59.671 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.667+0000 7f67b7fff640 10 monclient(hunting): my global_id is 4110 2026-02-12T03:57:59.671 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.667+0000 7f67b7fff640 1 -- 10.20.193.91:0/4092429012 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67ac003610 con 0x7f67b8045020 2026-02-12T03:57:59.705 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.701+0000 7f67b7fff640 1 -- 10.20.193.91:0/4092429012 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1837409024 0 0) 0x7f67ac003610 con 0x7f67b8045020 2026-02-12T03:57:59.705 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.701+0000 7f67b7fff640 1 -- 10.20.193.91:0/4092429012 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f67dc1416f0 con 0x7f67b8045020 2026-02-12T03:57:59.705 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.701+0000 7f67b7fff640 1 -- 10.20.193.91:0/4092429012 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f67c80041c0 con 0x7f67b8045020 2026-02-12T03:57:59.705 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.701+0000 7f67b7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:57:59.705 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.701+0000 7f67b7fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:57:59.705 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.701+0000 7f67b7fff640 10 monclient(hunting): dump: 2026-02-12T03:57:59.705 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:57:59.706 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:57:59.706 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:57:59.706 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:57:59.706 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:57:59.706 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:57:59.706 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:57:59.706 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:57:59.706 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:57:59.706 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:57:59.706 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.701+0000 7f67b7fff640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:57:59.707 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.703+0000 7f67b7fff640 1 -- 10.20.193.91:0/4092429012 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1902587329 0 0) 0x7f67dc144290 con 0x7f67b8069600 2026-02-12T03:57:59.707 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.703+0000 7f67b7fff640 10 monclient(hunting): _negotiate 2026-02-12T03:57:59.707 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.703+0000 7f67b7fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:57:59.707 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.703+0000 7f67b7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:57:59.707 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.703+0000 7f67b7fff640 10 monclient(hunting): my global_id is 4115 2026-02-12T03:57:59.708 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.703+0000 7f67b7fff640 1 -- 10.20.193.91:0/4092429012 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67ac003610 con 0x7f67b8069600 2026-02-12T03:57:59.710 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.706+0000 7f67b7fff640 1 -- 10.20.193.91:0/4092429012 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1883512908 0 0) 0x7f67dc1416f0 con 0x7f67b8045020 2026-02-12T03:57:59.710 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.706+0000 7f67b7fff640 1 -- 10.20.193.91:0/4092429012 >> v1:10.20.193.111:6789/0 conn(0x7f67b8069600 legacy=0x7f67dc140fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:57:59.711 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.706+0000 7f67b7fff640 1 -- 10.20.193.91:0/4092429012 >> v1:10.20.193.98:6789/0 conn(0x7f67dc0b5b70 legacy=0x7f67dc15d050 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T03:57:59.711 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.706+0000 7f67b7fff640 10 monclient: _finish_hunting 0 2026-02-12T03:57:59.711 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.706+0000 7f67b7fff640 1 monclient: found mon.a 2026-02-12T03:57:59.711 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.706+0000 7f67b7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:57:59.711 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.706+0000 7f67b7fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:57:59.711 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.706+0000 7f67b7fff640 1 -- 10.20.193.91:0/4092429012 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67dc144570 con 0x7f67b8045020 2026-02-12T03:57:59.711 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.706+0000 7f67b7fff640 10 monclient: _finish_auth 0 2026-02-12T03:57:59.711 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.706+0000 7f67b7fff640 10 monclient: _check_auth_tickets 2026-02-12T03:57:59.711 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.706+0000 7f67b7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:57:59.711 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.706+0000 7f67e21d3640 5 monclient: authenticate success, global_id 4110 2026-02-12T03:57:59.711 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.706+0000 7f67e21d3640 10 monclient: _renew_subs 2026-02-12T03:57:59.712 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.706+0000 7f67e21d3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:57:59.712 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.706+0000 7f67e21d3640 1 -- 10.20.193.91:0/4092429012 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f67dc144850 con 0x7f67b8045020 2026-02-12T03:57:59.712 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.706+0000 7f67e21d3640 10 client.4110.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:57:59.712 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.706+0000 7f67e21d3640 10 monclient: _renew_subs 2026-02-12T03:57:59.712 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.706+0000 7f67e21d3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:57:59.712 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.706+0000 7f67e21d3640 1 -- 10.20.193.91:0/4092429012 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f67dc1407e0 con 0x7f67b8045020 2026-02-12T03:57:59.712 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.706+0000 7f67e21d3640 1 librados: init done 2026-02-12T03:57:59.712 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.707+0000 7f67e21d3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:57:59.712 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.707+0000 7f67e21d3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:57:59.712 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.707+0000 7f67e21d3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:57:59.712 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.707+0000 7f67e21d3640 1 -- 10.20.193.91:0/4092429012 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67dc0b60e0 con 0x7f67b8045020 2026-02-12T03:57:59.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.824+0000 7f67b7fff640 1 -- 10.20.193.91:0/4092429012 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f67c8004650 con 0x7f67b8045020 2026-02-12T03:57:59.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.824+0000 7f67b7fff640 10 monclient: handle_config config(0 keys) 2026-02-12T03:57:59.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.824+0000 7f67b7fff640 1 -- 10.20.193.91:0/4092429012 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f67c8004a60 con 0x7f67b8045020 2026-02-12T03:57:59.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.824+0000 7f67b7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:57:59.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.824+0000 7f67b7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:57:59.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.824+0000 7f67d9ffb640 4 set_mon_vals no callback set 2026-02-12T03:57:59.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.824+0000 7f67b7fff640 10 monclient: dump: 2026-02-12T03:57:59.829 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:57:59.829 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:57:59.829 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:57:59.829 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:57:59.829 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:57:59.829 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:57:59.829 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:57:59.829 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:57:59.829 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:57:59.829 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:57:59.829 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.824+0000 7f67b7fff640 1 -- 10.20.193.91:0/4092429012 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f67c8005050 con 0x7f67b8045020 2026-02-12T03:57:59.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.824+0000 7f67b7fff640 1 -- 10.20.193.91:0/4092429012 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (unknown 3238993746 0 0) 0x7f67c8006940 con 0x7f67b8045020 2026-02-12T03:57:59.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.824+0000 7f67b7fff640 10 client.4110.objecter ms_dispatch2 0x7f67dc000b90 osd_map(1..1 src has 1..1) 2026-02-12T03:57:59.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.824+0000 7f67b7fff640 3 client.4110.objecter handle_osd_map got epochs [1,1] > 0 2026-02-12T03:57:59.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.824+0000 7f67b7fff640 3 client.4110.objecter handle_osd_map decoding full epoch 1 2026-02-12T03:57:59.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.824+0000 7f67b7fff640 20 client.4110.objecter dump_active .. 0 homeless 2026-02-12T03:57:59.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.824+0000 7f67b7fff640 1 -- 10.20.193.91:0/4092429012 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77303 (unknown 1092875540 0 3794932319) 0x7f67c8019e40 con 0x7f67b8045020 2026-02-12T03:57:59.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.824+0000 7f67b7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:57:59.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.824+0000 7f67b7fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:57:59.857 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.854+0000 7f67e21d3640 10 start_mon_command cmd=[{"prefix": "config dump"}] 2026-02-12T03:57:59.857 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.854+0000 7f67e21d3640 10 monclient: _send_command 2 [{"prefix": "config dump"}] 2026-02-12T03:57:59.857 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.854+0000 7f67e21d3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:57:59.857 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.854+0000 7f67e21d3640 1 -- 10.20.193.91:0/4092429012 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "config dump"} v 0) -- 0x7f67dc0b60e0 con 0x7f67b8045020 2026-02-12T03:57:59.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.881+0000 7f67b7fff640 1 -- 10.20.193.91:0/4092429012 <== mon.0 v1:10.20.193.91:6789/0 10 ==== mon_command_ack([{"prefix": "config dump"}]=0 v1) ==== 59+0+36 (unknown 4069917974 0 2919340917) 0x7f67c8005550 con 0x7f67b8045020 2026-02-12T03:57:59.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.881+0000 7f67b7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config dump"}] 2026-02-12T03:57:59.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.881+0000 7f67b7fff640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:57:59.885 INFO:teuthology.orchestra.run.trial091.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-12T03:57:59.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.882+0000 7f67e21d3640 10 librados: watch_flush enter 2026-02-12T03:57:59.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.882+0000 7f67e21d3640 10 librados: watch_flush exit 2026-02-12T03:57:59.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.882+0000 7f67e21d3640 20 client.4110.objecter shutdown clearing up homeless session... 2026-02-12T03:57:59.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.882+0000 7f67e21d3640 10 client.4110.objecter successfully canceled tick 2026-02-12T03:57:59.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.882+0000 7f67e21d3640 10 monclient: shutdown 2026-02-12T03:57:59.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.882+0000 7f67e21d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:57:59.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.882+0000 7f67e21d3640 1 -- 10.20.193.91:0/4092429012 >> v1:10.20.193.91:6789/0 conn(0x7f67b8045020 legacy=0x7f67dc157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:57:59.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.882+0000 7f67e21d3640 1 -- 10.20.193.91:0/4092429012 shutdown_connections 2026-02-12T03:57:59.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.882+0000 7f67e21d3640 1 -- 10.20.193.91:0/4092429012 >> 10.20.193.91:0/4092429012 conn(0x7f67dc0559c0 msgr2=0x7f67dc135490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:57:59.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.882+0000 7f67e21d3640 1 -- 10.20.193.91:0/4092429012 shutdown_connections 2026-02-12T03:57:59.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.882+0000 7f67e21d3640 1 -- 10.20.193.91:0/4092429012 wait complete. 2026-02-12T03:57:59.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.882+0000 7f67e21d3640 1 librados: shutdown 2026-02-12T03:57:59.893 INFO:tasks.ceph:Setting crush tunables to default 2026-02-12T03:57:59.893 DEBUG:teuthology.orchestra.run.trial091:> sudo ceph --cluster ceph osd crush tunables default 2026-02-12T03:57:59.958 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.955+0000 7f7da11b9640 10 monclient: get_monmap_and_config 2026-02-12T03:57:59.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.955+0000 7f7da11b9640 10 monclient: build_initial_monmap 2026-02-12T03:57:59.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.956+0000 7f7da11b9640 10 monclient: monmap: 2026-02-12T03:57:59.959 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:57:59.959 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:57:59.959 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:59.957568+0000 2026-02-12T03:57:59.959 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:59.957568+0000 2026-02-12T03:57:59.959 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:57:59.959 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:57:59.960 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:57:59.960 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:57:59.960 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:57:59.960 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:57:59.961 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.956+0000 7f7da11b9640 1 Processor -- start 2026-02-12T03:57:59.961 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.956+0000 7f7da11b9640 1 -- start start 2026-02-12T03:57:59.962 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.956+0000 7f7da11b9640 10 monclient: init 2026-02-12T03:57:59.962 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.956+0000 7f7da11b9640 10 monclient: _reopen_session rank -1 2026-02-12T03:57:59.962 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.956+0000 7f7da11b9640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T03:57:59.962 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.956+0000 7f7da11b9640 10 monclient(hunting): picked mon.noname-b con 0x7f7d9c15e220 addr v1:10.20.193.98:6789/0 2026-02-12T03:57:59.962 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.956+0000 7f7da11b9640 10 monclient(hunting): picked mon.noname-a con 0x7f7d9c15e5f0 addr v1:10.20.193.91:6789/0 2026-02-12T03:57:59.962 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.956+0000 7f7da11b9640 10 monclient(hunting): picked mon.noname-c con 0x7f7d9c1626e0 addr v1:10.20.193.111:6789/0 2026-02-12T03:57:59.962 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.956+0000 7f7da11b9640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d9c059220 con 0x7f7d9c15e5f0 2026-02-12T03:57:59.962 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.957+0000 7f7da11b9640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d9c059500 con 0x7f7d9c15e220 2026-02-12T03:57:59.962 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.957+0000 7f7da11b9640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d9c0597e0 con 0x7f7d9c1626e0 2026-02-12T03:57:59.962 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.957+0000 7f7da11b9640 10 monclient(hunting): _renew_subs 2026-02-12T03:57:59.962 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.957+0000 7f7da11b9640 10 monclient(hunting): authenticate will time out at 1082.701015s 2026-02-12T03:57:59.963 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.957+0000 7f7d9ad76640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f7d9c15e220 0x7f7d9c0b1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:42662/0 (socket says 10.20.193.91:42662) 2026-02-12T03:57:59.963 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.957+0000 7f7d9ad76640 1 -- 10.20.193.91:0/19364801 learned_addr learned my addr 10.20.193.91:0/19364801 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:57:59.982 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.979+0000 7f7d99d74640 1 -- 10.20.193.91:0/19364801 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1846829011 0 0) 0x7f7d9c059220 con 0x7f7d9c15e5f0 2026-02-12T03:57:59.982 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.979+0000 7f7d99d74640 10 monclient(hunting): _negotiate 2026-02-12T03:57:59.982 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.979+0000 7f7d99d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:57:59.982 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.979+0000 7f7d99d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:57:59.983 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.979+0000 7f7d99d74640 10 monclient(hunting): my global_id is 4116 2026-02-12T03:57:59.983 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.979+0000 7f7d99d74640 1 -- 10.20.193.91:0/19364801 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d88003610 con 0x7f7d9c15e5f0 2026-02-12T03:57:59.988 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.981+0000 7f7d99d74640 1 -- 10.20.193.91:0/19364801 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3346151108 0 0) 0x7f7d88003610 con 0x7f7d9c15e5f0 2026-02-12T03:57:59.988 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.981+0000 7f7d99d74640 1 -- 10.20.193.91:0/19364801 >> v1:10.20.193.111:6789/0 conn(0x7f7d9c1626e0 legacy=0x7f7d9c162b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:57:59.988 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.981+0000 7f7d99d74640 1 -- 10.20.193.91:0/19364801 >> v1:10.20.193.98:6789/0 conn(0x7f7d9c15e220 legacy=0x7f7d9c0b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:57:59.988 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.981+0000 7f7d99d74640 10 monclient: _finish_hunting 0 2026-02-12T03:57:59.988 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.981+0000 7f7d99d74640 1 monclient: found mon.noname-a 2026-02-12T03:57:59.988 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.981+0000 7f7d99d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:57:59.989 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.981+0000 7f7d99d74640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.91:6789/0 2026-02-12T03:57:59.989 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.981+0000 7f7d99d74640 1 -- 10.20.193.91:0/19364801 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d9c059ac0 con 0x7f7d9c15e5f0 2026-02-12T03:57:59.989 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.981+0000 7f7d99d74640 10 monclient: _finish_auth 0 2026-02-12T03:57:59.989 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.981+0000 7f7d99d74640 10 monclient: _check_auth_tickets 2026-02-12T03:57:59.989 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.981+0000 7f7d99d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:57:59.989 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.981+0000 7f7d99d74640 1 -- 10.20.193.91:0/19364801 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f7d84002df0 con 0x7f7d9c15e5f0 2026-02-12T03:57:59.989 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.981+0000 7f7d99d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:57:59.989 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.981+0000 7f7d99d74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:57:59.989 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.981+0000 7f7d99d74640 10 monclient: dump: 2026-02-12T03:57:59.989 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:57:59.990 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:57:59.990 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:57:59.990 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:57:59.990 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:57:59.990 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:57:59.990 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:57:59.991 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:57:59.991 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:57:59.991 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:57:59.991 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.981+0000 7f7da11b9640 5 monclient: authenticate success, global_id 4116 2026-02-12T03:57:59.991 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.981+0000 7f7da11b9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:57:59.991 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.982+0000 7f7d99d74640 1 -- 10.20.193.91:0/19364801 <== mon.0 v1:10.20.193.91:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7d84003000 con 0x7f7d9c15e5f0 2026-02-12T03:57:59.992 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.982+0000 7f7d99d74640 10 monclient: handle_config config(0 keys) 2026-02-12T03:57:59.992 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.982+0000 7f7d99d74640 1 -- 10.20.193.91:0/19364801 <== mon.0 v1:10.20.193.91:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f7d84003400 con 0x7f7d9c15e5f0 2026-02-12T03:57:59.992 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.982+0000 7f7d99d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:57:59.992 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.982+0000 7f7d99d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:57:59.992 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.982+0000 7f7d99d74640 10 monclient: dump: 2026-02-12T03:57:59.992 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:57:59.993 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:57:59.993 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:57:59.993 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:57:59.993 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:57:59.993 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:57:59.993 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:57:59.993 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:57:59.993 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:57:59.993 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:57:59.993 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.982+0000 7f7da11b9640 10 monclient: get_monmap_and_config success 2026-02-12T03:57:59.994 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.982+0000 7f7da11b9640 4 set_mon_vals no callback set 2026-02-12T03:57:59.994 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.982+0000 7f7da11b9640 10 monclient: shutdown 2026-02-12T03:57:59.994 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.982+0000 7f7da11b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:57:59.994 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.982+0000 7f7da11b9640 1 -- 10.20.193.91:0/19364801 >> v1:10.20.193.91:6789/0 conn(0x7f7d9c15e5f0 legacy=0x7f7d9c058700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:57:59.994 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.982+0000 7f7da11b9640 1 -- 10.20.193.91:0/19364801 shutdown_connections 2026-02-12T03:57:59.994 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.982+0000 7f7da11b9640 1 -- 10.20.193.91:0/19364801 >> 10.20.193.91:0/19364801 conn(0x7f7d9c0b6590 msgr2=0x7f7d9c0b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:57:59.995 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.982+0000 7f7da11b9640 1 -- 10.20.193.91:0/19364801 shutdown_connections 2026-02-12T03:57:59.995 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.982+0000 7f7da11b9640 1 -- 10.20.193.91:0/19364801 wait complete. 2026-02-12T03:57:59.995 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.982+0000 7f7da11b9640 10 monclient: build_initial_monmap 2026-02-12T03:57:59.995 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.982+0000 7f7da11b9640 10 monclient: monmap: 2026-02-12T03:57:59.995 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:57:59.995 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:57:59.995 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:57:59.995 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:57:59.995 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:57:59.995 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:57:59.995 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:57:59.996 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:57:59.996 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:57:59.996 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:57:59.996 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.983+0000 7f7da11b9640 1 librados: starting msgr at 2026-02-12T03:57:59.996 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.983+0000 7f7da11b9640 1 librados: starting objecter 2026-02-12T03:57:59.996 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.983+0000 7f7da11b9640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:57:59.996 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.983+0000 7f7da11b9640 1 Processor -- start 2026-02-12T03:57:59.996 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.983+0000 7f7da11b9640 1 -- start start 2026-02-12T03:57:59.996 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.983+0000 7f7da11b9640 1 librados: setting wanted keys 2026-02-12T03:57:59.996 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.983+0000 7f7da11b9640 1 librados: calling monclient init 2026-02-12T03:57:59.996 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.983+0000 7f7da11b9640 10 monclient: init 2026-02-12T03:57:59.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.983+0000 7f7da11b9640 10 monclient: _reopen_session rank -1 2026-02-12T03:57:59.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.983+0000 7f7da11b9640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T03:57:59.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.983+0000 7f7da11b9640 10 monclient(hunting): picked mon.noname-a con 0x7f7d9c15e220 addr v1:10.20.193.91:6789/0 2026-02-12T03:57:59.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.983+0000 7f7da11b9640 10 monclient(hunting): picked mon.noname-b con 0x7f7d9c15e5f0 addr v1:10.20.193.98:6789/0 2026-02-12T03:57:59.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.983+0000 7f7da11b9640 10 monclient(hunting): picked mon.noname-c con 0x7f7d9c1626e0 addr v1:10.20.193.111:6789/0 2026-02-12T03:57:59.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.983+0000 7f7da11b9640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d9c0b1d70 con 0x7f7d9c15e220 2026-02-12T03:57:59.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.983+0000 7f7da11b9640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d9c1fba40 con 0x7f7d9c15e5f0 2026-02-12T03:57:59.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.983+0000 7f7da11b9640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d9c1fbd20 con 0x7f7d9c1626e0 2026-02-12T03:57:59.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.983+0000 7f7da11b9640 10 monclient(hunting): _renew_subs 2026-02-12T03:57:59.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.983+0000 7f7da11b9640 10 monclient(hunting): authenticate will time out at 1082.727603s 2026-02-12T03:57:59.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.983+0000 7f7d9ad76640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f7d9c15e220 0x7f7d9c1ff180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:33324/0 (socket says 10.20.193.91:33324) 2026-02-12T03:57:59.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.983+0000 7f7d9ad76640 1 -- 10.20.193.91:0/2585858167 learned_addr learned my addr 10.20.193.91:0/2585858167 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:57:59.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.983+0000 7f7d7b7fe640 10 client.?.objecter ms_handle_connect 0x7f7d9c15e220 2026-02-12T03:57:59.998 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.983+0000 7f7d7b7fe640 10 client.?.objecter resend_mon_ops 2026-02-12T03:57:59.998 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.984+0000 7f7d7b7fe640 1 -- 10.20.193.91:0/2585858167 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2694573955 0 0) 0x7f7d9c0b1d70 con 0x7f7d9c15e220 2026-02-12T03:57:59.998 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.984+0000 7f7d7b7fe640 10 monclient(hunting): _negotiate 2026-02-12T03:57:59.998 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.984+0000 7f7d7b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:57:59.998 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.984+0000 7f7d7b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:57:59.998 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.984+0000 7f7d7b7fe640 10 monclient(hunting): my global_id is 4119 2026-02-12T03:57:59.998 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.984+0000 7f7d7b7fe640 1 -- 10.20.193.91:0/2585858167 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d68003610 con 0x7f7d9c15e220 2026-02-12T03:57:59.999 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.987+0000 7f7d7b7fe640 10 client.?.objecter ms_handle_connect 0x7f7d9c15e5f0 2026-02-12T03:57:59.999 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.987+0000 7f7d7b7fe640 10 client.?.objecter resend_mon_ops 2026-02-12T03:57:59.999 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.987+0000 7f7d7b7fe640 10 client.?.objecter ms_handle_connect 0x7f7d9c1626e0 2026-02-12T03:58:00.000 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.987+0000 7f7d7b7fe640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:00.000 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.988+0000 7f7d7b7fe640 1 -- 10.20.193.91:0/2585858167 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2169111998 0 0) 0x7f7d68003610 con 0x7f7d9c15e220 2026-02-12T03:58:00.000 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.988+0000 7f7d7b7fe640 1 -- 10.20.193.91:0/2585858167 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7d9c0b1d70 con 0x7f7d9c15e220 2026-02-12T03:58:00.000 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.988+0000 7f7d7b7fe640 1 -- 10.20.193.91:0/2585858167 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f7d90002f70 con 0x7f7d9c15e220 2026-02-12T03:58:00.000 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.988+0000 7f7d7b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:00.000 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.988+0000 7f7d7b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:00.000 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.988+0000 7f7d7b7fe640 10 monclient(hunting): dump: 2026-02-12T03:58:00.000 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:00.000 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:00.000 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:00.000 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:00.000 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:00.001 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:00.001 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:00.001 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:00.001 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:00.001 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:00.001 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:57:59.988+0000 7f7d7b7fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:00.017 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.013+0000 7f7d7b7fe640 1 -- 10.20.193.91:0/2585858167 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1807778783 0 0) 0x7f7d9c0b1d70 con 0x7f7d9c15e220 2026-02-12T03:58:00.017 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.013+0000 7f7d7b7fe640 1 -- 10.20.193.91:0/2585858167 >> v1:10.20.193.111:6789/0 conn(0x7f7d9c1626e0 legacy=0x7f7d9c1fdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:00.017 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.013+0000 7f7d7b7fe640 1 -- 10.20.193.91:0/2585858167 >> v1:10.20.193.98:6789/0 conn(0x7f7d9c15e5f0 legacy=0x7f7d9c0b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:00.017 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.013+0000 7f7d7b7fe640 10 monclient: _finish_hunting 0 2026-02-12T03:58:00.017 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.013+0000 7f7d7b7fe640 1 monclient: found mon.a 2026-02-12T03:58:00.017 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.013+0000 7f7d7b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:00.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.013+0000 7f7d7b7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:00.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.013+0000 7f7d7b7fe640 1 -- 10.20.193.91:0/2585858167 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d9c1fc000 con 0x7f7d9c15e220 2026-02-12T03:58:00.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.013+0000 7f7d7b7fe640 10 monclient: _finish_auth 0 2026-02-12T03:58:00.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.013+0000 7f7d7b7fe640 10 monclient: _check_auth_tickets 2026-02-12T03:58:00.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.013+0000 7f7d7b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:00.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.013+0000 7f7da11b9640 5 monclient: authenticate success, global_id 4119 2026-02-12T03:58:00.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.013+0000 7f7da11b9640 10 monclient: _renew_subs 2026-02-12T03:58:00.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.013+0000 7f7da11b9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:00.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.013+0000 7f7da11b9640 1 -- 10.20.193.91:0/2585858167 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7d9c1fe980 con 0x7f7d9c15e220 2026-02-12T03:58:00.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.013+0000 7f7da11b9640 10 client.4119.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:00.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.013+0000 7f7da11b9640 10 monclient: _renew_subs 2026-02-12T03:58:00.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.013+0000 7f7da11b9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:00.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.013+0000 7f7da11b9640 1 -- 10.20.193.91:0/2585858167 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7d9c1fc700 con 0x7f7d9c15e220 2026-02-12T03:58:00.019 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.013+0000 7f7da11b9640 1 librados: init done 2026-02-12T03:58:00.019 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.014+0000 7f7da11b9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:00.019 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.014+0000 7f7da11b9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:00.019 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.014+0000 7f7da11b9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:00.019 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.014+0000 7f7da11b9640 1 -- 10.20.193.91:0/2585858167 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d9c058d90 con 0x7f7d9c15e220 2026-02-12T03:58:00.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.045+0000 7f7d7b7fe640 1 -- 10.20.193.91:0/2585858167 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7d900048d0 con 0x7f7d9c15e220 2026-02-12T03:58:00.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.045+0000 7f7d7b7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:00.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.045+0000 7f7d7b7fe640 1 -- 10.20.193.91:0/2585858167 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f7d90004b40 con 0x7f7d9c15e220 2026-02-12T03:58:00.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.045+0000 7f7d7b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:00.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.045+0000 7f7d7b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:00.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.045+0000 7f7d99573640 4 set_mon_vals no callback set 2026-02-12T03:58:00.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.045+0000 7f7d7b7fe640 10 monclient: dump: 2026-02-12T03:58:00.049 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:00.049 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:00.049 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:00.050 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:00.050 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:00.050 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:00.050 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:00.050 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:00.050 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:00.050 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:00.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.045+0000 7f7d7b7fe640 1 -- 10.20.193.91:0/2585858167 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f7d90005130 con 0x7f7d9c15e220 2026-02-12T03:58:00.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.045+0000 7f7d7b7fe640 1 -- 10.20.193.91:0/2585858167 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (unknown 3238993746 0 0) 0x7f7d90006b70 con 0x7f7d9c15e220 2026-02-12T03:58:00.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.045+0000 7f7d7b7fe640 10 client.4119.objecter ms_dispatch2 0x7f7d9c000b90 osd_map(1..1 src has 1..1) 2026-02-12T03:58:00.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.045+0000 7f7d7b7fe640 3 client.4119.objecter handle_osd_map got epochs [1,1] > 0 2026-02-12T03:58:00.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.045+0000 7f7d7b7fe640 3 client.4119.objecter handle_osd_map decoding full epoch 1 2026-02-12T03:58:00.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.045+0000 7f7d7b7fe640 20 client.4119.objecter dump_active .. 0 homeless 2026-02-12T03:58:00.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.045+0000 7f7d7b7fe640 1 -- 10.20.193.91:0/2585858167 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77303 (unknown 1092875540 0 3794932319) 0x7f7d90019e40 con 0x7f7d9c15e220 2026-02-12T03:58:00.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.045+0000 7f7d7b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:00.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.045+0000 7f7d7b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:00.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.076+0000 7f7da11b9640 10 start_mon_command cmd=[{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-12T03:58:00.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.076+0000 7f7da11b9640 10 monclient: _send_command 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-12T03:58:00.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.076+0000 7f7da11b9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:00.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.076+0000 7f7da11b9640 1 -- 10.20.193.91:0/2585858167 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f7d9c0b2d80 con 0x7f7d9c15e220 2026-02-12T03:58:00.151 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.148+0000 7f7d7b7fe640 1 -- 10.20.193.91:0/2585858167 <== mon.0 v1:10.20.193.91:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (unknown 2277712955 0 0) 0x7f7d900059c0 con 0x7f7d9c15e220 2026-02-12T03:58:00.151 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.148+0000 7f7d7b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-12T03:58:00.151 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.148+0000 7f7d7b7fe640 10 monclient: _finish_command 2 = system:0 adjusted tunables profile to default 2026-02-12T03:58:00.151 INFO:teuthology.orchestra.run.trial091.stderr:adjusted tunables profile to default 2026-02-12T03:58:00.152 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.149+0000 7f7da11b9640 10 librados: watch_flush enter 2026-02-12T03:58:00.152 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.149+0000 7f7da11b9640 10 librados: watch_flush exit 2026-02-12T03:58:00.152 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.149+0000 7f7da11b9640 20 client.4119.objecter shutdown clearing up homeless session... 2026-02-12T03:58:00.152 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.149+0000 7f7da11b9640 10 client.4119.objecter successfully canceled tick 2026-02-12T03:58:00.152 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.149+0000 7f7da11b9640 10 monclient: shutdown 2026-02-12T03:58:00.152 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.149+0000 7f7da11b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:00.152 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.149+0000 7f7da11b9640 1 -- 10.20.193.91:0/2585858167 >> v1:10.20.193.91:6789/0 conn(0x7f7d9c15e220 legacy=0x7f7d9c1ff180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:00.152 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.149+0000 7f7da11b9640 1 -- 10.20.193.91:0/2585858167 shutdown_connections 2026-02-12T03:58:00.152 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.149+0000 7f7da11b9640 1 -- 10.20.193.91:0/2585858167 >> 10.20.193.91:0/2585858167 conn(0x7f7d9c0b6590 msgr2=0x7f7d9c0afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:00.152 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.149+0000 7f7da11b9640 1 -- 10.20.193.91:0/2585858167 shutdown_connections 2026-02-12T03:58:00.152 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.149+0000 7f7da11b9640 1 -- 10.20.193.91:0/2585858167 wait complete. 2026-02-12T03:58:00.152 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:00.149+0000 7f7da11b9640 1 librados: shutdown 2026-02-12T03:58:00.160 INFO:tasks.ceph:check_enable_crimson: False 2026-02-12T03:58:00.160 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-12T03:58:00.160 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-12T03:58:00.160 DEBUG:teuthology.orchestra.run.trial091:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-12T03:58:00.185 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-12T03:58:00.185 DEBUG:teuthology.orchestra.run.trial091:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2026-02-12T03:58:00.249 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-12T03:58:00.249 DEBUG:teuthology.orchestra.run.trial091:> sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2026-02-12T03:58:00.314 DEBUG:teuthology.orchestra.run.trial091:> set -ex 2026-02-12T03:58:00.314 DEBUG:teuthology.orchestra.run.trial091:> sudo dd if=/var/lib/ceph/osd/ceph-12/fsid of=/dev/stdout 2026-02-12T03:58:00.377 DEBUG:teuthology.orchestra.run.trial098:> set -ex 2026-02-12T03:58:00.377 DEBUG:teuthology.orchestra.run.trial098:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-12T03:58:00.403 DEBUG:teuthology.orchestra.run.trial098:> set -ex 2026-02-12T03:58:00.404 DEBUG:teuthology.orchestra.run.trial098:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2026-02-12T03:58:00.467 DEBUG:teuthology.orchestra.run.trial098:> set -ex 2026-02-12T03:58:00.467 DEBUG:teuthology.orchestra.run.trial098:> sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2026-02-12T03:58:00.531 DEBUG:teuthology.orchestra.run.trial098:> set -ex 2026-02-12T03:58:00.531 DEBUG:teuthology.orchestra.run.trial098:> sudo dd if=/var/lib/ceph/osd/ceph-13/fsid of=/dev/stdout 2026-02-12T03:58:00.545 INFO:tasks.ceph.mgr.x.trial154.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-12T03:58:00.546 INFO:tasks.ceph.mgr.x.trial154.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-12T03:58:00.546 INFO:tasks.ceph.mgr.x.trial154.stderr: from numpy import show_config as show_numpy_config 2026-02-12T03:58:00.553 INFO:tasks.ceph.mgr.y.trial091.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-12T03:58:00.554 INFO:tasks.ceph.mgr.y.trial091.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-12T03:58:00.554 INFO:tasks.ceph.mgr.y.trial091.stderr: from numpy import show_config as show_numpy_config 2026-02-12T03:58:00.594 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-12T03:58:00.595 DEBUG:teuthology.orchestra.run.trial111:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-12T03:58:00.622 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-12T03:58:00.622 DEBUG:teuthology.orchestra.run.trial111:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2026-02-12T03:58:00.687 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-12T03:58:00.687 DEBUG:teuthology.orchestra.run.trial111:> sudo dd if=/var/lib/ceph/osd/ceph-10/fsid of=/dev/stdout 2026-02-12T03:58:00.750 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-12T03:58:00.750 DEBUG:teuthology.orchestra.run.trial111:> sudo dd if=/var/lib/ceph/osd/ceph-14/fsid of=/dev/stdout 2026-02-12T03:58:00.815 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-12T03:58:00.815 DEBUG:teuthology.orchestra.run.trial154:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-12T03:58:00.840 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-12T03:58:00.840 DEBUG:teuthology.orchestra.run.trial154:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2026-02-12T03:58:00.904 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-12T03:58:00.904 DEBUG:teuthology.orchestra.run.trial154:> sudo dd if=/var/lib/ceph/osd/ceph-11/fsid of=/dev/stdout 2026-02-12T03:58:00.967 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-12T03:58:00.967 DEBUG:teuthology.orchestra.run.trial154:> sudo dd if=/var/lib/ceph/osd/ceph-15/fsid of=/dev/stdout 2026-02-12T03:58:01.030 DEBUG:teuthology.orchestra.run.trial154:> sudo ceph --cluster ceph osd new 791c97c5-83f6-4024-9f43-ff3b2ee22a30 0 2026-02-12T03:58:01.136 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.133+0000 7fcb63577640 10 monclient: get_monmap_and_config 2026-02-12T03:58:01.136 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.133+0000 7fcb63577640 10 monclient: build_initial_monmap 2026-02-12T03:58:01.136 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.133+0000 7fcb63577640 10 monclient: monmap: 2026-02-12T03:58:01.136 INFO:teuthology.orchestra.run.trial154.stderr:epoch 0 2026-02-12T03:58:01.136 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:01.136 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:58:01.135274+0000 2026-02-12T03:58:01.136 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:58:01.135274+0000 2026-02-12T03:58:01.136 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:01.136 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:01.136 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:01.136 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:01.136 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:01.136 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:01.137 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.134+0000 7fcb63577640 1 Processor -- start 2026-02-12T03:58:01.137 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.134+0000 7fcb63577640 1 -- start start 2026-02-12T03:58:01.137 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.134+0000 7fcb63577640 10 monclient: init 2026-02-12T03:58:01.137 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.134+0000 7fcb63577640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:01.137 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.134+0000 7fcb63577640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T03:58:01.137 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.134+0000 7fcb63577640 10 monclient(hunting): picked mon.noname-a con 0x7fcb6411ca60 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:01.137 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.134+0000 7fcb63577640 10 monclient(hunting): picked mon.noname-c con 0x7fcb6411ce30 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:01.137 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.134+0000 7fcb63577640 10 monclient(hunting): picked mon.noname-b con 0x7fcb641649c0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:01.137 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.134+0000 7fcb63577640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb641864c0 con 0x7fcb6411ca60 2026-02-12T03:58:01.137 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.134+0000 7fcb63577640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb641876a0 con 0x7fcb641649c0 2026-02-12T03:58:01.137 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.134+0000 7fcb63577640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb64188880 con 0x7fcb6411ce30 2026-02-12T03:58:01.137 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.134+0000 7fcb63577640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:01.137 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.134+0000 7fcb63577640 10 monclient(hunting): authenticate will time out at 1081.787534s 2026-02-12T03:58:01.137 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.134+0000 7fcb62d76640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7fcb641649c0 0x7fcb64184da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.154:52092/0 (socket says 10.20.193.154:52092) 2026-02-12T03:58:01.137 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.134+0000 7fcb62d76640 1 -- 10.20.193.154:0/803010552 learned_addr learned my addr 10.20.193.154:0/803010552 (peer_addr_for_me v1:10.20.193.154:0/0) 2026-02-12T03:58:01.138 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.136+0000 7fcb61573640 1 -- 10.20.193.154:0/803010552 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3421369595 0 0) 0x7fcb641876a0 con 0x7fcb641649c0 2026-02-12T03:58:01.138 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.136+0000 7fcb61573640 10 monclient(hunting): _negotiate 2026-02-12T03:58:01.138 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.136+0000 7fcb61573640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:01.138 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.136+0000 7fcb61573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:01.138 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.136+0000 7fcb61573640 10 monclient(hunting): my global_id is 4120 2026-02-12T03:58:01.138 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.136+0000 7fcb61573640 1 -- 10.20.193.154:0/803010552 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb50003610 con 0x7fcb641649c0 2026-02-12T03:58:01.139 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.136+0000 7fcb61573640 1 -- 10.20.193.154:0/803010552 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1767963071 0 0) 0x7fcb641864c0 con 0x7fcb6411ca60 2026-02-12T03:58:01.139 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.136+0000 7fcb61573640 10 monclient(hunting): _negotiate 2026-02-12T03:58:01.139 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.136+0000 7fcb61573640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:01.139 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.136+0000 7fcb61573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:01.139 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.136+0000 7fcb61573640 10 monclient(hunting): my global_id is 4122 2026-02-12T03:58:01.139 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.136+0000 7fcb61573640 1 -- 10.20.193.154:0/803010552 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb641876a0 con 0x7fcb6411ca60 2026-02-12T03:58:01.139 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.136+0000 7fcb61573640 1 -- 10.20.193.154:0/803010552 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4275815537 0 0) 0x7fcb64188880 con 0x7fcb6411ce30 2026-02-12T03:58:01.139 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.136+0000 7fcb61573640 10 monclient(hunting): _negotiate 2026-02-12T03:58:01.139 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.136+0000 7fcb61573640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:01.139 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.136+0000 7fcb61573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:01.139 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.136+0000 7fcb61573640 10 monclient(hunting): my global_id is 4121 2026-02-12T03:58:01.139 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.136+0000 7fcb61573640 1 -- 10.20.193.154:0/803010552 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb641864c0 con 0x7fcb6411ce30 2026-02-12T03:58:01.141 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.138+0000 7fcb61573640 1 -- 10.20.193.154:0/803010552 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 40289211 0 0) 0x7fcb641876a0 con 0x7fcb6411ca60 2026-02-12T03:58:01.141 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.138+0000 7fcb61573640 1 -- 10.20.193.154:0/803010552 >> v1:10.20.193.111:6789/0 conn(0x7fcb6411ce30 legacy=0x7fcb6411b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:01.141 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.138+0000 7fcb61573640 1 -- 10.20.193.154:0/803010552 >> v1:10.20.193.98:6789/0 conn(0x7fcb641649c0 legacy=0x7fcb64184da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:01.141 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.138+0000 7fcb61573640 10 monclient: _finish_hunting 0 2026-02-12T03:58:01.141 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.138+0000 7fcb61573640 1 monclient: found mon.noname-a 2026-02-12T03:58:01.141 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.138+0000 7fcb61573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:01.141 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.138+0000 7fcb61573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.91:6789/0 2026-02-12T03:58:01.141 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.138+0000 7fcb61573640 1 -- 10.20.193.154:0/803010552 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb64189a60 con 0x7fcb6411ca60 2026-02-12T03:58:01.141 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.138+0000 7fcb61573640 10 monclient: _finish_auth 0 2026-02-12T03:58:01.141 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.138+0000 7fcb61573640 10 monclient: _check_auth_tickets 2026-02-12T03:58:01.141 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.138+0000 7fcb61573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:01.141 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.138+0000 7fcb61573640 1 -- 10.20.193.154:0/803010552 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fcb58002df0 con 0x7fcb6411ca60 2026-02-12T03:58:01.141 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.138+0000 7fcb61573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:01.141 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.138+0000 7fcb61573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:01.141 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.138+0000 7fcb61573640 10 monclient: dump: 2026-02-12T03:58:01.141 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:01.141 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:01.141 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.141 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.141 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:01.141 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:01.141 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:01.141 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:01.141 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:01.141 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:01.141 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.138+0000 7fcb63577640 5 monclient: authenticate success, global_id 4122 2026-02-12T03:58:01.141 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.138+0000 7fcb63577640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:01.141 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.139+0000 7fcb61573640 1 -- 10.20.193.154:0/803010552 <== mon.0 v1:10.20.193.91:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcb58003030 con 0x7fcb6411ca60 2026-02-12T03:58:01.141 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.139+0000 7fcb61573640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:01.141 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.139+0000 7fcb61573640 1 -- 10.20.193.154:0/803010552 <== mon.0 v1:10.20.193.91:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fcb58003470 con 0x7fcb6411ca60 2026-02-12T03:58:01.142 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.139+0000 7fcb63577640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:01.142 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.139+0000 7fcb63577640 4 set_mon_vals no callback set 2026-02-12T03:58:01.142 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.139+0000 7fcb61573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:01.142 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.139+0000 7fcb61573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:01.142 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.139+0000 7fcb61573640 10 monclient: dump: 2026-02-12T03:58:01.142 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:01.142 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:01.142 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.142 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.142 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:01.142 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:01.142 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:01.142 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:01.142 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:01.142 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:01.142 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.140+0000 7fcb63577640 10 monclient: shutdown 2026-02-12T03:58:01.142 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.140+0000 7fcb63577640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:01.142 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.140+0000 7fcb63577640 1 -- 10.20.193.154:0/803010552 >> v1:10.20.193.91:6789/0 conn(0x7fcb6411ca60 legacy=0x7fcb6411b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:01.143 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.140+0000 7fcb63577640 1 -- 10.20.193.154:0/803010552 shutdown_connections 2026-02-12T03:58:01.143 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.140+0000 7fcb63577640 1 -- 10.20.193.154:0/803010552 >> 10.20.193.154:0/803010552 conn(0x7fcb64058980 msgr2=0x7fcb64058d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:01.143 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.140+0000 7fcb63577640 1 -- 10.20.193.154:0/803010552 shutdown_connections 2026-02-12T03:58:01.143 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.140+0000 7fcb63577640 1 -- 10.20.193.154:0/803010552 wait complete. 2026-02-12T03:58:01.143 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.140+0000 7fcb63577640 10 monclient: build_initial_monmap 2026-02-12T03:58:01.143 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.140+0000 7fcb63577640 10 monclient: monmap: 2026-02-12T03:58:01.143 INFO:teuthology.orchestra.run.trial154.stderr:epoch 0 2026-02-12T03:58:01.143 INFO:teuthology.orchestra.run.trial154.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:01.143 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 0.000000 2026-02-12T03:58:01.143 INFO:teuthology.orchestra.run.trial154.stderr:created 0.000000 2026-02-12T03:58:01.143 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:01.143 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 1 2026-02-12T03:58:01.143 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:01.143 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:01.143 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:01.143 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:01.143 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.140+0000 7fcb63577640 1 librados: starting msgr at 2026-02-12T03:58:01.143 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.140+0000 7fcb63577640 1 librados: starting objecter 2026-02-12T03:58:01.143 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.140+0000 7fcb63577640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:01.143 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.140+0000 7fcb63577640 1 Processor -- start 2026-02-12T03:58:01.143 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.140+0000 7fcb63577640 1 -- start start 2026-02-12T03:58:01.143 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.140+0000 7fcb63577640 1 librados: setting wanted keys 2026-02-12T03:58:01.143 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.140+0000 7fcb63577640 1 librados: calling monclient init 2026-02-12T03:58:01.143 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.140+0000 7fcb63577640 10 monclient: init 2026-02-12T03:58:01.143 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.140+0000 7fcb63577640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:01.144 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.140+0000 7fcb63577640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T03:58:01.144 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.140+0000 7fcb63577640 10 monclient(hunting): picked mon.noname-c con 0x7fcb6411ca60 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:01.144 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.140+0000 7fcb63577640 10 monclient(hunting): picked mon.noname-a con 0x7fcb6411ce30 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:01.144 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.140+0000 7fcb63577640 10 monclient(hunting): picked mon.noname-b con 0x7fcb641649c0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:01.144 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.140+0000 7fcb63577640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb64102030 con 0x7fcb6411ce30 2026-02-12T03:58:01.144 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.140+0000 7fcb63577640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb64108f10 con 0x7fcb641649c0 2026-02-12T03:58:01.144 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.140+0000 7fcb63577640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb6410a0f0 con 0x7fcb6411ca60 2026-02-12T03:58:01.144 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.140+0000 7fcb63577640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:01.144 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.140+0000 7fcb63577640 10 monclient(hunting): authenticate will time out at 1081.793958s 2026-02-12T03:58:01.144 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.141+0000 7fcb61d74640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7fcb6411ce30 0x7fcb64161990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.154:46326/0 (socket says 10.20.193.154:46326) 2026-02-12T03:58:01.144 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.141+0000 7fcb61d74640 1 -- 10.20.193.154:0/625984988 learned_addr learned my addr 10.20.193.154:0/625984988 (peer_addr_for_me v1:10.20.193.154:0/0) 2026-02-12T03:58:01.144 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.141+0000 7fcb4affd640 10 client.?.objecter ms_handle_connect 0x7fcb6411ce30 2026-02-12T03:58:01.144 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.141+0000 7fcb4affd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:01.144 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.142+0000 7fcb4affd640 1 -- 10.20.193.154:0/625984988 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 341731741 0 0) 0x7fcb64102030 con 0x7fcb6411ce30 2026-02-12T03:58:01.144 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.142+0000 7fcb4affd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:01.144 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.142+0000 7fcb4affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:01.144 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.142+0000 7fcb4affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:01.144 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.142+0000 7fcb4affd640 10 monclient(hunting): my global_id is 4125 2026-02-12T03:58:01.144 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.142+0000 7fcb4affd640 1 -- 10.20.193.154:0/625984988 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb30003610 con 0x7fcb6411ce30 2026-02-12T03:58:01.147 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.144+0000 7fcb4affd640 1 -- 10.20.193.154:0/625984988 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3832425992 0 0) 0x7fcb30003610 con 0x7fcb6411ce30 2026-02-12T03:58:01.147 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.144+0000 7fcb4affd640 1 -- 10.20.193.154:0/625984988 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcb64102030 con 0x7fcb6411ce30 2026-02-12T03:58:01.147 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.144+0000 7fcb4affd640 1 -- 10.20.193.154:0/625984988 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fcb4c003170 con 0x7fcb6411ce30 2026-02-12T03:58:01.147 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.144+0000 7fcb4affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:01.147 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.144+0000 7fcb4affd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:01.147 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.144+0000 7fcb4affd640 10 monclient(hunting): dump: 2026-02-12T03:58:01.147 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:01.147 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:01.147 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.147 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.147 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:01.147 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:01.147 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:01.147 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:01.147 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:01.147 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:01.147 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.144+0000 7fcb4affd640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:01.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.146+0000 7fcb4affd640 1 -- 10.20.193.154:0/625984988 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4235444111 0 0) 0x7fcb64102030 con 0x7fcb6411ce30 2026-02-12T03:58:01.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.146+0000 7fcb4affd640 1 -- 10.20.193.154:0/625984988 >> v1:10.20.193.111:6789/0 conn(0x7fcb6411ca60 legacy=0x7fcb64101520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:01.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.146+0000 7fcb4affd640 1 -- 10.20.193.154:0/625984988 >> v1:10.20.193.98:6789/0 conn(0x7fcb641649c0 legacy=0x7fcb641630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:01.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.146+0000 7fcb4affd640 10 monclient: _finish_hunting 0 2026-02-12T03:58:01.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.146+0000 7fcb4affd640 1 monclient: found mon.a 2026-02-12T03:58:01.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.146+0000 7fcb4affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:01.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.146+0000 7fcb4affd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:01.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.146+0000 7fcb4affd640 1 -- 10.20.193.154:0/625984988 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb6410b2d0 con 0x7fcb6411ce30 2026-02-12T03:58:01.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.146+0000 7fcb4affd640 10 monclient: _finish_auth 0 2026-02-12T03:58:01.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.146+0000 7fcb4affd640 10 monclient: _check_auth_tickets 2026-02-12T03:58:01.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.146+0000 7fcb4affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:01.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.146+0000 7fcb63577640 5 monclient: authenticate success, global_id 4125 2026-02-12T03:58:01.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.146+0000 7fcb63577640 10 monclient: _renew_subs 2026-02-12T03:58:01.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.146+0000 7fcb63577640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:01.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.146+0000 7fcb63577640 1 -- 10.20.193.154:0/625984988 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcb6410a2c0 con 0x7fcb6411ce30 2026-02-12T03:58:01.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.146+0000 7fcb63577640 10 client.4125.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:01.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.146+0000 7fcb63577640 10 monclient: _renew_subs 2026-02-12T03:58:01.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.146+0000 7fcb63577640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:01.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.146+0000 7fcb63577640 1 -- 10.20.193.154:0/625984988 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fcb6410a900 con 0x7fcb6411ce30 2026-02-12T03:58:01.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.146+0000 7fcb63577640 1 librados: init done 2026-02-12T03:58:01.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.147+0000 7fcb63577640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:01.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.147+0000 7fcb63577640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:01.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.147+0000 7fcb63577640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:01.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.147+0000 7fcb63577640 1 -- 10.20.193.154:0/625984988 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb64186b60 con 0x7fcb6411ce30 2026-02-12T03:58:01.150 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.148+0000 7fcb4affd640 1 -- 10.20.193.154:0/625984988 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcb4c003520 con 0x7fcb6411ce30 2026-02-12T03:58:01.150 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.148+0000 7fcb4affd640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:01.150 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.148+0000 7fcb4affd640 1 -- 10.20.193.154:0/625984988 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fcb4c003b90 con 0x7fcb6411ce30 2026-02-12T03:58:01.151 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.148+0000 7fcb4affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:01.151 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.148+0000 7fcb4affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:01.151 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.148+0000 7fcb4affd640 10 monclient: dump: 2026-02-12T03:58:01.151 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:01.151 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:01.151 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.151 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.151 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:01.151 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:01.151 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:01.151 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:01.151 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:01.151 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:01.151 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.148+0000 7fcb60d72640 4 set_mon_vals no callback set 2026-02-12T03:58:01.151 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.148+0000 7fcb4affd640 1 -- 10.20.193.154:0/625984988 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7fcb4c004180 con 0x7fcb6411ce30 2026-02-12T03:58:01.151 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.148+0000 7fcb4affd640 1 -- 10.20.193.154:0/625984988 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 720+0+0 (unknown 883113076 0 0) 0x7fcb4c006c20 con 0x7fcb6411ce30 2026-02-12T03:58:01.151 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.148+0000 7fcb4affd640 10 client.4125.objecter ms_dispatch2 0x7fcb64000b90 osd_map(2..2 src has 1..2) 2026-02-12T03:58:01.151 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.148+0000 7fcb4affd640 3 client.4125.objecter handle_osd_map got epochs [2,2] > 0 2026-02-12T03:58:01.151 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.148+0000 7fcb4affd640 3 client.4125.objecter handle_osd_map decoding full epoch 2 2026-02-12T03:58:01.151 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.148+0000 7fcb4affd640 20 client.4125.objecter dump_active .. 0 homeless 2026-02-12T03:58:01.181 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.179+0000 7fcb4affd640 1 -- 10.20.193.154:0/625984988 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77303 (unknown 1092875540 0 3794932319) 0x7fcb4c0044a0 con 0x7fcb6411ce30 2026-02-12T03:58:01.181 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.179+0000 7fcb4affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:01.181 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.179+0000 7fcb4affd640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:01.214 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.212+0000 7fcb63577640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "791c97c5-83f6-4024-9f43-ff3b2ee22a30", "id": 0}] 2026-02-12T03:58:01.214 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.212+0000 7fcb63577640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "791c97c5-83f6-4024-9f43-ff3b2ee22a30", "id": 0}] 2026-02-12T03:58:01.214 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.212+0000 7fcb63577640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:01.214 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.212+0000 7fcb63577640 1 -- 10.20.193.154:0/625984988 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "osd new", "uuid": "791c97c5-83f6-4024-9f43-ff3b2ee22a30", "id": 0} v 0) -- 0x7fcb6410b0a0 con 0x7fcb6411ce30 2026-02-12T03:58:01.259 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.257+0000 7fcb4affd640 1 -- 10.20.193.154:0/625984988 <== mon.0 v1:10.20.193.91:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "791c97c5-83f6-4024-9f43-ff3b2ee22a30", "id": 0}]=0 v3) ==== 112+0+2 (unknown 3033922822 0 732707515) 0x7fcb4c0058b0 con 0x7fcb6411ce30 2026-02-12T03:58:01.259 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.257+0000 7fcb4affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "791c97c5-83f6-4024-9f43-ff3b2ee22a30", "id": 0}] 2026-02-12T03:58:01.259 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.257+0000 7fcb4affd640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:01.259 INFO:teuthology.orchestra.run.trial154.stdout:0 2026-02-12T03:58:01.260 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.257+0000 7fcb63577640 10 librados: watch_flush enter 2026-02-12T03:58:01.260 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.257+0000 7fcb63577640 10 librados: watch_flush exit 2026-02-12T03:58:01.260 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.257+0000 7fcb63577640 20 client.4125.objecter shutdown clearing up homeless session... 2026-02-12T03:58:01.260 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.257+0000 7fcb63577640 10 client.4125.objecter successfully canceled tick 2026-02-12T03:58:01.260 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.257+0000 7fcb63577640 10 monclient: shutdown 2026-02-12T03:58:01.260 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.257+0000 7fcb63577640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:01.260 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.257+0000 7fcb63577640 1 -- 10.20.193.154:0/625984988 >> v1:10.20.193.91:6789/0 conn(0x7fcb6411ce30 legacy=0x7fcb64161990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:01.260 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.257+0000 7fcb63577640 1 -- 10.20.193.154:0/625984988 shutdown_connections 2026-02-12T03:58:01.260 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.257+0000 7fcb63577640 1 -- 10.20.193.154:0/625984988 >> 10.20.193.154:0/625984988 conn(0x7fcb64058980 msgr2=0x7fcb64184da0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:01.260 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.258+0000 7fcb63577640 1 -- 10.20.193.154:0/625984988 shutdown_connections 2026-02-12T03:58:01.260 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.258+0000 7fcb63577640 1 -- 10.20.193.154:0/625984988 wait complete. 2026-02-12T03:58:01.260 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.258+0000 7fcb63577640 1 librados: shutdown 2026-02-12T03:58:01.268 DEBUG:teuthology.orchestra.run.trial154:> sudo ceph --cluster ceph osd new 0cf561d6-85aa-428a-bc69-83ce77b1c802 1 2026-02-12T03:58:01.333 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.331+0000 7fd006155640 10 monclient: get_monmap_and_config 2026-02-12T03:58:01.333 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.331+0000 7fd006155640 10 monclient: build_initial_monmap 2026-02-12T03:58:01.333 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.331+0000 7fd006155640 10 monclient: monmap: 2026-02-12T03:58:01.333 INFO:teuthology.orchestra.run.trial154.stderr:epoch 0 2026-02-12T03:58:01.333 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:01.333 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:58:01.332392+0000 2026-02-12T03:58:01.333 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:58:01.332392+0000 2026-02-12T03:58:01.333 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:01.333 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:01.333 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:01.333 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:01.333 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:01.333 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:01.334 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.331+0000 7fd006155640 1 Processor -- start 2026-02-12T03:58:01.334 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.331+0000 7fd006155640 1 -- start start 2026-02-12T03:58:01.334 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.331+0000 7fd006155640 10 monclient: init 2026-02-12T03:58:01.334 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.331+0000 7fd006155640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:01.334 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.331+0000 7fd006155640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T03:58:01.334 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.331+0000 7fd006155640 10 monclient(hunting): picked mon.noname-a con 0x7fd00011cae0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:01.334 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.331+0000 7fd006155640 10 monclient(hunting): picked mon.noname-c con 0x7fd00011ceb0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:01.334 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.331+0000 7fd006155640 10 monclient(hunting): picked mon.noname-b con 0x7fd0001649c0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:01.334 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.331+0000 7fd006155640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0001864c0 con 0x7fd00011cae0 2026-02-12T03:58:01.334 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.331+0000 7fd006155640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0001876a0 con 0x7fd0001649c0 2026-02-12T03:58:01.334 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.331+0000 7fd006155640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd000188880 con 0x7fd00011ceb0 2026-02-12T03:58:01.334 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.331+0000 7fd006155640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:01.334 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.331+0000 7fd006155640 10 monclient(hunting): authenticate will time out at 1081.984647s 2026-02-12T03:58:01.334 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.331+0000 7fcffffff640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7fd0001649c0 0x7fd000184da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.154:52118/0 (socket says 10.20.193.154:52118) 2026-02-12T03:58:01.334 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.331+0000 7fcffffff640 1 -- 10.20.193.154:0/3015165325 learned_addr learned my addr 10.20.193.154:0/3015165325 (peer_addr_for_me v1:10.20.193.154:0/0) 2026-02-12T03:58:01.335 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.333+0000 7fcffe7fc640 1 -- 10.20.193.154:0/3015165325 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2611909096 0 0) 0x7fd0001876a0 con 0x7fd0001649c0 2026-02-12T03:58:01.335 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.333+0000 7fcffe7fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:01.335 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.333+0000 7fcffe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:01.335 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.333+0000 7fcffe7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:01.335 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.333+0000 7fcffe7fc640 10 monclient(hunting): my global_id is 4123 2026-02-12T03:58:01.335 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.333+0000 7fcffe7fc640 1 -- 10.20.193.154:0/3015165325 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfe4003610 con 0x7fd0001649c0 2026-02-12T03:58:01.336 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.334+0000 7fcffe7fc640 1 -- 10.20.193.154:0/3015165325 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1065545290 0 0) 0x7fd000188880 con 0x7fd00011ceb0 2026-02-12T03:58:01.336 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.334+0000 7fcffe7fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:01.336 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.334+0000 7fcffe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:01.336 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.334+0000 7fcffe7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:01.336 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.334+0000 7fcffe7fc640 10 monclient(hunting): my global_id is 4124 2026-02-12T03:58:01.336 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.334+0000 7fcffe7fc640 1 -- 10.20.193.154:0/3015165325 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0001876a0 con 0x7fd00011ceb0 2026-02-12T03:58:01.336 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.334+0000 7fcffe7fc640 1 -- 10.20.193.154:0/3015165325 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 682870201 0 0) 0x7fd0001864c0 con 0x7fd00011cae0 2026-02-12T03:58:01.336 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.334+0000 7fcffe7fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:01.336 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.334+0000 7fcffe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:01.336 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.334+0000 7fcffe7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:01.336 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.334+0000 7fcffe7fc640 10 monclient(hunting): my global_id is 4128 2026-02-12T03:58:01.336 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.334+0000 7fcffe7fc640 1 -- 10.20.193.154:0/3015165325 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd000188880 con 0x7fd00011cae0 2026-02-12T03:58:01.338 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.335+0000 7fcffe7fc640 1 -- 10.20.193.154:0/3015165325 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 421908820 0 0) 0x7fcfe4003610 con 0x7fd0001649c0 2026-02-12T03:58:01.338 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.335+0000 7fcffe7fc640 1 -- 10.20.193.154:0/3015165325 >> v1:10.20.193.111:6789/0 conn(0x7fd00011ceb0 legacy=0x7fd00011b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:01.338 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.335+0000 7fcffe7fc640 1 -- 10.20.193.154:0/3015165325 >> v1:10.20.193.91:6789/0 conn(0x7fd00011cae0 legacy=0x7fd00011b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:01.338 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.335+0000 7fcffe7fc640 10 monclient: _finish_hunting 0 2026-02-12T03:58:01.338 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.335+0000 7fcffe7fc640 1 monclient: found mon.noname-b 2026-02-12T03:58:01.338 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.335+0000 7fcffe7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:01.338 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.335+0000 7fcffe7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T03:58:01.338 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.335+0000 7fcffe7fc640 1 -- 10.20.193.154:0/3015165325 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd000189b20 con 0x7fd0001649c0 2026-02-12T03:58:01.338 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.335+0000 7fcffe7fc640 10 monclient: _finish_auth 0 2026-02-12T03:58:01.338 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.335+0000 7fcffe7fc640 10 monclient: _check_auth_tickets 2026-02-12T03:58:01.338 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.335+0000 7fcffe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:01.338 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.335+0000 7fd006155640 5 monclient: authenticate success, global_id 4123 2026-02-12T03:58:01.338 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.335+0000 7fd006155640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:01.338 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.336+0000 7fcffe7fc640 1 -- 10.20.193.154:0/3015165325 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fcff4003170 con 0x7fd0001649c0 2026-02-12T03:58:01.338 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.336+0000 7fcffe7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:01.338 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.336+0000 7fcffe7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:01.338 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.336+0000 7fcffe7fc640 10 monclient: dump: 2026-02-12T03:58:01.338 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:01.338 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:01.338 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.338 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.338 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:01.338 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:01.338 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:01.338 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:01.338 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:01.338 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:01.338 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.336+0000 7fd006155640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:01.352 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.350+0000 7fcffe7fc640 1 -- 10.20.193.154:0/3015165325 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcff4003430 con 0x7fd0001649c0 2026-02-12T03:58:01.352 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.350+0000 7fcffe7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:01.352 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.350+0000 7fcffe7fc640 1 -- 10.20.193.154:0/3015165325 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fcff4003830 con 0x7fd0001649c0 2026-02-12T03:58:01.352 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.350+0000 7fd006155640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:01.352 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.350+0000 7fd006155640 4 set_mon_vals no callback set 2026-02-12T03:58:01.352 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.350+0000 7fcffe7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:01.352 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.350+0000 7fcffe7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:01.352 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.350+0000 7fcffe7fc640 10 monclient: dump: 2026-02-12T03:58:01.352 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:01.352 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:01.352 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.352 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.352 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:01.352 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:01.352 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:01.352 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:01.352 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:01.352 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:01.353 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.350+0000 7fd006155640 10 monclient: shutdown 2026-02-12T03:58:01.353 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.350+0000 7fd006155640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:01.353 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.350+0000 7fd006155640 1 -- 10.20.193.154:0/3015165325 >> v1:10.20.193.98:6789/0 conn(0x7fd0001649c0 legacy=0x7fd000184da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:01.353 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.350+0000 7fd006155640 1 -- 10.20.193.154:0/3015165325 shutdown_connections 2026-02-12T03:58:01.353 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.350+0000 7fd006155640 1 -- 10.20.193.154:0/3015165325 >> 10.20.193.154:0/3015165325 conn(0x7fd000058b60 msgr2=0x7fd000058f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:01.353 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.350+0000 7fd006155640 1 -- 10.20.193.154:0/3015165325 shutdown_connections 2026-02-12T03:58:01.353 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.350+0000 7fd006155640 1 -- 10.20.193.154:0/3015165325 wait complete. 2026-02-12T03:58:01.353 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.350+0000 7fd006155640 10 monclient: build_initial_monmap 2026-02-12T03:58:01.353 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.350+0000 7fd006155640 10 monclient: monmap: 2026-02-12T03:58:01.353 INFO:teuthology.orchestra.run.trial154.stderr:epoch 0 2026-02-12T03:58:01.353 INFO:teuthology.orchestra.run.trial154.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:01.353 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 0.000000 2026-02-12T03:58:01.353 INFO:teuthology.orchestra.run.trial154.stderr:created 0.000000 2026-02-12T03:58:01.353 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:01.353 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 1 2026-02-12T03:58:01.353 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:01.353 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:01.353 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:01.353 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:01.353 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.350+0000 7fd006155640 1 librados: starting msgr at 2026-02-12T03:58:01.353 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.350+0000 7fd006155640 1 librados: starting objecter 2026-02-12T03:58:01.353 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.350+0000 7fd006155640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:01.353 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.350+0000 7fd006155640 1 Processor -- start 2026-02-12T03:58:01.353 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.350+0000 7fd006155640 1 -- start start 2026-02-12T03:58:01.354 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.350+0000 7fd006155640 1 librados: setting wanted keys 2026-02-12T03:58:01.354 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.350+0000 7fd006155640 1 librados: calling monclient init 2026-02-12T03:58:01.354 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.350+0000 7fd006155640 10 monclient: init 2026-02-12T03:58:01.354 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.351+0000 7fd006155640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:01.354 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.351+0000 7fd006155640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T03:58:01.354 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.351+0000 7fd006155640 10 monclient(hunting): picked mon.noname-a con 0x7fd00011cae0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:01.354 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.351+0000 7fd006155640 10 monclient(hunting): picked mon.noname-c con 0x7fd00011ceb0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:01.354 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.351+0000 7fd006155640 10 monclient(hunting): picked mon.noname-b con 0x7fd0001649c0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:01.354 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.351+0000 7fd006155640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd000102260 con 0x7fd00011cae0 2026-02-12T03:58:01.354 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.351+0000 7fd006155640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd000109140 con 0x7fd0001649c0 2026-02-12T03:58:01.354 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.351+0000 7fd006155640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd00010a320 con 0x7fd00011ceb0 2026-02-12T03:58:01.354 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.351+0000 7fd006155640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:01.354 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.351+0000 7fd006155640 10 monclient(hunting): authenticate will time out at 1082.004098s 2026-02-12T03:58:01.354 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.351+0000 7fcffeffd640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7fd00011ceb0 0x7fd000161990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.154:46312/0 (socket says 10.20.193.154:46312) 2026-02-12T03:58:01.354 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.351+0000 7fcfff7fe640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7fd00011cae0 0x7fd000101750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.154:46334/0 (socket says 10.20.193.154:46334) 2026-02-12T03:58:01.354 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.351+0000 7fcffeffd640 1 -- 10.20.193.154:0/1194556098 learned_addr learned my addr 10.20.193.154:0/1194556098 (peer_addr_for_me v1:10.20.193.154:0/0) 2026-02-12T03:58:01.354 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.351+0000 7fcfdbfff640 10 client.?.objecter ms_handle_connect 0x7fd00011ceb0 2026-02-12T03:58:01.354 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.351+0000 7fcfdbfff640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:01.354 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.351+0000 7fcfdbfff640 10 client.?.objecter ms_handle_connect 0x7fd00011cae0 2026-02-12T03:58:01.354 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.351+0000 7fcfdbfff640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:01.354 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.351+0000 7fcfdbfff640 10 client.?.objecter ms_handle_connect 0x7fd0001649c0 2026-02-12T03:58:01.354 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.351+0000 7fcfdbfff640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:01.355 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.352+0000 7fcfdbfff640 1 -- 10.20.193.154:0/1194556098 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 937406619 0 0) 0x7fd00010a320 con 0x7fd00011ceb0 2026-02-12T03:58:01.355 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.352+0000 7fcfdbfff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:01.355 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.352+0000 7fcfdbfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:01.355 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.352+0000 7fcfdbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:01.355 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.352+0000 7fcfdbfff640 10 monclient(hunting): my global_id is 4127 2026-02-12T03:58:01.355 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.352+0000 7fcfdbfff640 1 -- 10.20.193.154:0/1194556098 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfd0003610 con 0x7fd00011ceb0 2026-02-12T03:58:01.355 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.352+0000 7fcfdbfff640 1 -- 10.20.193.154:0/1194556098 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2705728096 0 0) 0x7fd000109140 con 0x7fd0001649c0 2026-02-12T03:58:01.355 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.352+0000 7fcfdbfff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:01.355 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.352+0000 7fcfdbfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:01.355 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.352+0000 7fcfdbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:01.355 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.352+0000 7fcfdbfff640 10 monclient(hunting): my global_id is 4126 2026-02-12T03:58:01.355 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.352+0000 7fcfdbfff640 1 -- 10.20.193.154:0/1194556098 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd00010a320 con 0x7fd0001649c0 2026-02-12T03:58:01.355 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.352+0000 7fcfdbfff640 1 -- 10.20.193.154:0/1194556098 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2393490485 0 0) 0x7fd000102260 con 0x7fd00011cae0 2026-02-12T03:58:01.355 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.352+0000 7fcfdbfff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:01.355 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.352+0000 7fcfdbfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:01.355 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.352+0000 7fcfdbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:01.355 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.352+0000 7fcfdbfff640 10 monclient(hunting): my global_id is 4131 2026-02-12T03:58:01.355 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.352+0000 7fcfdbfff640 1 -- 10.20.193.154:0/1194556098 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd000109140 con 0x7fd00011cae0 2026-02-12T03:58:01.357 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.355+0000 7fcfdbfff640 1 -- 10.20.193.154:0/1194556098 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 51891728 0 0) 0x7fd000109140 con 0x7fd00011cae0 2026-02-12T03:58:01.357 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.355+0000 7fcfdbfff640 1 -- 10.20.193.154:0/1194556098 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd000102260 con 0x7fd00011cae0 2026-02-12T03:58:01.357 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.355+0000 7fcfdbfff640 1 -- 10.20.193.154:0/1194556098 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fcfec0030b0 con 0x7fd00011cae0 2026-02-12T03:58:01.357 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.355+0000 7fcfdbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:01.357 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.355+0000 7fcfdbfff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:01.357 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.355+0000 7fcfdbfff640 10 monclient(hunting): dump: 2026-02-12T03:58:01.357 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:01.358 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:01.358 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.358 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.358 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:01.358 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:01.358 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:01.358 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:01.358 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:01.358 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:01.358 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.355+0000 7fcfdbfff640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:01.359 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.357+0000 7fcfdbfff640 1 -- 10.20.193.154:0/1194556098 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2128831859 0 0) 0x7fd000102260 con 0x7fd00011cae0 2026-02-12T03:58:01.359 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.357+0000 7fcfdbfff640 1 -- 10.20.193.154:0/1194556098 >> v1:10.20.193.111:6789/0 conn(0x7fd00011ceb0 legacy=0x7fd000161990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:01.359 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.357+0000 7fcfdbfff640 1 -- 10.20.193.154:0/1194556098 >> v1:10.20.193.98:6789/0 conn(0x7fd0001649c0 legacy=0x7fd0001630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:01.359 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.357+0000 7fcfdbfff640 10 monclient: _finish_hunting 0 2026-02-12T03:58:01.359 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.357+0000 7fcfdbfff640 1 monclient: found mon.a 2026-02-12T03:58:01.359 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.357+0000 7fcfdbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:01.359 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.357+0000 7fcfdbfff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:01.359 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.357+0000 7fcfdbfff640 1 -- 10.20.193.154:0/1194556098 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd00010b500 con 0x7fd00011cae0 2026-02-12T03:58:01.359 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.357+0000 7fcfdbfff640 10 monclient: _finish_auth 0 2026-02-12T03:58:01.359 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.357+0000 7fcfdbfff640 10 monclient: _check_auth_tickets 2026-02-12T03:58:01.360 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.357+0000 7fcfdbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:01.360 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.357+0000 7fd006155640 5 monclient: authenticate success, global_id 4131 2026-02-12T03:58:01.360 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.357+0000 7fd006155640 10 monclient: _renew_subs 2026-02-12T03:58:01.360 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.357+0000 7fd006155640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:01.360 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.357+0000 7fd006155640 1 -- 10.20.193.154:0/1194556098 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd000108130 con 0x7fd00011cae0 2026-02-12T03:58:01.360 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.357+0000 7fd006155640 10 client.4131.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:01.360 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.357+0000 7fd006155640 10 monclient: _renew_subs 2026-02-12T03:58:01.360 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.357+0000 7fd006155640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:01.360 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.357+0000 7fd006155640 1 -- 10.20.193.154:0/1194556098 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd000108720 con 0x7fd00011cae0 2026-02-12T03:58:01.360 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.357+0000 7fd006155640 1 librados: init done 2026-02-12T03:58:01.360 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.358+0000 7fd006155640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:01.360 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.358+0000 7fd006155640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:01.360 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.358+0000 7fd006155640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:01.360 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.358+0000 7fd006155640 1 -- 10.20.193.154:0/1194556098 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd000188f50 con 0x7fd00011cae0 2026-02-12T03:58:01.361 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.359+0000 7fcfdbfff640 1 -- 10.20.193.154:0/1194556098 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcfec0036e0 con 0x7fd00011cae0 2026-02-12T03:58:01.361 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.359+0000 7fcfdbfff640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:01.361 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.359+0000 7fcfdbfff640 1 -- 10.20.193.154:0/1194556098 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fcfec003af0 con 0x7fd00011cae0 2026-02-12T03:58:01.361 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.359+0000 7fcfdbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:01.361 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.359+0000 7fcfdbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:01.361 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.359+0000 7fcffdffb640 4 set_mon_vals no callback set 2026-02-12T03:58:01.361 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.359+0000 7fcfdbfff640 10 monclient: dump: 2026-02-12T03:58:01.361 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:01.361 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:01.361 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.361 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.361 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:01.361 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:01.361 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:01.361 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:01.361 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:01.361 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:01.361 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.359+0000 7fcfdbfff640 1 -- 10.20.193.154:0/1194556098 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7fcfec0040e0 con 0x7fd00011cae0 2026-02-12T03:58:01.361 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.359+0000 7fcfdbfff640 1 -- 10.20.193.154:0/1194556098 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(3..3 src has 1..3) ==== 835+0+0 (unknown 299889504 0 0) 0x7fcfec006b10 con 0x7fd00011cae0 2026-02-12T03:58:01.361 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.359+0000 7fcfdbfff640 10 client.4131.objecter ms_dispatch2 0x7fd000000b90 osd_map(3..3 src has 1..3) 2026-02-12T03:58:01.361 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.359+0000 7fcfdbfff640 3 client.4131.objecter handle_osd_map got epochs [3,3] > 0 2026-02-12T03:58:01.362 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.359+0000 7fcfdbfff640 3 client.4131.objecter handle_osd_map decoding full epoch 3 2026-02-12T03:58:01.362 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.359+0000 7fcfdbfff640 20 client.4131.objecter dump_active .. 0 homeless 2026-02-12T03:58:01.390 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.388+0000 7fcfdbfff640 1 -- 10.20.193.154:0/1194556098 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77303 (unknown 1092875540 0 3794932319) 0x7fcfec004400 con 0x7fd00011cae0 2026-02-12T03:58:01.391 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.388+0000 7fcfdbfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:01.391 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.388+0000 7fcfdbfff640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:01.424 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.422+0000 7fd006155640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "0cf561d6-85aa-428a-bc69-83ce77b1c802", "id": 1}] 2026-02-12T03:58:01.424 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.422+0000 7fd006155640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "0cf561d6-85aa-428a-bc69-83ce77b1c802", "id": 1}] 2026-02-12T03:58:01.424 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.422+0000 7fd006155640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:01.424 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.422+0000 7fd006155640 1 -- 10.20.193.154:0/1194556098 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "osd new", "uuid": "0cf561d6-85aa-428a-bc69-83ce77b1c802", "id": 1} v 0) -- 0x7fd000108f50 con 0x7fd00011cae0 2026-02-12T03:58:01.455 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.453+0000 7fcfdbfff640 1 -- 10.20.193.154:0/1194556098 <== mon.0 v1:10.20.193.91:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0cf561d6-85aa-428a-bc69-83ce77b1c802", "id": 1}]=0 v4) ==== 112+0+2 (unknown 592775253 0 940483276) 0x7fcfec0058b0 con 0x7fd00011cae0 2026-02-12T03:58:01.456 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.453+0000 7fcfdbfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "0cf561d6-85aa-428a-bc69-83ce77b1c802", "id": 1}] 2026-02-12T03:58:01.456 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.453+0000 7fcfdbfff640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:01.456 INFO:teuthology.orchestra.run.trial154.stdout:1 2026-02-12T03:58:01.456 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.454+0000 7fd006155640 10 librados: watch_flush enter 2026-02-12T03:58:01.456 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.454+0000 7fd006155640 10 librados: watch_flush exit 2026-02-12T03:58:01.456 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.454+0000 7fd006155640 20 client.4131.objecter shutdown clearing up homeless session... 2026-02-12T03:58:01.456 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.454+0000 7fd006155640 10 client.4131.objecter successfully canceled tick 2026-02-12T03:58:01.456 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.454+0000 7fd006155640 10 monclient: shutdown 2026-02-12T03:58:01.456 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.454+0000 7fd006155640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:01.456 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.454+0000 7fd006155640 1 -- 10.20.193.154:0/1194556098 >> v1:10.20.193.91:6789/0 conn(0x7fd00011cae0 legacy=0x7fd000101750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:01.456 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.454+0000 7fd006155640 1 -- 10.20.193.154:0/1194556098 shutdown_connections 2026-02-12T03:58:01.456 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.454+0000 7fd006155640 1 -- 10.20.193.154:0/1194556098 >> 10.20.193.154:0/1194556098 conn(0x7fd000058b60 msgr2=0x7fd00005bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:01.457 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.454+0000 7fd006155640 1 -- 10.20.193.154:0/1194556098 shutdown_connections 2026-02-12T03:58:01.457 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.454+0000 7fd006155640 1 -- 10.20.193.154:0/1194556098 wait complete. 2026-02-12T03:58:01.457 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.454+0000 7fd006155640 1 librados: shutdown 2026-02-12T03:58:01.464 DEBUG:teuthology.orchestra.run.trial154:> sudo ceph --cluster ceph osd new b3dc78b9-cae6-4b1f-931f-7352a43b9e26 2 2026-02-12T03:58:01.531 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.527+0000 7f0a57f34640 10 monclient: get_monmap_and_config 2026-02-12T03:58:01.531 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.527+0000 7f0a57f34640 10 monclient: build_initial_monmap 2026-02-12T03:58:01.531 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.527+0000 7f0a57f34640 10 monclient: monmap: 2026-02-12T03:58:01.531 INFO:teuthology.orchestra.run.trial154.stderr:epoch 0 2026-02-12T03:58:01.532 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:01.532 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:58:01.528863+0000 2026-02-12T03:58:01.532 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:58:01.528863+0000 2026-02-12T03:58:01.532 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:01.532 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:01.532 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:01.532 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:01.532 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:01.532 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:01.532 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.527+0000 7f0a57f34640 1 Processor -- start 2026-02-12T03:58:01.533 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.527+0000 7f0a57f34640 1 -- start start 2026-02-12T03:58:01.533 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.527+0000 7f0a57f34640 10 monclient: init 2026-02-12T03:58:01.533 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.528+0000 7f0a57f34640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:01.533 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.528+0000 7f0a57f34640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T03:58:01.533 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.528+0000 7f0a57f34640 10 monclient(hunting): picked mon.noname-b con 0x7f0a5011cae0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:01.533 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.528+0000 7f0a57f34640 10 monclient(hunting): picked mon.noname-c con 0x7f0a5011ceb0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:01.533 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.528+0000 7f0a57f34640 10 monclient(hunting): picked mon.noname-a con 0x7f0a501649c0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:01.533 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.528+0000 7f0a57f34640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a501864c0 con 0x7f0a501649c0 2026-02-12T03:58:01.533 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.528+0000 7f0a57f34640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a501876a0 con 0x7f0a5011cae0 2026-02-12T03:58:01.533 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.528+0000 7f0a57f34640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a50188880 con 0x7f0a5011ceb0 2026-02-12T03:58:01.534 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.528+0000 7f0a57f34640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:01.534 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.528+0000 7f0a57f34640 10 monclient(hunting): authenticate will time out at 1082.181117s 2026-02-12T03:58:01.534 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.528+0000 7f0a55ca9640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f0a5011cae0 0x7f0a5011b1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.154:52134/0 (socket says 10.20.193.154:52134) 2026-02-12T03:58:01.534 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.528+0000 7f0a55ca9640 1 -- 10.20.193.154:0/971402809 learned_addr learned my addr 10.20.193.154:0/971402809 (peer_addr_for_me v1:10.20.193.154:0/0) 2026-02-12T03:58:01.540 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.529+0000 7f0a54ca7640 1 -- 10.20.193.154:0/971402809 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 367852537 0 0) 0x7f0a501876a0 con 0x7f0a5011cae0 2026-02-12T03:58:01.540 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.529+0000 7f0a54ca7640 10 monclient(hunting): _negotiate 2026-02-12T03:58:01.540 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.529+0000 7f0a54ca7640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:01.540 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.529+0000 7f0a54ca7640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:01.541 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.529+0000 7f0a54ca7640 10 monclient(hunting): my global_id is 4129 2026-02-12T03:58:01.541 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.529+0000 7f0a54ca7640 1 -- 10.20.193.154:0/971402809 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a38003610 con 0x7f0a5011cae0 2026-02-12T03:58:01.541 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.530+0000 7f0a54ca7640 1 -- 10.20.193.154:0/971402809 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 102217569 0 0) 0x7f0a50188880 con 0x7f0a5011ceb0 2026-02-12T03:58:01.541 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.530+0000 7f0a54ca7640 10 monclient(hunting): _negotiate 2026-02-12T03:58:01.541 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.530+0000 7f0a54ca7640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:01.541 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.530+0000 7f0a54ca7640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:01.541 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.530+0000 7f0a54ca7640 10 monclient(hunting): my global_id is 4130 2026-02-12T03:58:01.541 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.530+0000 7f0a54ca7640 1 -- 10.20.193.154:0/971402809 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a501876a0 con 0x7f0a5011ceb0 2026-02-12T03:58:01.541 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.530+0000 7f0a54ca7640 1 -- 10.20.193.154:0/971402809 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3064029739 0 0) 0x7f0a501864c0 con 0x7f0a501649c0 2026-02-12T03:58:01.541 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.530+0000 7f0a54ca7640 10 monclient(hunting): _negotiate 2026-02-12T03:58:01.541 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.530+0000 7f0a54ca7640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:01.542 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.530+0000 7f0a54ca7640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:01.542 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.530+0000 7f0a54ca7640 10 monclient(hunting): my global_id is 4134 2026-02-12T03:58:01.542 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.530+0000 7f0a54ca7640 1 -- 10.20.193.154:0/971402809 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a50188880 con 0x7f0a501649c0 2026-02-12T03:58:01.542 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.531+0000 7f0a54ca7640 1 -- 10.20.193.154:0/971402809 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2075359324 0 0) 0x7f0a38003610 con 0x7f0a5011cae0 2026-02-12T03:58:01.542 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.531+0000 7f0a54ca7640 1 -- 10.20.193.154:0/971402809 >> v1:10.20.193.111:6789/0 conn(0x7f0a5011ceb0 legacy=0x7f0a5011b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:01.542 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.531+0000 7f0a54ca7640 1 -- 10.20.193.154:0/971402809 >> v1:10.20.193.91:6789/0 conn(0x7f0a501649c0 legacy=0x7f0a50184da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:01.542 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.531+0000 7f0a54ca7640 10 monclient: _finish_hunting 0 2026-02-12T03:58:01.542 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.531+0000 7f0a54ca7640 1 monclient: found mon.noname-b 2026-02-12T03:58:01.542 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.531+0000 7f0a54ca7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:01.542 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.531+0000 7f0a54ca7640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T03:58:01.543 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.531+0000 7f0a54ca7640 1 -- 10.20.193.154:0/971402809 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a50189b20 con 0x7f0a5011cae0 2026-02-12T03:58:01.543 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.531+0000 7f0a54ca7640 10 monclient: _finish_auth 0 2026-02-12T03:58:01.543 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.531+0000 7f0a54ca7640 10 monclient: _check_auth_tickets 2026-02-12T03:58:01.543 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.531+0000 7f0a54ca7640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:01.543 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.531+0000 7f0a54ca7640 1 -- 10.20.193.154:0/971402809 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f0a40002df0 con 0x7f0a5011cae0 2026-02-12T03:58:01.543 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.531+0000 7f0a57f34640 5 monclient: authenticate success, global_id 4129 2026-02-12T03:58:01.543 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.531+0000 7f0a57f34640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:01.543 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.531+0000 7f0a54ca7640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:01.543 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.531+0000 7f0a54ca7640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:01.543 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.531+0000 7f0a54ca7640 10 monclient: dump: 2026-02-12T03:58:01.544 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:01.544 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:01.544 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.544 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.544 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:01.544 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:01.544 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:01.544 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:01.544 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:01.544 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:01.545 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.531+0000 7f0a57f34640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:01.545 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.532+0000 7f0a54ca7640 1 -- 10.20.193.154:0/971402809 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0a40003030 con 0x7f0a5011cae0 2026-02-12T03:58:01.545 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.532+0000 7f0a54ca7640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:01.545 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.532+0000 7f0a54ca7640 1 -- 10.20.193.154:0/971402809 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f0a40003470 con 0x7f0a5011cae0 2026-02-12T03:58:01.545 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.532+0000 7f0a54ca7640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:01.545 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.532+0000 7f0a54ca7640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:01.545 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.532+0000 7f0a54ca7640 10 monclient: dump: 2026-02-12T03:58:01.545 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:01.545 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:01.545 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.545 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.546 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:01.546 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:01.546 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:01.546 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:01.546 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:01.546 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:01.546 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.532+0000 7f0a57f34640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:01.546 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.532+0000 7f0a57f34640 4 set_mon_vals no callback set 2026-02-12T03:58:01.546 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.532+0000 7f0a57f34640 10 monclient: shutdown 2026-02-12T03:58:01.546 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.532+0000 7f0a57f34640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:01.547 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.532+0000 7f0a57f34640 1 -- 10.20.193.154:0/971402809 >> v1:10.20.193.98:6789/0 conn(0x7f0a5011cae0 legacy=0x7f0a5011b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:01.547 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.532+0000 7f0a57f34640 1 -- 10.20.193.154:0/971402809 shutdown_connections 2026-02-12T03:58:01.547 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.532+0000 7f0a57f34640 1 -- 10.20.193.154:0/971402809 >> 10.20.193.154:0/971402809 conn(0x7f0a50058b60 msgr2=0x7f0a50058f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:01.547 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.532+0000 7f0a57f34640 1 -- 10.20.193.154:0/971402809 shutdown_connections 2026-02-12T03:58:01.547 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.532+0000 7f0a57f34640 1 -- 10.20.193.154:0/971402809 wait complete. 2026-02-12T03:58:01.547 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.533+0000 7f0a57f34640 10 monclient: build_initial_monmap 2026-02-12T03:58:01.547 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.533+0000 7f0a57f34640 10 monclient: monmap: 2026-02-12T03:58:01.547 INFO:teuthology.orchestra.run.trial154.stderr:epoch 0 2026-02-12T03:58:01.547 INFO:teuthology.orchestra.run.trial154.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:01.547 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 0.000000 2026-02-12T03:58:01.547 INFO:teuthology.orchestra.run.trial154.stderr:created 0.000000 2026-02-12T03:58:01.547 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:01.548 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 1 2026-02-12T03:58:01.548 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:01.548 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:01.548 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:01.548 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:01.548 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.533+0000 7f0a57f34640 1 librados: starting msgr at 2026-02-12T03:58:01.548 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.533+0000 7f0a57f34640 1 librados: starting objecter 2026-02-12T03:58:01.548 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.533+0000 7f0a57f34640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:01.548 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.533+0000 7f0a57f34640 1 Processor -- start 2026-02-12T03:58:01.548 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.533+0000 7f0a57f34640 1 -- start start 2026-02-12T03:58:01.548 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.533+0000 7f0a57f34640 1 librados: setting wanted keys 2026-02-12T03:58:01.549 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.533+0000 7f0a57f34640 1 librados: calling monclient init 2026-02-12T03:58:01.549 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.533+0000 7f0a57f34640 10 monclient: init 2026-02-12T03:58:01.549 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.533+0000 7f0a57f34640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:01.549 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.533+0000 7f0a57f34640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T03:58:01.549 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.533+0000 7f0a57f34640 10 monclient(hunting): picked mon.noname-a con 0x7f0a5011cae0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:01.549 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.533+0000 7f0a57f34640 10 monclient(hunting): picked mon.noname-b con 0x7f0a5011ceb0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:01.549 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.533+0000 7f0a57f34640 10 monclient(hunting): picked mon.noname-c con 0x7f0a501649c0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:01.549 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.533+0000 7f0a57f34640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a501022f0 con 0x7f0a5011cae0 2026-02-12T03:58:01.549 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.533+0000 7f0a57f34640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a501091d0 con 0x7f0a5011ceb0 2026-02-12T03:58:01.549 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.533+0000 7f0a57f34640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a5010a3b0 con 0x7f0a501649c0 2026-02-12T03:58:01.549 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.533+0000 7f0a57f34640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:01.550 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.533+0000 7f0a57f34640 10 monclient(hunting): authenticate will time out at 1082.186476s 2026-02-12T03:58:01.550 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.533+0000 7f0a564aa640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f0a501649c0 0x7f0a501630b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.154:46338/0 (socket says 10.20.193.154:46338) 2026-02-12T03:58:01.550 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.533+0000 7f0a564aa640 1 -- 10.20.193.154:0/1449889528 learned_addr learned my addr 10.20.193.154:0/1449889528 (peer_addr_for_me v1:10.20.193.154:0/0) 2026-02-12T03:58:01.550 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.534+0000 7f0a3e7fc640 10 client.?.objecter ms_handle_connect 0x7f0a5011ceb0 2026-02-12T03:58:01.550 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.534+0000 7f0a3e7fc640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:01.550 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.534+0000 7f0a3e7fc640 10 client.?.objecter ms_handle_connect 0x7f0a501649c0 2026-02-12T03:58:01.550 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.534+0000 7f0a3e7fc640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:01.550 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.535+0000 7f0a3e7fc640 1 -- 10.20.193.154:0/1449889528 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1431830483 0 0) 0x7f0a5010a3b0 con 0x7f0a501649c0 2026-02-12T03:58:01.550 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.535+0000 7f0a3e7fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:01.550 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.535+0000 7f0a3e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:01.550 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.535+0000 7f0a3e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:01.551 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.535+0000 7f0a3e7fc640 10 monclient(hunting): my global_id is 4133 2026-02-12T03:58:01.551 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.535+0000 7f0a3e7fc640 1 -- 10.20.193.154:0/1449889528 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a20003610 con 0x7f0a501649c0 2026-02-12T03:58:01.551 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.535+0000 7f0a3e7fc640 10 client.?.objecter ms_handle_connect 0x7f0a5011cae0 2026-02-12T03:58:01.551 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.535+0000 7f0a3e7fc640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:01.551 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.537+0000 7f0a3e7fc640 1 -- 10.20.193.154:0/1449889528 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 144672486 0 0) 0x7f0a501022f0 con 0x7f0a5011cae0 2026-02-12T03:58:01.551 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.537+0000 7f0a3e7fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:01.551 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.537+0000 7f0a3e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:01.551 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.537+0000 7f0a3e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:01.551 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.537+0000 7f0a3e7fc640 10 monclient(hunting): my global_id is 4137 2026-02-12T03:58:01.551 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.537+0000 7f0a3e7fc640 1 -- 10.20.193.154:0/1449889528 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a5010a3b0 con 0x7f0a5011cae0 2026-02-12T03:58:01.554 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.540+0000 7f0a3e7fc640 1 -- 10.20.193.154:0/1449889528 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4199773835 0 0) 0x7f0a5010a3b0 con 0x7f0a5011cae0 2026-02-12T03:58:01.554 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.540+0000 7f0a3e7fc640 1 -- 10.20.193.154:0/1449889528 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0a501022f0 con 0x7f0a5011cae0 2026-02-12T03:58:01.554 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.540+0000 7f0a3e7fc640 1 -- 10.20.193.154:0/1449889528 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f0a400031e0 con 0x7f0a5011cae0 2026-02-12T03:58:01.554 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.540+0000 7f0a3e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:01.554 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.540+0000 7f0a3e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:01.554 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.540+0000 7f0a3e7fc640 10 monclient(hunting): dump: 2026-02-12T03:58:01.554 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:01.554 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:01.554 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.555 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.555 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:01.555 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:01.555 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:01.555 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:01.555 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:01.555 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:01.555 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.540+0000 7f0a3e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:01.555 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.541+0000 7f0a3e7fc640 1 -- 10.20.193.154:0/1449889528 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1284433085 0 0) 0x7f0a501091d0 con 0x7f0a5011ceb0 2026-02-12T03:58:01.555 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.541+0000 7f0a3e7fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:01.555 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.541+0000 7f0a3e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:01.556 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.541+0000 7f0a3e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:01.556 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.541+0000 7f0a3e7fc640 10 monclient(hunting): my global_id is 4132 2026-02-12T03:58:01.556 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.541+0000 7f0a3e7fc640 1 -- 10.20.193.154:0/1449889528 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a5010a3b0 con 0x7f0a5011ceb0 2026-02-12T03:58:01.556 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.542+0000 7f0a3e7fc640 1 -- 10.20.193.154:0/1449889528 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2685486299 0 0) 0x7f0a501022f0 con 0x7f0a5011cae0 2026-02-12T03:58:01.556 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.542+0000 7f0a3e7fc640 1 -- 10.20.193.154:0/1449889528 >> v1:10.20.193.111:6789/0 conn(0x7f0a501649c0 legacy=0x7f0a501630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:01.556 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.542+0000 7f0a3e7fc640 1 -- 10.20.193.154:0/1449889528 >> v1:10.20.193.98:6789/0 conn(0x7f0a5011ceb0 legacy=0x7f0a50161990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:01.556 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.542+0000 7f0a3e7fc640 10 monclient: _finish_hunting 0 2026-02-12T03:58:01.556 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.542+0000 7f0a3e7fc640 1 monclient: found mon.a 2026-02-12T03:58:01.556 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.542+0000 7f0a3e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:01.556 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.542+0000 7f0a3e7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:01.557 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.542+0000 7f0a3e7fc640 1 -- 10.20.193.154:0/1449889528 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a5010b590 con 0x7f0a5011cae0 2026-02-12T03:58:01.557 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.542+0000 7f0a3e7fc640 10 monclient: _finish_auth 0 2026-02-12T03:58:01.557 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.542+0000 7f0a3e7fc640 10 monclient: _check_auth_tickets 2026-02-12T03:58:01.557 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.542+0000 7f0a3e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:01.557 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.542+0000 7f0a57f34640 5 monclient: authenticate success, global_id 4137 2026-02-12T03:58:01.557 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.542+0000 7f0a57f34640 10 monclient: _renew_subs 2026-02-12T03:58:01.557 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.542+0000 7f0a57f34640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:01.557 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.542+0000 7f0a57f34640 1 -- 10.20.193.154:0/1449889528 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0a5010a580 con 0x7f0a5011cae0 2026-02-12T03:58:01.557 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.542+0000 7f0a57f34640 10 client.4137.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:01.557 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.542+0000 7f0a57f34640 10 monclient: _renew_subs 2026-02-12T03:58:01.557 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.542+0000 7f0a57f34640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:01.558 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.542+0000 7f0a57f34640 1 -- 10.20.193.154:0/1449889528 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0a5010ab40 con 0x7f0a5011cae0 2026-02-12T03:58:01.558 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.542+0000 7f0a57f34640 1 librados: init done 2026-02-12T03:58:01.558 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.542+0000 7f0a57f34640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:01.558 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.542+0000 7f0a57f34640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:01.558 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.542+0000 7f0a57f34640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:01.558 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.542+0000 7f0a57f34640 1 -- 10.20.193.154:0/1449889528 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a50186b90 con 0x7f0a5011cae0 2026-02-12T03:58:01.577 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.574+0000 7f0a3e7fc640 1 -- 10.20.193.154:0/1449889528 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0a400034f0 con 0x7f0a5011cae0 2026-02-12T03:58:01.577 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.574+0000 7f0a3e7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:01.577 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.574+0000 7f0a3e7fc640 1 -- 10.20.193.154:0/1449889528 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f0a40004ce0 con 0x7f0a5011cae0 2026-02-12T03:58:01.577 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.574+0000 7f0a3e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:01.577 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.574+0000 7f0a3e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:01.577 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.574+0000 7f0a3e7fc640 10 monclient: dump: 2026-02-12T03:58:01.577 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:01.577 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:01.578 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.578 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.578 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:01.578 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:01.578 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:01.578 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:01.578 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:01.578 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:01.578 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.574+0000 7f0a3ffff640 4 set_mon_vals no callback set 2026-02-12T03:58:01.579 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.575+0000 7f0a3e7fc640 1 -- 10.20.193.154:0/1449889528 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f0a40005290 con 0x7f0a5011cae0 2026-02-12T03:58:01.579 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.575+0000 7f0a3e7fc640 1 -- 10.20.193.154:0/1449889528 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(4..4 src has 1..4) ==== 950+0+0 (unknown 4209790816 0 0) 0x7f0a40006a90 con 0x7f0a5011cae0 2026-02-12T03:58:01.579 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.575+0000 7f0a3e7fc640 10 client.4137.objecter ms_dispatch2 0x7f0a50000b90 osd_map(4..4 src has 1..4) 2026-02-12T03:58:01.579 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.575+0000 7f0a3e7fc640 3 client.4137.objecter handle_osd_map got epochs [4,4] > 0 2026-02-12T03:58:01.580 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.575+0000 7f0a3e7fc640 3 client.4137.objecter handle_osd_map decoding full epoch 4 2026-02-12T03:58:01.580 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.575+0000 7f0a3e7fc640 20 client.4137.objecter dump_active .. 0 homeless 2026-02-12T03:58:01.580 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.575+0000 7f0a3e7fc640 1 -- 10.20.193.154:0/1449889528 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77303 (unknown 1092875540 0 3794932319) 0x7f0a40006670 con 0x7f0a5011cae0 2026-02-12T03:58:01.580 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.575+0000 7f0a3e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:01.580 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.575+0000 7f0a3e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:01.611 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.608+0000 7f0a57f34640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "b3dc78b9-cae6-4b1f-931f-7352a43b9e26", "id": 2}] 2026-02-12T03:58:01.611 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.608+0000 7f0a57f34640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "b3dc78b9-cae6-4b1f-931f-7352a43b9e26", "id": 2}] 2026-02-12T03:58:01.611 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.608+0000 7f0a57f34640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:01.611 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.608+0000 7f0a57f34640 1 -- 10.20.193.154:0/1449889528 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "osd new", "uuid": "b3dc78b9-cae6-4b1f-931f-7352a43b9e26", "id": 2} v 0) -- 0x7f0a5010b2c0 con 0x7f0a5011cae0 2026-02-12T03:58:01.628 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.626+0000 7f0a3e7fc640 1 -- 10.20.193.154:0/1449889528 <== mon.0 v1:10.20.193.91:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b3dc78b9-cae6-4b1f-931f-7352a43b9e26", "id": 2}]=0 v5) ==== 112+0+2 (unknown 2939825522 0 216599125) 0x7f0a40005650 con 0x7f0a5011cae0 2026-02-12T03:58:01.628 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.626+0000 7f0a3e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "b3dc78b9-cae6-4b1f-931f-7352a43b9e26", "id": 2}] 2026-02-12T03:58:01.629 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.626+0000 7f0a3e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:01.629 INFO:teuthology.orchestra.run.trial154.stdout:2 2026-02-12T03:58:01.630 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.626+0000 7f0a57f34640 10 librados: watch_flush enter 2026-02-12T03:58:01.630 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.626+0000 7f0a57f34640 10 librados: watch_flush exit 2026-02-12T03:58:01.631 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.626+0000 7f0a57f34640 20 client.4137.objecter shutdown clearing up homeless session... 2026-02-12T03:58:01.631 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.626+0000 7f0a57f34640 10 client.4137.objecter successfully canceled tick 2026-02-12T03:58:01.631 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.626+0000 7f0a57f34640 10 monclient: shutdown 2026-02-12T03:58:01.631 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.626+0000 7f0a57f34640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:01.631 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.626+0000 7f0a57f34640 1 -- 10.20.193.154:0/1449889528 >> v1:10.20.193.91:6789/0 conn(0x7f0a5011cae0 legacy=0x7f0a501017e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:01.631 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.626+0000 7f0a57f34640 1 -- 10.20.193.154:0/1449889528 shutdown_connections 2026-02-12T03:58:01.631 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.626+0000 7f0a57f34640 1 -- 10.20.193.154:0/1449889528 >> 10.20.193.154:0/1449889528 conn(0x7f0a50058b60 msgr2=0x7f0a5005b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:01.631 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.626+0000 7f0a57f34640 1 -- 10.20.193.154:0/1449889528 shutdown_connections 2026-02-12T03:58:01.631 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.626+0000 7f0a57f34640 1 -- 10.20.193.154:0/1449889528 wait complete. 2026-02-12T03:58:01.631 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.626+0000 7f0a57f34640 1 librados: shutdown 2026-02-12T03:58:01.637 DEBUG:teuthology.orchestra.run.trial154:> sudo ceph --cluster ceph osd new e164e3ae-cf6a-45ff-b126-3ac739c5b1be 3 2026-02-12T03:58:01.703 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.700+0000 7f27e8a88640 10 monclient: get_monmap_and_config 2026-02-12T03:58:01.703 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.700+0000 7f27e8a88640 10 monclient: build_initial_monmap 2026-02-12T03:58:01.703 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.700+0000 7f27e8a88640 10 monclient: monmap: 2026-02-12T03:58:01.703 INFO:teuthology.orchestra.run.trial154.stderr:epoch 0 2026-02-12T03:58:01.703 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:01.703 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:58:01.701911+0000 2026-02-12T03:58:01.703 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:58:01.701911+0000 2026-02-12T03:58:01.704 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:01.704 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:01.704 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:01.704 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:01.704 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:01.704 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:01.711 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.701+0000 7f27e8a88640 1 Processor -- start 2026-02-12T03:58:01.712 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.701+0000 7f27e8a88640 1 -- start start 2026-02-12T03:58:01.712 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.701+0000 7f27e8a88640 10 monclient: init 2026-02-12T03:58:01.712 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.701+0000 7f27e8a88640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:01.712 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.701+0000 7f27e8a88640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T03:58:01.712 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.701+0000 7f27e8a88640 10 monclient(hunting): picked mon.noname-a con 0x7f27e405daf0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:01.712 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.701+0000 7f27e8a88640 10 monclient(hunting): picked mon.noname-b con 0x7f27e405dfb0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:01.712 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.701+0000 7f27e8a88640 10 monclient(hunting): picked mon.noname-c con 0x7f27e41624d0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:01.712 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.701+0000 7f27e8a88640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27e41841d0 con 0x7f27e405daf0 2026-02-12T03:58:01.712 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.701+0000 7f27e8a88640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27e41853d0 con 0x7f27e405dfb0 2026-02-12T03:58:01.713 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.701+0000 7f27e8a88640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27e41865d0 con 0x7f27e41624d0 2026-02-12T03:58:01.713 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.701+0000 7f27e8a88640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:01.713 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.701+0000 7f27e8a88640 10 monclient(hunting): authenticate will time out at 1082.354347s 2026-02-12T03:58:01.713 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.701+0000 7f27e1d74640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f27e405dfb0 0x7f27e405b1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.154:52150/0 (socket says 10.20.193.154:52150) 2026-02-12T03:58:01.713 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.701+0000 7f27e1d74640 1 -- 10.20.193.154:0/1180201014 learned_addr learned my addr 10.20.193.154:0/1180201014 (peer_addr_for_me v1:10.20.193.154:0/0) 2026-02-12T03:58:01.713 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.703+0000 7f27e1573640 1 -- 10.20.193.154:0/1180201014 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3365820962 0 0) 0x7f27e41853d0 con 0x7f27e405dfb0 2026-02-12T03:58:01.713 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.703+0000 7f27e1573640 10 monclient(hunting): _negotiate 2026-02-12T03:58:01.713 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.703+0000 7f27e1573640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:01.713 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.703+0000 7f27e1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:01.713 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.703+0000 7f27e1573640 10 monclient(hunting): my global_id is 4135 2026-02-12T03:58:01.714 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.703+0000 7f27e1573640 1 -- 10.20.193.154:0/1180201014 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27d0003610 con 0x7f27e405dfb0 2026-02-12T03:58:01.714 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.703+0000 7f27e1573640 1 -- 10.20.193.154:0/1180201014 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3113475712 0 0) 0x7f27e41865d0 con 0x7f27e41624d0 2026-02-12T03:58:01.714 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.703+0000 7f27e1573640 10 monclient(hunting): _negotiate 2026-02-12T03:58:01.714 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.703+0000 7f27e1573640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:01.714 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.703+0000 7f27e1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:01.714 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.703+0000 7f27e1573640 10 monclient(hunting): my global_id is 4136 2026-02-12T03:58:01.714 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.703+0000 7f27e1573640 1 -- 10.20.193.154:0/1180201014 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27e41853d0 con 0x7f27e41624d0 2026-02-12T03:58:01.714 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.703+0000 7f27e1573640 1 -- 10.20.193.154:0/1180201014 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 81765630 0 0) 0x7f27e41841d0 con 0x7f27e405daf0 2026-02-12T03:58:01.714 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.703+0000 7f27e1573640 10 monclient(hunting): _negotiate 2026-02-12T03:58:01.715 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.703+0000 7f27e1573640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:01.715 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.703+0000 7f27e1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:01.715 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.703+0000 7f27e1573640 10 monclient(hunting): my global_id is 4140 2026-02-12T03:58:01.715 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.703+0000 7f27e1573640 1 -- 10.20.193.154:0/1180201014 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27e41865d0 con 0x7f27e405daf0 2026-02-12T03:58:01.715 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.704+0000 7f27e1573640 1 -- 10.20.193.154:0/1180201014 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3507937769 0 0) 0x7f27d0003610 con 0x7f27e405dfb0 2026-02-12T03:58:01.715 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.704+0000 7f27e1573640 1 -- 10.20.193.154:0/1180201014 >> v1:10.20.193.111:6789/0 conn(0x7f27e41624d0 legacy=0x7f27e41828d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:01.715 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.704+0000 7f27e1573640 1 -- 10.20.193.154:0/1180201014 >> v1:10.20.193.91:6789/0 conn(0x7f27e405daf0 legacy=0x7f27e405aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:01.715 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.704+0000 7f27e1573640 10 monclient: _finish_hunting 0 2026-02-12T03:58:01.715 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.704+0000 7f27e1573640 1 monclient: found mon.noname-b 2026-02-12T03:58:01.715 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.704+0000 7f27e1573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:01.715 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.704+0000 7f27e1573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T03:58:01.715 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.704+0000 7f27e1573640 1 -- 10.20.193.154:0/1180201014 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e4187870 con 0x7f27e405dfb0 2026-02-12T03:58:01.716 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.704+0000 7f27e1573640 10 monclient: _finish_auth 0 2026-02-12T03:58:01.716 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.704+0000 7f27e1573640 10 monclient: _check_auth_tickets 2026-02-12T03:58:01.716 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.704+0000 7f27e1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:01.716 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.704+0000 7f27e1573640 1 -- 10.20.193.154:0/1180201014 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f27cc002df0 con 0x7f27e405dfb0 2026-02-12T03:58:01.716 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.704+0000 7f27e1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:01.716 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.704+0000 7f27e1573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:01.716 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.704+0000 7f27e1573640 10 monclient: dump: 2026-02-12T03:58:01.716 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:01.716 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:01.717 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.717 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.717 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:01.717 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:01.717 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:01.717 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:01.717 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:01.717 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:01.717 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.704+0000 7f27e8a88640 5 monclient: authenticate success, global_id 4135 2026-02-12T03:58:01.717 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.704+0000 7f27e8a88640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:01.717 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.705+0000 7f27e1573640 1 -- 10.20.193.154:0/1180201014 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f27cc003030 con 0x7f27e405dfb0 2026-02-12T03:58:01.718 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.705+0000 7f27e1573640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:01.718 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.705+0000 7f27e1573640 1 -- 10.20.193.154:0/1180201014 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f27cc003470 con 0x7f27e405dfb0 2026-02-12T03:58:01.718 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.705+0000 7f27e1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:01.718 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.705+0000 7f27e1573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:01.718 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.705+0000 7f27e1573640 10 monclient: dump: 2026-02-12T03:58:01.718 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:01.718 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:01.718 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.718 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.718 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:01.718 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:01.719 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:01.719 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:01.719 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:01.719 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:01.719 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.705+0000 7f27e8a88640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:01.719 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.705+0000 7f27e8a88640 4 set_mon_vals no callback set 2026-02-12T03:58:01.719 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.705+0000 7f27e8a88640 10 monclient: shutdown 2026-02-12T03:58:01.719 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.705+0000 7f27e8a88640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:01.719 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.705+0000 7f27e8a88640 1 -- 10.20.193.154:0/1180201014 >> v1:10.20.193.98:6789/0 conn(0x7f27e405dfb0 legacy=0x7f27e405b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:01.719 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.705+0000 7f27e8a88640 1 -- 10.20.193.154:0/1180201014 shutdown_connections 2026-02-12T03:58:01.719 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.705+0000 7f27e8a88640 1 -- 10.20.193.154:0/1180201014 >> 10.20.193.154:0/1180201014 conn(0x7f27e4058ca0 msgr2=0x7f27e40590a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:01.720 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.705+0000 7f27e8a88640 1 -- 10.20.193.154:0/1180201014 shutdown_connections 2026-02-12T03:58:01.720 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.705+0000 7f27e8a88640 1 -- 10.20.193.154:0/1180201014 wait complete. 2026-02-12T03:58:01.720 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.706+0000 7f27e8a88640 10 monclient: build_initial_monmap 2026-02-12T03:58:01.720 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.706+0000 7f27e8a88640 10 monclient: monmap: 2026-02-12T03:58:01.720 INFO:teuthology.orchestra.run.trial154.stderr:epoch 0 2026-02-12T03:58:01.720 INFO:teuthology.orchestra.run.trial154.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:01.720 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 0.000000 2026-02-12T03:58:01.720 INFO:teuthology.orchestra.run.trial154.stderr:created 0.000000 2026-02-12T03:58:01.720 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:01.720 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 1 2026-02-12T03:58:01.720 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:01.721 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:01.721 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:01.721 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:01.721 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.706+0000 7f27e8a88640 1 librados: starting msgr at 2026-02-12T03:58:01.721 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.706+0000 7f27e8a88640 1 librados: starting objecter 2026-02-12T03:58:01.721 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.706+0000 7f27e8a88640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:01.721 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.706+0000 7f27e8a88640 1 Processor -- start 2026-02-12T03:58:01.721 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.706+0000 7f27e8a88640 1 -- start start 2026-02-12T03:58:01.721 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.706+0000 7f27e8a88640 1 librados: setting wanted keys 2026-02-12T03:58:01.721 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.706+0000 7f27e8a88640 1 librados: calling monclient init 2026-02-12T03:58:01.721 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.706+0000 7f27e8a88640 10 monclient: init 2026-02-12T03:58:01.722 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.706+0000 7f27e8a88640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:01.722 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.706+0000 7f27e8a88640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T03:58:01.722 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.706+0000 7f27e8a88640 10 monclient(hunting): picked mon.noname-c con 0x7f27e405daf0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:01.722 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.706+0000 7f27e8a88640 10 monclient(hunting): picked mon.noname-a con 0x7f27e405dfb0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:01.722 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.706+0000 7f27e8a88640 10 monclient(hunting): picked mon.noname-b con 0x7f27e41624d0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:01.722 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.706+0000 7f27e8a88640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27e415e030 con 0x7f27e405dfb0 2026-02-12T03:58:01.722 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.706+0000 7f27e8a88640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27e415f210 con 0x7f27e41624d0 2026-02-12T03:58:01.722 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.706+0000 7f27e8a88640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27e41603f0 con 0x7f27e405daf0 2026-02-12T03:58:01.722 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.706+0000 7f27e8a88640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:01.722 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.706+0000 7f27e8a88640 10 monclient(hunting): authenticate will time out at 1082.359498s 2026-02-12T03:58:01.722 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.706+0000 7f27e2d76640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f27e41624d0 0x7f27e415c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.154:52162/0 (socket says 10.20.193.154:52162) 2026-02-12T03:58:01.722 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.706+0000 7f27e2d76640 1 -- 10.20.193.154:0/4042255072 learned_addr learned my addr 10.20.193.154:0/4042255072 (peer_addr_for_me v1:10.20.193.154:0/0) 2026-02-12T03:58:01.723 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.706+0000 7f27caffd640 10 client.?.objecter ms_handle_connect 0x7f27e41624d0 2026-02-12T03:58:01.723 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.706+0000 7f27caffd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:01.723 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.707+0000 7f27caffd640 10 client.?.objecter ms_handle_connect 0x7f27e405daf0 2026-02-12T03:58:01.723 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.707+0000 7f27caffd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:01.723 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.707+0000 7f27caffd640 10 client.?.objecter ms_handle_connect 0x7f27e405dfb0 2026-02-12T03:58:01.723 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.707+0000 7f27caffd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:01.723 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.708+0000 7f27caffd640 1 -- 10.20.193.154:0/4042255072 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2915028114 0 0) 0x7f27e415f210 con 0x7f27e41624d0 2026-02-12T03:58:01.723 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.708+0000 7f27caffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:01.723 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.708+0000 7f27caffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:01.723 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.708+0000 7f27caffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:01.723 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.708+0000 7f27caffd640 10 monclient(hunting): my global_id is 4138 2026-02-12T03:58:01.724 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.708+0000 7f27caffd640 1 -- 10.20.193.154:0/4042255072 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27b0003610 con 0x7f27e41624d0 2026-02-12T03:58:01.724 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.708+0000 7f27caffd640 1 -- 10.20.193.154:0/4042255072 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4008021964 0 0) 0x7f27e41603f0 con 0x7f27e405daf0 2026-02-12T03:58:01.724 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.708+0000 7f27caffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:01.724 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.708+0000 7f27caffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:01.724 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.708+0000 7f27caffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:01.724 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.708+0000 7f27caffd640 10 monclient(hunting): my global_id is 4139 2026-02-12T03:58:01.724 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.708+0000 7f27caffd640 1 -- 10.20.193.154:0/4042255072 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27e415f210 con 0x7f27e405daf0 2026-02-12T03:58:01.724 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.708+0000 7f27caffd640 1 -- 10.20.193.154:0/4042255072 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 842181572 0 0) 0x7f27e415e030 con 0x7f27e405dfb0 2026-02-12T03:58:01.724 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.708+0000 7f27caffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:01.724 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.708+0000 7f27caffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:01.725 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.708+0000 7f27caffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:01.725 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.708+0000 7f27caffd640 10 monclient(hunting): my global_id is 4143 2026-02-12T03:58:01.725 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.708+0000 7f27caffd640 1 -- 10.20.193.154:0/4042255072 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27e41603f0 con 0x7f27e405dfb0 2026-02-12T03:58:01.728 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.710+0000 7f27caffd640 1 -- 10.20.193.154:0/4042255072 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2565268774 0 0) 0x7f27b0003610 con 0x7f27e41624d0 2026-02-12T03:58:01.728 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.710+0000 7f27caffd640 1 -- 10.20.193.154:0/4042255072 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f27e415e030 con 0x7f27e41624d0 2026-02-12T03:58:01.728 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.710+0000 7f27caffd640 1 -- 10.20.193.154:0/4042255072 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f27d4003470 con 0x7f27e41624d0 2026-02-12T03:58:01.728 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.710+0000 7f27caffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:01.728 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.710+0000 7f27caffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:01.728 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.710+0000 7f27caffd640 10 monclient(hunting): dump: 2026-02-12T03:58:01.729 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:01.729 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:01.729 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.729 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.729 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:01.729 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:01.729 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:01.729 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:01.729 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:01.729 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:01.730 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.710+0000 7f27caffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:01.730 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.710+0000 7f27caffd640 1 -- 10.20.193.154:0/4042255072 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 360132857 0 0) 0x7f27e41603f0 con 0x7f27e405dfb0 2026-02-12T03:58:01.730 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.710+0000 7f27caffd640 1 -- 10.20.193.154:0/4042255072 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f27b0003610 con 0x7f27e405dfb0 2026-02-12T03:58:01.730 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.710+0000 7f27caffd640 1 -- 10.20.193.154:0/4042255072 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f27cc0031e0 con 0x7f27e405dfb0 2026-02-12T03:58:01.730 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.710+0000 7f27caffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:01.730 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.710+0000 7f27caffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:01.730 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.710+0000 7f27caffd640 10 monclient(hunting): dump: 2026-02-12T03:58:01.730 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:01.730 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:01.730 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.730 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.731 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:01.731 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:01.731 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:01.731 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:01.731 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:01.731 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:01.731 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.711+0000 7f27caffd640 1 -- 10.20.193.154:0/4042255072 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2509201666 0 0) 0x7f27e415f210 con 0x7f27e405daf0 2026-02-12T03:58:01.731 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.711+0000 7f27caffd640 1 -- 10.20.193.154:0/4042255072 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f27e41603f0 con 0x7f27e405daf0 2026-02-12T03:58:01.731 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.711+0000 7f27caffd640 1 -- 10.20.193.154:0/4042255072 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f27d8003060 con 0x7f27e405daf0 2026-02-12T03:58:01.731 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.711+0000 7f27caffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:01.731 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.711+0000 7f27caffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:01.732 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.711+0000 7f27caffd640 10 monclient(hunting): dump: 2026-02-12T03:58:01.732 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:01.732 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:01.732 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.732 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.732 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:01.732 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:01.732 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:01.732 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:01.732 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:01.732 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:01.733 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.712+0000 7f27caffd640 1 -- 10.20.193.154:0/4042255072 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2935802840 0 0) 0x7f27b0003610 con 0x7f27e405dfb0 2026-02-12T03:58:01.733 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.712+0000 7f27caffd640 1 -- 10.20.193.154:0/4042255072 >> v1:10.20.193.111:6789/0 conn(0x7f27e405daf0 legacy=0x7f27e416eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:01.733 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.712+0000 7f27caffd640 1 -- 10.20.193.154:0/4042255072 >> v1:10.20.193.98:6789/0 conn(0x7f27e41624d0 legacy=0x7f27e415c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:01.733 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.712+0000 7f27caffd640 10 monclient: _finish_hunting 0 2026-02-12T03:58:01.733 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.712+0000 7f27caffd640 1 monclient: found mon.a 2026-02-12T03:58:01.733 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.712+0000 7f27caffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:01.733 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.712+0000 7f27caffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:01.733 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.712+0000 7f27caffd640 1 -- 10.20.193.154:0/4042255072 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e41615d0 con 0x7f27e405dfb0 2026-02-12T03:58:01.733 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.712+0000 7f27caffd640 10 monclient: _finish_auth 0 2026-02-12T03:58:01.733 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.712+0000 7f27caffd640 10 monclient: _check_auth_tickets 2026-02-12T03:58:01.734 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.712+0000 7f27caffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:01.734 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.712+0000 7f27e8a88640 5 monclient: authenticate success, global_id 4143 2026-02-12T03:58:01.734 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.712+0000 7f27e8a88640 10 monclient: _renew_subs 2026-02-12T03:58:01.734 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.712+0000 7f27e8a88640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:01.734 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.712+0000 7f27e8a88640 1 -- 10.20.193.154:0/4042255072 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f27e4161860 con 0x7f27e405dfb0 2026-02-12T03:58:01.734 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.712+0000 7f27e8a88640 10 client.4143.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:01.734 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.712+0000 7f27e8a88640 10 monclient: _renew_subs 2026-02-12T03:58:01.734 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.712+0000 7f27e8a88640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:01.734 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.712+0000 7f27e8a88640 1 -- 10.20.193.154:0/4042255072 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f27e4161e50 con 0x7f27e405dfb0 2026-02-12T03:58:01.734 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.712+0000 7f27e8a88640 1 librados: init done 2026-02-12T03:58:01.734 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.712+0000 7f27e8a88640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:01.734 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.712+0000 7f27e8a88640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:01.735 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.712+0000 7f27e8a88640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:01.735 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.712+0000 7f27e8a88640 1 -- 10.20.193.154:0/4042255072 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27e41622b0 con 0x7f27e405dfb0 2026-02-12T03:58:01.745 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.742+0000 7f27caffd640 1 -- 10.20.193.154:0/4042255072 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f27cc002f40 con 0x7f27e405dfb0 2026-02-12T03:58:01.745 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.742+0000 7f27caffd640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:01.745 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.742+0000 7f27caffd640 1 -- 10.20.193.154:0/4042255072 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f27cc004a30 con 0x7f27e405dfb0 2026-02-12T03:58:01.745 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.742+0000 7f27caffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:01.745 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.742+0000 7f27caffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:01.745 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.742+0000 7f27caffd640 10 monclient: dump: 2026-02-12T03:58:01.745 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:01.746 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:01.746 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.746 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.746 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:01.746 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:01.746 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:01.746 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:01.746 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:01.746 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:01.746 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.742+0000 7f27e0d72640 4 set_mon_vals no callback set 2026-02-12T03:58:01.747 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.743+0000 7f27caffd640 1 -- 10.20.193.154:0/4042255072 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f27cc004fe0 con 0x7f27e405dfb0 2026-02-12T03:58:01.747 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.743+0000 7f27caffd640 1 -- 10.20.193.154:0/4042255072 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(5..5 src has 1..5) ==== 1065+0+0 (unknown 3077832441 0 0) 0x7f27cc006800 con 0x7f27e405dfb0 2026-02-12T03:58:01.747 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.743+0000 7f27caffd640 10 client.4143.objecter ms_dispatch2 0x7f27e4000b90 osd_map(5..5 src has 1..5) 2026-02-12T03:58:01.748 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.743+0000 7f27caffd640 3 client.4143.objecter handle_osd_map got epochs [5,5] > 0 2026-02-12T03:58:01.748 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.743+0000 7f27caffd640 3 client.4143.objecter handle_osd_map decoding full epoch 5 2026-02-12T03:58:01.748 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.744+0000 7f27caffd640 20 client.4143.objecter dump_active .. 0 homeless 2026-02-12T03:58:01.748 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.744+0000 7f27caffd640 1 -- 10.20.193.154:0/4042255072 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77303 (unknown 1092875540 0 3794932319) 0x7f27cc006b80 con 0x7f27e405dfb0 2026-02-12T03:58:01.748 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.744+0000 7f27caffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:01.748 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.744+0000 7f27caffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:01.779 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.777+0000 7f27e8a88640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "e164e3ae-cf6a-45ff-b126-3ac739c5b1be", "id": 3}] 2026-02-12T03:58:01.780 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.777+0000 7f27e8a88640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "e164e3ae-cf6a-45ff-b126-3ac739c5b1be", "id": 3}] 2026-02-12T03:58:01.780 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.777+0000 7f27e8a88640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:01.780 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.777+0000 7f27e8a88640 1 -- 10.20.193.154:0/4042255072 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "osd new", "uuid": "e164e3ae-cf6a-45ff-b126-3ac739c5b1be", "id": 3} v 0) -- 0x7f27e4185a70 con 0x7f27e405dfb0 2026-02-12T03:58:01.796 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.793+0000 7f27caffd640 1 -- 10.20.193.154:0/4042255072 <== mon.0 v1:10.20.193.91:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e164e3ae-cf6a-45ff-b126-3ac739c5b1be", "id": 3}]=0 v6) ==== 112+0+2 (unknown 2262733342 0 525046306) 0x7f27cc006440 con 0x7f27e405dfb0 2026-02-12T03:58:01.796 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.793+0000 7f27caffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "e164e3ae-cf6a-45ff-b126-3ac739c5b1be", "id": 3}] 2026-02-12T03:58:01.796 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.793+0000 7f27caffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:01.797 INFO:teuthology.orchestra.run.trial154.stdout:3 2026-02-12T03:58:01.798 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.794+0000 7f27e8a88640 10 librados: watch_flush enter 2026-02-12T03:58:01.798 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.794+0000 7f27e8a88640 10 librados: watch_flush exit 2026-02-12T03:58:01.798 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.794+0000 7f27e8a88640 20 client.4143.objecter shutdown clearing up homeless session... 2026-02-12T03:58:01.799 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.794+0000 7f27e8a88640 10 client.4143.objecter successfully canceled tick 2026-02-12T03:58:01.799 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.794+0000 7f27e8a88640 10 monclient: shutdown 2026-02-12T03:58:01.799 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.794+0000 7f27e8a88640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:01.799 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.794+0000 7f27e8a88640 1 -- 10.20.193.154:0/4042255072 >> v1:10.20.193.91:6789/0 conn(0x7f27e405dfb0 legacy=0x7f27e415b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:01.799 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.794+0000 7f27e8a88640 1 -- 10.20.193.154:0/4042255072 shutdown_connections 2026-02-12T03:58:01.799 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.794+0000 7f27e8a88640 1 -- 10.20.193.154:0/4042255072 >> 10.20.193.154:0/4042255072 conn(0x7f27e4058ca0 msgr2=0x7f27e4059070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:01.799 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.794+0000 7f27e8a88640 1 -- 10.20.193.154:0/4042255072 shutdown_connections 2026-02-12T03:58:01.799 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.794+0000 7f27e8a88640 1 -- 10.20.193.154:0/4042255072 wait complete. 2026-02-12T03:58:01.799 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.794+0000 7f27e8a88640 1 librados: shutdown 2026-02-12T03:58:01.804 DEBUG:teuthology.orchestra.run.trial154:> sudo ceph --cluster ceph osd new 5583cc8c-83d4-42b4-a997-c056f3b145a0 4 2026-02-12T03:58:01.868 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.864+0000 7ff07ff33640 10 monclient: get_monmap_and_config 2026-02-12T03:58:01.868 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.864+0000 7ff07ff33640 10 monclient: build_initial_monmap 2026-02-12T03:58:01.868 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.864+0000 7ff07ff33640 10 monclient: monmap: 2026-02-12T03:58:01.869 INFO:teuthology.orchestra.run.trial154.stderr:epoch 0 2026-02-12T03:58:01.869 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:01.869 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:58:01.865955+0000 2026-02-12T03:58:01.869 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:58:01.865955+0000 2026-02-12T03:58:01.869 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:01.869 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:01.869 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:01.869 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:01.869 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:01.869 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:01.869 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.864+0000 7ff07ff33640 1 Processor -- start 2026-02-12T03:58:01.869 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.865+0000 7ff07ff33640 1 -- start start 2026-02-12T03:58:01.870 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.865+0000 7ff07ff33640 10 monclient: init 2026-02-12T03:58:01.870 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.865+0000 7ff07ff33640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:01.870 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.865+0000 7ff07ff33640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T03:58:01.870 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.865+0000 7ff07ff33640 10 monclient(hunting): picked mon.noname-b con 0x7ff07811cae0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:01.870 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.865+0000 7ff07ff33640 10 monclient(hunting): picked mon.noname-c con 0x7ff07811ceb0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:01.870 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.865+0000 7ff07ff33640 10 monclient(hunting): picked mon.noname-a con 0x7ff0781649c0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:01.870 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.865+0000 7ff07ff33640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0781864c0 con 0x7ff0781649c0 2026-02-12T03:58:01.870 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.865+0000 7ff07ff33640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0781876a0 con 0x7ff07811cae0 2026-02-12T03:58:01.870 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.865+0000 7ff07ff33640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff078188880 con 0x7ff07811ceb0 2026-02-12T03:58:01.870 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.865+0000 7ff07ff33640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:01.870 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.865+0000 7ff07ff33640 10 monclient(hunting): authenticate will time out at 1082.518244s 2026-02-12T03:58:01.871 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.865+0000 7ff07d4a7640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7ff07811ceb0 0x7ff07811b8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.154:46362/0 (socket says 10.20.193.154:46362) 2026-02-12T03:58:01.871 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.865+0000 7ff07d4a7640 1 -- 10.20.193.154:0/675546931 learned_addr learned my addr 10.20.193.154:0/675546931 (peer_addr_for_me v1:10.20.193.154:0/0) 2026-02-12T03:58:01.871 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.865+0000 7ff07dca8640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7ff07811cae0 0x7ff07811b1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.154:52174/0 (socket says 10.20.193.154:52174) 2026-02-12T03:58:01.880 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.866+0000 7ff07cca6640 1 -- 10.20.193.154:0/675546931 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1024529620 0 0) 0x7ff0781876a0 con 0x7ff07811cae0 2026-02-12T03:58:01.880 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.866+0000 7ff07cca6640 10 monclient(hunting): _negotiate 2026-02-12T03:58:01.880 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.866+0000 7ff07cca6640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:01.880 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.866+0000 7ff07cca6640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:01.880 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.866+0000 7ff07cca6640 10 monclient(hunting): my global_id is 4141 2026-02-12T03:58:01.880 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.866+0000 7ff07cca6640 1 -- 10.20.193.154:0/675546931 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff060003610 con 0x7ff07811cae0 2026-02-12T03:58:01.881 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.867+0000 7ff07cca6640 1 -- 10.20.193.154:0/675546931 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1754714647 0 0) 0x7ff078188880 con 0x7ff07811ceb0 2026-02-12T03:58:01.881 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.867+0000 7ff07cca6640 10 monclient(hunting): _negotiate 2026-02-12T03:58:01.881 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.867+0000 7ff07cca6640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:01.881 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.867+0000 7ff07cca6640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:01.881 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.867+0000 7ff07cca6640 10 monclient(hunting): my global_id is 4142 2026-02-12T03:58:01.881 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.867+0000 7ff07cca6640 1 -- 10.20.193.154:0/675546931 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0781876a0 con 0x7ff07811ceb0 2026-02-12T03:58:01.881 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.867+0000 7ff07cca6640 1 -- 10.20.193.154:0/675546931 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2092559825 0 0) 0x7ff0781864c0 con 0x7ff0781649c0 2026-02-12T03:58:01.881 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.867+0000 7ff07cca6640 10 monclient(hunting): _negotiate 2026-02-12T03:58:01.881 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.867+0000 7ff07cca6640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:01.881 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.867+0000 7ff07cca6640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:01.882 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.867+0000 7ff07cca6640 10 monclient(hunting): my global_id is 4146 2026-02-12T03:58:01.882 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.867+0000 7ff07cca6640 1 -- 10.20.193.154:0/675546931 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff078188880 con 0x7ff0781649c0 2026-02-12T03:58:01.882 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.868+0000 7ff07cca6640 1 -- 10.20.193.154:0/675546931 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 329366318 0 0) 0x7ff060003610 con 0x7ff07811cae0 2026-02-12T03:58:01.882 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.868+0000 7ff07cca6640 1 -- 10.20.193.154:0/675546931 >> v1:10.20.193.111:6789/0 conn(0x7ff07811ceb0 legacy=0x7ff07811b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:01.882 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.868+0000 7ff07cca6640 1 -- 10.20.193.154:0/675546931 >> v1:10.20.193.91:6789/0 conn(0x7ff0781649c0 legacy=0x7ff078184da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:01.882 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.868+0000 7ff07cca6640 10 monclient: _finish_hunting 0 2026-02-12T03:58:01.882 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.868+0000 7ff07cca6640 1 monclient: found mon.noname-b 2026-02-12T03:58:01.882 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.868+0000 7ff07cca6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:01.882 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.868+0000 7ff07cca6640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T03:58:01.882 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.868+0000 7ff07cca6640 1 -- 10.20.193.154:0/675546931 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff078189b20 con 0x7ff07811cae0 2026-02-12T03:58:01.882 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.868+0000 7ff07cca6640 10 monclient: _finish_auth 0 2026-02-12T03:58:01.883 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.868+0000 7ff07cca6640 10 monclient: _check_auth_tickets 2026-02-12T03:58:01.883 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.868+0000 7ff07cca6640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:01.883 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.868+0000 7ff07cca6640 1 -- 10.20.193.154:0/675546931 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7ff068002df0 con 0x7ff07811cae0 2026-02-12T03:58:01.883 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.868+0000 7ff07cca6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:01.883 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.868+0000 7ff07cca6640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:01.883 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.868+0000 7ff07cca6640 10 monclient: dump: 2026-02-12T03:58:01.883 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:01.883 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:01.883 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.883 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.884 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:01.884 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:01.884 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:01.884 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:01.884 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:01.884 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:01.884 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.868+0000 7ff07ff33640 5 monclient: authenticate success, global_id 4141 2026-02-12T03:58:01.884 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.868+0000 7ff07ff33640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:01.884 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.869+0000 7ff07cca6640 1 -- 10.20.193.154:0/675546931 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff068003030 con 0x7ff07811cae0 2026-02-12T03:58:01.884 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.869+0000 7ff07cca6640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:01.885 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.869+0000 7ff07cca6640 1 -- 10.20.193.154:0/675546931 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7ff068003470 con 0x7ff07811cae0 2026-02-12T03:58:01.885 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.869+0000 7ff07cca6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:01.885 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.869+0000 7ff07cca6640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:01.885 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.869+0000 7ff07cca6640 10 monclient: dump: 2026-02-12T03:58:01.886 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:01.886 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:01.886 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.886 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.886 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:01.886 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:01.886 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:01.886 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:01.886 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:01.886 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:01.886 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.869+0000 7ff07ff33640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:01.886 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.869+0000 7ff07ff33640 4 set_mon_vals no callback set 2026-02-12T03:58:01.887 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.869+0000 7ff07ff33640 10 monclient: shutdown 2026-02-12T03:58:01.887 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.869+0000 7ff07ff33640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:01.887 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.869+0000 7ff07ff33640 1 -- 10.20.193.154:0/675546931 >> v1:10.20.193.98:6789/0 conn(0x7ff07811cae0 legacy=0x7ff07811b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:01.887 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.869+0000 7ff07ff33640 1 -- 10.20.193.154:0/675546931 shutdown_connections 2026-02-12T03:58:01.887 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.869+0000 7ff07ff33640 1 -- 10.20.193.154:0/675546931 >> 10.20.193.154:0/675546931 conn(0x7ff078058b60 msgr2=0x7ff078058f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:01.887 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.869+0000 7ff07ff33640 1 -- 10.20.193.154:0/675546931 shutdown_connections 2026-02-12T03:58:01.887 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.869+0000 7ff07ff33640 1 -- 10.20.193.154:0/675546931 wait complete. 2026-02-12T03:58:01.887 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.870+0000 7ff07ff33640 10 monclient: build_initial_monmap 2026-02-12T03:58:01.887 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.870+0000 7ff07ff33640 10 monclient: monmap: 2026-02-12T03:58:01.887 INFO:teuthology.orchestra.run.trial154.stderr:epoch 0 2026-02-12T03:58:01.887 INFO:teuthology.orchestra.run.trial154.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:01.887 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 0.000000 2026-02-12T03:58:01.888 INFO:teuthology.orchestra.run.trial154.stderr:created 0.000000 2026-02-12T03:58:01.888 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:01.888 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 1 2026-02-12T03:58:01.888 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:01.888 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:01.888 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:01.888 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:01.888 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.870+0000 7ff07ff33640 1 librados: starting msgr at 2026-02-12T03:58:01.888 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.870+0000 7ff07ff33640 1 librados: starting objecter 2026-02-12T03:58:01.888 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.870+0000 7ff07ff33640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:01.888 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.870+0000 7ff07ff33640 1 Processor -- start 2026-02-12T03:58:01.888 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.870+0000 7ff07ff33640 1 -- start start 2026-02-12T03:58:01.889 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.870+0000 7ff07ff33640 1 librados: setting wanted keys 2026-02-12T03:58:01.889 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.870+0000 7ff07ff33640 1 librados: calling monclient init 2026-02-12T03:58:01.889 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.870+0000 7ff07ff33640 10 monclient: init 2026-02-12T03:58:01.889 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.870+0000 7ff07ff33640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:01.889 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.870+0000 7ff07ff33640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T03:58:01.889 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.870+0000 7ff07ff33640 10 monclient(hunting): picked mon.noname-a con 0x7ff07811cae0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:01.889 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.870+0000 7ff07ff33640 10 monclient(hunting): picked mon.noname-c con 0x7ff07811ceb0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:01.889 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.870+0000 7ff07ff33640 10 monclient(hunting): picked mon.noname-b con 0x7ff0781649c0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:01.889 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.870+0000 7ff07ff33640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0781022f0 con 0x7ff07811cae0 2026-02-12T03:58:01.889 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.870+0000 7ff07ff33640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0781091d0 con 0x7ff0781649c0 2026-02-12T03:58:01.889 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.870+0000 7ff07ff33640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff07810a3b0 con 0x7ff07811ceb0 2026-02-12T03:58:01.889 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.870+0000 7ff07ff33640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:01.890 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.870+0000 7ff07ff33640 10 monclient(hunting): authenticate will time out at 1082.523623s 2026-02-12T03:58:01.890 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.870+0000 7ff07e4a9640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7ff0781649c0 0x7ff0781630b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.154:52178/0 (socket says 10.20.193.154:52178) 2026-02-12T03:58:01.890 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.870+0000 7ff07dca8640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7ff07811cae0 0x7ff0781017e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.154:46374/0 (socket says 10.20.193.154:46374) 2026-02-12T03:58:01.890 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.870+0000 7ff07e4a9640 1 -- 10.20.193.154:0/1504345719 learned_addr learned my addr 10.20.193.154:0/1504345719 (peer_addr_for_me v1:10.20.193.154:0/0) 2026-02-12T03:58:01.890 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.871+0000 7ff0667fc640 10 client.?.objecter ms_handle_connect 0x7ff0781649c0 2026-02-12T03:58:01.890 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.871+0000 7ff0667fc640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:01.890 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.871+0000 7ff0667fc640 10 client.?.objecter ms_handle_connect 0x7ff07811cae0 2026-02-12T03:58:01.890 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.871+0000 7ff0667fc640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:01.890 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.871+0000 7ff0667fc640 10 client.?.objecter ms_handle_connect 0x7ff07811ceb0 2026-02-12T03:58:01.890 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.871+0000 7ff0667fc640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:01.890 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.871+0000 7ff0667fc640 1 -- 10.20.193.154:0/1504345719 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 828155596 0 0) 0x7ff0781091d0 con 0x7ff0781649c0 2026-02-12T03:58:01.890 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.871+0000 7ff0667fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:01.891 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.871+0000 7ff0667fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:01.891 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.871+0000 7ff0667fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:01.891 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.871+0000 7ff0667fc640 10 monclient(hunting): my global_id is 4144 2026-02-12T03:58:01.891 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.871+0000 7ff0667fc640 1 -- 10.20.193.154:0/1504345719 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff048003610 con 0x7ff0781649c0 2026-02-12T03:58:01.891 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.872+0000 7ff0667fc640 1 -- 10.20.193.154:0/1504345719 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 450341841 0 0) 0x7ff0781022f0 con 0x7ff07811cae0 2026-02-12T03:58:01.891 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.872+0000 7ff0667fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:01.891 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.872+0000 7ff0667fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:01.891 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.872+0000 7ff0667fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:01.891 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.872+0000 7ff0667fc640 10 monclient(hunting): my global_id is 4149 2026-02-12T03:58:01.891 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.872+0000 7ff0667fc640 1 -- 10.20.193.154:0/1504345719 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0781091d0 con 0x7ff07811cae0 2026-02-12T03:58:01.891 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.872+0000 7ff0667fc640 1 -- 10.20.193.154:0/1504345719 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 324768597 0 0) 0x7ff07810a3b0 con 0x7ff07811ceb0 2026-02-12T03:58:01.891 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.872+0000 7ff0667fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:01.892 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.872+0000 7ff0667fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:01.892 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.872+0000 7ff0667fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:01.892 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.872+0000 7ff0667fc640 10 monclient(hunting): my global_id is 4145 2026-02-12T03:58:01.892 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.872+0000 7ff0667fc640 1 -- 10.20.193.154:0/1504345719 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0781022f0 con 0x7ff07811ceb0 2026-02-12T03:58:01.892 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.874+0000 7ff0667fc640 1 -- 10.20.193.154:0/1504345719 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2358016937 0 0) 0x7ff048003610 con 0x7ff0781649c0 2026-02-12T03:58:01.892 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.874+0000 7ff0667fc640 1 -- 10.20.193.154:0/1504345719 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff07810a3b0 con 0x7ff0781649c0 2026-02-12T03:58:01.892 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.874+0000 7ff0667fc640 1 -- 10.20.193.154:0/1504345719 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7ff074003470 con 0x7ff0781649c0 2026-02-12T03:58:01.892 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.874+0000 7ff0667fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:01.892 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.874+0000 7ff0667fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:01.893 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.874+0000 7ff0667fc640 10 monclient(hunting): dump: 2026-02-12T03:58:01.893 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:01.893 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:01.893 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.893 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.893 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:01.893 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:01.893 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:01.893 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:01.893 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:01.893 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:01.894 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.874+0000 7ff0667fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:01.894 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.874+0000 7ff0667fc640 1 -- 10.20.193.154:0/1504345719 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 397268332 0 0) 0x7ff0781022f0 con 0x7ff07811ceb0 2026-02-12T03:58:01.894 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.874+0000 7ff0667fc640 1 -- 10.20.193.154:0/1504345719 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff048003610 con 0x7ff07811ceb0 2026-02-12T03:58:01.894 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.874+0000 7ff0667fc640 1 -- 10.20.193.154:0/1504345719 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 74717104 0 0) 0x7ff0781091d0 con 0x7ff07811cae0 2026-02-12T03:58:01.894 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.874+0000 7ff0667fc640 1 -- 10.20.193.154:0/1504345719 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff0781022f0 con 0x7ff07811cae0 2026-02-12T03:58:01.894 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.874+0000 7ff0667fc640 1 -- 10.20.193.154:0/1504345719 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7ff068003380 con 0x7ff07811cae0 2026-02-12T03:58:01.894 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.874+0000 7ff0667fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:01.894 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.874+0000 7ff0667fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:01.894 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.874+0000 7ff0667fc640 10 monclient(hunting): dump: 2026-02-12T03:58:01.894 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:01.894 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:01.894 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.895 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.895 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:01.895 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:01.895 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:01.895 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:01.895 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:01.895 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:01.895 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.874+0000 7ff0667fc640 1 -- 10.20.193.154:0/1504345719 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7ff06c0031b0 con 0x7ff07811ceb0 2026-02-12T03:58:01.895 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.874+0000 7ff0667fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:01.895 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.874+0000 7ff0667fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:01.895 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.874+0000 7ff0667fc640 10 monclient(hunting): dump: 2026-02-12T03:58:01.895 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:01.896 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:01.896 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.896 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.896 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:01.896 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:01.896 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:01.896 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:01.896 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:01.896 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:01.896 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.876+0000 7ff0667fc640 1 -- 10.20.193.154:0/1504345719 <== mon.1 v1:10.20.193.98:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2132043191 0 0) 0x7ff07810a3b0 con 0x7ff0781649c0 2026-02-12T03:58:01.896 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.876+0000 7ff0667fc640 1 -- 10.20.193.154:0/1504345719 >> v1:10.20.193.111:6789/0 conn(0x7ff07811ceb0 legacy=0x7ff078161990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:01.896 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.876+0000 7ff0667fc640 1 -- 10.20.193.154:0/1504345719 >> v1:10.20.193.91:6789/0 conn(0x7ff07811cae0 legacy=0x7ff0781017e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:01.897 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.876+0000 7ff0667fc640 10 monclient: _finish_hunting 0 2026-02-12T03:58:01.897 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.876+0000 7ff0667fc640 1 monclient: found mon.b 2026-02-12T03:58:01.897 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.876+0000 7ff0667fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:01.897 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.876+0000 7ff0667fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:01.897 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.876+0000 7ff0667fc640 1 -- 10.20.193.154:0/1504345719 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff07810b590 con 0x7ff0781649c0 2026-02-12T03:58:01.897 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.876+0000 7ff0667fc640 10 monclient: _finish_auth 0 2026-02-12T03:58:01.897 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.876+0000 7ff0667fc640 10 monclient: _check_auth_tickets 2026-02-12T03:58:01.897 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.876+0000 7ff0667fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:01.897 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.876+0000 7ff07ff33640 5 monclient: authenticate success, global_id 4144 2026-02-12T03:58:01.897 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.876+0000 7ff07ff33640 10 monclient: _renew_subs 2026-02-12T03:58:01.897 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.876+0000 7ff07ff33640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:01.897 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.876+0000 7ff07ff33640 1 -- 10.20.193.154:0/1504345719 --> v1:10.20.193.98:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff0781081c0 con 0x7ff0781649c0 2026-02-12T03:58:01.897 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.876+0000 7ff07ff33640 10 client.4144.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:01.898 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.876+0000 7ff07ff33640 10 monclient: _renew_subs 2026-02-12T03:58:01.898 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.876+0000 7ff07ff33640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:01.898 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.876+0000 7ff07ff33640 1 -- 10.20.193.154:0/1504345719 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff078108780 con 0x7ff0781649c0 2026-02-12T03:58:01.898 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.876+0000 7ff07ff33640 1 librados: init done 2026-02-12T03:58:01.898 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.876+0000 7ff07ff33640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:01.898 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.876+0000 7ff07ff33640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:01.898 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.876+0000 7ff07ff33640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:01.898 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.876+0000 7ff07ff33640 1 -- 10.20.193.154:0/1504345719 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff078186b90 con 0x7ff0781649c0 2026-02-12T03:58:01.900 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.886+0000 7ff0667fc640 1 -- 10.20.193.154:0/1504345719 <== mon.1 v1:10.20.193.98:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff0740037e0 con 0x7ff0781649c0 2026-02-12T03:58:01.900 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.886+0000 7ff0667fc640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:01.900 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.886+0000 7ff0667fc640 1 -- 10.20.193.154:0/1504345719 <== mon.1 v1:10.20.193.98:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7ff074003ed0 con 0x7ff0781649c0 2026-02-12T03:58:01.900 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.886+0000 7ff0667fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:01.900 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.886+0000 7ff0667fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:01.900 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.886+0000 7ff0667fc640 10 monclient: dump: 2026-02-12T03:58:01.900 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:01.900 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:01.900 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.900 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:01.900 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:01.900 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:01.900 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:01.901 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:01.901 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:01.901 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:01.901 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.886+0000 7ff067fff640 4 set_mon_vals no callback set 2026-02-12T03:58:01.901 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.888+0000 7ff0667fc640 1 -- 10.20.193.154:0/1504345719 <== mon.1 v1:10.20.193.98:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7ff0740044c0 con 0x7ff0781649c0 2026-02-12T03:58:01.901 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.888+0000 7ff0667fc640 1 -- 10.20.193.154:0/1504345719 <== mon.1 v1:10.20.193.98:6789/0 8 ==== osd_map(6..6 src has 1..6) ==== 1180+0+0 (unknown 654711409 0 0) 0x7ff074006ef0 con 0x7ff0781649c0 2026-02-12T03:58:01.901 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.888+0000 7ff0667fc640 10 client.4144.objecter ms_dispatch2 0x7ff078000b90 osd_map(6..6 src has 1..6) 2026-02-12T03:58:01.901 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.888+0000 7ff0667fc640 3 client.4144.objecter handle_osd_map got epochs [6,6] > 0 2026-02-12T03:58:01.901 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.888+0000 7ff0667fc640 3 client.4144.objecter handle_osd_map decoding full epoch 6 2026-02-12T03:58:01.901 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.888+0000 7ff0667fc640 20 client.4144.objecter dump_active .. 0 homeless 2026-02-12T03:58:01.958 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.956+0000 7ff0667fc640 1 -- 10.20.193.154:0/1504345719 <== mon.1 v1:10.20.193.98:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77303 (unknown 1092875540 0 3794932319) 0x7ff0740047e0 con 0x7ff0781649c0 2026-02-12T03:58:01.958 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.956+0000 7ff0667fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:01.958 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.956+0000 7ff0667fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:01.991 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.989+0000 7ff07ff33640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "5583cc8c-83d4-42b4-a997-c056f3b145a0", "id": 4}] 2026-02-12T03:58:01.991 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.989+0000 7ff07ff33640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "5583cc8c-83d4-42b4-a997-c056f3b145a0", "id": 4}] 2026-02-12T03:58:01.991 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.989+0000 7ff07ff33640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:01.991 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:01.989+0000 7ff07ff33640 1 -- 10.20.193.154:0/1504345719 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "osd new", "uuid": "5583cc8c-83d4-42b4-a997-c056f3b145a0", "id": 4} v 0) -- 0x7ff078108a70 con 0x7ff0781649c0 2026-02-12T03:58:02.019 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.017+0000 7ff0667fc640 1 -- 10.20.193.154:0/1504345719 <== mon.1 v1:10.20.193.98:6789/0 10 ==== mgrmap(e 2) ==== 51721+0+0 (unknown 3160786211 0 0) 0x7ff074006aa0 con 0x7ff0781649c0 2026-02-12T03:58:02.198 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.196+0000 7ff0667fc640 1 -- 10.20.193.154:0/1504345719 <== mon.1 v1:10.20.193.98:6789/0 11 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5583cc8c-83d4-42b4-a997-c056f3b145a0", "id": 4}]=0 v7) ==== 112+0+2 (unknown 1513666629 0 1697012583) 0x7ff074019110 con 0x7ff0781649c0 2026-02-12T03:58:02.199 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.196+0000 7ff0667fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "5583cc8c-83d4-42b4-a997-c056f3b145a0", "id": 4}] 2026-02-12T03:58:02.199 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.196+0000 7ff0667fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:02.199 INFO:teuthology.orchestra.run.trial154.stdout:4 2026-02-12T03:58:02.200 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.196+0000 7ff07ff33640 10 librados: watch_flush enter 2026-02-12T03:58:02.201 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.196+0000 7ff07ff33640 10 librados: watch_flush exit 2026-02-12T03:58:02.201 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.196+0000 7ff07ff33640 20 client.4144.objecter shutdown clearing up homeless session... 2026-02-12T03:58:02.201 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.196+0000 7ff07ff33640 10 client.4144.objecter successfully canceled tick 2026-02-12T03:58:02.201 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.196+0000 7ff07ff33640 10 monclient: shutdown 2026-02-12T03:58:02.201 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.196+0000 7ff07ff33640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:02.201 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.196+0000 7ff07ff33640 1 -- 10.20.193.154:0/1504345719 >> v1:10.20.193.98:6789/0 conn(0x7ff0781649c0 legacy=0x7ff0781630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:02.201 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.196+0000 7ff07ff33640 1 -- 10.20.193.154:0/1504345719 shutdown_connections 2026-02-12T03:58:02.201 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.196+0000 7ff07ff33640 1 -- 10.20.193.154:0/1504345719 >> 10.20.193.154:0/1504345719 conn(0x7ff078058b60 msgr2=0x7ff07805b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:02.201 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.196+0000 7ff07ff33640 1 -- 10.20.193.154:0/1504345719 shutdown_connections 2026-02-12T03:58:02.201 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.196+0000 7ff07ff33640 1 -- 10.20.193.154:0/1504345719 wait complete. 2026-02-12T03:58:02.201 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.196+0000 7ff07ff33640 1 librados: shutdown 2026-02-12T03:58:02.209 DEBUG:teuthology.orchestra.run.trial154:> sudo ceph --cluster ceph osd new d7bb6fa1-b042-4dce-9644-00e817a5bc8c 5 2026-02-12T03:58:02.273 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.270+0000 7f0d96b33640 10 monclient: get_monmap_and_config 2026-02-12T03:58:02.273 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.270+0000 7f0d96b33640 10 monclient: build_initial_monmap 2026-02-12T03:58:02.273 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.270+0000 7f0d96b33640 10 monclient: monmap: 2026-02-12T03:58:02.273 INFO:teuthology.orchestra.run.trial154.stderr:epoch 0 2026-02-12T03:58:02.273 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:02.273 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:58:02.271894+0000 2026-02-12T03:58:02.273 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:58:02.271894+0000 2026-02-12T03:58:02.273 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:02.273 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:02.274 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:02.274 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:02.274 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:02.274 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:02.276 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.270+0000 7f0d96b33640 1 Processor -- start 2026-02-12T03:58:02.276 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.270+0000 7f0d96b33640 1 -- start start 2026-02-12T03:58:02.276 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.270+0000 7f0d96b33640 10 monclient: init 2026-02-12T03:58:02.276 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.271+0000 7f0d96b33640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:02.276 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.271+0000 7f0d96b33640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T03:58:02.276 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.271+0000 7f0d96b33640 10 monclient(hunting): picked mon.noname-a con 0x7f0d9011cae0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:02.277 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.271+0000 7f0d96b33640 10 monclient(hunting): picked mon.noname-c con 0x7f0d9011ceb0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:02.277 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.271+0000 7f0d96b33640 10 monclient(hunting): picked mon.noname-b con 0x7f0d901649c0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:02.277 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.271+0000 7f0d96b33640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d901864c0 con 0x7f0d9011cae0 2026-02-12T03:58:02.277 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.271+0000 7f0d96b33640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d901876a0 con 0x7f0d901649c0 2026-02-12T03:58:02.277 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.271+0000 7f0d96b33640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d90188880 con 0x7f0d9011ceb0 2026-02-12T03:58:02.277 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.271+0000 7f0d96b33640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:02.277 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.271+0000 7f0d96b33640 10 monclient(hunting): authenticate will time out at 1082.924211s 2026-02-12T03:58:02.277 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.271+0000 7f0d948a8640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f0d9011cae0 0x7f0d9011b1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.154:41660/0 (socket says 10.20.193.154:41660) 2026-02-12T03:58:02.277 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.271+0000 7f0d948a8640 1 -- 10.20.193.154:0/1910757789 learned_addr learned my addr 10.20.193.154:0/1910757789 (peer_addr_for_me v1:10.20.193.154:0/0) 2026-02-12T03:58:02.277 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.272+0000 7f0d877fe640 1 -- 10.20.193.154:0/1910757789 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 546282568 0 0) 0x7f0d901864c0 con 0x7f0d9011cae0 2026-02-12T03:58:02.277 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.272+0000 7f0d877fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:02.278 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.272+0000 7f0d877fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:02.278 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.272+0000 7f0d877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:02.278 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.272+0000 7f0d877fe640 10 monclient(hunting): my global_id is 4164 2026-02-12T03:58:02.278 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.272+0000 7f0d877fe640 1 -- 10.20.193.154:0/1910757789 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d7c003610 con 0x7f0d9011cae0 2026-02-12T03:58:02.278 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.273+0000 7f0d877fe640 1 -- 10.20.193.154:0/1910757789 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 71522241 0 0) 0x7f0d901876a0 con 0x7f0d901649c0 2026-02-12T03:58:02.278 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.273+0000 7f0d877fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:02.278 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.273+0000 7f0d877fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:02.278 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.273+0000 7f0d877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:02.278 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.273+0000 7f0d877fe640 10 monclient(hunting): my global_id is 4162 2026-02-12T03:58:02.278 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.273+0000 7f0d877fe640 1 -- 10.20.193.154:0/1910757789 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d901864c0 con 0x7f0d901649c0 2026-02-12T03:58:02.283 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.274+0000 7f0d877fe640 1 -- 10.20.193.154:0/1910757789 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1589922908 0 0) 0x7f0d7c003610 con 0x7f0d9011cae0 2026-02-12T03:58:02.283 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.274+0000 7f0d877fe640 1 -- 10.20.193.154:0/1910757789 >> v1:10.20.193.111:6789/0 conn(0x7f0d9011ceb0 legacy=0x7f0d9011b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T03:58:02.284 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.274+0000 7f0d877fe640 1 -- 10.20.193.154:0/1910757789 >> v1:10.20.193.98:6789/0 conn(0x7f0d901649c0 legacy=0x7f0d90184da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:02.284 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.274+0000 7f0d877fe640 10 monclient: _finish_hunting 0 2026-02-12T03:58:02.284 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.274+0000 7f0d877fe640 1 monclient: found mon.noname-a 2026-02-12T03:58:02.284 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.274+0000 7f0d877fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:02.284 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.274+0000 7f0d877fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.91:6789/0 2026-02-12T03:58:02.284 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.274+0000 7f0d877fe640 1 -- 10.20.193.154:0/1910757789 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d90189b20 con 0x7f0d9011cae0 2026-02-12T03:58:02.284 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.274+0000 7f0d877fe640 10 monclient: _finish_auth 0 2026-02-12T03:58:02.284 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.274+0000 7f0d877fe640 10 monclient: _check_auth_tickets 2026-02-12T03:58:02.284 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.274+0000 7f0d877fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:02.284 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.274+0000 7f0d877fe640 1 -- 10.20.193.154:0/1910757789 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f0d80002df0 con 0x7f0d9011cae0 2026-02-12T03:58:02.284 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.274+0000 7f0d877fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:02.284 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.274+0000 7f0d877fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:02.285 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.274+0000 7f0d877fe640 10 monclient: dump: 2026-02-12T03:58:02.285 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:02.285 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:02.285 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.285 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.285 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:02.285 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:02.285 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:02.285 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:02.285 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:02.285 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:02.285 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.274+0000 7f0d96b33640 5 monclient: authenticate success, global_id 4164 2026-02-12T03:58:02.286 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.274+0000 7f0d96b33640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:02.286 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.275+0000 7f0d877fe640 1 -- 10.20.193.154:0/1910757789 <== mon.0 v1:10.20.193.91:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0d80003070 con 0x7f0d9011cae0 2026-02-12T03:58:02.286 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.275+0000 7f0d877fe640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:02.286 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.275+0000 7f0d877fe640 1 -- 10.20.193.154:0/1910757789 <== mon.0 v1:10.20.193.91:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f0d800034b0 con 0x7f0d9011cae0 2026-02-12T03:58:02.286 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.275+0000 7f0d96b33640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:02.286 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.275+0000 7f0d877fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:02.286 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.275+0000 7f0d96b33640 4 set_mon_vals no callback set 2026-02-12T03:58:02.286 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.275+0000 7f0d877fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:02.286 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.275+0000 7f0d877fe640 10 monclient: dump: 2026-02-12T03:58:02.286 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:02.286 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:02.286 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.287 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.287 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:02.287 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:02.287 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:02.287 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:02.287 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:02.287 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:02.287 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.275+0000 7f0d96b33640 10 monclient: shutdown 2026-02-12T03:58:02.287 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.275+0000 7f0d96b33640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:02.287 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.275+0000 7f0d96b33640 1 -- 10.20.193.154:0/1910757789 >> v1:10.20.193.91:6789/0 conn(0x7f0d9011cae0 legacy=0x7f0d9011b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:02.287 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.275+0000 7f0d96b33640 1 -- 10.20.193.154:0/1910757789 shutdown_connections 2026-02-12T03:58:02.287 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.275+0000 7f0d96b33640 1 -- 10.20.193.154:0/1910757789 >> 10.20.193.154:0/1910757789 conn(0x7f0d90058b60 msgr2=0x7f0d90058f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:02.288 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.275+0000 7f0d96b33640 1 -- 10.20.193.154:0/1910757789 shutdown_connections 2026-02-12T03:58:02.288 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.275+0000 7f0d96b33640 1 -- 10.20.193.154:0/1910757789 wait complete. 2026-02-12T03:58:02.288 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.275+0000 7f0d96b33640 10 monclient: build_initial_monmap 2026-02-12T03:58:02.288 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.275+0000 7f0d96b33640 10 monclient: monmap: 2026-02-12T03:58:02.288 INFO:teuthology.orchestra.run.trial154.stderr:epoch 0 2026-02-12T03:58:02.288 INFO:teuthology.orchestra.run.trial154.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:02.288 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 0.000000 2026-02-12T03:58:02.288 INFO:teuthology.orchestra.run.trial154.stderr:created 0.000000 2026-02-12T03:58:02.288 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:02.288 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 1 2026-02-12T03:58:02.288 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:02.288 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:02.288 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:02.289 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:02.289 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.275+0000 7f0d96b33640 1 librados: starting msgr at 2026-02-12T03:58:02.289 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.275+0000 7f0d96b33640 1 librados: starting objecter 2026-02-12T03:58:02.289 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.275+0000 7f0d96b33640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:02.289 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.275+0000 7f0d96b33640 1 Processor -- start 2026-02-12T03:58:02.289 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.276+0000 7f0d96b33640 1 -- start start 2026-02-12T03:58:02.289 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.276+0000 7f0d96b33640 1 librados: setting wanted keys 2026-02-12T03:58:02.289 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.276+0000 7f0d96b33640 1 librados: calling monclient init 2026-02-12T03:58:02.289 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.276+0000 7f0d96b33640 10 monclient: init 2026-02-12T03:58:02.289 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.276+0000 7f0d96b33640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:02.289 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.276+0000 7f0d96b33640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T03:58:02.289 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.276+0000 7f0d96b33640 10 monclient(hunting): picked mon.noname-c con 0x7f0d9011cae0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:02.290 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.276+0000 7f0d96b33640 10 monclient(hunting): picked mon.noname-a con 0x7f0d9011ceb0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:02.290 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.276+0000 7f0d96b33640 10 monclient(hunting): picked mon.noname-b con 0x7f0d901649c0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:02.290 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.276+0000 7f0d96b33640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d9016c600 con 0x7f0d9011ceb0 2026-02-12T03:58:02.290 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.276+0000 7f0d96b33640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d90173490 con 0x7f0d901649c0 2026-02-12T03:58:02.290 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.276+0000 7f0d96b33640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d90174670 con 0x7f0d9011cae0 2026-02-12T03:58:02.290 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.276+0000 7f0d96b33640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:02.290 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.276+0000 7f0d96b33640 10 monclient(hunting): authenticate will time out at 1082.929171s 2026-02-12T03:58:02.290 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.276+0000 7f0d950a9640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f0d901649c0 0x7f0d901630b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.154:39376/0 (socket says 10.20.193.154:39376) 2026-02-12T03:58:02.290 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.276+0000 7f0d950a9640 1 -- 10.20.193.154:0/2133667633 learned_addr learned my addr 10.20.193.154:0/2133667633 (peer_addr_for_me v1:10.20.193.154:0/0) 2026-02-12T03:58:02.290 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.276+0000 7f0d857fa640 10 client.?.objecter ms_handle_connect 0x7f0d901649c0 2026-02-12T03:58:02.290 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.276+0000 7f0d857fa640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:02.290 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.277+0000 7f0d857fa640 10 client.?.objecter ms_handle_connect 0x7f0d9011ceb0 2026-02-12T03:58:02.290 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.277+0000 7f0d857fa640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:02.291 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.277+0000 7f0d857fa640 1 -- 10.20.193.154:0/2133667633 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1092411427 0 0) 0x7f0d90173490 con 0x7f0d901649c0 2026-02-12T03:58:02.291 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.277+0000 7f0d857fa640 10 monclient(hunting): _negotiate 2026-02-12T03:58:02.291 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.277+0000 7f0d857fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:02.291 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.277+0000 7f0d857fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:02.291 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.277+0000 7f0d857fa640 10 monclient(hunting): my global_id is 4165 2026-02-12T03:58:02.291 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.277+0000 7f0d857fa640 1 -- 10.20.193.154:0/2133667633 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d60003610 con 0x7f0d901649c0 2026-02-12T03:58:02.291 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.277+0000 7f0d857fa640 1 -- 10.20.193.154:0/2133667633 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 414355815 0 0) 0x7f0d9016c600 con 0x7f0d9011ceb0 2026-02-12T03:58:02.291 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.277+0000 7f0d857fa640 10 monclient(hunting): _negotiate 2026-02-12T03:58:02.291 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.277+0000 7f0d857fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:02.291 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.277+0000 7f0d857fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:02.291 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.277+0000 7f0d857fa640 10 monclient(hunting): my global_id is 4167 2026-02-12T03:58:02.291 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.277+0000 7f0d857fa640 1 -- 10.20.193.154:0/2133667633 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d90173490 con 0x7f0d9011ceb0 2026-02-12T03:58:02.292 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.280+0000 7f0d857fa640 1 -- 10.20.193.154:0/2133667633 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2728659149 0 0) 0x7f0d60003610 con 0x7f0d901649c0 2026-02-12T03:58:02.292 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.280+0000 7f0d857fa640 1 -- 10.20.193.154:0/2133667633 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0d9016c600 con 0x7f0d901649c0 2026-02-12T03:58:02.292 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.280+0000 7f0d857fa640 1 -- 10.20.193.154:0/2133667633 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f0d8c003470 con 0x7f0d901649c0 2026-02-12T03:58:02.292 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.280+0000 7f0d857fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:02.292 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.280+0000 7f0d857fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:02.292 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.280+0000 7f0d857fa640 10 monclient(hunting): dump: 2026-02-12T03:58:02.292 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:02.292 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:02.292 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.292 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.292 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:02.292 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:02.293 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:02.293 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:02.293 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:02.293 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:02.293 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.280+0000 7f0d857fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:02.293 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.280+0000 7f0d857fa640 1 -- 10.20.193.154:0/2133667633 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 98282132 0 0) 0x7f0d90173490 con 0x7f0d9011ceb0 2026-02-12T03:58:02.293 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.280+0000 7f0d857fa640 1 -- 10.20.193.154:0/2133667633 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0d60003610 con 0x7f0d9011ceb0 2026-02-12T03:58:02.293 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.280+0000 7f0d857fa640 1 -- 10.20.193.154:0/2133667633 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f0d78002f70 con 0x7f0d9011ceb0 2026-02-12T03:58:02.293 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.280+0000 7f0d857fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:02.293 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.280+0000 7f0d857fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:02.293 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.280+0000 7f0d857fa640 10 monclient(hunting): dump: 2026-02-12T03:58:02.293 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:02.293 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:02.294 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.294 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.294 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:02.294 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:02.294 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:02.294 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:02.294 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:02.294 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:02.296 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.281+0000 7f0d857fa640 1 -- 10.20.193.154:0/2133667633 <== mon.1 v1:10.20.193.98:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 871565050 0 0) 0x7f0d9016c600 con 0x7f0d901649c0 2026-02-12T03:58:02.296 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.281+0000 7f0d857fa640 1 -- 10.20.193.154:0/2133667633 >> v1:10.20.193.111:6789/0 conn(0x7f0d9011cae0 legacy=0x7f0d9016baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:02.296 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.281+0000 7f0d857fa640 1 -- 10.20.193.154:0/2133667633 >> v1:10.20.193.91:6789/0 conn(0x7f0d9011ceb0 legacy=0x7f0d90161990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:02.296 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.281+0000 7f0d857fa640 10 monclient: _finish_hunting 0 2026-02-12T03:58:02.296 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.281+0000 7f0d857fa640 1 monclient: found mon.b 2026-02-12T03:58:02.297 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.281+0000 7f0d857fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:02.297 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.281+0000 7f0d857fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:02.297 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.281+0000 7f0d857fa640 1 -- 10.20.193.154:0/2133667633 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d90175850 con 0x7f0d901649c0 2026-02-12T03:58:02.297 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.281+0000 7f0d857fa640 10 monclient: _finish_auth 0 2026-02-12T03:58:02.297 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.281+0000 7f0d857fa640 10 monclient: _check_auth_tickets 2026-02-12T03:58:02.297 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.281+0000 7f0d857fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:02.297 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.281+0000 7f0d96b33640 5 monclient: authenticate success, global_id 4165 2026-02-12T03:58:02.297 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.281+0000 7f0d96b33640 10 monclient: _renew_subs 2026-02-12T03:58:02.297 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.281+0000 7f0d96b33640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:02.297 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.281+0000 7f0d96b33640 1 -- 10.20.193.154:0/2133667633 --> v1:10.20.193.98:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0d90172480 con 0x7f0d901649c0 2026-02-12T03:58:02.297 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.281+0000 7f0d96b33640 10 client.4165.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:02.297 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.281+0000 7f0d96b33640 10 monclient: _renew_subs 2026-02-12T03:58:02.298 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.281+0000 7f0d96b33640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:02.298 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.281+0000 7f0d96b33640 1 -- 10.20.193.154:0/2133667633 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0d90172ac0 con 0x7f0d901649c0 2026-02-12T03:58:02.298 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.281+0000 7f0d96b33640 1 librados: init done 2026-02-12T03:58:02.298 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.282+0000 7f0d96b33640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:02.298 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.282+0000 7f0d96b33640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:02.298 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.282+0000 7f0d96b33640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:02.298 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.282+0000 7f0d96b33640 1 -- 10.20.193.154:0/2133667633 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d90187da0 con 0x7f0d901649c0 2026-02-12T03:58:02.317 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.315+0000 7f0d857fa640 1 -- 10.20.193.154:0/2133667633 <== mon.1 v1:10.20.193.98:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0d8c003820 con 0x7f0d901649c0 2026-02-12T03:58:02.318 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.315+0000 7f0d857fa640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:02.318 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.315+0000 7f0d86ffd640 4 set_mon_vals no callback set 2026-02-12T03:58:02.318 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.315+0000 7f0d857fa640 1 -- 10.20.193.154:0/2133667633 <== mon.1 v1:10.20.193.98:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f0d8c003ed0 con 0x7f0d901649c0 2026-02-12T03:58:02.318 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.315+0000 7f0d857fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:02.318 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.315+0000 7f0d857fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:02.318 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.315+0000 7f0d857fa640 10 monclient: dump: 2026-02-12T03:58:02.318 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:02.318 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:02.318 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.319 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.319 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:02.319 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:02.319 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:02.319 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:02.319 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:02.319 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:02.319 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.315+0000 7f0d857fa640 1 -- 10.20.193.154:0/2133667633 <== mon.1 v1:10.20.193.98:6789/0 7 ==== mgrmap(e 2) ==== 51721+0+0 (unknown 3160786211 0 0) 0x7f0d8c0040b0 con 0x7f0d901649c0 2026-02-12T03:58:02.320 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.316+0000 7f0d857fa640 1 -- 10.20.193.154:0/2133667633 <== mon.1 v1:10.20.193.98:6789/0 8 ==== osd_map(7..7 src has 1..7) ==== 1295+0+0 (unknown 822852557 0 0) 0x7f0d8c0043d0 con 0x7f0d901649c0 2026-02-12T03:58:02.320 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.316+0000 7f0d857fa640 10 client.4165.objecter ms_dispatch2 0x7f0d90000b90 osd_map(7..7 src has 1..7) 2026-02-12T03:58:02.320 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.316+0000 7f0d857fa640 3 client.4165.objecter handle_osd_map got epochs [7,7] > 0 2026-02-12T03:58:02.320 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.316+0000 7f0d857fa640 3 client.4165.objecter handle_osd_map decoding full epoch 7 2026-02-12T03:58:02.321 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.316+0000 7f0d857fa640 20 client.4165.objecter dump_active .. 0 homeless 2026-02-12T03:58:02.321 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.316+0000 7f0d857fa640 1 -- 10.20.193.154:0/2133667633 <== mon.1 v1:10.20.193.98:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77303 (unknown 1092875540 0 3794932319) 0x7f0d8c017dd0 con 0x7f0d901649c0 2026-02-12T03:58:02.321 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.316+0000 7f0d857fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:02.321 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.316+0000 7f0d857fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:02.352 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.349+0000 7f0d96b33640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "d7bb6fa1-b042-4dce-9644-00e817a5bc8c", "id": 5}] 2026-02-12T03:58:02.352 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.349+0000 7f0d96b33640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "d7bb6fa1-b042-4dce-9644-00e817a5bc8c", "id": 5}] 2026-02-12T03:58:02.352 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.349+0000 7f0d96b33640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:02.352 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.349+0000 7f0d96b33640 1 -- 10.20.193.154:0/2133667633 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "osd new", "uuid": "d7bb6fa1-b042-4dce-9644-00e817a5bc8c", "id": 5} v 0) -- 0x7f0d90172db0 con 0x7f0d901649c0 2026-02-12T03:58:02.408 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.406+0000 7f0d857fa640 1 -- 10.20.193.154:0/2133667633 <== mon.1 v1:10.20.193.98:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d7bb6fa1-b042-4dce-9644-00e817a5bc8c", "id": 5}]=0 v8) ==== 112+0+2 (unknown 2396466652 0 1988412176) 0x7f0d8c0176d0 con 0x7f0d901649c0 2026-02-12T03:58:02.408 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.406+0000 7f0d857fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "d7bb6fa1-b042-4dce-9644-00e817a5bc8c", "id": 5}] 2026-02-12T03:58:02.408 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.406+0000 7f0d857fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:02.409 INFO:teuthology.orchestra.run.trial154.stdout:5 2026-02-12T03:58:02.410 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.406+0000 7f0d96b33640 10 librados: watch_flush enter 2026-02-12T03:58:02.410 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.406+0000 7f0d96b33640 10 librados: watch_flush exit 2026-02-12T03:58:02.410 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.406+0000 7f0d96b33640 20 client.4165.objecter shutdown clearing up homeless session... 2026-02-12T03:58:02.410 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.406+0000 7f0d96b33640 10 client.4165.objecter successfully canceled tick 2026-02-12T03:58:02.410 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.406+0000 7f0d96b33640 10 monclient: shutdown 2026-02-12T03:58:02.411 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.406+0000 7f0d96b33640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:02.411 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.406+0000 7f0d96b33640 1 -- 10.20.193.154:0/2133667633 >> v1:10.20.193.98:6789/0 conn(0x7f0d901649c0 legacy=0x7f0d901630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:02.411 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.406+0000 7f0d96b33640 1 -- 10.20.193.154:0/2133667633 shutdown_connections 2026-02-12T03:58:02.411 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.406+0000 7f0d96b33640 1 -- 10.20.193.154:0/2133667633 >> 10.20.193.154:0/2133667633 conn(0x7f0d90058b60 msgr2=0x7f0d9011b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:02.411 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.406+0000 7f0d96b33640 1 -- 10.20.193.154:0/2133667633 shutdown_connections 2026-02-12T03:58:02.411 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.406+0000 7f0d96b33640 1 -- 10.20.193.154:0/2133667633 wait complete. 2026-02-12T03:58:02.411 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.406+0000 7f0d96b33640 1 librados: shutdown 2026-02-12T03:58:02.417 DEBUG:teuthology.orchestra.run.trial154:> sudo ceph --cluster ceph osd new 93cd9edf-a000-4d22-8da7-52f4bd547765 6 2026-02-12T03:58:02.480 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.477+0000 7f5f6360b640 10 monclient: get_monmap_and_config 2026-02-12T03:58:02.481 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.477+0000 7f5f6360b640 10 monclient: build_initial_monmap 2026-02-12T03:58:02.481 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.477+0000 7f5f6360b640 10 monclient: monmap: 2026-02-12T03:58:02.481 INFO:teuthology.orchestra.run.trial154.stderr:epoch 0 2026-02-12T03:58:02.481 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:02.481 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:58:02.478828+0000 2026-02-12T03:58:02.481 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:58:02.478828+0000 2026-02-12T03:58:02.481 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:02.481 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:02.482 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:02.482 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:02.482 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:02.482 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:02.482 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.477+0000 7f5f6360b640 1 Processor -- start 2026-02-12T03:58:02.482 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.477+0000 7f5f6360b640 1 -- start start 2026-02-12T03:58:02.482 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.477+0000 7f5f6360b640 10 monclient: init 2026-02-12T03:58:02.482 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.477+0000 7f5f6360b640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:02.482 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.478+0000 7f5f6360b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T03:58:02.482 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.478+0000 7f5f6360b640 10 monclient(hunting): picked mon.noname-c con 0x7f5f5c11cae0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:02.482 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.478+0000 7f5f6360b640 10 monclient(hunting): picked mon.noname-b con 0x7f5f5c11ceb0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:02.482 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.478+0000 7f5f6360b640 10 monclient(hunting): picked mon.noname-a con 0x7f5f5c1649c0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:02.483 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.478+0000 7f5f6360b640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f5c1864c0 con 0x7f5f5c1649c0 2026-02-12T03:58:02.483 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.478+0000 7f5f6360b640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f5c1876a0 con 0x7f5f5c11ceb0 2026-02-12T03:58:02.483 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.478+0000 7f5f6360b640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f5c188880 con 0x7f5f5c11cae0 2026-02-12T03:58:02.483 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.478+0000 7f5f6360b640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:02.483 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.478+0000 7f5f6360b640 10 monclient(hunting): authenticate will time out at 1083.131064s 2026-02-12T03:58:02.483 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.478+0000 7f5f60b7f640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f5f5c11ceb0 0x7f5f5c11b8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.154:39384/0 (socket says 10.20.193.154:39384) 2026-02-12T03:58:02.483 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.478+0000 7f5f60b7f640 1 -- 10.20.193.154:0/3469618513 learned_addr learned my addr 10.20.193.154:0/3469618513 (peer_addr_for_me v1:10.20.193.154:0/0) 2026-02-12T03:58:02.488 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.479+0000 7f5f4bfff640 1 -- 10.20.193.154:0/3469618513 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 253694269 0 0) 0x7f5f5c1864c0 con 0x7f5f5c1649c0 2026-02-12T03:58:02.488 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.479+0000 7f5f4bfff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:02.488 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.479+0000 7f5f4bfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:02.488 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.479+0000 7f5f4bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:02.488 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.479+0000 7f5f4bfff640 10 monclient(hunting): my global_id is 4170 2026-02-12T03:58:02.488 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.479+0000 7f5f4bfff640 1 -- 10.20.193.154:0/3469618513 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f44003610 con 0x7f5f5c1649c0 2026-02-12T03:58:02.488 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.479+0000 7f5f4bfff640 1 -- 10.20.193.154:0/3469618513 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 417201311 0 0) 0x7f5f5c1876a0 con 0x7f5f5c11ceb0 2026-02-12T03:58:02.489 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.479+0000 7f5f4bfff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:02.489 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.479+0000 7f5f4bfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:02.489 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.479+0000 7f5f4bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:02.489 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.479+0000 7f5f4bfff640 10 monclient(hunting): my global_id is 4168 2026-02-12T03:58:02.489 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.479+0000 7f5f4bfff640 1 -- 10.20.193.154:0/3469618513 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f5c1864c0 con 0x7f5f5c11ceb0 2026-02-12T03:58:02.489 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.481+0000 7f5f4bfff640 1 -- 10.20.193.154:0/3469618513 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1993139295 0 0) 0x7f5f5c1864c0 con 0x7f5f5c11ceb0 2026-02-12T03:58:02.489 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.481+0000 7f5f4bfff640 1 -- 10.20.193.154:0/3469618513 >> v1:10.20.193.111:6789/0 conn(0x7f5f5c11cae0 legacy=0x7f5f5c11b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T03:58:02.489 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.481+0000 7f5f4bfff640 1 -- 10.20.193.154:0/3469618513 >> v1:10.20.193.91:6789/0 conn(0x7f5f5c1649c0 legacy=0x7f5f5c184da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:02.489 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.481+0000 7f5f4bfff640 10 monclient: _finish_hunting 0 2026-02-12T03:58:02.489 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.481+0000 7f5f4bfff640 1 monclient: found mon.noname-b 2026-02-12T03:58:02.489 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.481+0000 7f5f4bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:02.490 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.481+0000 7f5f4bfff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T03:58:02.490 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.481+0000 7f5f4bfff640 1 -- 10.20.193.154:0/3469618513 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f5c189b20 con 0x7f5f5c11ceb0 2026-02-12T03:58:02.490 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.481+0000 7f5f4bfff640 10 monclient: _finish_auth 0 2026-02-12T03:58:02.490 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.481+0000 7f5f4bfff640 10 monclient: _check_auth_tickets 2026-02-12T03:58:02.490 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.481+0000 7f5f4bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:02.490 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.481+0000 7f5f4bfff640 1 -- 10.20.193.154:0/3469618513 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f5f50002df0 con 0x7f5f5c11ceb0 2026-02-12T03:58:02.490 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.481+0000 7f5f4bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:02.490 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.481+0000 7f5f4bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:02.490 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.481+0000 7f5f4bfff640 10 monclient: dump: 2026-02-12T03:58:02.490 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:02.490 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:02.490 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.491 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.491 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:02.491 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:02.491 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:02.491 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:02.491 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:02.491 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:02.491 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.481+0000 7f5f6360b640 5 monclient: authenticate success, global_id 4168 2026-02-12T03:58:02.491 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.481+0000 7f5f6360b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:02.491 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.482+0000 7f5f4bfff640 1 -- 10.20.193.154:0/3469618513 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5f50003070 con 0x7f5f5c11ceb0 2026-02-12T03:58:02.491 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.482+0000 7f5f4bfff640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:02.492 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.482+0000 7f5f4bfff640 1 -- 10.20.193.154:0/3469618513 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f5f500034b0 con 0x7f5f5c11ceb0 2026-02-12T03:58:02.492 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.482+0000 7f5f4bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:02.492 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.482+0000 7f5f4bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:02.492 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.482+0000 7f5f4bfff640 10 monclient: dump: 2026-02-12T03:58:02.492 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:02.492 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:02.492 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.492 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.492 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:02.492 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:02.492 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:02.492 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:02.493 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:02.493 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:02.493 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.482+0000 7f5f6360b640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:02.493 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.482+0000 7f5f6360b640 4 set_mon_vals no callback set 2026-02-12T03:58:02.493 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.482+0000 7f5f6360b640 10 monclient: shutdown 2026-02-12T03:58:02.493 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.482+0000 7f5f6360b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:02.493 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.482+0000 7f5f6360b640 1 -- 10.20.193.154:0/3469618513 >> v1:10.20.193.98:6789/0 conn(0x7f5f5c11ceb0 legacy=0x7f5f5c11b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:02.493 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.482+0000 7f5f6360b640 1 -- 10.20.193.154:0/3469618513 shutdown_connections 2026-02-12T03:58:02.493 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.482+0000 7f5f6360b640 1 -- 10.20.193.154:0/3469618513 >> 10.20.193.154:0/3469618513 conn(0x7f5f5c058b60 msgr2=0x7f5f5c058f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:02.493 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.482+0000 7f5f6360b640 1 -- 10.20.193.154:0/3469618513 shutdown_connections 2026-02-12T03:58:02.493 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.482+0000 7f5f6360b640 1 -- 10.20.193.154:0/3469618513 wait complete. 2026-02-12T03:58:02.493 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.483+0000 7f5f6360b640 10 monclient: build_initial_monmap 2026-02-12T03:58:02.494 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.483+0000 7f5f6360b640 10 monclient: monmap: 2026-02-12T03:58:02.494 INFO:teuthology.orchestra.run.trial154.stderr:epoch 0 2026-02-12T03:58:02.494 INFO:teuthology.orchestra.run.trial154.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:02.494 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 0.000000 2026-02-12T03:58:02.494 INFO:teuthology.orchestra.run.trial154.stderr:created 0.000000 2026-02-12T03:58:02.494 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:02.494 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 1 2026-02-12T03:58:02.494 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:02.494 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:02.494 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:02.494 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:02.494 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.483+0000 7f5f6360b640 1 librados: starting msgr at 2026-02-12T03:58:02.494 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.483+0000 7f5f6360b640 1 librados: starting objecter 2026-02-12T03:58:02.495 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.483+0000 7f5f6360b640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:02.495 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.483+0000 7f5f6360b640 1 Processor -- start 2026-02-12T03:58:02.495 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.483+0000 7f5f6360b640 1 -- start start 2026-02-12T03:58:02.495 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.483+0000 7f5f6360b640 1 librados: setting wanted keys 2026-02-12T03:58:02.495 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.483+0000 7f5f6360b640 1 librados: calling monclient init 2026-02-12T03:58:02.495 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.483+0000 7f5f6360b640 10 monclient: init 2026-02-12T03:58:02.495 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.483+0000 7f5f6360b640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:02.495 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.483+0000 7f5f6360b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T03:58:02.495 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.483+0000 7f5f6360b640 10 monclient(hunting): picked mon.noname-a con 0x7f5f5c11cae0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:02.495 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.483+0000 7f5f6360b640 10 monclient(hunting): picked mon.noname-c con 0x7f5f5c11ceb0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:02.495 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.483+0000 7f5f6360b640 10 monclient(hunting): picked mon.noname-b con 0x7f5f5c1649c0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:02.495 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.483+0000 7f5f6360b640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f5c16c560 con 0x7f5f5c11cae0 2026-02-12T03:58:02.495 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.483+0000 7f5f6360b640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f5c173440 con 0x7f5f5c1649c0 2026-02-12T03:58:02.496 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.483+0000 7f5f6360b640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f5c174620 con 0x7f5f5c11ceb0 2026-02-12T03:58:02.496 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.483+0000 7f5f6360b640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:02.496 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.483+0000 7f5f6360b640 10 monclient(hunting): authenticate will time out at 1083.136481s 2026-02-12T03:58:02.496 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.483+0000 7f5f61b81640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f5f5c1649c0 0x7f5f5c1630b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.154:39386/0 (socket says 10.20.193.154:39386) 2026-02-12T03:58:02.496 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.483+0000 7f5f61b81640 1 -- 10.20.193.154:0/257654728 learned_addr learned my addr 10.20.193.154:0/257654728 (peer_addr_for_me v1:10.20.193.154:0/0) 2026-02-12T03:58:02.496 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.483+0000 7f5f49ffb640 10 client.?.objecter ms_handle_connect 0x7f5f5c11cae0 2026-02-12T03:58:02.496 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.483+0000 7f5f49ffb640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:02.497 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.483+0000 7f5f49ffb640 10 client.?.objecter ms_handle_connect 0x7f5f5c1649c0 2026-02-12T03:58:02.497 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.483+0000 7f5f49ffb640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:02.497 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.484+0000 7f5f49ffb640 1 -- 10.20.193.154:0/257654728 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4059295396 0 0) 0x7f5f5c16c560 con 0x7f5f5c11cae0 2026-02-12T03:58:02.497 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.484+0000 7f5f49ffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:02.497 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.484+0000 7f5f49ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:02.497 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.484+0000 7f5f49ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:02.497 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.484+0000 7f5f49ffb640 10 monclient(hunting): my global_id is 4173 2026-02-12T03:58:02.497 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.484+0000 7f5f49ffb640 1 -- 10.20.193.154:0/257654728 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f2c003610 con 0x7f5f5c11cae0 2026-02-12T03:58:02.497 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.484+0000 7f5f49ffb640 1 -- 10.20.193.154:0/257654728 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 612612944 0 0) 0x7f5f5c173440 con 0x7f5f5c1649c0 2026-02-12T03:58:02.497 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.484+0000 7f5f49ffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:02.497 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.484+0000 7f5f49ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:02.497 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.484+0000 7f5f49ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:02.497 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.484+0000 7f5f49ffb640 10 monclient(hunting): my global_id is 4171 2026-02-12T03:58:02.498 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.484+0000 7f5f49ffb640 1 -- 10.20.193.154:0/257654728 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f5c16c560 con 0x7f5f5c1649c0 2026-02-12T03:58:02.500 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.487+0000 7f5f49ffb640 1 -- 10.20.193.154:0/257654728 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 433434424 0 0) 0x7f5f5c16c560 con 0x7f5f5c1649c0 2026-02-12T03:58:02.500 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.487+0000 7f5f49ffb640 1 -- 10.20.193.154:0/257654728 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5f5c173440 con 0x7f5f5c1649c0 2026-02-12T03:58:02.501 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.487+0000 7f5f49ffb640 1 -- 10.20.193.154:0/257654728 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f5f58003470 con 0x7f5f5c1649c0 2026-02-12T03:58:02.501 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.487+0000 7f5f49ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:02.501 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.487+0000 7f5f49ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:02.501 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.487+0000 7f5f49ffb640 10 monclient(hunting): dump: 2026-02-12T03:58:02.501 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:02.501 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:02.501 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.501 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.501 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:02.501 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:02.501 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:02.501 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:02.502 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:02.502 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:02.502 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.487+0000 7f5f49ffb640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:02.502 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.487+0000 7f5f49ffb640 10 client.?.objecter ms_handle_connect 0x7f5f5c11ceb0 2026-02-12T03:58:02.502 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.487+0000 7f5f49ffb640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:02.502 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.487+0000 7f5f49ffb640 1 -- 10.20.193.154:0/257654728 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1108966880 0 0) 0x7f5f2c003610 con 0x7f5f5c11cae0 2026-02-12T03:58:02.502 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.487+0000 7f5f49ffb640 1 -- 10.20.193.154:0/257654728 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5f5c16c560 con 0x7f5f5c11cae0 2026-02-12T03:58:02.502 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.487+0000 7f5f49ffb640 1 -- 10.20.193.154:0/257654728 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f5f4c002f70 con 0x7f5f5c11cae0 2026-02-12T03:58:02.502 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.487+0000 7f5f49ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:02.502 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.487+0000 7f5f49ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:02.502 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.487+0000 7f5f49ffb640 10 monclient(hunting): dump: 2026-02-12T03:58:02.503 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:02.503 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:02.503 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.503 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.503 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:02.503 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:02.503 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:02.503 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:02.503 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:02.503 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:02.503 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.489+0000 7f5f49ffb640 1 -- 10.20.193.154:0/257654728 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1248296797 0 0) 0x7f5f5c174620 con 0x7f5f5c11ceb0 2026-02-12T03:58:02.503 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.489+0000 7f5f49ffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:02.504 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.489+0000 7f5f49ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:02.504 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.489+0000 7f5f49ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:02.504 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.489+0000 7f5f49ffb640 10 monclient(hunting): my global_id is 4148 2026-02-12T03:58:02.504 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.489+0000 7f5f49ffb640 1 -- 10.20.193.154:0/257654728 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f2c003610 con 0x7f5f5c11ceb0 2026-02-12T03:58:02.504 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.489+0000 7f5f49ffb640 1 -- 10.20.193.154:0/257654728 <== mon.1 v1:10.20.193.98:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3251285137 0 0) 0x7f5f5c173440 con 0x7f5f5c1649c0 2026-02-12T03:58:02.504 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.489+0000 7f5f49ffb640 1 -- 10.20.193.154:0/257654728 >> v1:10.20.193.111:6789/0 conn(0x7f5f5c11ceb0 legacy=0x7f5f5c161990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:02.504 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.489+0000 7f5f49ffb640 1 -- 10.20.193.154:0/257654728 >> v1:10.20.193.91:6789/0 conn(0x7f5f5c11cae0 legacy=0x7f5f5c16ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:02.504 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.489+0000 7f5f49ffb640 10 monclient: _finish_hunting 0 2026-02-12T03:58:02.504 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.489+0000 7f5f49ffb640 1 monclient: found mon.b 2026-02-12T03:58:02.504 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.489+0000 7f5f49ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:02.504 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.489+0000 7f5f49ffb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:02.504 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.489+0000 7f5f49ffb640 1 -- 10.20.193.154:0/257654728 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f5c175800 con 0x7f5f5c1649c0 2026-02-12T03:58:02.505 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.489+0000 7f5f49ffb640 10 monclient: _finish_auth 0 2026-02-12T03:58:02.505 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.489+0000 7f5f49ffb640 10 monclient: _check_auth_tickets 2026-02-12T03:58:02.505 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.489+0000 7f5f49ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:02.505 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.489+0000 7f5f6360b640 5 monclient: authenticate success, global_id 4171 2026-02-12T03:58:02.505 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.489+0000 7f5f6360b640 10 monclient: _renew_subs 2026-02-12T03:58:02.505 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.489+0000 7f5f6360b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:02.505 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.489+0000 7f5f6360b640 1 -- 10.20.193.154:0/257654728 --> v1:10.20.193.98:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5f5c173610 con 0x7f5f5c1649c0 2026-02-12T03:58:02.505 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.489+0000 7f5f6360b640 10 client.4171.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:02.505 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.489+0000 7f5f6360b640 10 monclient: _renew_subs 2026-02-12T03:58:02.505 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.489+0000 7f5f6360b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:02.505 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.489+0000 7f5f6360b640 1 -- 10.20.193.154:0/257654728 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5f5c173c00 con 0x7f5f5c1649c0 2026-02-12T03:58:02.505 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.489+0000 7f5f6360b640 1 librados: init done 2026-02-12T03:58:02.505 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.489+0000 7f5f6360b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:02.505 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.489+0000 7f5f6360b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:02.506 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.489+0000 7f5f6360b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:02.506 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.489+0000 7f5f6360b640 1 -- 10.20.193.154:0/257654728 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f5c186bc0 con 0x7f5f5c1649c0 2026-02-12T03:58:02.525 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.523+0000 7f5f49ffb640 1 -- 10.20.193.154:0/257654728 <== mon.1 v1:10.20.193.98:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5f58003820 con 0x7f5f5c1649c0 2026-02-12T03:58:02.525 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.523+0000 7f5f49ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:02.525 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.523+0000 7f5f49ffb640 1 -- 10.20.193.154:0/257654728 <== mon.1 v1:10.20.193.98:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f5f58003ed0 con 0x7f5f5c1649c0 2026-02-12T03:58:02.526 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.523+0000 7f5f49ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:02.526 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.523+0000 7f5f49ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:02.526 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.523+0000 7f5f49ffb640 10 monclient: dump: 2026-02-12T03:58:02.526 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:02.526 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:02.526 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.526 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.526 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:02.526 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:02.526 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:02.526 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:02.527 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:02.527 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:02.527 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.523+0000 7f5f4b7fe640 4 set_mon_vals no callback set 2026-02-12T03:58:02.527 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.523+0000 7f5f49ffb640 1 -- 10.20.193.154:0/257654728 <== mon.1 v1:10.20.193.98:6789/0 7 ==== mgrmap(e 2) ==== 51721+0+0 (unknown 3160786211 0 0) 0x7f5f580040b0 con 0x7f5f5c1649c0 2026-02-12T03:58:02.528 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.523+0000 7f5f49ffb640 1 -- 10.20.193.154:0/257654728 <== mon.1 v1:10.20.193.98:6789/0 8 ==== osd_map(8..8 src has 1..8) ==== 1410+0+0 (unknown 3732988840 0 0) 0x7f5f58017010 con 0x7f5f5c1649c0 2026-02-12T03:58:02.528 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.523+0000 7f5f49ffb640 10 client.4171.objecter ms_dispatch2 0x7f5f5c000b90 osd_map(8..8 src has 1..8) 2026-02-12T03:58:02.528 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.523+0000 7f5f49ffb640 3 client.4171.objecter handle_osd_map got epochs [8,8] > 0 2026-02-12T03:58:02.528 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.523+0000 7f5f49ffb640 3 client.4171.objecter handle_osd_map decoding full epoch 8 2026-02-12T03:58:02.528 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.523+0000 7f5f49ffb640 20 client.4171.objecter dump_active .. 0 homeless 2026-02-12T03:58:02.528 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.523+0000 7f5f49ffb640 1 -- 10.20.193.154:0/257654728 <== mon.1 v1:10.20.193.98:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77303 (unknown 1092875540 0 3794932319) 0x7f5f58017df0 con 0x7f5f5c1649c0 2026-02-12T03:58:02.528 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.523+0000 7f5f49ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:02.528 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.523+0000 7f5f49ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:02.560 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.557+0000 7f5f6360b640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "93cd9edf-a000-4d22-8da7-52f4bd547765", "id": 6}] 2026-02-12T03:58:02.560 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.557+0000 7f5f6360b640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "93cd9edf-a000-4d22-8da7-52f4bd547765", "id": 6}] 2026-02-12T03:58:02.560 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.557+0000 7f5f6360b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:02.560 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.557+0000 7f5f6360b640 1 -- 10.20.193.154:0/257654728 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "osd new", "uuid": "93cd9edf-a000-4d22-8da7-52f4bd547765", "id": 6} v 0) -- 0x7f5f5c1742e0 con 0x7f5f5c1649c0 2026-02-12T03:58:02.600 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.598+0000 7f5f49ffb640 1 -- 10.20.193.154:0/257654728 <== mon.1 v1:10.20.193.98:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "93cd9edf-a000-4d22-8da7-52f4bd547765", "id": 6}]=0 v9) ==== 112+0+2 (unknown 4156455445 0 1113811849) 0x7f5f580176f0 con 0x7f5f5c1649c0 2026-02-12T03:58:02.601 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.598+0000 7f5f49ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "93cd9edf-a000-4d22-8da7-52f4bd547765", "id": 6}] 2026-02-12T03:58:02.601 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.598+0000 7f5f49ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:02.601 INFO:teuthology.orchestra.run.trial154.stdout:6 2026-02-12T03:58:02.602 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.598+0000 7f5f6360b640 10 librados: watch_flush enter 2026-02-12T03:58:02.603 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.598+0000 7f5f6360b640 10 librados: watch_flush exit 2026-02-12T03:58:02.603 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.598+0000 7f5f6360b640 20 client.4171.objecter shutdown clearing up homeless session... 2026-02-12T03:58:02.603 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.598+0000 7f5f6360b640 10 client.4171.objecter successfully canceled tick 2026-02-12T03:58:02.603 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.598+0000 7f5f6360b640 10 monclient: shutdown 2026-02-12T03:58:02.603 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.598+0000 7f5f6360b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:02.603 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.598+0000 7f5f6360b640 1 -- 10.20.193.154:0/257654728 >> v1:10.20.193.98:6789/0 conn(0x7f5f5c1649c0 legacy=0x7f5f5c1630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:02.603 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.599+0000 7f5f6360b640 1 -- 10.20.193.154:0/257654728 shutdown_connections 2026-02-12T03:58:02.603 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.599+0000 7f5f6360b640 1 -- 10.20.193.154:0/257654728 >> 10.20.193.154:0/257654728 conn(0x7f5f5c058b60 msgr2=0x7f5f5c11b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:02.603 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.599+0000 7f5f6360b640 1 -- 10.20.193.154:0/257654728 shutdown_connections 2026-02-12T03:58:02.603 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.599+0000 7f5f6360b640 1 -- 10.20.193.154:0/257654728 wait complete. 2026-02-12T03:58:02.603 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.599+0000 7f5f6360b640 1 librados: shutdown 2026-02-12T03:58:02.609 DEBUG:teuthology.orchestra.run.trial154:> sudo ceph --cluster ceph osd new f5e11a47-d746-46ca-85f1-27d3bc586371 7 2026-02-12T03:58:02.674 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.672+0000 7f3f5aded640 10 monclient: get_monmap_and_config 2026-02-12T03:58:02.675 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.672+0000 7f3f5aded640 10 monclient: build_initial_monmap 2026-02-12T03:58:02.675 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.672+0000 7f3f5aded640 10 monclient: monmap: 2026-02-12T03:58:02.675 INFO:teuthology.orchestra.run.trial154.stderr:epoch 0 2026-02-12T03:58:02.675 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:02.675 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:58:02.673743+0000 2026-02-12T03:58:02.675 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:58:02.673743+0000 2026-02-12T03:58:02.675 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:02.675 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:02.675 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:02.675 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:02.676 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:02.676 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:02.678 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.672+0000 7f3f5aded640 1 Processor -- start 2026-02-12T03:58:02.678 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.672+0000 7f3f5aded640 1 -- start start 2026-02-12T03:58:02.678 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.672+0000 7f3f5aded640 10 monclient: init 2026-02-12T03:58:02.678 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.672+0000 7f3f5aded640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:02.678 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.672+0000 7f3f5aded640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T03:58:02.679 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.672+0000 7f3f5aded640 10 monclient(hunting): picked mon.noname-a con 0x7f3f5405db20 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:02.679 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.672+0000 7f3f5aded640 10 monclient(hunting): picked mon.noname-c con 0x7f3f5405dfe0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:02.679 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.672+0000 7f3f5aded640 10 monclient(hunting): picked mon.noname-b con 0x7f3f541624d0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:02.679 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.673+0000 7f3f5aded640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f54184210 con 0x7f3f5405db20 2026-02-12T03:58:02.679 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.673+0000 7f3f5aded640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f54185410 con 0x7f3f541624d0 2026-02-12T03:58:02.679 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.673+0000 7f3f5aded640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f54186610 con 0x7f3f5405dfe0 2026-02-12T03:58:02.679 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.673+0000 7f3f5aded640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:02.679 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.673+0000 7f3f5aded640 10 monclient(hunting): authenticate will time out at 1083.326054s 2026-02-12T03:58:02.679 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.673+0000 7f3f58b62640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f3f5405db20 0x7f3f5405ad00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.154:41700/0 (socket says 10.20.193.154:41700) 2026-02-12T03:58:02.679 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.673+0000 7f3f58b62640 1 -- 10.20.193.154:0/471445977 learned_addr learned my addr 10.20.193.154:0/471445977 (peer_addr_for_me v1:10.20.193.154:0/0) 2026-02-12T03:58:02.679 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.674+0000 7f3f4b7fe640 1 -- 10.20.193.154:0/471445977 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 941742342 0 0) 0x7f3f54184210 con 0x7f3f5405db20 2026-02-12T03:58:02.680 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.674+0000 7f3f4b7fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:02.680 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.674+0000 7f3f4b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:02.680 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.674+0000 7f3f4b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:02.680 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.674+0000 7f3f4b7fe640 10 monclient(hunting): my global_id is 4176 2026-02-12T03:58:02.680 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.674+0000 7f3f4b7fe640 1 -- 10.20.193.154:0/471445977 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f40003610 con 0x7f3f5405db20 2026-02-12T03:58:02.680 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.674+0000 7f3f4b7fe640 1 -- 10.20.193.154:0/471445977 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2525509945 0 0) 0x7f3f54185410 con 0x7f3f541624d0 2026-02-12T03:58:02.680 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.674+0000 7f3f4b7fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:02.680 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.674+0000 7f3f4b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:02.680 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.674+0000 7f3f4b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:02.680 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.674+0000 7f3f4b7fe640 10 monclient(hunting): my global_id is 4174 2026-02-12T03:58:02.680 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.674+0000 7f3f4b7fe640 1 -- 10.20.193.154:0/471445977 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f54184210 con 0x7f3f541624d0 2026-02-12T03:58:02.686 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.676+0000 7f3f4b7fe640 1 -- 10.20.193.154:0/471445977 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3805636557 0 0) 0x7f3f54184210 con 0x7f3f541624d0 2026-02-12T03:58:02.686 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.676+0000 7f3f4b7fe640 1 -- 10.20.193.154:0/471445977 >> v1:10.20.193.111:6789/0 conn(0x7f3f5405dfe0 legacy=0x7f3f5405b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:02.686 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.676+0000 7f3f4b7fe640 1 -- 10.20.193.154:0/471445977 >> v1:10.20.193.91:6789/0 conn(0x7f3f5405db20 legacy=0x7f3f5405ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:02.686 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.676+0000 7f3f4b7fe640 10 monclient: _finish_hunting 0 2026-02-12T03:58:02.686 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.676+0000 7f3f4b7fe640 1 monclient: found mon.noname-b 2026-02-12T03:58:02.686 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.676+0000 7f3f4b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:02.686 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.676+0000 7f3f4b7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T03:58:02.686 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.676+0000 7f3f4b7fe640 1 -- 10.20.193.154:0/471445977 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f541878b0 con 0x7f3f541624d0 2026-02-12T03:58:02.686 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.676+0000 7f3f4b7fe640 10 monclient: _finish_auth 0 2026-02-12T03:58:02.686 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.676+0000 7f3f4b7fe640 10 monclient: _check_auth_tickets 2026-02-12T03:58:02.686 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.676+0000 7f3f4b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:02.687 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.676+0000 7f3f4b7fe640 1 -- 10.20.193.154:0/471445977 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f3f50003170 con 0x7f3f541624d0 2026-02-12T03:58:02.687 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.676+0000 7f3f5aded640 5 monclient: authenticate success, global_id 4174 2026-02-12T03:58:02.687 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.676+0000 7f3f5aded640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:02.687 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.676+0000 7f3f4b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:02.687 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.676+0000 7f3f4b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:02.687 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.676+0000 7f3f4b7fe640 10 monclient: dump: 2026-02-12T03:58:02.687 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:02.687 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:02.687 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.687 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.687 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:02.688 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:02.688 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:02.688 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:02.688 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:02.688 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:02.688 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.676+0000 7f3f5aded640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:02.688 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.677+0000 7f3f4b7fe640 1 -- 10.20.193.154:0/471445977 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3f500033f0 con 0x7f3f541624d0 2026-02-12T03:58:02.688 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.677+0000 7f3f4b7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:02.688 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.677+0000 7f3f4b7fe640 1 -- 10.20.193.154:0/471445977 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f3f50003830 con 0x7f3f541624d0 2026-02-12T03:58:02.688 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.677+0000 7f3f4b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:02.689 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.677+0000 7f3f4b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:02.689 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.677+0000 7f3f4b7fe640 10 monclient: dump: 2026-02-12T03:58:02.689 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:02.689 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:02.689 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.689 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.689 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:02.689 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:02.689 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:02.689 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:02.689 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:02.689 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:02.690 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.677+0000 7f3f5aded640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:02.690 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.677+0000 7f3f5aded640 4 set_mon_vals no callback set 2026-02-12T03:58:02.690 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.677+0000 7f3f5aded640 10 monclient: shutdown 2026-02-12T03:58:02.690 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.677+0000 7f3f5aded640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:02.690 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.677+0000 7f3f5aded640 1 -- 10.20.193.154:0/471445977 >> v1:10.20.193.98:6789/0 conn(0x7f3f541624d0 legacy=0x7f3f54182910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:02.690 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.677+0000 7f3f5aded640 1 -- 10.20.193.154:0/471445977 shutdown_connections 2026-02-12T03:58:02.690 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.677+0000 7f3f5aded640 1 -- 10.20.193.154:0/471445977 >> 10.20.193.154:0/471445977 conn(0x7f3f54058b60 msgr2=0x7f3f54058f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:02.690 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.677+0000 7f3f5aded640 1 -- 10.20.193.154:0/471445977 shutdown_connections 2026-02-12T03:58:02.690 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.677+0000 7f3f5aded640 1 -- 10.20.193.154:0/471445977 wait complete. 2026-02-12T03:58:02.690 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.677+0000 7f3f5aded640 10 monclient: build_initial_monmap 2026-02-12T03:58:02.690 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.677+0000 7f3f5aded640 10 monclient: monmap: 2026-02-12T03:58:02.690 INFO:teuthology.orchestra.run.trial154.stderr:epoch 0 2026-02-12T03:58:02.691 INFO:teuthology.orchestra.run.trial154.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:02.691 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 0.000000 2026-02-12T03:58:02.691 INFO:teuthology.orchestra.run.trial154.stderr:created 0.000000 2026-02-12T03:58:02.691 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:02.691 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 1 2026-02-12T03:58:02.691 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:02.691 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:02.691 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:02.691 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:02.691 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.677+0000 7f3f5aded640 1 librados: starting msgr at 2026-02-12T03:58:02.691 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.677+0000 7f3f5aded640 1 librados: starting objecter 2026-02-12T03:58:02.691 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.678+0000 7f3f5aded640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:02.692 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.678+0000 7f3f5aded640 1 Processor -- start 2026-02-12T03:58:02.692 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.678+0000 7f3f5aded640 1 -- start start 2026-02-12T03:58:02.692 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.678+0000 7f3f5aded640 1 librados: setting wanted keys 2026-02-12T03:58:02.692 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.678+0000 7f3f5aded640 1 librados: calling monclient init 2026-02-12T03:58:02.692 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.678+0000 7f3f5aded640 10 monclient: init 2026-02-12T03:58:02.692 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.678+0000 7f3f5aded640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:02.692 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.678+0000 7f3f5aded640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T03:58:02.692 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.678+0000 7f3f5aded640 10 monclient(hunting): picked mon.noname-c con 0x7f3f5405db20 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:02.692 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.678+0000 7f3f5aded640 10 monclient(hunting): picked mon.noname-b con 0x7f3f5405dfe0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:02.692 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.678+0000 7f3f5aded640 10 monclient(hunting): picked mon.noname-a con 0x7f3f541624d0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:02.692 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.678+0000 7f3f5aded640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f54150500 con 0x7f3f541624d0 2026-02-12T03:58:02.692 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.678+0000 7f3f5aded640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f541516e0 con 0x7f3f5405dfe0 2026-02-12T03:58:02.693 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.678+0000 7f3f5aded640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f541528c0 con 0x7f3f5405db20 2026-02-12T03:58:02.693 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.678+0000 7f3f5aded640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:02.693 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.678+0000 7f3f5aded640 10 monclient(hunting): authenticate will time out at 1083.331245s 2026-02-12T03:58:02.693 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.678+0000 7f3f58b62640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f3f5405db20 0x7f3f54106cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.154:53388/0 (socket says 10.20.193.154:53388) 2026-02-12T03:58:02.693 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.678+0000 7f3f58b62640 1 -- 10.20.193.154:0/1702061199 learned_addr learned my addr 10.20.193.154:0/1702061199 (peer_addr_for_me v1:10.20.193.154:0/0) 2026-02-12T03:58:02.693 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.678+0000 7f3f497fa640 10 client.?.objecter ms_handle_connect 0x7f3f5405db20 2026-02-12T03:58:02.693 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.678+0000 7f3f497fa640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:02.693 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.678+0000 7f3f497fa640 10 client.?.objecter ms_handle_connect 0x7f3f5405dfe0 2026-02-12T03:58:02.693 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.678+0000 7f3f497fa640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:02.693 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.679+0000 7f3f497fa640 1 -- 10.20.193.154:0/1702061199 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2476156667 0 0) 0x7f3f541528c0 con 0x7f3f5405db20 2026-02-12T03:58:02.693 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.679+0000 7f3f497fa640 10 monclient(hunting): _negotiate 2026-02-12T03:58:02.693 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.679+0000 7f3f497fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:02.693 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.679+0000 7f3f497fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:02.694 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.679+0000 7f3f497fa640 10 monclient(hunting): my global_id is 4154 2026-02-12T03:58:02.694 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.679+0000 7f3f497fa640 1 -- 10.20.193.154:0/1702061199 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f24003610 con 0x7f3f5405db20 2026-02-12T03:58:02.694 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.680+0000 7f3f497fa640 1 -- 10.20.193.154:0/1702061199 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3306239393 0 0) 0x7f3f541516e0 con 0x7f3f5405dfe0 2026-02-12T03:58:02.694 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.680+0000 7f3f497fa640 10 monclient(hunting): _negotiate 2026-02-12T03:58:02.694 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.680+0000 7f3f497fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:02.694 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.680+0000 7f3f497fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:02.694 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.680+0000 7f3f497fa640 10 monclient(hunting): my global_id is 4177 2026-02-12T03:58:02.694 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.680+0000 7f3f497fa640 1 -- 10.20.193.154:0/1702061199 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f541528c0 con 0x7f3f5405dfe0 2026-02-12T03:58:02.694 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.682+0000 7f3f497fa640 1 -- 10.20.193.154:0/1702061199 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2102530934 0 0) 0x7f3f24003610 con 0x7f3f5405db20 2026-02-12T03:58:02.694 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.682+0000 7f3f497fa640 1 -- 10.20.193.154:0/1702061199 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3f541516e0 con 0x7f3f5405db20 2026-02-12T03:58:02.694 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.682+0000 7f3f497fa640 1 -- 10.20.193.154:0/1702061199 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f3f440030b0 con 0x7f3f5405db20 2026-02-12T03:58:02.695 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.682+0000 7f3f497fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:02.695 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.682+0000 7f3f497fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:02.695 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.682+0000 7f3f497fa640 10 monclient(hunting): dump: 2026-02-12T03:58:02.695 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:02.695 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:02.695 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.695 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.695 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:02.695 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:02.695 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:02.695 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:02.695 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:02.695 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:02.696 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.682+0000 7f3f497fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:02.696 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.682+0000 7f3f497fa640 1 -- 10.20.193.154:0/1702061199 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2644103837 0 0) 0x7f3f541528c0 con 0x7f3f5405dfe0 2026-02-12T03:58:02.696 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.682+0000 7f3f497fa640 1 -- 10.20.193.154:0/1702061199 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3f24003610 con 0x7f3f5405dfe0 2026-02-12T03:58:02.696 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.682+0000 7f3f497fa640 1 -- 10.20.193.154:0/1702061199 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f3f3c003030 con 0x7f3f5405dfe0 2026-02-12T03:58:02.696 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.682+0000 7f3f497fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:02.696 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.682+0000 7f3f497fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:02.696 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.682+0000 7f3f497fa640 10 monclient(hunting): dump: 2026-02-12T03:58:02.696 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:02.696 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:02.696 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.696 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.696 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:02.697 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:02.697 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:02.697 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:02.697 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:02.697 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:02.697 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.683+0000 7f3f497fa640 10 client.?.objecter ms_handle_connect 0x7f3f541624d0 2026-02-12T03:58:02.697 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.683+0000 7f3f497fa640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:02.700 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.683+0000 7f3f497fa640 1 -- 10.20.193.154:0/1702061199 <== mon.1 v1:10.20.193.98:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3135998075 0 0) 0x7f3f24003610 con 0x7f3f5405dfe0 2026-02-12T03:58:02.700 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.683+0000 7f3f497fa640 1 -- 10.20.193.154:0/1702061199 >> v1:10.20.193.111:6789/0 conn(0x7f3f5405db20 legacy=0x7f3f54106cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:02.700 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.683+0000 7f3f497fa640 1 -- 10.20.193.154:0/1702061199 >> v1:10.20.193.91:6789/0 conn(0x7f3f541624d0 legacy=0x7f3f5414ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:02.700 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.683+0000 7f3f497fa640 10 monclient: _finish_hunting 0 2026-02-12T03:58:02.700 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.683+0000 7f3f497fa640 1 monclient: found mon.b 2026-02-12T03:58:02.700 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.683+0000 7f3f497fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:02.700 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.683+0000 7f3f497fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:02.700 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.683+0000 7f3f497fa640 1 -- 10.20.193.154:0/1702061199 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f54153aa0 con 0x7f3f5405dfe0 2026-02-12T03:58:02.701 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.683+0000 7f3f497fa640 10 monclient: _finish_auth 0 2026-02-12T03:58:02.701 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.683+0000 7f3f497fa640 10 monclient: _check_auth_tickets 2026-02-12T03:58:02.701 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.683+0000 7f3f497fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:02.701 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.684+0000 7f3f5aded640 5 monclient: authenticate success, global_id 4177 2026-02-12T03:58:02.701 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.684+0000 7f3f5aded640 10 monclient: _renew_subs 2026-02-12T03:58:02.701 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.684+0000 7f3f5aded640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:02.701 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.684+0000 7f3f5aded640 1 -- 10.20.193.154:0/1702061199 --> v1:10.20.193.98:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3f541518b0 con 0x7f3f5405dfe0 2026-02-12T03:58:02.701 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.684+0000 7f3f5aded640 10 client.4177.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:02.701 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.684+0000 7f3f5aded640 10 monclient: _renew_subs 2026-02-12T03:58:02.701 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.684+0000 7f3f5aded640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:02.701 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.684+0000 7f3f5aded640 1 -- 10.20.193.154:0/1702061199 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3f54151ef0 con 0x7f3f5405dfe0 2026-02-12T03:58:02.701 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.684+0000 7f3f5aded640 1 librados: init done 2026-02-12T03:58:02.702 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.684+0000 7f3f5aded640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:02.702 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.684+0000 7f3f5aded640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:02.702 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.684+0000 7f3f5aded640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:02.702 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.684+0000 7f3f5aded640 1 -- 10.20.193.154:0/1702061199 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f54185b10 con 0x7f3f5405dfe0 2026-02-12T03:58:02.702 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.688+0000 7f3f497fa640 1 -- 10.20.193.154:0/1702061199 <== mon.1 v1:10.20.193.98:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3f3c003700 con 0x7f3f5405dfe0 2026-02-12T03:58:02.702 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.688+0000 7f3f497fa640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:02.702 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.688+0000 7f3f497fa640 1 -- 10.20.193.154:0/1702061199 <== mon.1 v1:10.20.193.98:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f3f3c003b10 con 0x7f3f5405dfe0 2026-02-12T03:58:02.702 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.688+0000 7f3f497fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:02.702 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.688+0000 7f3f497fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:02.702 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.688+0000 7f3f497fa640 10 monclient: dump: 2026-02-12T03:58:02.702 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:02.702 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:02.702 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.703 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.703 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:02.703 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:02.703 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:02.703 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:02.703 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:02.703 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:02.703 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.688+0000 7f3f4affd640 4 set_mon_vals no callback set 2026-02-12T03:58:02.703 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.689+0000 7f3f497fa640 1 -- 10.20.193.154:0/1702061199 <== mon.1 v1:10.20.193.98:6789/0 7 ==== mgrmap(e 2) ==== 51721+0+0 (unknown 3160786211 0 0) 0x7f3f3c003cf0 con 0x7f3f5405dfe0 2026-02-12T03:58:02.703 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.690+0000 7f3f497fa640 1 -- 10.20.193.154:0/1702061199 <== mon.1 v1:10.20.193.98:6789/0 8 ==== osd_map(9..9 src has 1..9) ==== 1525+0+0 (unknown 1234459871 0 0) 0x7f3f3c012120 con 0x7f3f5405dfe0 2026-02-12T03:58:02.703 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.690+0000 7f3f497fa640 10 client.4177.objecter ms_dispatch2 0x7f3f54000b90 osd_map(9..9 src has 1..9) 2026-02-12T03:58:02.703 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.690+0000 7f3f497fa640 3 client.4177.objecter handle_osd_map got epochs [9,9] > 0 2026-02-12T03:58:02.704 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.690+0000 7f3f497fa640 3 client.4177.objecter handle_osd_map decoding full epoch 9 2026-02-12T03:58:02.704 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.690+0000 7f3f497fa640 20 client.4177.objecter dump_active .. 0 homeless 2026-02-12T03:58:02.722 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.720+0000 7f3f497fa640 1 -- 10.20.193.154:0/1702061199 <== mon.1 v1:10.20.193.98:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77303 (unknown 1092875540 0 3794932319) 0x7f3f3c0167a0 con 0x7f3f5405dfe0 2026-02-12T03:58:02.722 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.720+0000 7f3f497fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:02.722 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.720+0000 7f3f497fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:02.755 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.752+0000 7f3f5aded640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "f5e11a47-d746-46ca-85f1-27d3bc586371", "id": 7}] 2026-02-12T03:58:02.755 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.752+0000 7f3f5aded640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "f5e11a47-d746-46ca-85f1-27d3bc586371", "id": 7}] 2026-02-12T03:58:02.755 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.752+0000 7f3f5aded640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:02.755 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.752+0000 7f3f5aded640 1 -- 10.20.193.154:0/1702061199 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "osd new", "uuid": "f5e11a47-d746-46ca-85f1-27d3bc586371", "id": 7} v 0) -- 0x7f3f541521e0 con 0x7f3f5405dfe0 2026-02-12T03:58:02.794 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.793+0000 7f3f497fa640 1 -- 10.20.193.154:0/1702061199 <== mon.1 v1:10.20.193.98:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f5e11a47-d746-46ca-85f1-27d3bc586371", "id": 7}]=0 v10) ==== 112+0+2 (unknown 1480502613 0 1371665406) 0x7f3f3c0160a0 con 0x7f3f5405dfe0 2026-02-12T03:58:02.795 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.793+0000 7f3f497fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "f5e11a47-d746-46ca-85f1-27d3bc586371", "id": 7}] 2026-02-12T03:58:02.795 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.793+0000 7f3f497fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:02.795 INFO:teuthology.orchestra.run.trial154.stdout:7 2026-02-12T03:58:02.796 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.793+0000 7f3f5aded640 10 librados: watch_flush enter 2026-02-12T03:58:02.796 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.793+0000 7f3f5aded640 10 librados: watch_flush exit 2026-02-12T03:58:02.797 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.793+0000 7f3f5aded640 20 client.4177.objecter shutdown clearing up homeless session... 2026-02-12T03:58:02.797 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.793+0000 7f3f5aded640 10 client.4177.objecter successfully canceled tick 2026-02-12T03:58:02.797 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.793+0000 7f3f5aded640 10 monclient: shutdown 2026-02-12T03:58:02.797 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.793+0000 7f3f5aded640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:02.797 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.793+0000 7f3f5aded640 1 -- 10.20.193.154:0/1702061199 >> v1:10.20.193.98:6789/0 conn(0x7f3f5405dfe0 legacy=0x7f3f5414d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:02.797 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.793+0000 7f3f5aded640 1 -- 10.20.193.154:0/1702061199 shutdown_connections 2026-02-12T03:58:02.797 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.793+0000 7f3f5aded640 1 -- 10.20.193.154:0/1702061199 >> 10.20.193.154:0/1702061199 conn(0x7f3f54058b60 msgr2=0x7f3f541828f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:02.797 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.793+0000 7f3f5aded640 1 -- 10.20.193.154:0/1702061199 shutdown_connections 2026-02-12T03:58:02.797 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.793+0000 7f3f5aded640 1 -- 10.20.193.154:0/1702061199 wait complete. 2026-02-12T03:58:02.797 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.793+0000 7f3f5aded640 1 librados: shutdown 2026-02-12T03:58:02.802 DEBUG:teuthology.orchestra.run.trial154:> sudo ceph --cluster ceph osd new bb8207ce-22b9-46be-9c89-c77f2690e405 8 2026-02-12T03:58:02.866 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.863+0000 7fd4589e0640 10 monclient: get_monmap_and_config 2026-02-12T03:58:02.867 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.863+0000 7fd4589e0640 10 monclient: build_initial_monmap 2026-02-12T03:58:02.867 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.863+0000 7fd4589e0640 10 monclient: monmap: 2026-02-12T03:58:02.867 INFO:teuthology.orchestra.run.trial154.stderr:epoch 0 2026-02-12T03:58:02.867 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:02.867 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:58:02.864551+0000 2026-02-12T03:58:02.867 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:58:02.864551+0000 2026-02-12T03:58:02.867 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:02.867 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:02.867 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:02.867 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:02.868 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:02.868 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:02.868 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.863+0000 7fd4589e0640 1 Processor -- start 2026-02-12T03:58:02.868 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.863+0000 7fd4589e0640 1 -- start start 2026-02-12T03:58:02.868 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.863+0000 7fd4589e0640 10 monclient: init 2026-02-12T03:58:02.868 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.863+0000 7fd4589e0640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:02.868 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.863+0000 7fd4589e0640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T03:58:02.868 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.863+0000 7fd4589e0640 10 monclient(hunting): picked mon.noname-b con 0x7fd45005dce0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:02.868 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.863+0000 7fd4589e0640 10 monclient(hunting): picked mon.noname-c con 0x7fd45005ce10 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:02.868 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.863+0000 7fd4589e0640 10 monclient(hunting): picked mon.noname-a con 0x7fd45005d290 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:02.868 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.863+0000 7fd4589e0640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd450183150 con 0x7fd45005d290 2026-02-12T03:58:02.869 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.863+0000 7fd4589e0640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd450184330 con 0x7fd45005dce0 2026-02-12T03:58:02.869 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.863+0000 7fd4589e0640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd450185530 con 0x7fd45005ce10 2026-02-12T03:58:02.869 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.863+0000 7fd4589e0640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:02.869 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.863+0000 7fd4589e0640 10 monclient(hunting): authenticate will time out at 1083.516827s 2026-02-12T03:58:02.869 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.864+0000 7fd456f56640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7fd45005d290 0x7fd450181970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.154:41722/0 (socket says 10.20.193.154:41722) 2026-02-12T03:58:02.869 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.864+0000 7fd456f56640 1 -- 10.20.193.154:0/3183753406 learned_addr learned my addr 10.20.193.154:0/3183753406 (peer_addr_for_me v1:10.20.193.154:0/0) 2026-02-12T03:58:02.869 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.864+0000 7fd456755640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7fd45005dce0 0x7fd45005c700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.154:39406/0 (socket says 10.20.193.154:39406) 2026-02-12T03:58:02.874 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.865+0000 7fd455753640 1 -- 10.20.193.154:0/3183753406 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2315469249 0 0) 0x7fd450184330 con 0x7fd45005dce0 2026-02-12T03:58:02.875 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.865+0000 7fd455753640 10 monclient(hunting): _negotiate 2026-02-12T03:58:02.875 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.865+0000 7fd455753640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:02.875 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.865+0000 7fd455753640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:02.875 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.865+0000 7fd455753640 10 monclient(hunting): my global_id is 4180 2026-02-12T03:58:02.875 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.865+0000 7fd455753640 1 -- 10.20.193.154:0/3183753406 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd440003610 con 0x7fd45005dce0 2026-02-12T03:58:02.875 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.865+0000 7fd455753640 1 -- 10.20.193.154:0/3183753406 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3288518336 0 0) 0x7fd450183150 con 0x7fd45005d290 2026-02-12T03:58:02.875 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.865+0000 7fd455753640 10 monclient(hunting): _negotiate 2026-02-12T03:58:02.875 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.865+0000 7fd455753640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:02.875 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.865+0000 7fd455753640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:02.875 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.865+0000 7fd455753640 10 monclient(hunting): my global_id is 4182 2026-02-12T03:58:02.875 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.865+0000 7fd455753640 1 -- 10.20.193.154:0/3183753406 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd450184330 con 0x7fd45005d290 2026-02-12T03:58:02.876 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.867+0000 7fd455753640 1 -- 10.20.193.154:0/3183753406 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 370484159 0 0) 0x7fd450184330 con 0x7fd45005d290 2026-02-12T03:58:02.876 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.867+0000 7fd455753640 1 -- 10.20.193.154:0/3183753406 >> v1:10.20.193.111:6789/0 conn(0x7fd45005ce10 legacy=0x7fd450160240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T03:58:02.876 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.867+0000 7fd455753640 1 -- 10.20.193.154:0/3183753406 >> v1:10.20.193.98:6789/0 conn(0x7fd45005dce0 legacy=0x7fd45005c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:02.876 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.867+0000 7fd455753640 10 monclient: _finish_hunting 0 2026-02-12T03:58:02.876 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.867+0000 7fd455753640 1 monclient: found mon.noname-a 2026-02-12T03:58:02.876 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.867+0000 7fd455753640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:02.876 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.867+0000 7fd455753640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.91:6789/0 2026-02-12T03:58:02.876 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.867+0000 7fd455753640 1 -- 10.20.193.154:0/3183753406 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4501867d0 con 0x7fd45005d290 2026-02-12T03:58:02.876 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.867+0000 7fd455753640 10 monclient: _finish_auth 0 2026-02-12T03:58:02.876 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.867+0000 7fd455753640 10 monclient: _check_auth_tickets 2026-02-12T03:58:02.876 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.867+0000 7fd455753640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:02.877 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.867+0000 7fd4589e0640 5 monclient: authenticate success, global_id 4182 2026-02-12T03:58:02.877 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.867+0000 7fd4589e0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:02.877 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.867+0000 7fd455753640 1 -- 10.20.193.154:0/3183753406 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd444003170 con 0x7fd45005d290 2026-02-12T03:58:02.877 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.867+0000 7fd455753640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:02.877 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.867+0000 7fd455753640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:02.877 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.867+0000 7fd455753640 10 monclient: dump: 2026-02-12T03:58:02.877 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:02.877 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:02.877 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.877 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.877 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:02.877 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:02.878 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:02.878 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:02.878 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:02.878 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:02.878 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.867+0000 7fd4589e0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:02.878 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.868+0000 7fd455753640 1 -- 10.20.193.154:0/3183753406 <== mon.0 v1:10.20.193.91:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd444003470 con 0x7fd45005d290 2026-02-12T03:58:02.878 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.868+0000 7fd455753640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:02.878 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.868+0000 7fd455753640 1 -- 10.20.193.154:0/3183753406 <== mon.0 v1:10.20.193.91:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd4440038b0 con 0x7fd45005d290 2026-02-12T03:58:02.878 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.868+0000 7fd455753640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:02.878 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.868+0000 7fd455753640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:02.878 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.868+0000 7fd455753640 10 monclient: dump: 2026-02-12T03:58:02.879 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:02.879 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:02.879 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.879 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.879 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:02.879 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:02.879 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:02.879 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:02.879 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:02.879 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:02.879 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.868+0000 7fd4589e0640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:02.880 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.868+0000 7fd4589e0640 4 set_mon_vals no callback set 2026-02-12T03:58:02.880 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.868+0000 7fd4589e0640 10 monclient: shutdown 2026-02-12T03:58:02.880 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.868+0000 7fd4589e0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:02.880 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.868+0000 7fd4589e0640 1 -- 10.20.193.154:0/3183753406 >> v1:10.20.193.91:6789/0 conn(0x7fd45005d290 legacy=0x7fd450181970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:02.880 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.868+0000 7fd4589e0640 1 -- 10.20.193.154:0/3183753406 shutdown_connections 2026-02-12T03:58:02.880 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.868+0000 7fd4589e0640 1 -- 10.20.193.154:0/3183753406 >> 10.20.193.154:0/3183753406 conn(0x7fd450058b60 msgr2=0x7fd450058f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:02.880 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.868+0000 7fd4589e0640 1 -- 10.20.193.154:0/3183753406 shutdown_connections 2026-02-12T03:58:02.880 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.868+0000 7fd4589e0640 1 -- 10.20.193.154:0/3183753406 wait complete. 2026-02-12T03:58:02.880 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.868+0000 7fd4589e0640 10 monclient: build_initial_monmap 2026-02-12T03:58:02.880 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.868+0000 7fd4589e0640 10 monclient: monmap: 2026-02-12T03:58:02.880 INFO:teuthology.orchestra.run.trial154.stderr:epoch 0 2026-02-12T03:58:02.880 INFO:teuthology.orchestra.run.trial154.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:02.881 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 0.000000 2026-02-12T03:58:02.881 INFO:teuthology.orchestra.run.trial154.stderr:created 0.000000 2026-02-12T03:58:02.881 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:02.881 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 1 2026-02-12T03:58:02.881 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:02.881 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:02.881 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:02.881 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:02.881 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.868+0000 7fd4589e0640 1 librados: starting msgr at 2026-02-12T03:58:02.881 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.868+0000 7fd4589e0640 1 librados: starting objecter 2026-02-12T03:58:02.881 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.868+0000 7fd4589e0640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:02.882 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.868+0000 7fd4589e0640 1 Processor -- start 2026-02-12T03:58:02.882 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.868+0000 7fd4589e0640 1 -- start start 2026-02-12T03:58:02.882 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.868+0000 7fd4589e0640 1 librados: setting wanted keys 2026-02-12T03:58:02.882 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.868+0000 7fd4589e0640 1 librados: calling monclient init 2026-02-12T03:58:02.882 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.868+0000 7fd4589e0640 10 monclient: init 2026-02-12T03:58:02.882 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.869+0000 7fd4589e0640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:02.882 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.869+0000 7fd4589e0640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T03:58:02.882 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.869+0000 7fd4589e0640 10 monclient(hunting): picked mon.noname-c con 0x7fd45005ce10 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:02.882 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.869+0000 7fd4589e0640 10 monclient(hunting): picked mon.noname-b con 0x7fd45005d290 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:02.882 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.869+0000 7fd4589e0640 10 monclient(hunting): picked mon.noname-a con 0x7fd45005dce0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:02.882 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.869+0000 7fd4589e0640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd45021a310 con 0x7fd45005dce0 2026-02-12T03:58:02.882 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.869+0000 7fd4589e0640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd45021b4f0 con 0x7fd45005d290 2026-02-12T03:58:02.883 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.869+0000 7fd4589e0640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd45021c6d0 con 0x7fd45005ce10 2026-02-12T03:58:02.883 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.869+0000 7fd4589e0640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:02.883 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.869+0000 7fd4589e0640 10 monclient(hunting): authenticate will time out at 1083.522100s 2026-02-12T03:58:02.883 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.869+0000 7fd456f56640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7fd45005dce0 0x7fd450218bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.154:41734/0 (socket says 10.20.193.154:41734) 2026-02-12T03:58:02.883 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.869+0000 7fd456f56640 1 -- 10.20.193.154:0/2234412249 learned_addr learned my addr 10.20.193.154:0/2234412249 (peer_addr_for_me v1:10.20.193.154:0/0) 2026-02-12T03:58:02.883 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.869+0000 7fd43affd640 10 client.?.objecter ms_handle_connect 0x7fd45005dce0 2026-02-12T03:58:02.883 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.869+0000 7fd43affd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:02.883 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.870+0000 7fd43affd640 1 -- 10.20.193.154:0/2234412249 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3724970368 0 0) 0x7fd45021a310 con 0x7fd45005dce0 2026-02-12T03:58:02.883 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.870+0000 7fd43affd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:02.883 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.870+0000 7fd43affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:02.883 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.870+0000 7fd43affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:02.883 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.870+0000 7fd43affd640 10 monclient(hunting): my global_id is 4185 2026-02-12T03:58:02.884 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.870+0000 7fd43affd640 1 -- 10.20.193.154:0/2234412249 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd420003610 con 0x7fd45005dce0 2026-02-12T03:58:02.884 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.870+0000 7fd43affd640 10 client.?.objecter ms_handle_connect 0x7fd45005d290 2026-02-12T03:58:02.884 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.870+0000 7fd43affd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:02.884 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.871+0000 7fd43affd640 1 -- 10.20.193.154:0/2234412249 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4220425116 0 0) 0x7fd45021b4f0 con 0x7fd45005d290 2026-02-12T03:58:02.884 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.871+0000 7fd43affd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:02.884 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.871+0000 7fd43affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:02.884 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.871+0000 7fd43affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:02.884 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.871+0000 7fd43affd640 10 monclient(hunting): my global_id is 4183 2026-02-12T03:58:02.884 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.871+0000 7fd43affd640 1 -- 10.20.193.154:0/2234412249 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd45021a310 con 0x7fd45005d290 2026-02-12T03:58:02.887 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.873+0000 7fd43affd640 1 -- 10.20.193.154:0/2234412249 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2108262858 0 0) 0x7fd420003610 con 0x7fd45005dce0 2026-02-12T03:58:02.887 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.873+0000 7fd43affd640 1 -- 10.20.193.154:0/2234412249 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd45021b4f0 con 0x7fd45005dce0 2026-02-12T03:58:02.887 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.873+0000 7fd43affd640 1 -- 10.20.193.154:0/2234412249 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd444003130 con 0x7fd45005dce0 2026-02-12T03:58:02.888 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.873+0000 7fd43affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:02.888 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.873+0000 7fd43affd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:02.888 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.873+0000 7fd43affd640 10 monclient(hunting): dump: 2026-02-12T03:58:02.888 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:02.888 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:02.888 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.888 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.888 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:02.888 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:02.888 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:02.888 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:02.889 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:02.889 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:02.889 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.873+0000 7fd43affd640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:02.889 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.874+0000 7fd43affd640 1 -- 10.20.193.154:0/2234412249 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3120096123 0 0) 0x7fd45021a310 con 0x7fd45005d290 2026-02-12T03:58:02.889 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.874+0000 7fd43affd640 1 -- 10.20.193.154:0/2234412249 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd420003610 con 0x7fd45005d290 2026-02-12T03:58:02.889 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.874+0000 7fd43affd640 1 -- 10.20.193.154:0/2234412249 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd43c002f70 con 0x7fd45005d290 2026-02-12T03:58:02.889 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.874+0000 7fd43affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:02.889 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.874+0000 7fd43affd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:02.889 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.874+0000 7fd43affd640 10 monclient(hunting): dump: 2026-02-12T03:58:02.889 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:02.889 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:02.889 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.890 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.890 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:02.890 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:02.890 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:02.890 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:02.890 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:02.890 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:02.890 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.874+0000 7fd43affd640 1 -- 10.20.193.154:0/2234412249 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 164097707 0 0) 0x7fd45021b4f0 con 0x7fd45005dce0 2026-02-12T03:58:02.890 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.874+0000 7fd43affd640 1 -- 10.20.193.154:0/2234412249 >> v1:10.20.193.111:6789/0 conn(0x7fd45005ce10 legacy=0x7fd4501b0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:02.890 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.874+0000 7fd43affd640 1 -- 10.20.193.154:0/2234412249 >> v1:10.20.193.98:6789/0 conn(0x7fd45005d290 legacy=0x7fd4501f74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:02.890 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.874+0000 7fd43affd640 10 monclient: _finish_hunting 0 2026-02-12T03:58:02.890 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.874+0000 7fd43affd640 1 monclient: found mon.a 2026-02-12T03:58:02.891 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.874+0000 7fd43affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:02.891 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.874+0000 7fd43affd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:02.891 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.874+0000 7fd43affd640 1 -- 10.20.193.154:0/2234412249 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd45021d8b0 con 0x7fd45005dce0 2026-02-12T03:58:02.891 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.874+0000 7fd43affd640 10 monclient: _finish_auth 0 2026-02-12T03:58:02.891 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.874+0000 7fd43affd640 10 monclient: _check_auth_tickets 2026-02-12T03:58:02.891 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.874+0000 7fd43affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:02.891 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.874+0000 7fd4589e0640 5 monclient: authenticate success, global_id 4185 2026-02-12T03:58:02.891 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.874+0000 7fd4589e0640 10 monclient: _renew_subs 2026-02-12T03:58:02.891 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.874+0000 7fd4589e0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:02.891 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.874+0000 7fd4589e0640 1 -- 10.20.193.154:0/2234412249 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd45021b720 con 0x7fd45005dce0 2026-02-12T03:58:02.891 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.874+0000 7fd4589e0640 10 client.4185.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:02.891 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.874+0000 7fd4589e0640 10 monclient: _renew_subs 2026-02-12T03:58:02.892 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.874+0000 7fd4589e0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:02.892 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.874+0000 7fd4589e0640 1 -- 10.20.193.154:0/2234412249 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd45021bd60 con 0x7fd45005dce0 2026-02-12T03:58:02.892 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.874+0000 7fd4589e0640 1 librados: init done 2026-02-12T03:58:02.892 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.875+0000 7fd4589e0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:02.892 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.875+0000 7fd4589e0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:02.892 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.875+0000 7fd4589e0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:02.892 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.875+0000 7fd4589e0640 1 -- 10.20.193.154:0/2234412249 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd450184a30 con 0x7fd45005dce0 2026-02-12T03:58:02.892 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.879+0000 7fd43affd640 1 -- 10.20.193.154:0/2234412249 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd4440033a0 con 0x7fd45005dce0 2026-02-12T03:58:02.892 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.879+0000 7fd43affd640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:02.892 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.879+0000 7fd43affd640 1 -- 10.20.193.154:0/2234412249 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd444005240 con 0x7fd45005dce0 2026-02-12T03:58:02.892 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.879+0000 7fd43affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:02.892 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.879+0000 7fd43affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:02.893 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.879+0000 7fd454f52640 4 set_mon_vals no callback set 2026-02-12T03:58:02.893 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.879+0000 7fd43affd640 10 monclient: dump: 2026-02-12T03:58:02.893 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:02.893 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:02.893 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.893 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:02.893 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:02.893 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:02.893 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:02.893 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:02.893 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:02.893 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:02.894 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.879+0000 7fd43affd640 1 -- 10.20.193.154:0/2234412249 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 2) ==== 51721+0+0 (unknown 3160786211 0 0) 0x7fd444011e00 con 0x7fd45005dce0 2026-02-12T03:58:02.894 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.880+0000 7fd43affd640 1 -- 10.20.193.154:0/2234412249 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(10..10 src has 1..10) ==== 1640+0+0 (unknown 1770078985 0 0) 0x7fd444013770 con 0x7fd45005dce0 2026-02-12T03:58:02.894 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.880+0000 7fd43affd640 10 client.4185.objecter ms_dispatch2 0x7fd450000b90 osd_map(10..10 src has 1..10) 2026-02-12T03:58:02.894 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.880+0000 7fd43affd640 3 client.4185.objecter handle_osd_map got epochs [10,10] > 0 2026-02-12T03:58:02.894 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.880+0000 7fd43affd640 3 client.4185.objecter handle_osd_map decoding full epoch 10 2026-02-12T03:58:02.894 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.880+0000 7fd43affd640 20 client.4185.objecter dump_active .. 0 homeless 2026-02-12T03:58:02.912 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.910+0000 7fd43affd640 1 -- 10.20.193.154:0/2234412249 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77303 (unknown 1092875540 0 3794932319) 0x7fd444017e30 con 0x7fd45005dce0 2026-02-12T03:58:02.912 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.910+0000 7fd43affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:02.912 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.910+0000 7fd43affd640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:02.944 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.942+0000 7fd4589e0640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "bb8207ce-22b9-46be-9c89-c77f2690e405", "id": 8}] 2026-02-12T03:58:02.945 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.942+0000 7fd4589e0640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "bb8207ce-22b9-46be-9c89-c77f2690e405", "id": 8}] 2026-02-12T03:58:02.945 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.942+0000 7fd4589e0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:02.945 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.942+0000 7fd4589e0640 1 -- 10.20.193.154:0/2234412249 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "osd new", "uuid": "bb8207ce-22b9-46be-9c89-c77f2690e405", "id": 8} v 0) -- 0x7fd45021c0a0 con 0x7fd45005dce0 2026-02-12T03:58:02.978 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.976+0000 7fd43affd640 1 -- 10.20.193.154:0/2234412249 <== mon.0 v1:10.20.193.91:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bb8207ce-22b9-46be-9c89-c77f2690e405", "id": 8}]=0 v11) ==== 112+0+2 (unknown 2324131396 0 3065575683) 0x7fd444017730 con 0x7fd45005dce0 2026-02-12T03:58:02.978 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.976+0000 7fd43affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "bb8207ce-22b9-46be-9c89-c77f2690e405", "id": 8}] 2026-02-12T03:58:02.978 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.976+0000 7fd43affd640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:02.979 INFO:teuthology.orchestra.run.trial154.stdout:8 2026-02-12T03:58:02.980 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.976+0000 7fd4589e0640 10 librados: watch_flush enter 2026-02-12T03:58:02.980 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.976+0000 7fd4589e0640 10 librados: watch_flush exit 2026-02-12T03:58:02.980 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.976+0000 7fd4589e0640 20 client.4185.objecter shutdown clearing up homeless session... 2026-02-12T03:58:02.980 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.976+0000 7fd4589e0640 10 client.4185.objecter successfully canceled tick 2026-02-12T03:58:02.980 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.976+0000 7fd4589e0640 10 monclient: shutdown 2026-02-12T03:58:02.981 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.976+0000 7fd4589e0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:02.981 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.976+0000 7fd4589e0640 1 -- 10.20.193.154:0/2234412249 >> v1:10.20.193.91:6789/0 conn(0x7fd45005dce0 legacy=0x7fd450218bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:02.981 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.976+0000 7fd4589e0640 1 -- 10.20.193.154:0/2234412249 shutdown_connections 2026-02-12T03:58:02.981 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.976+0000 7fd4589e0640 1 -- 10.20.193.154:0/2234412249 >> 10.20.193.154:0/2234412249 conn(0x7fd450058b60 msgr2=0x7fd450182600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:02.981 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.976+0000 7fd4589e0640 1 -- 10.20.193.154:0/2234412249 shutdown_connections 2026-02-12T03:58:02.981 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.976+0000 7fd4589e0640 1 -- 10.20.193.154:0/2234412249 wait complete. 2026-02-12T03:58:02.981 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:02.976+0000 7fd4589e0640 1 librados: shutdown 2026-02-12T03:58:02.986 DEBUG:teuthology.orchestra.run.trial154:> sudo ceph --cluster ceph osd new e6318a6d-2367-48ce-a3a1-47307de14b99 9 2026-02-12T03:58:03.051 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.047+0000 7f25e6ee9640 10 monclient: get_monmap_and_config 2026-02-12T03:58:03.051 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.047+0000 7f25e6ee9640 10 monclient: build_initial_monmap 2026-02-12T03:58:03.051 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.047+0000 7f25e6ee9640 10 monclient: monmap: 2026-02-12T03:58:03.051 INFO:teuthology.orchestra.run.trial154.stderr:epoch 0 2026-02-12T03:58:03.051 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:03.051 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:58:03.048614+0000 2026-02-12T03:58:03.051 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:58:03.048614+0000 2026-02-12T03:58:03.052 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:03.052 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:03.052 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:03.052 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:03.052 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:03.052 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:03.052 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.047+0000 7f25e6ee9640 1 Processor -- start 2026-02-12T03:58:03.052 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.047+0000 7f25e6ee9640 1 -- start start 2026-02-12T03:58:03.052 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.047+0000 7f25e6ee9640 10 monclient: init 2026-02-12T03:58:03.052 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.047+0000 7f25e6ee9640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:03.052 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.047+0000 7f25e6ee9640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T03:58:03.052 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.047+0000 7f25e6ee9640 10 monclient(hunting): picked mon.noname-a con 0x7f25e005db20 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:03.053 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.047+0000 7f25e6ee9640 10 monclient(hunting): picked mon.noname-c con 0x7f25e005dfe0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:03.053 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.047+0000 7f25e6ee9640 10 monclient(hunting): picked mon.noname-b con 0x7f25e0120220 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:03.053 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.047+0000 7f25e6ee9640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25e0120f50 con 0x7f25e005db20 2026-02-12T03:58:03.053 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.047+0000 7f25e6ee9640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25e0121140 con 0x7f25e0120220 2026-02-12T03:58:03.053 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.047+0000 7f25e6ee9640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25e0121330 con 0x7f25e005dfe0 2026-02-12T03:58:03.053 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.047+0000 7f25e6ee9640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:03.053 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.047+0000 7f25e6ee9640 10 monclient(hunting): authenticate will time out at 1083.700885s 2026-02-12T03:58:03.053 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.048+0000 7f25d7fff640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f25e005dfe0 0x7f25e005b410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.154:53420/0 (socket says 10.20.193.154:53420) 2026-02-12T03:58:03.053 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.048+0000 7f25d7fff640 1 -- 10.20.193.154:0/164049245 learned_addr learned my addr 10.20.193.154:0/164049245 (peer_addr_for_me v1:10.20.193.154:0/0) 2026-02-12T03:58:03.120 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.118+0000 7f25d77fe640 1 -- 10.20.193.154:0/164049245 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 661811283 0 0) 0x7f25e0120f50 con 0x7f25e005db20 2026-02-12T03:58:03.121 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.118+0000 7f25d77fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:03.121 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.118+0000 7f25d77fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:03.121 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.118+0000 7f25d77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:03.121 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.118+0000 7f25d77fe640 10 monclient(hunting): my global_id is 4188 2026-02-12T03:58:03.121 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.118+0000 7f25d77fe640 1 -- 10.20.193.154:0/164049245 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f25cc003610 con 0x7f25e005db20 2026-02-12T03:58:03.128 INFO:tasks.ceph.mgr.y.trial091.stderr:2026-02-12T03:58:03.126+0000 7f0a8c819640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-12T03:58:03.131 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.129+0000 7f25d77fe640 1 -- 10.20.193.154:0/164049245 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 673534709 0 0) 0x7f25e0121140 con 0x7f25e0120220 2026-02-12T03:58:03.131 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.129+0000 7f25d77fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:03.131 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.129+0000 7f25d77fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:03.131 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.129+0000 7f25d77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:03.131 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.129+0000 7f25d77fe640 10 monclient(hunting): my global_id is 4186 2026-02-12T03:58:03.131 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.129+0000 7f25d77fe640 1 -- 10.20.193.154:0/164049245 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f25e0120f50 con 0x7f25e0120220 2026-02-12T03:58:03.136 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.131+0000 7f25d77fe640 1 -- 10.20.193.154:0/164049245 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 905237752 0 0) 0x7f25e0120f50 con 0x7f25e0120220 2026-02-12T03:58:03.136 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.131+0000 7f25d77fe640 1 -- 10.20.193.154:0/164049245 >> v1:10.20.193.111:6789/0 conn(0x7f25e005dfe0 legacy=0x7f25e005b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:03.136 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.131+0000 7f25d77fe640 1 -- 10.20.193.154:0/164049245 >> v1:10.20.193.91:6789/0 conn(0x7f25e005db20 legacy=0x7f25e005ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:03.136 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.131+0000 7f25d77fe640 10 monclient: _finish_hunting 0 2026-02-12T03:58:03.136 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.131+0000 7f25d77fe640 1 monclient: found mon.noname-b 2026-02-12T03:58:03.136 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.131+0000 7f25d77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:03.136 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.131+0000 7f25d77fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T03:58:03.137 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.131+0000 7f25d77fe640 1 -- 10.20.193.154:0/164049245 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e01215c0 con 0x7f25e0120220 2026-02-12T03:58:03.137 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.131+0000 7f25d77fe640 10 monclient: _finish_auth 0 2026-02-12T03:58:03.137 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.131+0000 7f25d77fe640 10 monclient: _check_auth_tickets 2026-02-12T03:58:03.137 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.131+0000 7f25d77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:03.137 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.131+0000 7f25d77fe640 1 -- 10.20.193.154:0/164049245 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f25dc003170 con 0x7f25e0120220 2026-02-12T03:58:03.137 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.131+0000 7f25d77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:03.137 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.131+0000 7f25d77fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:03.137 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.131+0000 7f25d77fe640 10 monclient: dump: 2026-02-12T03:58:03.137 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:03.137 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:03.137 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:03.138 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:03.138 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:03.138 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:03.138 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:03.138 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:03.138 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:03.138 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:03.138 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.131+0000 7f25e6ee9640 5 monclient: authenticate success, global_id 4186 2026-02-12T03:58:03.138 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.131+0000 7f25e6ee9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:03.138 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.131+0000 7f25d77fe640 1 -- 10.20.193.154:0/164049245 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f25dc0033f0 con 0x7f25e0120220 2026-02-12T03:58:03.138 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.131+0000 7f25d77fe640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:03.139 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.131+0000 7f25d77fe640 1 -- 10.20.193.154:0/164049245 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f25dc0037f0 con 0x7f25e0120220 2026-02-12T03:58:03.139 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.131+0000 7f25d77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:03.139 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.131+0000 7f25d77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:03.139 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.131+0000 7f25d77fe640 10 monclient: dump: 2026-02-12T03:58:03.139 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:03.139 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:03.139 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:03.139 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:03.139 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:03.139 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:03.139 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:03.139 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:03.140 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:03.140 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:03.140 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.131+0000 7f25e6ee9640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:03.140 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.131+0000 7f25e6ee9640 4 set_mon_vals no callback set 2026-02-12T03:58:03.140 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.131+0000 7f25e6ee9640 10 monclient: shutdown 2026-02-12T03:58:03.140 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.131+0000 7f25e6ee9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:03.140 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.131+0000 7f25e6ee9640 1 -- 10.20.193.154:0/164049245 >> v1:10.20.193.98:6789/0 conn(0x7f25e0120220 legacy=0x7f25e01206c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:03.140 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.131+0000 7f25e6ee9640 1 -- 10.20.193.154:0/164049245 shutdown_connections 2026-02-12T03:58:03.140 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.131+0000 7f25e6ee9640 1 -- 10.20.193.154:0/164049245 >> 10.20.193.154:0/164049245 conn(0x7f25e0058b60 msgr2=0x7f25e0058f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:03.140 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.131+0000 7f25e6ee9640 1 -- 10.20.193.154:0/164049245 shutdown_connections 2026-02-12T03:58:03.141 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.131+0000 7f25e6ee9640 1 -- 10.20.193.154:0/164049245 wait complete. 2026-02-12T03:58:03.141 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.131+0000 7f25e6ee9640 10 monclient: build_initial_monmap 2026-02-12T03:58:03.141 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.131+0000 7f25e6ee9640 10 monclient: monmap: 2026-02-12T03:58:03.141 INFO:teuthology.orchestra.run.trial154.stderr:epoch 0 2026-02-12T03:58:03.141 INFO:teuthology.orchestra.run.trial154.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:03.141 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 0.000000 2026-02-12T03:58:03.141 INFO:teuthology.orchestra.run.trial154.stderr:created 0.000000 2026-02-12T03:58:03.141 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:03.141 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 1 2026-02-12T03:58:03.141 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:03.141 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:03.142 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:03.142 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:03.142 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.131+0000 7f25e6ee9640 1 librados: starting msgr at 2026-02-12T03:58:03.142 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.131+0000 7f25e6ee9640 1 librados: starting objecter 2026-02-12T03:58:03.142 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.131+0000 7f25e6ee9640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:03.142 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.131+0000 7f25e6ee9640 1 Processor -- start 2026-02-12T03:58:03.142 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.132+0000 7f25e6ee9640 1 -- start start 2026-02-12T03:58:03.142 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.132+0000 7f25e6ee9640 1 librados: setting wanted keys 2026-02-12T03:58:03.142 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.132+0000 7f25e6ee9640 1 librados: calling monclient init 2026-02-12T03:58:03.142 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.132+0000 7f25e6ee9640 10 monclient: init 2026-02-12T03:58:03.142 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.132+0000 7f25e6ee9640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:03.142 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.132+0000 7f25e6ee9640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T03:58:03.143 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.132+0000 7f25e6ee9640 10 monclient(hunting): picked mon.noname-b con 0x7f25e005db20 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:03.143 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.132+0000 7f25e6ee9640 10 monclient(hunting): picked mon.noname-c con 0x7f25e005dfe0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:03.143 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.132+0000 7f25e6ee9640 10 monclient(hunting): picked mon.noname-a con 0x7f25e0120220 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:03.143 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.132+0000 7f25e6ee9640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25e0106740 con 0x7f25e0120220 2026-02-12T03:58:03.143 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.132+0000 7f25e6ee9640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25e010f700 con 0x7f25e005db20 2026-02-12T03:58:03.143 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.132+0000 7f25e6ee9640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25e01108e0 con 0x7f25e005dfe0 2026-02-12T03:58:03.143 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.132+0000 7f25e6ee9640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:03.143 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.132+0000 7f25e6ee9640 10 monclient(hunting): authenticate will time out at 1083.785209s 2026-02-12T03:58:03.143 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.133+0000 7f25e4c5e640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f25e005db20 0x7f25e0105cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.154:39412/0 (socket says 10.20.193.154:39412) 2026-02-12T03:58:03.143 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.133+0000 7f25e4c5e640 1 -- 10.20.193.154:0/2293563488 learned_addr learned my addr 10.20.193.154:0/2293563488 (peer_addr_for_me v1:10.20.193.154:0/0) 2026-02-12T03:58:03.143 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.133+0000 7f25d57fa640 10 client.?.objecter ms_handle_connect 0x7f25e005db20 2026-02-12T03:58:03.143 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.133+0000 7f25d57fa640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:03.146 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.134+0000 7f25d57fa640 1 -- 10.20.193.154:0/2293563488 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 512612600 0 0) 0x7f25e010f700 con 0x7f25e005db20 2026-02-12T03:58:03.147 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.134+0000 7f25d57fa640 10 monclient(hunting): _negotiate 2026-02-12T03:58:03.147 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.134+0000 7f25d57fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:03.147 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.134+0000 7f25d57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:03.147 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.134+0000 7f25d57fa640 10 monclient(hunting): my global_id is 4189 2026-02-12T03:58:03.147 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.134+0000 7f25d57fa640 1 -- 10.20.193.154:0/2293563488 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f25b0003610 con 0x7f25e005db20 2026-02-12T03:58:03.147 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.136+0000 7f25d57fa640 1 -- 10.20.193.154:0/2293563488 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2935006202 0 0) 0x7f25b0003610 con 0x7f25e005db20 2026-02-12T03:58:03.147 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.136+0000 7f25d57fa640 1 -- 10.20.193.154:0/2293563488 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f25e010f700 con 0x7f25e005db20 2026-02-12T03:58:03.147 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.136+0000 7f25d57fa640 1 -- 10.20.193.154:0/2293563488 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f25d0003170 con 0x7f25e005db20 2026-02-12T03:58:03.147 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.136+0000 7f25d57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:03.147 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.136+0000 7f25d57fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:03.148 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.136+0000 7f25d57fa640 10 monclient(hunting): dump: 2026-02-12T03:58:03.148 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:03.148 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:03.148 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:03.148 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:03.148 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:03.148 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:03.148 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:03.148 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:03.148 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:03.148 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:03.148 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.136+0000 7f25d57fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:03.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.138+0000 7f25d57fa640 1 -- 10.20.193.154:0/2293563488 <== mon.1 v1:10.20.193.98:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1477378140 0 0) 0x7f25e010f700 con 0x7f25e005db20 2026-02-12T03:58:03.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.138+0000 7f25d57fa640 1 -- 10.20.193.154:0/2293563488 >> v1:10.20.193.111:6789/0 conn(0x7f25e005dfe0 legacy=0x7f25e018a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:03.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.138+0000 7f25d57fa640 1 -- 10.20.193.154:0/2293563488 >> v1:10.20.193.91:6789/0 conn(0x7f25e0120220 legacy=0x7f25e018aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:03.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.138+0000 7f25d57fa640 10 monclient: _finish_hunting 0 2026-02-12T03:58:03.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.138+0000 7f25d57fa640 1 monclient: found mon.b 2026-02-12T03:58:03.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.138+0000 7f25d57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:03.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.138+0000 7f25d57fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:03.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.138+0000 7f25d57fa640 1 -- 10.20.193.154:0/2293563488 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e0111ac0 con 0x7f25e005db20 2026-02-12T03:58:03.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.138+0000 7f25d57fa640 10 monclient: _finish_auth 0 2026-02-12T03:58:03.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.138+0000 7f25d57fa640 10 monclient: _check_auth_tickets 2026-02-12T03:58:03.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.138+0000 7f25d57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:03.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.138+0000 7f25e6ee9640 5 monclient: authenticate success, global_id 4189 2026-02-12T03:58:03.149 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.138+0000 7f25e6ee9640 10 monclient: _renew_subs 2026-02-12T03:58:03.150 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.138+0000 7f25e6ee9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:03.150 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.138+0000 7f25e6ee9640 1 -- 10.20.193.154:0/2293563488 --> v1:10.20.193.98:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f25e0110ab0 con 0x7f25e005db20 2026-02-12T03:58:03.150 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.138+0000 7f25e6ee9640 10 client.4189.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:03.150 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.138+0000 7f25e6ee9640 10 monclient: _renew_subs 2026-02-12T03:58:03.150 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.138+0000 7f25e6ee9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:03.150 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.138+0000 7f25e6ee9640 1 -- 10.20.193.154:0/2293563488 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f25e01110a0 con 0x7f25e005db20 2026-02-12T03:58:03.150 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.138+0000 7f25e6ee9640 1 librados: init done 2026-02-12T03:58:03.150 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.139+0000 7f25e6ee9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:03.150 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.139+0000 7f25e6ee9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:03.150 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.139+0000 7f25e6ee9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:03.150 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.139+0000 7f25e6ee9640 1 -- 10.20.193.154:0/2293563488 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25e018b830 con 0x7f25e005db20 2026-02-12T03:58:03.209 INFO:tasks.ceph.mgr.y.trial091.stderr:2026-02-12T03:58:03.207+0000 7f0a8c819640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-12T03:58:03.233 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.231+0000 7f25d57fa640 1 -- 10.20.193.154:0/2293563488 <== mon.1 v1:10.20.193.98:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f25d0003520 con 0x7f25e005db20 2026-02-12T03:58:03.233 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.231+0000 7f25d57fa640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:03.233 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.231+0000 7f25d57fa640 1 -- 10.20.193.154:0/2293563488 <== mon.1 v1:10.20.193.98:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f25d0003b90 con 0x7f25e005db20 2026-02-12T03:58:03.234 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.231+0000 7f25d57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:03.234 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.231+0000 7f25d57fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:03.234 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.231+0000 7f25d57fa640 10 monclient: dump: 2026-02-12T03:58:03.234 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:03.234 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:03.234 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:03.234 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:03.234 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:03.234 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:03.234 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:03.234 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:03.234 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:03.235 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:03.235 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.231+0000 7f25d6ffd640 4 set_mon_vals no callback set 2026-02-12T03:58:03.236 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.232+0000 7f25d57fa640 1 -- 10.20.193.154:0/2293563488 <== mon.1 v1:10.20.193.98:6789/0 7 ==== mgrmap(e 3) ==== 103062+0+0 (unknown 3263092698 0 0) 0x7f25d0003d70 con 0x7f25e005db20 2026-02-12T03:58:03.236 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.232+0000 7f25d7fff640 10 monclient: get_auth_request con 0x7f25b0079d00 auth_method 0 2026-02-12T03:58:03.236 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.232+0000 7f25d57fa640 10 client.4189.objecter ms_handle_connect 0x7f25b0079d00 2026-02-12T03:58:03.236 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.233+0000 7f25d57fa640 1 -- 10.20.193.154:0/2293563488 <== mon.1 v1:10.20.193.98:6789/0 8 ==== osd_map(11..11 src has 1..11) ==== 1755+0+0 (unknown 3554283497 0 0) 0x7f25d005af40 con 0x7f25e005db20 2026-02-12T03:58:03.236 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.233+0000 7f25d57fa640 10 client.4189.objecter ms_dispatch2 0x7f25e0000b90 osd_map(11..11 src has 1..11) 2026-02-12T03:58:03.236 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.233+0000 7f25d57fa640 3 client.4189.objecter handle_osd_map got epochs [11,11] > 0 2026-02-12T03:58:03.236 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.233+0000 7f25d57fa640 3 client.4189.objecter handle_osd_map decoding full epoch 11 2026-02-12T03:58:03.236 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.233+0000 7f25d57fa640 20 client.4189.objecter dump_active .. 0 homeless 2026-02-12T03:58:03.237 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.234+0000 7f25d57fa640 1 -- 10.20.193.154:0/2293563488 <== mon.1 v1:10.20.193.98:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f25d005f6b0 con 0x7f25e005db20 2026-02-12T03:58:03.237 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.234+0000 7f25d57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:03.237 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.234+0000 7f25d57fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:03.347 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.344+0000 7f25e6ee9640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "e6318a6d-2367-48ce-a3a1-47307de14b99", "id": 9}] 2026-02-12T03:58:03.347 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.344+0000 7f25e6ee9640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "e6318a6d-2367-48ce-a3a1-47307de14b99", "id": 9}] 2026-02-12T03:58:03.347 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.344+0000 7f25e6ee9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:03.347 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.344+0000 7f25e6ee9640 1 -- 10.20.193.154:0/2293563488 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "osd new", "uuid": "e6318a6d-2367-48ce-a3a1-47307de14b99", "id": 9} v 0) -- 0x7f25e01113e0 con 0x7f25e005db20 2026-02-12T03:58:03.394 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.392+0000 7f25d57fa640 1 -- 10.20.193.154:0/2293563488 <== mon.1 v1:10.20.193.98:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e6318a6d-2367-48ce-a3a1-47307de14b99", "id": 9}]=0 v12) ==== 112+0+2 (unknown 2557706326 0 2769969524) 0x7f25d005efb0 con 0x7f25e005db20 2026-02-12T03:58:03.394 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.392+0000 7f25d57fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "e6318a6d-2367-48ce-a3a1-47307de14b99", "id": 9}] 2026-02-12T03:58:03.394 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.392+0000 7f25d57fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:03.394 INFO:teuthology.orchestra.run.trial154.stdout:9 2026-02-12T03:58:03.396 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.393+0000 7f25e6ee9640 10 librados: watch_flush enter 2026-02-12T03:58:03.396 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.393+0000 7f25e6ee9640 10 librados: watch_flush exit 2026-02-12T03:58:03.397 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.393+0000 7f25e6ee9640 20 client.4189.objecter shutdown clearing up homeless session... 2026-02-12T03:58:03.397 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.393+0000 7f25e6ee9640 10 client.4189.objecter successfully canceled tick 2026-02-12T03:58:03.397 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.393+0000 7f25e6ee9640 1 -- 10.20.193.154:0/2293563488 >> v1:10.20.193.91:6800/2929217192 conn(0x7f25b0079d00 legacy=0x7f25b009a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:03.397 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.393+0000 7f25e6ee9640 10 monclient: shutdown 2026-02-12T03:58:03.397 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.393+0000 7f25e6ee9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:03.397 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.393+0000 7f25e6ee9640 1 -- 10.20.193.154:0/2293563488 >> v1:10.20.193.98:6789/0 conn(0x7f25e005db20 legacy=0x7f25e0105cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:03.397 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.393+0000 7f25e6ee9640 1 -- 10.20.193.154:0/2293563488 shutdown_connections 2026-02-12T03:58:03.397 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.393+0000 7f25e6ee9640 1 -- 10.20.193.154:0/2293563488 >> 10.20.193.154:0/2293563488 conn(0x7f25e0058b60 msgr2=0x7f25e01003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:03.397 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.393+0000 7f25e6ee9640 1 -- 10.20.193.154:0/2293563488 shutdown_connections 2026-02-12T03:58:03.397 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.393+0000 7f25e6ee9640 1 -- 10.20.193.154:0/2293563488 wait complete. 2026-02-12T03:58:03.397 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.393+0000 7f25e6ee9640 1 librados: shutdown 2026-02-12T03:58:03.405 DEBUG:teuthology.orchestra.run.trial154:> sudo ceph --cluster ceph osd new cd6c97a2-bdfe-4b86-afeb-217315976d6c 10 2026-02-12T03:58:03.470 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.466+0000 7f84579a2640 10 monclient: get_monmap_and_config 2026-02-12T03:58:03.470 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.466+0000 7f84579a2640 10 monclient: build_initial_monmap 2026-02-12T03:58:03.470 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.466+0000 7f84579a2640 10 monclient: monmap: 2026-02-12T03:58:03.470 INFO:teuthology.orchestra.run.trial154.stderr:epoch 0 2026-02-12T03:58:03.470 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:03.471 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:58:03.467665+0000 2026-02-12T03:58:03.471 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:58:03.467665+0000 2026-02-12T03:58:03.471 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:03.471 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:03.471 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:03.471 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:03.471 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:03.471 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:03.471 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.466+0000 7f84579a2640 1 Processor -- start 2026-02-12T03:58:03.471 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.466+0000 7f84579a2640 1 -- start start 2026-02-12T03:58:03.471 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.466+0000 7f84579a2640 10 monclient: init 2026-02-12T03:58:03.472 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.466+0000 7f84579a2640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:03.472 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.466+0000 7f84579a2640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T03:58:03.472 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.466+0000 7f84579a2640 10 monclient(hunting): picked mon.noname-a con 0x7f845005db20 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:03.472 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.466+0000 7f84579a2640 10 monclient(hunting): picked mon.noname-b con 0x7f845005dfe0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:03.472 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.466+0000 7f84579a2640 10 monclient(hunting): picked mon.noname-c con 0x7f84501624d0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:03.472 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.466+0000 7f84579a2640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8450184210 con 0x7f845005db20 2026-02-12T03:58:03.472 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.466+0000 7f84579a2640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8450185410 con 0x7f845005dfe0 2026-02-12T03:58:03.472 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.466+0000 7f84579a2640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8450186610 con 0x7f84501624d0 2026-02-12T03:58:03.472 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.466+0000 7f84579a2640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:03.472 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.466+0000 7f84579a2640 10 monclient(hunting): authenticate will time out at 1084.119907s 2026-02-12T03:58:03.472 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.467+0000 7f8454f16640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f845005dfe0 0x7f845005b410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.154:39414/0 (socket says 10.20.193.154:39414) 2026-02-12T03:58:03.472 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.467+0000 7f8454f16640 1 -- 10.20.193.154:0/276183196 learned_addr learned my addr 10.20.193.154:0/276183196 (peer_addr_for_me v1:10.20.193.154:0/0) 2026-02-12T03:58:03.481 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.468+0000 7f843ffff640 1 -- 10.20.193.154:0/276183196 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3684029663 0 0) 0x7f8450185410 con 0x7f845005dfe0 2026-02-12T03:58:03.481 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.468+0000 7f843ffff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:03.481 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.468+0000 7f843ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:03.481 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.468+0000 7f843ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:03.481 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.468+0000 7f843ffff640 10 monclient(hunting): my global_id is 4192 2026-02-12T03:58:03.481 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.468+0000 7f843ffff640 1 -- 10.20.193.154:0/276183196 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8438003610 con 0x7f845005dfe0 2026-02-12T03:58:03.481 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.468+0000 7f843ffff640 1 -- 10.20.193.154:0/276183196 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3664938898 0 0) 0x7f8450186610 con 0x7f84501624d0 2026-02-12T03:58:03.481 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.468+0000 7f843ffff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:03.482 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.468+0000 7f843ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:03.482 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.468+0000 7f843ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:03.482 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.468+0000 7f843ffff640 10 monclient(hunting): my global_id is 4160 2026-02-12T03:58:03.482 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.468+0000 7f843ffff640 1 -- 10.20.193.154:0/276183196 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8450185410 con 0x7f84501624d0 2026-02-12T03:58:03.482 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.468+0000 7f843ffff640 1 -- 10.20.193.154:0/276183196 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1730491236 0 0) 0x7f8450184210 con 0x7f845005db20 2026-02-12T03:58:03.482 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.468+0000 7f843ffff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:03.482 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.468+0000 7f843ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:03.482 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.468+0000 7f843ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:03.482 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.468+0000 7f843ffff640 10 monclient(hunting): my global_id is 4191 2026-02-12T03:58:03.482 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.468+0000 7f843ffff640 1 -- 10.20.193.154:0/276183196 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8450186610 con 0x7f845005db20 2026-02-12T03:58:03.482 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.470+0000 7f843ffff640 1 -- 10.20.193.154:0/276183196 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1727847755 0 0) 0x7f8438003610 con 0x7f845005dfe0 2026-02-12T03:58:03.483 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.470+0000 7f843ffff640 1 -- 10.20.193.154:0/276183196 >> v1:10.20.193.111:6789/0 conn(0x7f84501624d0 legacy=0x7f8450182910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:03.483 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.470+0000 7f843ffff640 1 -- 10.20.193.154:0/276183196 >> v1:10.20.193.91:6789/0 conn(0x7f845005db20 legacy=0x7f845005ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:03.483 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.470+0000 7f843ffff640 10 monclient: _finish_hunting 0 2026-02-12T03:58:03.483 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.470+0000 7f843ffff640 1 monclient: found mon.noname-b 2026-02-12T03:58:03.483 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.470+0000 7f843ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:03.483 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.470+0000 7f843ffff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T03:58:03.483 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.470+0000 7f843ffff640 1 -- 10.20.193.154:0/276183196 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84501878b0 con 0x7f845005dfe0 2026-02-12T03:58:03.483 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.470+0000 7f843ffff640 10 monclient: _finish_auth 0 2026-02-12T03:58:03.483 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.470+0000 7f843ffff640 10 monclient: _check_auth_tickets 2026-02-12T03:58:03.483 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.470+0000 7f843ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:03.483 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.470+0000 7f84579a2640 5 monclient: authenticate success, global_id 4192 2026-02-12T03:58:03.484 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.470+0000 7f843ffff640 1 -- 10.20.193.154:0/276183196 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8444002df0 con 0x7f845005dfe0 2026-02-12T03:58:03.484 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.470+0000 7f843ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:03.484 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.470+0000 7f843ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:03.484 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.470+0000 7f843ffff640 10 monclient: dump: 2026-02-12T03:58:03.484 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:03.484 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:03.484 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:03.484 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:03.484 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:03.484 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:03.484 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:03.484 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:03.485 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:03.485 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:03.485 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.470+0000 7f84579a2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:03.485 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.471+0000 7f843ffff640 1 -- 10.20.193.154:0/276183196 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8444003030 con 0x7f845005dfe0 2026-02-12T03:58:03.485 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.471+0000 7f843ffff640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:03.485 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.471+0000 7f843ffff640 1 -- 10.20.193.154:0/276183196 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8444003470 con 0x7f845005dfe0 2026-02-12T03:58:03.485 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.471+0000 7f84579a2640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:03.485 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.471+0000 7f84579a2640 4 set_mon_vals no callback set 2026-02-12T03:58:03.485 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.471+0000 7f843ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:03.485 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.471+0000 7f843ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:03.486 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.471+0000 7f843ffff640 10 monclient: dump: 2026-02-12T03:58:03.486 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:03.486 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:03.486 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:03.486 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:03.486 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:03.486 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:03.486 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:03.486 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:03.486 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:03.486 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:03.486 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.471+0000 7f84579a2640 10 monclient: shutdown 2026-02-12T03:58:03.487 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.471+0000 7f84579a2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:03.487 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.471+0000 7f84579a2640 1 -- 10.20.193.154:0/276183196 >> v1:10.20.193.98:6789/0 conn(0x7f845005dfe0 legacy=0x7f845005b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:03.487 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.471+0000 7f84579a2640 1 -- 10.20.193.154:0/276183196 shutdown_connections 2026-02-12T03:58:03.487 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.471+0000 7f84579a2640 1 -- 10.20.193.154:0/276183196 >> 10.20.193.154:0/276183196 conn(0x7f8450058b60 msgr2=0x7f8450058f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:03.487 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.471+0000 7f84579a2640 1 -- 10.20.193.154:0/276183196 shutdown_connections 2026-02-12T03:58:03.487 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.471+0000 7f84579a2640 1 -- 10.20.193.154:0/276183196 wait complete. 2026-02-12T03:58:03.487 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.471+0000 7f84579a2640 10 monclient: build_initial_monmap 2026-02-12T03:58:03.487 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.471+0000 7f84579a2640 10 monclient: monmap: 2026-02-12T03:58:03.487 INFO:teuthology.orchestra.run.trial154.stderr:epoch 0 2026-02-12T03:58:03.487 INFO:teuthology.orchestra.run.trial154.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:03.487 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 0.000000 2026-02-12T03:58:03.488 INFO:teuthology.orchestra.run.trial154.stderr:created 0.000000 2026-02-12T03:58:03.488 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:03.488 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 1 2026-02-12T03:58:03.488 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:03.488 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:03.488 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:03.488 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:03.488 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.471+0000 7f84579a2640 1 librados: starting msgr at 2026-02-12T03:58:03.488 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.471+0000 7f84579a2640 1 librados: starting objecter 2026-02-12T03:58:03.488 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.471+0000 7f84579a2640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:03.488 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.471+0000 7f84579a2640 1 Processor -- start 2026-02-12T03:58:03.488 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.471+0000 7f84579a2640 1 -- start start 2026-02-12T03:58:03.488 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.471+0000 7f84579a2640 1 librados: setting wanted keys 2026-02-12T03:58:03.489 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.471+0000 7f84579a2640 1 librados: calling monclient init 2026-02-12T03:58:03.489 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.471+0000 7f84579a2640 10 monclient: init 2026-02-12T03:58:03.489 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.472+0000 7f84579a2640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:03.489 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.472+0000 7f84579a2640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T03:58:03.489 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.472+0000 7f84579a2640 10 monclient(hunting): picked mon.noname-b con 0x7f845005db20 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:03.489 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.472+0000 7f84579a2640 10 monclient(hunting): picked mon.noname-c con 0x7f845005dfe0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:03.489 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.472+0000 7f84579a2640 10 monclient(hunting): picked mon.noname-a con 0x7f84501624d0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:03.489 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.472+0000 7f84579a2640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8450150700 con 0x7f84501624d0 2026-02-12T03:58:03.489 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.472+0000 7f84579a2640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84501518e0 con 0x7f845005db20 2026-02-12T03:58:03.489 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.472+0000 7f84579a2640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8450152ac0 con 0x7f845005dfe0 2026-02-12T03:58:03.489 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.472+0000 7f84579a2640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:03.490 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.472+0000 7f84579a2640 10 monclient(hunting): authenticate will time out at 1084.125103s 2026-02-12T03:58:03.490 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.472+0000 7f8455717640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f845005db20 0x7f8450106ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.154:39426/0 (socket says 10.20.193.154:39426) 2026-02-12T03:58:03.490 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.472+0000 7f8455717640 1 -- 10.20.193.154:0/616807494 learned_addr learned my addr 10.20.193.154:0/616807494 (peer_addr_for_me v1:10.20.193.154:0/0) 2026-02-12T03:58:03.490 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.472+0000 7f843dffb640 10 client.?.objecter ms_handle_connect 0x7f845005db20 2026-02-12T03:58:03.490 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.472+0000 7f843dffb640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:03.490 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.472+0000 7f843dffb640 10 client.?.objecter ms_handle_connect 0x7f845005dfe0 2026-02-12T03:58:03.490 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.472+0000 7f843dffb640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:03.490 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.473+0000 7f843dffb640 10 client.?.objecter ms_handle_connect 0x7f84501624d0 2026-02-12T03:58:03.490 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.473+0000 7f843dffb640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:03.490 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.473+0000 7f843dffb640 1 -- 10.20.193.154:0/616807494 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4172143572 0 0) 0x7f84501518e0 con 0x7f845005db20 2026-02-12T03:58:03.490 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.473+0000 7f843dffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:03.491 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.473+0000 7f843dffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:03.491 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.473+0000 7f843dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:03.491 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.473+0000 7f843dffb640 10 monclient(hunting): my global_id is 4195 2026-02-12T03:58:03.491 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.473+0000 7f843dffb640 1 -- 10.20.193.154:0/616807494 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8420003610 con 0x7f845005db20 2026-02-12T03:58:03.491 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.473+0000 7f843dffb640 1 -- 10.20.193.154:0/616807494 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3573400676 0 0) 0x7f8450152ac0 con 0x7f845005dfe0 2026-02-12T03:58:03.491 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.473+0000 7f843dffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:03.491 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.473+0000 7f843dffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:03.491 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.473+0000 7f843dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:03.491 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.473+0000 7f843dffb640 10 monclient(hunting): my global_id is 4163 2026-02-12T03:58:03.491 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.473+0000 7f843dffb640 1 -- 10.20.193.154:0/616807494 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84501518e0 con 0x7f845005dfe0 2026-02-12T03:58:03.491 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.475+0000 7f843dffb640 1 -- 10.20.193.154:0/616807494 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3579125506 0 0) 0x7f8450150700 con 0x7f84501624d0 2026-02-12T03:58:03.491 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.475+0000 7f843dffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:03.492 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.475+0000 7f843dffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:03.492 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.475+0000 7f843dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:03.492 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.475+0000 7f843dffb640 10 monclient(hunting): my global_id is 4194 2026-02-12T03:58:03.492 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.475+0000 7f843dffb640 1 -- 10.20.193.154:0/616807494 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8450152ac0 con 0x7f84501624d0 2026-02-12T03:58:03.492 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.475+0000 7f843dffb640 1 -- 10.20.193.154:0/616807494 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3470056957 0 0) 0x7f8420003610 con 0x7f845005db20 2026-02-12T03:58:03.492 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.475+0000 7f843dffb640 1 -- 10.20.193.154:0/616807494 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8450150700 con 0x7f845005db20 2026-02-12T03:58:03.492 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.475+0000 7f843dffb640 1 -- 10.20.193.154:0/616807494 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8440003170 con 0x7f845005db20 2026-02-12T03:58:03.492 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.475+0000 7f843dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:03.492 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.475+0000 7f843dffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:03.492 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.475+0000 7f843dffb640 10 monclient(hunting): dump: 2026-02-12T03:58:03.492 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:03.493 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:03.493 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:03.493 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:03.493 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:03.493 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:03.493 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:03.493 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:03.493 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:03.493 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:03.493 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.475+0000 7f843dffb640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:03.493 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.476+0000 7f843dffb640 1 -- 10.20.193.154:0/616807494 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3127188923 0 0) 0x7f84501518e0 con 0x7f845005dfe0 2026-02-12T03:58:03.493 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.476+0000 7f843dffb640 1 -- 10.20.193.154:0/616807494 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8420003610 con 0x7f845005dfe0 2026-02-12T03:58:03.494 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.476+0000 7f843dffb640 1 -- 10.20.193.154:0/616807494 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8444003380 con 0x7f845005dfe0 2026-02-12T03:58:03.494 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.476+0000 7f843dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:03.494 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.476+0000 7f843dffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:03.494 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.476+0000 7f843dffb640 10 monclient(hunting): dump: 2026-02-12T03:58:03.494 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:03.494 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:03.494 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:03.494 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:03.494 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:03.494 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:03.494 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:03.494 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:03.494 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:03.495 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:03.495 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.477+0000 7f843dffb640 1 -- 10.20.193.154:0/616807494 <== mon.1 v1:10.20.193.98:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1172741201 0 0) 0x7f8450150700 con 0x7f845005db20 2026-02-12T03:58:03.495 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.477+0000 7f843dffb640 1 -- 10.20.193.154:0/616807494 >> v1:10.20.193.111:6789/0 conn(0x7f845005dfe0 legacy=0x7f845014d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:03.495 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.477+0000 7f843dffb640 1 -- 10.20.193.154:0/616807494 >> v1:10.20.193.91:6789/0 conn(0x7f84501624d0 legacy=0x7f845014efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:03.495 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.477+0000 7f843dffb640 10 monclient: _finish_hunting 0 2026-02-12T03:58:03.495 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.477+0000 7f843dffb640 1 monclient: found mon.b 2026-02-12T03:58:03.495 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.477+0000 7f843dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:03.495 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.477+0000 7f843dffb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:03.495 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.477+0000 7f843dffb640 1 -- 10.20.193.154:0/616807494 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8450153ca0 con 0x7f845005db20 2026-02-12T03:58:03.495 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.477+0000 7f843dffb640 10 monclient: _finish_auth 0 2026-02-12T03:58:03.495 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.477+0000 7f843dffb640 10 monclient: _check_auth_tickets 2026-02-12T03:58:03.495 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.477+0000 7f843dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:03.496 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.477+0000 7f84579a2640 5 monclient: authenticate success, global_id 4195 2026-02-12T03:58:03.496 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.477+0000 7f84579a2640 10 monclient: _renew_subs 2026-02-12T03:58:03.496 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.477+0000 7f84579a2640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:03.496 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.477+0000 7f84579a2640 1 -- 10.20.193.154:0/616807494 --> v1:10.20.193.98:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8450152c90 con 0x7f845005db20 2026-02-12T03:58:03.496 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.477+0000 7f84579a2640 10 client.4195.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:03.496 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.477+0000 7f84579a2640 10 monclient: _renew_subs 2026-02-12T03:58:03.496 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.477+0000 7f84579a2640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:03.496 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.477+0000 7f84579a2640 1 -- 10.20.193.154:0/616807494 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8450153230 con 0x7f845005db20 2026-02-12T03:58:03.496 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.477+0000 7f84579a2640 1 librados: init done 2026-02-12T03:58:03.496 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.477+0000 7f84579a2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:03.496 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.477+0000 7f84579a2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:03.496 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.477+0000 7f84579a2640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:03.496 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.477+0000 7f84579a2640 1 -- 10.20.193.154:0/616807494 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8450186d30 con 0x7f845005db20 2026-02-12T03:58:03.571 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.569+0000 7f843dffb640 1 -- 10.20.193.154:0/616807494 <== mon.1 v1:10.20.193.98:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f84400034e0 con 0x7f845005db20 2026-02-12T03:58:03.572 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.569+0000 7f843dffb640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:03.572 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.569+0000 7f843dffb640 1 -- 10.20.193.154:0/616807494 <== mon.1 v1:10.20.193.98:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8440003b50 con 0x7f845005db20 2026-02-12T03:58:03.572 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.569+0000 7f843dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:03.572 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.569+0000 7f843dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:03.572 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.569+0000 7f843dffb640 10 monclient: dump: 2026-02-12T03:58:03.572 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:03.572 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:03.572 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:03.572 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:03.573 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:03.573 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:03.573 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:03.573 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:03.573 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:03.573 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:03.573 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.569+0000 7f843f7fe640 4 set_mon_vals no callback set 2026-02-12T03:58:03.574 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.570+0000 7f843dffb640 1 -- 10.20.193.154:0/616807494 <== mon.1 v1:10.20.193.98:6789/0 7 ==== mgrmap(e 3) ==== 103062+0+0 (unknown 3263092698 0 0) 0x7f8440003d30 con 0x7f845005db20 2026-02-12T03:58:03.574 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.570+0000 7f8454f16640 10 monclient: get_auth_request con 0x7f8420079d50 auth_method 0 2026-02-12T03:58:03.574 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.571+0000 7f843dffb640 10 client.4195.objecter ms_handle_connect 0x7f8420079d50 2026-02-12T03:58:03.575 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.572+0000 7f843dffb640 1 -- 10.20.193.154:0/616807494 <== mon.1 v1:10.20.193.98:6789/0 8 ==== osd_map(12..12 src has 1..12) ==== 1870+0+0 (unknown 3141430228 0 0) 0x7f844005ae70 con 0x7f845005db20 2026-02-12T03:58:03.575 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.572+0000 7f843dffb640 10 client.4195.objecter ms_dispatch2 0x7f8450000b90 osd_map(12..12 src has 1..12) 2026-02-12T03:58:03.575 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.572+0000 7f843dffb640 3 client.4195.objecter handle_osd_map got epochs [12,12] > 0 2026-02-12T03:58:03.575 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.572+0000 7f843dffb640 3 client.4195.objecter handle_osd_map decoding full epoch 12 2026-02-12T03:58:03.575 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.572+0000 7f843dffb640 20 client.4195.objecter dump_active .. 0 homeless 2026-02-12T03:58:03.576 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.572+0000 7f843dffb640 1 -- 10.20.193.154:0/616807494 <== mon.1 v1:10.20.193.98:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f844005f5e0 con 0x7f845005db20 2026-02-12T03:58:03.576 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.572+0000 7f843dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:03.576 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.572+0000 7f843dffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:03.685 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.682+0000 7f84579a2640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "cd6c97a2-bdfe-4b86-afeb-217315976d6c", "id": 10}] 2026-02-12T03:58:03.685 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.682+0000 7f84579a2640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "cd6c97a2-bdfe-4b86-afeb-217315976d6c", "id": 10}] 2026-02-12T03:58:03.685 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.682+0000 7f84579a2640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:03.685 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.682+0000 7f84579a2640 1 -- 10.20.193.154:0/616807494 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "osd new", "uuid": "cd6c97a2-bdfe-4b86-afeb-217315976d6c", "id": 10} v 0) -- 0x7f8450153a40 con 0x7f845005db20 2026-02-12T03:58:03.728 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.726+0000 7f843dffb640 1 -- 10.20.193.154:0/616807494 <== mon.1 v1:10.20.193.98:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cd6c97a2-bdfe-4b86-afeb-217315976d6c", "id": 10}]=0 v13) ==== 113+0+3 (unknown 808834674 0 520826459) 0x7f844005eee0 con 0x7f845005db20 2026-02-12T03:58:03.728 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.726+0000 7f843dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "cd6c97a2-bdfe-4b86-afeb-217315976d6c", "id": 10}] 2026-02-12T03:58:03.729 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.726+0000 7f843dffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:03.729 INFO:teuthology.orchestra.run.trial154.stdout:10 2026-02-12T03:58:03.731 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.728+0000 7f84579a2640 10 librados: watch_flush enter 2026-02-12T03:58:03.731 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.728+0000 7f84579a2640 10 librados: watch_flush exit 2026-02-12T03:58:03.731 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.728+0000 7f84579a2640 20 client.4195.objecter shutdown clearing up homeless session... 2026-02-12T03:58:03.731 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.728+0000 7f84579a2640 10 client.4195.objecter successfully canceled tick 2026-02-12T03:58:03.731 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.728+0000 7f84579a2640 1 -- 10.20.193.154:0/616807494 >> v1:10.20.193.91:6800/2929217192 conn(0x7f8420079d50 legacy=0x7f842009a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:03.732 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.728+0000 7f84579a2640 10 monclient: shutdown 2026-02-12T03:58:03.732 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.728+0000 7f84579a2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:03.732 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.728+0000 7f84579a2640 1 -- 10.20.193.154:0/616807494 >> v1:10.20.193.98:6789/0 conn(0x7f845005db20 legacy=0x7f8450106ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:03.732 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.728+0000 7f84579a2640 1 -- 10.20.193.154:0/616807494 shutdown_connections 2026-02-12T03:58:03.732 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.728+0000 7f84579a2640 1 -- 10.20.193.154:0/616807494 >> 10.20.193.154:0/616807494 conn(0x7f8450058b60 msgr2=0x7f8450182910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:03.732 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.728+0000 7f84579a2640 1 -- 10.20.193.154:0/616807494 shutdown_connections 2026-02-12T03:58:03.732 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.728+0000 7f84579a2640 1 -- 10.20.193.154:0/616807494 wait complete. 2026-02-12T03:58:03.732 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.728+0000 7f84579a2640 1 librados: shutdown 2026-02-12T03:58:03.740 DEBUG:teuthology.orchestra.run.trial154:> sudo ceph --cluster ceph osd new b6c647bb-4e86-4b0e-b79c-b0236a780a66 11 2026-02-12T03:58:03.807 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.803+0000 7f55e2c3a640 10 monclient: get_monmap_and_config 2026-02-12T03:58:03.807 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.803+0000 7f55e2c3a640 10 monclient: build_initial_monmap 2026-02-12T03:58:03.808 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.803+0000 7f55e2c3a640 10 monclient: monmap: 2026-02-12T03:58:03.808 INFO:teuthology.orchestra.run.trial154.stderr:epoch 0 2026-02-12T03:58:03.808 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:03.808 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:58:03.805149+0000 2026-02-12T03:58:03.808 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:58:03.805149+0000 2026-02-12T03:58:03.808 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:03.808 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:03.808 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:03.808 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:03.808 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:03.809 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:03.809 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.804+0000 7f55e2c3a640 1 Processor -- start 2026-02-12T03:58:03.809 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.804+0000 7f55e2c3a640 1 -- start start 2026-02-12T03:58:03.809 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.804+0000 7f55e2c3a640 10 monclient: init 2026-02-12T03:58:03.809 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.804+0000 7f55e2c3a640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:03.809 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.804+0000 7f55e2c3a640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T03:58:03.809 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.804+0000 7f55e2c3a640 10 monclient(hunting): picked mon.noname-a con 0x7f55dc11e9e0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:03.809 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.804+0000 7f55e2c3a640 10 monclient(hunting): picked mon.noname-b con 0x7f55dc1408c0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:03.809 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.804+0000 7f55e2c3a640 10 monclient(hunting): picked mon.noname-c con 0x7f55dc162480 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:03.809 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.804+0000 7f55e2c3a640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55dc184230 con 0x7f55dc11e9e0 2026-02-12T03:58:03.809 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.804+0000 7f55e2c3a640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55dc185430 con 0x7f55dc1408c0 2026-02-12T03:58:03.809 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.804+0000 7f55e2c3a640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55dc186630 con 0x7f55dc162480 2026-02-12T03:58:03.810 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.804+0000 7f55e2c3a640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:03.810 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.804+0000 7f55e2c3a640 10 monclient(hunting): authenticate will time out at 1084.457516s 2026-02-12T03:58:03.810 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.804+0000 7f55d3fff640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f55dc1408c0 0x7f55dc160ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.154:39438/0 (socket says 10.20.193.154:39438) 2026-02-12T03:58:03.810 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.804+0000 7f55d3fff640 1 -- 10.20.193.154:0/3919872868 learned_addr learned my addr 10.20.193.154:0/3919872868 (peer_addr_for_me v1:10.20.193.154:0/0) 2026-02-12T03:58:03.816 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.806+0000 7f55d37fe640 1 -- 10.20.193.154:0/3919872868 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2315500531 0 0) 0x7f55dc185430 con 0x7f55dc1408c0 2026-02-12T03:58:03.816 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.806+0000 7f55d37fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:03.816 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.806+0000 7f55d37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:03.817 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.806+0000 7f55d37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:03.817 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.806+0000 7f55d37fe640 10 monclient(hunting): my global_id is 4198 2026-02-12T03:58:03.817 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.806+0000 7f55d37fe640 1 -- 10.20.193.154:0/3919872868 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55c8003610 con 0x7f55dc1408c0 2026-02-12T03:58:03.817 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.807+0000 7f55d37fe640 1 -- 10.20.193.154:0/3919872868 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4282582159 0 0) 0x7f55dc186630 con 0x7f55dc162480 2026-02-12T03:58:03.817 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.807+0000 7f55d37fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:03.817 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.807+0000 7f55d37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:03.817 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.807+0000 7f55d37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:03.817 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.807+0000 7f55d37fe640 10 monclient(hunting): my global_id is 4166 2026-02-12T03:58:03.817 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.807+0000 7f55d37fe640 1 -- 10.20.193.154:0/3919872868 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55dc185430 con 0x7f55dc162480 2026-02-12T03:58:03.817 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.807+0000 7f55d37fe640 1 -- 10.20.193.154:0/3919872868 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 696996261 0 0) 0x7f55dc184230 con 0x7f55dc11e9e0 2026-02-12T03:58:03.817 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.807+0000 7f55d37fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:03.818 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.807+0000 7f55d37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:03.818 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.807+0000 7f55d37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:03.818 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.807+0000 7f55d37fe640 10 monclient(hunting): my global_id is 4197 2026-02-12T03:58:03.818 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.807+0000 7f55d37fe640 1 -- 10.20.193.154:0/3919872868 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55dc186630 con 0x7f55dc11e9e0 2026-02-12T03:58:03.818 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.808+0000 7f55d37fe640 1 -- 10.20.193.154:0/3919872868 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1274704481 0 0) 0x7f55dc186630 con 0x7f55dc11e9e0 2026-02-12T03:58:03.818 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.808+0000 7f55d37fe640 1 -- 10.20.193.154:0/3919872868 >> v1:10.20.193.111:6789/0 conn(0x7f55dc162480 legacy=0x7f55dc182930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:03.818 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.808+0000 7f55d37fe640 1 -- 10.20.193.154:0/3919872868 >> v1:10.20.193.98:6789/0 conn(0x7f55dc1408c0 legacy=0x7f55dc160ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:03.818 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.808+0000 7f55d37fe640 10 monclient: _finish_hunting 0 2026-02-12T03:58:03.818 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.808+0000 7f55d37fe640 1 monclient: found mon.noname-a 2026-02-12T03:58:03.818 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.808+0000 7f55d37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:03.818 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.808+0000 7f55d37fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.91:6789/0 2026-02-12T03:58:03.819 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.808+0000 7f55d37fe640 1 -- 10.20.193.154:0/3919872868 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55dc187880 con 0x7f55dc11e9e0 2026-02-12T03:58:03.819 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.808+0000 7f55d37fe640 10 monclient: _finish_auth 0 2026-02-12T03:58:03.819 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.808+0000 7f55d37fe640 10 monclient: _check_auth_tickets 2026-02-12T03:58:03.819 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.808+0000 7f55d37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:03.819 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.808+0000 7f55d37fe640 1 -- 10.20.193.154:0/3919872868 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f55cc002dd0 con 0x7f55dc11e9e0 2026-02-12T03:58:03.819 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.808+0000 7f55d37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:03.819 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.808+0000 7f55d37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:03.819 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.808+0000 7f55d37fe640 10 monclient: dump: 2026-02-12T03:58:03.819 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:03.819 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:03.819 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:03.819 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:03.819 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:03.820 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:03.820 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:03.820 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:03.820 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:03.820 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:03.820 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.809+0000 7f55e2c3a640 5 monclient: authenticate success, global_id 4197 2026-02-12T03:58:03.820 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.809+0000 7f55e2c3a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:03.820 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.809+0000 7f55d37fe640 1 -- 10.20.193.154:0/3919872868 <== mon.0 v1:10.20.193.91:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f55cc003010 con 0x7f55dc11e9e0 2026-02-12T03:58:03.820 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.809+0000 7f55d37fe640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:03.820 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.809+0000 7f55d37fe640 1 -- 10.20.193.154:0/3919872868 <== mon.0 v1:10.20.193.91:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f55cc003450 con 0x7f55dc11e9e0 2026-02-12T03:58:03.820 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.809+0000 7f55d37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:03.820 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.809+0000 7f55d37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:03.821 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.809+0000 7f55d37fe640 10 monclient: dump: 2026-02-12T03:58:03.821 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:03.821 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:03.821 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:03.821 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:03.821 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:03.821 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:03.821 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:03.821 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:03.821 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:03.821 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:03.821 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.809+0000 7f55e2c3a640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:03.822 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.809+0000 7f55e2c3a640 4 set_mon_vals no callback set 2026-02-12T03:58:03.822 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.810+0000 7f55e2c3a640 10 monclient: shutdown 2026-02-12T03:58:03.822 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.810+0000 7f55e2c3a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:03.822 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.810+0000 7f55e2c3a640 1 -- 10.20.193.154:0/3919872868 >> v1:10.20.193.91:6789/0 conn(0x7f55dc11e9e0 legacy=0x7f55dc11edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:03.822 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.810+0000 7f55e2c3a640 1 -- 10.20.193.154:0/3919872868 shutdown_connections 2026-02-12T03:58:03.822 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.810+0000 7f55e2c3a640 1 -- 10.20.193.154:0/3919872868 >> 10.20.193.154:0/3919872868 conn(0x7f55dc055ff0 msgr2=0x7f55dc0563f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:03.822 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.810+0000 7f55e2c3a640 1 -- 10.20.193.154:0/3919872868 shutdown_connections 2026-02-12T03:58:03.822 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.810+0000 7f55e2c3a640 1 -- 10.20.193.154:0/3919872868 wait complete. 2026-02-12T03:58:03.822 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.810+0000 7f55e2c3a640 10 monclient: build_initial_monmap 2026-02-12T03:58:03.822 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.810+0000 7f55e2c3a640 10 monclient: monmap: 2026-02-12T03:58:03.822 INFO:teuthology.orchestra.run.trial154.stderr:epoch 0 2026-02-12T03:58:03.822 INFO:teuthology.orchestra.run.trial154.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:03.822 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 0.000000 2026-02-12T03:58:03.823 INFO:teuthology.orchestra.run.trial154.stderr:created 0.000000 2026-02-12T03:58:03.823 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:03.823 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 1 2026-02-12T03:58:03.823 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:03.823 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:03.823 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:03.823 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:03.823 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.810+0000 7f55e2c3a640 1 librados: starting msgr at 2026-02-12T03:58:03.823 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.810+0000 7f55e2c3a640 1 librados: starting objecter 2026-02-12T03:58:03.823 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.810+0000 7f55e2c3a640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:03.823 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.810+0000 7f55e2c3a640 1 Processor -- start 2026-02-12T03:58:03.823 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.810+0000 7f55e2c3a640 1 -- start start 2026-02-12T03:58:03.823 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.810+0000 7f55e2c3a640 1 librados: setting wanted keys 2026-02-12T03:58:03.824 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.810+0000 7f55e2c3a640 1 librados: calling monclient init 2026-02-12T03:58:03.824 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.810+0000 7f55e2c3a640 10 monclient: init 2026-02-12T03:58:03.824 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.810+0000 7f55e2c3a640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:03.824 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.810+0000 7f55e2c3a640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T03:58:03.824 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.810+0000 7f55e2c3a640 10 monclient(hunting): picked mon.noname-b con 0x7f55dc11e9e0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:03.824 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.810+0000 7f55e2c3a640 10 monclient(hunting): picked mon.noname-c con 0x7f55dc1408c0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:03.824 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.810+0000 7f55e2c3a640 10 monclient(hunting): picked mon.noname-a con 0x7f55dc162480 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:03.824 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.810+0000 7f55e2c3a640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55dc125870 con 0x7f55dc162480 2026-02-12T03:58:03.824 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.810+0000 7f55e2c3a640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55dc12d700 con 0x7f55dc11e9e0 2026-02-12T03:58:03.824 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.810+0000 7f55e2c3a640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55dc12e8e0 con 0x7f55dc1408c0 2026-02-12T03:58:03.824 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.810+0000 7f55e2c3a640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:03.824 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.810+0000 7f55e2c3a640 10 monclient(hunting): authenticate will time out at 1084.463783s 2026-02-12T03:58:03.825 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.811+0000 7f55d3fff640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f55dc1408c0 0x7f55dc124ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.154:53464/0 (socket says 10.20.193.154:53464) 2026-02-12T03:58:03.825 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.811+0000 7f55d3fff640 1 -- 10.20.193.154:0/261763206 learned_addr learned my addr 10.20.193.154:0/261763206 (peer_addr_for_me v1:10.20.193.154:0/0) 2026-02-12T03:58:03.825 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.811+0000 7f55d17fa640 10 client.?.objecter ms_handle_connect 0x7f55dc11e9e0 2026-02-12T03:58:03.825 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.811+0000 7f55d17fa640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:03.825 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.811+0000 7f55d17fa640 10 client.?.objecter ms_handle_connect 0x7f55dc162480 2026-02-12T03:58:03.825 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.811+0000 7f55d17fa640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:03.825 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.811+0000 7f55d17fa640 10 client.?.objecter ms_handle_connect 0x7f55dc1408c0 2026-02-12T03:58:03.825 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.811+0000 7f55d17fa640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:03.825 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.812+0000 7f55d17fa640 1 -- 10.20.193.154:0/261763206 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1597550157 0 0) 0x7f55dc12d700 con 0x7f55dc11e9e0 2026-02-12T03:58:03.825 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.812+0000 7f55d17fa640 10 monclient(hunting): _negotiate 2026-02-12T03:58:03.825 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.812+0000 7f55d17fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:03.825 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.812+0000 7f55d17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:03.826 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.812+0000 7f55d17fa640 10 monclient(hunting): my global_id is 4201 2026-02-12T03:58:03.826 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.812+0000 7f55d17fa640 1 -- 10.20.193.154:0/261763206 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55ac003610 con 0x7f55dc11e9e0 2026-02-12T03:58:03.826 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.812+0000 7f55d17fa640 1 -- 10.20.193.154:0/261763206 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3084452985 0 0) 0x7f55dc12e8e0 con 0x7f55dc1408c0 2026-02-12T03:58:03.826 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.812+0000 7f55d17fa640 10 monclient(hunting): _negotiate 2026-02-12T03:58:03.826 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.812+0000 7f55d17fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:03.826 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.812+0000 7f55d17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:03.826 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.812+0000 7f55d17fa640 10 monclient(hunting): my global_id is 4169 2026-02-12T03:58:03.826 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.812+0000 7f55d17fa640 1 -- 10.20.193.154:0/261763206 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55dc12d700 con 0x7f55dc1408c0 2026-02-12T03:58:03.826 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.812+0000 7f55d17fa640 1 -- 10.20.193.154:0/261763206 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 758314181 0 0) 0x7f55dc125870 con 0x7f55dc162480 2026-02-12T03:58:03.826 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.812+0000 7f55d17fa640 10 monclient(hunting): _negotiate 2026-02-12T03:58:03.826 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.812+0000 7f55d17fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:03.826 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.812+0000 7f55d17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:03.827 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.812+0000 7f55d17fa640 10 monclient(hunting): my global_id is 4200 2026-02-12T03:58:03.827 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.812+0000 7f55d17fa640 1 -- 10.20.193.154:0/261763206 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55dc12e8e0 con 0x7f55dc162480 2026-02-12T03:58:03.830 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.814+0000 7f55d17fa640 1 -- 10.20.193.154:0/261763206 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4250719534 0 0) 0x7f55dc12d700 con 0x7f55dc1408c0 2026-02-12T03:58:03.831 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.814+0000 7f55d17fa640 1 -- 10.20.193.154:0/261763206 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f55dc125870 con 0x7f55dc1408c0 2026-02-12T03:58:03.831 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.814+0000 7f55d17fa640 1 -- 10.20.193.154:0/261763206 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f55c40031b0 con 0x7f55dc1408c0 2026-02-12T03:58:03.831 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.814+0000 7f55d17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:03.831 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.814+0000 7f55d17fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:03.831 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.814+0000 7f55d17fa640 10 monclient(hunting): dump: 2026-02-12T03:58:03.831 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:03.831 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:03.831 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:03.831 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:03.831 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:03.831 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:03.832 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:03.832 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:03.832 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:03.832 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:03.832 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.814+0000 7f55d17fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:03.832 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.815+0000 7f55d17fa640 1 -- 10.20.193.154:0/261763206 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3113135782 0 0) 0x7f55dc12e8e0 con 0x7f55dc162480 2026-02-12T03:58:03.832 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.815+0000 7f55d17fa640 1 -- 10.20.193.154:0/261763206 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f55dc12d700 con 0x7f55dc162480 2026-02-12T03:58:03.832 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.815+0000 7f55d17fa640 1 -- 10.20.193.154:0/261763206 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f55d8003430 con 0x7f55dc162480 2026-02-12T03:58:03.832 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.815+0000 7f55d17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:03.832 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.815+0000 7f55d17fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:03.832 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.815+0000 7f55d17fa640 10 monclient(hunting): dump: 2026-02-12T03:58:03.832 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:03.833 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:03.833 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:03.833 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:03.833 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:03.833 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:03.833 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:03.833 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:03.833 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:03.833 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:03.833 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.815+0000 7f55d17fa640 1 -- 10.20.193.154:0/261763206 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3855024508 0 0) 0x7f55ac003610 con 0x7f55dc11e9e0 2026-02-12T03:58:03.833 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.815+0000 7f55d17fa640 1 -- 10.20.193.154:0/261763206 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f55dc12e8e0 con 0x7f55dc11e9e0 2026-02-12T03:58:03.834 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.815+0000 7f55d17fa640 1 -- 10.20.193.154:0/261763206 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f55cc003360 con 0x7f55dc11e9e0 2026-02-12T03:58:03.834 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.815+0000 7f55d17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:03.834 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.815+0000 7f55d17fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:03.834 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.815+0000 7f55d17fa640 10 monclient(hunting): dump: 2026-02-12T03:58:03.834 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:03.834 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:03.834 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:03.834 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:03.834 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:03.834 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:03.834 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:03.834 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:03.835 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:03.835 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:03.835 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.816+0000 7f55d17fa640 1 -- 10.20.193.154:0/261763206 <== mon.2 v1:10.20.193.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4161317679 0 0) 0x7f55dc125870 con 0x7f55dc1408c0 2026-02-12T03:58:03.835 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.816+0000 7f55d17fa640 1 -- 10.20.193.154:0/261763206 >> v1:10.20.193.98:6789/0 conn(0x7f55dc11e9e0 legacy=0x7f55dc182930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:03.835 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.816+0000 7f55d17fa640 1 -- 10.20.193.154:0/261763206 >> v1:10.20.193.91:6789/0 conn(0x7f55dc162480 legacy=0x7f55dc161cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:03.835 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.816+0000 7f55d17fa640 10 monclient: _finish_hunting 0 2026-02-12T03:58:03.835 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.816+0000 7f55d17fa640 1 monclient: found mon.c 2026-02-12T03:58:03.835 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.816+0000 7f55d17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:03.835 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.816+0000 7f55d17fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:03.835 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.816+0000 7f55d17fa640 1 -- 10.20.193.154:0/261763206 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55dc12fb60 con 0x7f55dc1408c0 2026-02-12T03:58:03.835 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.816+0000 7f55d17fa640 10 monclient: _finish_auth 0 2026-02-12T03:58:03.835 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.816+0000 7f55d17fa640 10 monclient: _check_auth_tickets 2026-02-12T03:58:03.836 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.816+0000 7f55d17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:03.836 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.816+0000 7f55e2c3a640 5 monclient: authenticate success, global_id 4169 2026-02-12T03:58:03.836 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.816+0000 7f55e2c3a640 10 monclient: _renew_subs 2026-02-12T03:58:03.836 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.816+0000 7f55e2c3a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:03.836 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.816+0000 7f55e2c3a640 1 -- 10.20.193.154:0/261763206 --> v1:10.20.193.111:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f55dc12c750 con 0x7f55dc1408c0 2026-02-12T03:58:03.836 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.816+0000 7f55e2c3a640 10 client.4169.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:03.836 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.816+0000 7f55e2c3a640 10 monclient: _renew_subs 2026-02-12T03:58:03.836 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.816+0000 7f55e2c3a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:03.836 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.816+0000 7f55e2c3a640 1 -- 10.20.193.154:0/261763206 --> v1:10.20.193.111:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f55dc12cd90 con 0x7f55dc1408c0 2026-02-12T03:58:03.836 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.816+0000 7f55e2c3a640 1 librados: init done 2026-02-12T03:58:03.836 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.816+0000 7f55e2c3a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:03.836 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.816+0000 7f55e2c3a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:03.836 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.816+0000 7f55e2c3a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:03.837 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.816+0000 7f55e2c3a640 1 -- 10.20.193.154:0/261763206 --> v1:10.20.193.111:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55dc184900 con 0x7f55dc1408c0 2026-02-12T03:58:03.837 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.824+0000 7f55d17fa640 1 -- 10.20.193.154:0/261763206 <== mon.2 v1:10.20.193.111:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f55c40048d0 con 0x7f55dc1408c0 2026-02-12T03:58:03.837 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.824+0000 7f55d17fa640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:03.837 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.824+0000 7f55d17fa640 1 -- 10.20.193.154:0/261763206 <== mon.2 v1:10.20.193.111:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f55c4004b40 con 0x7f55dc1408c0 2026-02-12T03:58:03.837 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.824+0000 7f55d17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:03.837 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.824+0000 7f55d17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:03.837 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.824+0000 7f55d17fa640 10 monclient: dump: 2026-02-12T03:58:03.837 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:03.837 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:03.837 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:03.837 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:03.837 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:03.837 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:03.838 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:03.838 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:03.838 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:03.838 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:03.838 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.824+0000 7f55d2ffd640 4 set_mon_vals no callback set 2026-02-12T03:58:03.838 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.825+0000 7f55d17fa640 1 -- 10.20.193.154:0/261763206 <== mon.2 v1:10.20.193.111:6789/0 7 ==== mgrmap(e 3) ==== 103062+0+0 (unknown 3263092698 0 0) 0x7f55c4004d20 con 0x7f55dc1408c0 2026-02-12T03:58:03.838 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.826+0000 7f55e09af640 10 monclient: get_auth_request con 0x7f55ac079f40 auth_method 0 2026-02-12T03:58:03.838 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.826+0000 7f55d17fa640 10 client.4169.objecter ms_handle_connect 0x7f55ac079f40 2026-02-12T03:58:03.838 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.827+0000 7f55d17fa640 1 -- 10.20.193.154:0/261763206 <== mon.2 v1:10.20.193.111:6789/0 8 ==== osd_map(13..13 src has 1..13) ==== 1985+0+0 (unknown 302703691 0 0) 0x7f55c4004b00 con 0x7f55dc1408c0 2026-02-12T03:58:03.838 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.827+0000 7f55d17fa640 10 client.4169.objecter ms_dispatch2 0x7f55dc000b90 osd_map(13..13 src has 1..13) 2026-02-12T03:58:03.838 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.827+0000 7f55d17fa640 3 client.4169.objecter handle_osd_map got epochs [13,13] > 0 2026-02-12T03:58:03.838 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.827+0000 7f55d17fa640 3 client.4169.objecter handle_osd_map decoding full epoch 13 2026-02-12T03:58:03.838 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.827+0000 7f55d17fa640 20 client.4169.objecter dump_active .. 0 homeless 2026-02-12T03:58:03.931 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.929+0000 7f55d17fa640 1 -- 10.20.193.154:0/261763206 <== mon.2 v1:10.20.193.111:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f55c405f3f0 con 0x7f55dc1408c0 2026-02-12T03:58:03.932 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.929+0000 7f55d17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:03.932 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:03.929+0000 7f55d17fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:04.047 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.044+0000 7f55e2c3a640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "b6c647bb-4e86-4b0e-b79c-b0236a780a66", "id": 11}] 2026-02-12T03:58:04.047 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.044+0000 7f55e2c3a640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "b6c647bb-4e86-4b0e-b79c-b0236a780a66", "id": 11}] 2026-02-12T03:58:04.047 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.044+0000 7f55e2c3a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:04.047 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.044+0000 7f55e2c3a640 1 -- 10.20.193.154:0/261763206 --> v1:10.20.193.111:6789/0 -- mon_command({"prefix": "osd new", "uuid": "b6c647bb-4e86-4b0e-b79c-b0236a780a66", "id": 11} v 0) -- 0x7f55dc12d0d0 con 0x7f55dc1408c0 2026-02-12T03:58:04.094 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.092+0000 7f55d17fa640 1 -- 10.20.193.154:0/261763206 <== mon.2 v1:10.20.193.111:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b6c647bb-4e86-4b0e-b79c-b0236a780a66", "id": 11}]=0 v14) ==== 113+0+3 (unknown 2605517419 0 212448812) 0x7f55c405ecf0 con 0x7f55dc1408c0 2026-02-12T03:58:04.094 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.092+0000 7f55d17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "b6c647bb-4e86-4b0e-b79c-b0236a780a66", "id": 11}] 2026-02-12T03:58:04.095 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.092+0000 7f55d17fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:04.095 INFO:teuthology.orchestra.run.trial154.stdout:11 2026-02-12T03:58:04.096 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.093+0000 7f55e2c3a640 10 librados: watch_flush enter 2026-02-12T03:58:04.097 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.093+0000 7f55e2c3a640 10 librados: watch_flush exit 2026-02-12T03:58:04.097 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.093+0000 7f55e2c3a640 20 client.4169.objecter shutdown clearing up homeless session... 2026-02-12T03:58:04.097 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.093+0000 7f55e2c3a640 10 client.4169.objecter successfully canceled tick 2026-02-12T03:58:04.097 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.093+0000 7f55e2c3a640 1 -- 10.20.193.154:0/261763206 >> v1:10.20.193.91:6800/2929217192 conn(0x7f55ac079f40 legacy=0x7f55ac09a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:04.097 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.093+0000 7f55e2c3a640 10 monclient: shutdown 2026-02-12T03:58:04.097 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.093+0000 7f55e2c3a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:04.097 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.093+0000 7f55e2c3a640 1 -- 10.20.193.154:0/261763206 >> v1:10.20.193.111:6789/0 conn(0x7f55dc1408c0 legacy=0x7f55dc124ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:04.097 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.093+0000 7f55e2c3a640 1 -- 10.20.193.154:0/261763206 shutdown_connections 2026-02-12T03:58:04.097 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.093+0000 7f55e2c3a640 1 -- 10.20.193.154:0/261763206 >> 10.20.193.154:0/261763206 conn(0x7f55dc055ff0 msgr2=0x7f55dc186a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:04.097 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.093+0000 7f55e2c3a640 1 -- 10.20.193.154:0/261763206 shutdown_connections 2026-02-12T03:58:04.098 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.093+0000 7f55e2c3a640 1 -- 10.20.193.154:0/261763206 wait complete. 2026-02-12T03:58:04.098 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.094+0000 7f55e2c3a640 1 librados: shutdown 2026-02-12T03:58:04.106 DEBUG:teuthology.orchestra.run.trial154:> sudo ceph --cluster ceph osd new 19bb3570-0c0a-48cc-a0b8-ec3194f30fa8 12 2026-02-12T03:58:04.171 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.167+0000 7f8d57f71640 10 monclient: get_monmap_and_config 2026-02-12T03:58:04.171 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.167+0000 7f8d57f71640 10 monclient: build_initial_monmap 2026-02-12T03:58:04.171 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.167+0000 7f8d57f71640 10 monclient: monmap: 2026-02-12T03:58:04.171 INFO:teuthology.orchestra.run.trial154.stderr:epoch 0 2026-02-12T03:58:04.171 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:04.171 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:58:04.168960+0000 2026-02-12T03:58:04.172 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:58:04.168960+0000 2026-02-12T03:58:04.172 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:04.172 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:04.172 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:04.172 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:04.172 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:04.172 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:04.172 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.167+0000 7f8d57f71640 1 Processor -- start 2026-02-12T03:58:04.172 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.168+0000 7f8d57f71640 1 -- start start 2026-02-12T03:58:04.172 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.168+0000 7f8d57f71640 10 monclient: init 2026-02-12T03:58:04.172 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.168+0000 7f8d57f71640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:04.173 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.168+0000 7f8d57f71640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T03:58:04.173 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.168+0000 7f8d57f71640 10 monclient(hunting): picked mon.noname-a con 0x7f8d5011cae0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:04.173 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.168+0000 7f8d57f71640 10 monclient(hunting): picked mon.noname-b con 0x7f8d5011ceb0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:04.173 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.168+0000 7f8d57f71640 10 monclient(hunting): picked mon.noname-c con 0x7f8d501649c0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:04.173 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.168+0000 7f8d57f71640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d501864c0 con 0x7f8d5011cae0 2026-02-12T03:58:04.173 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.168+0000 7f8d57f71640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d501876a0 con 0x7f8d5011ceb0 2026-02-12T03:58:04.173 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.168+0000 7f8d57f71640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d50188880 con 0x7f8d501649c0 2026-02-12T03:58:04.173 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.168+0000 7f8d57f71640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:04.173 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.168+0000 7f8d57f71640 10 monclient(hunting): authenticate will time out at 1084.821215s 2026-02-12T03:58:04.173 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.168+0000 7f8d554e5640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f8d5011ceb0 0x7f8d5011b8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.154:39462/0 (socket says 10.20.193.154:39462) 2026-02-12T03:58:04.173 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.168+0000 7f8d554e5640 1 -- 10.20.193.154:0/353599616 learned_addr learned my addr 10.20.193.154:0/353599616 (peer_addr_for_me v1:10.20.193.154:0/0) 2026-02-12T03:58:04.180 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.169+0000 7f8d54ce4640 1 -- 10.20.193.154:0/353599616 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 48912021 0 0) 0x7f8d50188880 con 0x7f8d501649c0 2026-02-12T03:58:04.180 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.169+0000 7f8d54ce4640 10 monclient(hunting): _negotiate 2026-02-12T03:58:04.180 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.169+0000 7f8d54ce4640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:04.180 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.169+0000 7f8d54ce4640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:04.180 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.169+0000 7f8d54ce4640 10 monclient(hunting): my global_id is 4172 2026-02-12T03:58:04.181 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.170+0000 7f8d54ce4640 1 -- 10.20.193.154:0/353599616 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d38003610 con 0x7f8d501649c0 2026-02-12T03:58:04.181 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.170+0000 7f8d54ce4640 1 -- 10.20.193.154:0/353599616 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4122418777 0 0) 0x7f8d501876a0 con 0x7f8d5011ceb0 2026-02-12T03:58:04.181 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.170+0000 7f8d54ce4640 10 monclient(hunting): _negotiate 2026-02-12T03:58:04.181 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.170+0000 7f8d54ce4640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:04.181 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.170+0000 7f8d54ce4640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:04.181 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.170+0000 7f8d54ce4640 10 monclient(hunting): my global_id is 4204 2026-02-12T03:58:04.181 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.170+0000 7f8d54ce4640 1 -- 10.20.193.154:0/353599616 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d50188880 con 0x7f8d5011ceb0 2026-02-12T03:58:04.181 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.170+0000 7f8d54ce4640 1 -- 10.20.193.154:0/353599616 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3414016884 0 0) 0x7f8d501864c0 con 0x7f8d5011cae0 2026-02-12T03:58:04.181 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.170+0000 7f8d54ce4640 10 monclient(hunting): _negotiate 2026-02-12T03:58:04.181 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.170+0000 7f8d54ce4640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:04.181 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.170+0000 7f8d54ce4640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:04.181 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.170+0000 7f8d54ce4640 10 monclient(hunting): my global_id is 4203 2026-02-12T03:58:04.182 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.170+0000 7f8d54ce4640 1 -- 10.20.193.154:0/353599616 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d501876a0 con 0x7f8d5011cae0 2026-02-12T03:58:04.182 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.171+0000 7f8d54ce4640 1 -- 10.20.193.154:0/353599616 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 944439647 0 0) 0x7f8d50188880 con 0x7f8d5011ceb0 2026-02-12T03:58:04.182 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.171+0000 7f8d54ce4640 1 -- 10.20.193.154:0/353599616 >> v1:10.20.193.111:6789/0 conn(0x7f8d501649c0 legacy=0x7f8d50184da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:04.182 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.171+0000 7f8d54ce4640 1 -- 10.20.193.154:0/353599616 >> v1:10.20.193.91:6789/0 conn(0x7f8d5011cae0 legacy=0x7f8d5011b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:04.182 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.171+0000 7f8d54ce4640 10 monclient: _finish_hunting 0 2026-02-12T03:58:04.182 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.171+0000 7f8d54ce4640 1 monclient: found mon.noname-b 2026-02-12T03:58:04.182 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.171+0000 7f8d54ce4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:04.182 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.171+0000 7f8d54ce4640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T03:58:04.182 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.171+0000 7f8d54ce4640 1 -- 10.20.193.154:0/353599616 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d50189b20 con 0x7f8d5011ceb0 2026-02-12T03:58:04.182 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.171+0000 7f8d54ce4640 10 monclient: _finish_auth 0 2026-02-12T03:58:04.182 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.171+0000 7f8d54ce4640 10 monclient: _check_auth_tickets 2026-02-12T03:58:04.182 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.171+0000 7f8d54ce4640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:04.183 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.171+0000 7f8d54ce4640 1 -- 10.20.193.154:0/353599616 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8d44002df0 con 0x7f8d5011ceb0 2026-02-12T03:58:04.183 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.171+0000 7f8d54ce4640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:04.183 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.171+0000 7f8d54ce4640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:04.183 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.171+0000 7f8d54ce4640 10 monclient: dump: 2026-02-12T03:58:04.183 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:04.183 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:04.183 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:04.183 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:04.183 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:04.183 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:04.183 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:04.183 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:04.184 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:04.184 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:04.184 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.171+0000 7f8d57f71640 5 monclient: authenticate success, global_id 4204 2026-02-12T03:58:04.184 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.171+0000 7f8d57f71640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:04.184 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.172+0000 7f8d54ce4640 1 -- 10.20.193.154:0/353599616 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8d44003030 con 0x7f8d5011ceb0 2026-02-12T03:58:04.184 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.172+0000 7f8d54ce4640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:04.184 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.172+0000 7f8d54ce4640 1 -- 10.20.193.154:0/353599616 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8d44003470 con 0x7f8d5011ceb0 2026-02-12T03:58:04.184 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.172+0000 7f8d54ce4640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:04.184 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.172+0000 7f8d54ce4640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:04.184 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.172+0000 7f8d54ce4640 10 monclient: dump: 2026-02-12T03:58:04.184 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:04.184 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:04.185 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:04.185 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:04.185 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:04.185 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:04.185 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:04.185 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:04.185 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:04.185 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:04.185 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.172+0000 7f8d57f71640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:04.185 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.172+0000 7f8d57f71640 4 set_mon_vals no callback set 2026-02-12T03:58:04.185 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.172+0000 7f8d57f71640 10 monclient: shutdown 2026-02-12T03:58:04.185 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.172+0000 7f8d57f71640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:04.186 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.172+0000 7f8d57f71640 1 -- 10.20.193.154:0/353599616 >> v1:10.20.193.98:6789/0 conn(0x7f8d5011ceb0 legacy=0x7f8d5011b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:04.186 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.172+0000 7f8d57f71640 1 -- 10.20.193.154:0/353599616 shutdown_connections 2026-02-12T03:58:04.186 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.172+0000 7f8d57f71640 1 -- 10.20.193.154:0/353599616 >> 10.20.193.154:0/353599616 conn(0x7f8d50058b60 msgr2=0x7f8d50058f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:04.186 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.172+0000 7f8d57f71640 1 -- 10.20.193.154:0/353599616 shutdown_connections 2026-02-12T03:58:04.186 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.172+0000 7f8d57f71640 1 -- 10.20.193.154:0/353599616 wait complete. 2026-02-12T03:58:04.186 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.173+0000 7f8d57f71640 10 monclient: build_initial_monmap 2026-02-12T03:58:04.186 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.173+0000 7f8d57f71640 10 monclient: monmap: 2026-02-12T03:58:04.186 INFO:teuthology.orchestra.run.trial154.stderr:epoch 0 2026-02-12T03:58:04.186 INFO:teuthology.orchestra.run.trial154.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:04.186 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 0.000000 2026-02-12T03:58:04.186 INFO:teuthology.orchestra.run.trial154.stderr:created 0.000000 2026-02-12T03:58:04.186 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:04.186 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 1 2026-02-12T03:58:04.187 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:04.187 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:04.187 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:04.187 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:04.187 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.173+0000 7f8d57f71640 1 librados: starting msgr at 2026-02-12T03:58:04.187 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.173+0000 7f8d57f71640 1 librados: starting objecter 2026-02-12T03:58:04.187 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.173+0000 7f8d57f71640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:04.187 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.173+0000 7f8d57f71640 1 Processor -- start 2026-02-12T03:58:04.187 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.173+0000 7f8d57f71640 1 -- start start 2026-02-12T03:58:04.187 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.173+0000 7f8d57f71640 1 librados: setting wanted keys 2026-02-12T03:58:04.187 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.173+0000 7f8d57f71640 1 librados: calling monclient init 2026-02-12T03:58:04.187 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.173+0000 7f8d57f71640 10 monclient: init 2026-02-12T03:58:04.187 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.173+0000 7f8d57f71640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:04.188 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.173+0000 7f8d57f71640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T03:58:04.188 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.173+0000 7f8d57f71640 10 monclient(hunting): picked mon.noname-a con 0x7f8d5011cae0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:04.188 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.173+0000 7f8d57f71640 10 monclient(hunting): picked mon.noname-b con 0x7f8d5011ceb0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:04.188 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.173+0000 7f8d57f71640 10 monclient(hunting): picked mon.noname-c con 0x7f8d501649c0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:04.188 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.173+0000 7f8d57f71640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d5016d7a0 con 0x7f8d5011cae0 2026-02-12T03:58:04.188 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.173+0000 7f8d57f71640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d50174680 con 0x7f8d5011ceb0 2026-02-12T03:58:04.188 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.173+0000 7f8d57f71640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d50175860 con 0x7f8d501649c0 2026-02-12T03:58:04.188 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.173+0000 7f8d57f71640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:04.188 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.173+0000 7f8d57f71640 10 monclient(hunting): authenticate will time out at 1084.826596s 2026-02-12T03:58:04.188 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.173+0000 7f8d564e7640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f8d501649c0 0x7f8d501630b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.154:53480/0 (socket says 10.20.193.154:53480) 2026-02-12T03:58:04.188 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.173+0000 7f8d564e7640 1 -- 10.20.193.154:0/1375140704 learned_addr learned my addr 10.20.193.154:0/1375140704 (peer_addr_for_me v1:10.20.193.154:0/0) 2026-02-12T03:58:04.189 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.174+0000 7f8d3e7fc640 10 client.?.objecter ms_handle_connect 0x7f8d5011ceb0 2026-02-12T03:58:04.189 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.174+0000 7f8d3e7fc640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:04.189 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.174+0000 7f8d3e7fc640 10 client.?.objecter ms_handle_connect 0x7f8d501649c0 2026-02-12T03:58:04.189 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.174+0000 7f8d3e7fc640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:04.189 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.174+0000 7f8d3e7fc640 10 client.?.objecter ms_handle_connect 0x7f8d5011cae0 2026-02-12T03:58:04.189 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.174+0000 7f8d3e7fc640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:04.189 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.175+0000 7f8d3e7fc640 1 -- 10.20.193.154:0/1375140704 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2449989361 0 0) 0x7f8d50174680 con 0x7f8d5011ceb0 2026-02-12T03:58:04.189 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.175+0000 7f8d3e7fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:04.189 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.175+0000 7f8d3e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:04.189 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.175+0000 7f8d3e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:04.189 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.175+0000 7f8d3e7fc640 10 monclient(hunting): my global_id is 4207 2026-02-12T03:58:04.189 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.175+0000 7f8d3e7fc640 1 -- 10.20.193.154:0/1375140704 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d20003610 con 0x7f8d5011ceb0 2026-02-12T03:58:04.189 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.175+0000 7f8d3e7fc640 1 -- 10.20.193.154:0/1375140704 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3182217126 0 0) 0x7f8d50175860 con 0x7f8d501649c0 2026-02-12T03:58:04.190 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.175+0000 7f8d3e7fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:04.190 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.175+0000 7f8d3e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:04.190 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.175+0000 7f8d3e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:04.190 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.175+0000 7f8d3e7fc640 10 monclient(hunting): my global_id is 4175 2026-02-12T03:58:04.190 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.175+0000 7f8d3e7fc640 1 -- 10.20.193.154:0/1375140704 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d50174680 con 0x7f8d501649c0 2026-02-12T03:58:04.190 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.175+0000 7f8d3e7fc640 1 -- 10.20.193.154:0/1375140704 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3076215393 0 0) 0x7f8d5016d7a0 con 0x7f8d5011cae0 2026-02-12T03:58:04.190 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.175+0000 7f8d3e7fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:04.190 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.175+0000 7f8d3e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:04.190 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.175+0000 7f8d3e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:04.190 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.175+0000 7f8d3e7fc640 10 monclient(hunting): my global_id is 4206 2026-02-12T03:58:04.190 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.175+0000 7f8d3e7fc640 1 -- 10.20.193.154:0/1375140704 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d50175860 con 0x7f8d5011cae0 2026-02-12T03:58:04.190 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.177+0000 7f8d3e7fc640 1 -- 10.20.193.154:0/1375140704 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3243905419 0 0) 0x7f8d20003610 con 0x7f8d5011ceb0 2026-02-12T03:58:04.190 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.177+0000 7f8d3e7fc640 1 -- 10.20.193.154:0/1375140704 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8d5016d7a0 con 0x7f8d5011ceb0 2026-02-12T03:58:04.191 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.177+0000 7f8d3e7fc640 1 -- 10.20.193.154:0/1375140704 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8d44003380 con 0x7f8d5011ceb0 2026-02-12T03:58:04.191 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.177+0000 7f8d3e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:04.191 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.177+0000 7f8d3e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:04.191 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.177+0000 7f8d3e7fc640 10 monclient(hunting): dump: 2026-02-12T03:58:04.191 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:04.191 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:04.191 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:04.191 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:04.191 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:04.191 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:04.191 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:04.191 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:04.191 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:04.192 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:04.192 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.177+0000 7f8d3e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:04.192 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.177+0000 7f8d3e7fc640 1 -- 10.20.193.154:0/1375140704 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1051929361 0 0) 0x7f8d50174680 con 0x7f8d501649c0 2026-02-12T03:58:04.192 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.177+0000 7f8d3e7fc640 1 -- 10.20.193.154:0/1375140704 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8d20003610 con 0x7f8d501649c0 2026-02-12T03:58:04.192 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.177+0000 7f8d3e7fc640 1 -- 10.20.193.154:0/1375140704 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8d4c003430 con 0x7f8d501649c0 2026-02-12T03:58:04.192 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.177+0000 7f8d3e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:04.192 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.177+0000 7f8d3e7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:04.192 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.177+0000 7f8d3e7fc640 10 monclient(hunting): dump: 2026-02-12T03:58:04.192 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:04.192 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:04.192 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:04.192 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:04.193 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:04.193 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:04.193 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:04.193 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:04.193 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:04.193 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:04.193 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.177+0000 7f8d3e7fc640 1 -- 10.20.193.154:0/1375140704 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 891008114 0 0) 0x7f8d50175860 con 0x7f8d5011cae0 2026-02-12T03:58:04.193 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.177+0000 7f8d3e7fc640 1 -- 10.20.193.154:0/1375140704 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8d50174680 con 0x7f8d5011cae0 2026-02-12T03:58:04.193 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.177+0000 7f8d3e7fc640 1 -- 10.20.193.154:0/1375140704 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8d40003060 con 0x7f8d5011cae0 2026-02-12T03:58:04.193 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.177+0000 7f8d3e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:04.193 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.177+0000 7f8d3e7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:04.193 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.177+0000 7f8d3e7fc640 10 monclient(hunting): dump: 2026-02-12T03:58:04.193 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:04.194 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:04.194 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:04.194 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:04.194 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:04.194 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:04.194 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:04.194 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:04.194 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:04.194 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:04.196 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.179+0000 7f8d3e7fc640 1 -- 10.20.193.154:0/1375140704 <== mon.1 v1:10.20.193.98:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 284662962 0 0) 0x7f8d5016d7a0 con 0x7f8d5011ceb0 2026-02-12T03:58:04.196 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.179+0000 7f8d3e7fc640 1 -- 10.20.193.154:0/1375140704 >> v1:10.20.193.111:6789/0 conn(0x7f8d501649c0 legacy=0x7f8d501630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:04.196 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.179+0000 7f8d3e7fc640 1 -- 10.20.193.154:0/1375140704 >> v1:10.20.193.91:6789/0 conn(0x7f8d5011cae0 legacy=0x7f8d5016cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:04.196 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.179+0000 7f8d3e7fc640 10 monclient: _finish_hunting 0 2026-02-12T03:58:04.196 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.179+0000 7f8d3e7fc640 1 monclient: found mon.b 2026-02-12T03:58:04.196 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.179+0000 7f8d3e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:04.196 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.179+0000 7f8d3e7fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:04.196 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.179+0000 7f8d3e7fc640 1 -- 10.20.193.154:0/1375140704 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d50176a40 con 0x7f8d5011ceb0 2026-02-12T03:58:04.197 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.179+0000 7f8d3e7fc640 10 monclient: _finish_auth 0 2026-02-12T03:58:04.197 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.179+0000 7f8d3e7fc640 10 monclient: _check_auth_tickets 2026-02-12T03:58:04.197 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.179+0000 7f8d3e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:04.197 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.179+0000 7f8d57f71640 5 monclient: authenticate success, global_id 4207 2026-02-12T03:58:04.197 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.179+0000 7f8d57f71640 10 monclient: _renew_subs 2026-02-12T03:58:04.197 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.179+0000 7f8d57f71640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:04.197 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.179+0000 7f8d57f71640 1 -- 10.20.193.154:0/1375140704 --> v1:10.20.193.98:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8d50175a30 con 0x7f8d5011ceb0 2026-02-12T03:58:04.197 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.179+0000 7f8d57f71640 10 client.4207.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:04.197 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.179+0000 7f8d57f71640 10 monclient: _renew_subs 2026-02-12T03:58:04.197 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.179+0000 7f8d57f71640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:04.197 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.179+0000 7f8d57f71640 1 -- 10.20.193.154:0/1375140704 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8d50176070 con 0x7f8d5011ceb0 2026-02-12T03:58:04.197 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.179+0000 7f8d57f71640 1 librados: init done 2026-02-12T03:58:04.197 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.179+0000 7f8d57f71640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:04.198 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.179+0000 7f8d57f71640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:04.198 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.179+0000 7f8d57f71640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:04.198 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.179+0000 7f8d57f71640 1 -- 10.20.193.154:0/1375140704 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d50188f50 con 0x7f8d5011ceb0 2026-02-12T03:58:04.272 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.270+0000 7f8d3e7fc640 1 -- 10.20.193.154:0/1375140704 <== mon.1 v1:10.20.193.98:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8d44003520 con 0x7f8d5011ceb0 2026-02-12T03:58:04.272 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.270+0000 7f8d3e7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:04.273 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.270+0000 7f8d3e7fc640 1 -- 10.20.193.154:0/1375140704 <== mon.1 v1:10.20.193.98:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8d44004ce0 con 0x7f8d5011ceb0 2026-02-12T03:58:04.273 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.270+0000 7f8d3e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:04.273 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.270+0000 7f8d3e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:04.273 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.270+0000 7f8d3e7fc640 10 monclient: dump: 2026-02-12T03:58:04.273 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:04.273 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:04.273 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:04.273 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:04.273 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:04.273 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:04.273 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:04.274 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:04.274 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:04.274 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:04.274 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.270+0000 7f8d3ffff640 4 set_mon_vals no callback set 2026-02-12T03:58:04.275 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.270+0000 7f8d3e7fc640 1 -- 10.20.193.154:0/1375140704 <== mon.1 v1:10.20.193.98:6789/0 7 ==== mgrmap(e 3) ==== 103062+0+0 (unknown 3263092698 0 0) 0x7f8d4401e120 con 0x7f8d5011ceb0 2026-02-12T03:58:04.275 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.271+0000 7f8d55ce6640 10 monclient: get_auth_request con 0x7f8d20079e60 auth_method 0 2026-02-12T03:58:04.275 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.271+0000 7f8d3e7fc640 10 client.4207.objecter ms_handle_connect 0x7f8d20079e60 2026-02-12T03:58:04.275 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.273+0000 7f8d3e7fc640 1 -- 10.20.193.154:0/1375140704 <== mon.1 v1:10.20.193.98:6789/0 8 ==== osd_map(14..14 src has 1..14) ==== 2100+0+0 (unknown 25368577 0 0) 0x7f8d4405c640 con 0x7f8d5011ceb0 2026-02-12T03:58:04.276 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.273+0000 7f8d3e7fc640 10 client.4207.objecter ms_dispatch2 0x7f8d50000b90 osd_map(14..14 src has 1..14) 2026-02-12T03:58:04.276 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.273+0000 7f8d3e7fc640 3 client.4207.objecter handle_osd_map got epochs [14,14] > 0 2026-02-12T03:58:04.276 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.273+0000 7f8d3e7fc640 3 client.4207.objecter handle_osd_map decoding full epoch 14 2026-02-12T03:58:04.276 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.273+0000 7f8d3e7fc640 20 client.4207.objecter dump_active .. 0 homeless 2026-02-12T03:58:04.276 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.273+0000 7f8d3e7fc640 1 -- 10.20.193.154:0/1375140704 <== mon.1 v1:10.20.193.98:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f8d4405f2f0 con 0x7f8d5011ceb0 2026-02-12T03:58:04.276 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.273+0000 7f8d3e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:04.276 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.273+0000 7f8d3e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:04.386 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.384+0000 7f8d57f71640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "19bb3570-0c0a-48cc-a0b8-ec3194f30fa8", "id": 12}] 2026-02-12T03:58:04.387 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.384+0000 7f8d57f71640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "19bb3570-0c0a-48cc-a0b8-ec3194f30fa8", "id": 12}] 2026-02-12T03:58:04.387 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.384+0000 7f8d57f71640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:04.387 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.384+0000 7f8d57f71640 1 -- 10.20.193.154:0/1375140704 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "osd new", "uuid": "19bb3570-0c0a-48cc-a0b8-ec3194f30fa8", "id": 12} v 0) -- 0x7f8d501763b0 con 0x7f8d5011ceb0 2026-02-12T03:58:04.431 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.429+0000 7f8d3e7fc640 1 -- 10.20.193.154:0/1375140704 <== mon.1 v1:10.20.193.98:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "19bb3570-0c0a-48cc-a0b8-ec3194f30fa8", "id": 12}]=0 v15) ==== 113+0+3 (unknown 3025509281 0 944643765) 0x7f8d44069460 con 0x7f8d5011ceb0 2026-02-12T03:58:04.431 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.429+0000 7f8d3e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "19bb3570-0c0a-48cc-a0b8-ec3194f30fa8", "id": 12}] 2026-02-12T03:58:04.431 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.429+0000 7f8d3e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:04.431 INFO:teuthology.orchestra.run.trial154.stdout:12 2026-02-12T03:58:04.434 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.430+0000 7f8d57f71640 10 librados: watch_flush enter 2026-02-12T03:58:04.434 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.430+0000 7f8d57f71640 10 librados: watch_flush exit 2026-02-12T03:58:04.434 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.430+0000 7f8d57f71640 20 client.4207.objecter shutdown clearing up homeless session... 2026-02-12T03:58:04.434 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.430+0000 7f8d57f71640 10 client.4207.objecter successfully canceled tick 2026-02-12T03:58:04.434 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.430+0000 7f8d57f71640 1 -- 10.20.193.154:0/1375140704 >> v1:10.20.193.91:6800/2929217192 conn(0x7f8d20079e60 legacy=0x7f8d2009a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:04.434 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.430+0000 7f8d57f71640 10 monclient: shutdown 2026-02-12T03:58:04.434 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.430+0000 7f8d57f71640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:04.434 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.430+0000 7f8d57f71640 1 -- 10.20.193.154:0/1375140704 >> v1:10.20.193.98:6789/0 conn(0x7f8d5011ceb0 legacy=0x7f8d50161990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:04.434 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.430+0000 7f8d57f71640 1 -- 10.20.193.154:0/1375140704 shutdown_connections 2026-02-12T03:58:04.434 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.430+0000 7f8d57f71640 1 -- 10.20.193.154:0/1375140704 >> 10.20.193.154:0/1375140704 conn(0x7f8d50058b60 msgr2=0x7f8d5005b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:04.435 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.430+0000 7f8d57f71640 1 -- 10.20.193.154:0/1375140704 shutdown_connections 2026-02-12T03:58:04.435 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.430+0000 7f8d57f71640 1 -- 10.20.193.154:0/1375140704 wait complete. 2026-02-12T03:58:04.435 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.431+0000 7f8d57f71640 1 librados: shutdown 2026-02-12T03:58:04.442 DEBUG:teuthology.orchestra.run.trial154:> sudo ceph --cluster ceph osd new a8215062-521c-47f6-b20a-9e40c1f3f5a6 13 2026-02-12T03:58:04.507 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.505+0000 7fe6f4713640 10 monclient: get_monmap_and_config 2026-02-12T03:58:04.507 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.505+0000 7fe6f4713640 10 monclient: build_initial_monmap 2026-02-12T03:58:04.508 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.505+0000 7fe6f4713640 10 monclient: monmap: 2026-02-12T03:58:04.508 INFO:teuthology.orchestra.run.trial154.stderr:epoch 0 2026-02-12T03:58:04.508 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:04.508 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:58:04.506455+0000 2026-02-12T03:58:04.508 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:58:04.506455+0000 2026-02-12T03:58:04.508 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:04.508 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:04.509 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:04.509 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:04.509 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:04.509 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:04.516 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.505+0000 7fe6f4713640 1 Processor -- start 2026-02-12T03:58:04.516 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.505+0000 7fe6f4713640 1 -- start start 2026-02-12T03:58:04.516 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.505+0000 7fe6f4713640 10 monclient: init 2026-02-12T03:58:04.517 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.505+0000 7fe6f4713640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:04.517 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.505+0000 7fe6f4713640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T03:58:04.517 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.505+0000 7fe6f4713640 10 monclient(hunting): picked mon.noname-c con 0x7fe6ec0584c0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:04.517 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.505+0000 7fe6f4713640 10 monclient(hunting): picked mon.noname-b con 0x7fe6ec058980 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:04.517 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.505+0000 7fe6f4713640 10 monclient(hunting): picked mon.noname-a con 0x7fe6ec164750 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:04.517 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.505+0000 7fe6f4713640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6ec1864b0 con 0x7fe6ec164750 2026-02-12T03:58:04.517 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.505+0000 7fe6f4713640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6ec1876b0 con 0x7fe6ec058980 2026-02-12T03:58:04.517 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.505+0000 7fe6f4713640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6ec1888b0 con 0x7fe6ec0584c0 2026-02-12T03:58:04.517 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.505+0000 7fe6f4713640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:04.517 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.505+0000 7fe6f4713640 10 monclient(hunting): authenticate will time out at 1085.158828s 2026-02-12T03:58:04.517 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.506+0000 7fe6f2488640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7fe6ec0584c0 0x7fe6ec05cd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.154:53482/0 (socket says 10.20.193.154:53482) 2026-02-12T03:58:04.518 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.506+0000 7fe6f2488640 1 -- 10.20.193.154:0/1234352921 learned_addr learned my addr 10.20.193.154:0/1234352921 (peer_addr_for_me v1:10.20.193.154:0/0) 2026-02-12T03:58:04.518 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.507+0000 7fe6f1486640 1 -- 10.20.193.154:0/1234352921 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 25237744 0 0) 0x7fe6ec1888b0 con 0x7fe6ec0584c0 2026-02-12T03:58:04.518 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.507+0000 7fe6f1486640 10 monclient(hunting): _negotiate 2026-02-12T03:58:04.518 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.507+0000 7fe6f1486640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:04.518 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.507+0000 7fe6f1486640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:04.518 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.507+0000 7fe6f1486640 10 monclient(hunting): my global_id is 4178 2026-02-12T03:58:04.518 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.507+0000 7fe6f1486640 1 -- 10.20.193.154:0/1234352921 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6d4003610 con 0x7fe6ec0584c0 2026-02-12T03:58:04.518 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.507+0000 7fe6f1486640 1 -- 10.20.193.154:0/1234352921 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 879896028 0 0) 0x7fe6ec1864b0 con 0x7fe6ec164750 2026-02-12T03:58:04.518 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.507+0000 7fe6f1486640 10 monclient(hunting): _negotiate 2026-02-12T03:58:04.518 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.507+0000 7fe6f1486640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:04.518 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.507+0000 7fe6f1486640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:04.519 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.507+0000 7fe6f1486640 10 monclient(hunting): my global_id is 4209 2026-02-12T03:58:04.519 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.507+0000 7fe6f1486640 1 -- 10.20.193.154:0/1234352921 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6ec1888b0 con 0x7fe6ec164750 2026-02-12T03:58:04.519 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.507+0000 7fe6f1486640 1 -- 10.20.193.154:0/1234352921 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1153864717 0 0) 0x7fe6ec1876b0 con 0x7fe6ec058980 2026-02-12T03:58:04.519 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.507+0000 7fe6f1486640 10 monclient(hunting): _negotiate 2026-02-12T03:58:04.519 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.507+0000 7fe6f1486640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:04.519 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.507+0000 7fe6f1486640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:04.519 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.507+0000 7fe6f1486640 10 monclient(hunting): my global_id is 4210 2026-02-12T03:58:04.519 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.507+0000 7fe6f1486640 1 -- 10.20.193.154:0/1234352921 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6ec1864b0 con 0x7fe6ec058980 2026-02-12T03:58:04.519 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.509+0000 7fe6f1486640 1 -- 10.20.193.154:0/1234352921 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 654978669 0 0) 0x7fe6ec1888b0 con 0x7fe6ec164750 2026-02-12T03:58:04.519 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.509+0000 7fe6f1486640 1 -- 10.20.193.154:0/1234352921 >> v1:10.20.193.111:6789/0 conn(0x7fe6ec0584c0 legacy=0x7fe6ec05cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:04.519 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.509+0000 7fe6f1486640 1 -- 10.20.193.154:0/1234352921 >> v1:10.20.193.98:6789/0 conn(0x7fe6ec058980 legacy=0x7fe6ec05d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:04.519 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.509+0000 7fe6f1486640 10 monclient: _finish_hunting 0 2026-02-12T03:58:04.520 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.509+0000 7fe6f1486640 1 monclient: found mon.noname-a 2026-02-12T03:58:04.520 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.509+0000 7fe6f1486640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:04.520 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.509+0000 7fe6f1486640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.91:6789/0 2026-02-12T03:58:04.520 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.509+0000 7fe6f1486640 1 -- 10.20.193.154:0/1234352921 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ec189b50 con 0x7fe6ec164750 2026-02-12T03:58:04.520 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.509+0000 7fe6f1486640 10 monclient: _finish_auth 0 2026-02-12T03:58:04.520 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.509+0000 7fe6f1486640 10 monclient: _check_auth_tickets 2026-02-12T03:58:04.520 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.509+0000 7fe6f1486640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:04.520 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.509+0000 7fe6f1486640 1 -- 10.20.193.154:0/1234352921 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fe6e8003170 con 0x7fe6ec164750 2026-02-12T03:58:04.520 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.509+0000 7fe6f1486640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:04.520 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.509+0000 7fe6f1486640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:04.521 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.509+0000 7fe6f1486640 10 monclient: dump: 2026-02-12T03:58:04.521 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:04.521 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:04.521 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:04.521 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:04.521 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:04.521 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:04.521 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:04.521 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:04.521 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:04.521 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:04.521 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.509+0000 7fe6f4713640 5 monclient: authenticate success, global_id 4209 2026-02-12T03:58:04.522 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.509+0000 7fe6f4713640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:04.522 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.510+0000 7fe6f1486640 1 -- 10.20.193.154:0/1234352921 <== mon.0 v1:10.20.193.91:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe6e80033b0 con 0x7fe6ec164750 2026-02-12T03:58:04.522 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.510+0000 7fe6f1486640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:04.522 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.510+0000 7fe6f1486640 1 -- 10.20.193.154:0/1234352921 <== mon.0 v1:10.20.193.91:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fe6e80037f0 con 0x7fe6ec164750 2026-02-12T03:58:04.522 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.510+0000 7fe6f1486640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:04.522 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.510+0000 7fe6f1486640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:04.522 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.510+0000 7fe6f1486640 10 monclient: dump: 2026-02-12T03:58:04.522 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:04.522 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:04.522 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:04.522 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:04.522 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:04.522 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:04.523 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:04.523 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:04.523 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:04.523 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:04.523 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.510+0000 7fe6f4713640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:04.523 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.510+0000 7fe6f4713640 4 set_mon_vals no callback set 2026-02-12T03:58:04.523 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.510+0000 7fe6f4713640 10 monclient: shutdown 2026-02-12T03:58:04.523 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.510+0000 7fe6f4713640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:04.523 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.510+0000 7fe6f4713640 1 -- 10.20.193.154:0/1234352921 >> v1:10.20.193.91:6789/0 conn(0x7fe6ec164750 legacy=0x7fe6ec184bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:04.523 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.510+0000 7fe6f4713640 1 -- 10.20.193.154:0/1234352921 shutdown_connections 2026-02-12T03:58:04.523 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.510+0000 7fe6f4713640 1 -- 10.20.193.154:0/1234352921 >> 10.20.193.154:0/1234352921 conn(0x7fe6ec05a750 msgr2=0x7fe6ec05ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:04.523 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.510+0000 7fe6f4713640 1 -- 10.20.193.154:0/1234352921 shutdown_connections 2026-02-12T03:58:04.524 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.510+0000 7fe6f4713640 1 -- 10.20.193.154:0/1234352921 wait complete. 2026-02-12T03:58:04.524 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.510+0000 7fe6f4713640 10 monclient: build_initial_monmap 2026-02-12T03:58:04.524 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.510+0000 7fe6f4713640 10 monclient: monmap: 2026-02-12T03:58:04.524 INFO:teuthology.orchestra.run.trial154.stderr:epoch 0 2026-02-12T03:58:04.524 INFO:teuthology.orchestra.run.trial154.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:04.524 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 0.000000 2026-02-12T03:58:04.524 INFO:teuthology.orchestra.run.trial154.stderr:created 0.000000 2026-02-12T03:58:04.524 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:04.524 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 1 2026-02-12T03:58:04.524 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:04.524 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:04.524 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:04.525 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:04.525 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.510+0000 7fe6f4713640 1 librados: starting msgr at 2026-02-12T03:58:04.525 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.510+0000 7fe6f4713640 1 librados: starting objecter 2026-02-12T03:58:04.525 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.510+0000 7fe6f4713640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:04.525 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.510+0000 7fe6f4713640 1 Processor -- start 2026-02-12T03:58:04.525 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.510+0000 7fe6f4713640 1 -- start start 2026-02-12T03:58:04.525 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.510+0000 7fe6f4713640 1 librados: setting wanted keys 2026-02-12T03:58:04.525 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.510+0000 7fe6f4713640 1 librados: calling monclient init 2026-02-12T03:58:04.525 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.510+0000 7fe6f4713640 10 monclient: init 2026-02-12T03:58:04.525 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.510+0000 7fe6f4713640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:04.525 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.510+0000 7fe6f4713640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T03:58:04.526 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.510+0000 7fe6f4713640 10 monclient(hunting): picked mon.noname-c con 0x7fe6ec0584c0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:04.526 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.510+0000 7fe6f4713640 10 monclient(hunting): picked mon.noname-a con 0x7fe6ec058980 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:04.526 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.510+0000 7fe6f4713640 10 monclient(hunting): picked mon.noname-b con 0x7fe6ec164750 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:04.526 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.510+0000 7fe6f4713640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6ec162540 con 0x7fe6ec058980 2026-02-12T03:58:04.526 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.510+0000 7fe6f4713640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6ec163720 con 0x7fe6ec164750 2026-02-12T03:58:04.526 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.510+0000 7fe6f4713640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6ec1638f0 con 0x7fe6ec0584c0 2026-02-12T03:58:04.526 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.510+0000 7fe6f4713640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:04.526 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.510+0000 7fe6f4713640 10 monclient(hunting): authenticate will time out at 1085.163927s 2026-02-12T03:58:04.526 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.511+0000 7fe6f2488640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7fe6ec0584c0 0x7fe6ec102810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.154:53486/0 (socket says 10.20.193.154:53486) 2026-02-12T03:58:04.526 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.511+0000 7fe6f2488640 1 -- 10.20.193.154:0/4286615491 learned_addr learned my addr 10.20.193.154:0/4286615491 (peer_addr_for_me v1:10.20.193.154:0/0) 2026-02-12T03:58:04.526 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.511+0000 7fe6d2ffd640 10 client.?.objecter ms_handle_connect 0x7fe6ec164750 2026-02-12T03:58:04.526 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.511+0000 7fe6d2ffd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:04.526 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.511+0000 7fe6d2ffd640 10 client.?.objecter ms_handle_connect 0x7fe6ec058980 2026-02-12T03:58:04.527 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.511+0000 7fe6d2ffd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:04.527 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.511+0000 7fe6d2ffd640 10 client.?.objecter ms_handle_connect 0x7fe6ec0584c0 2026-02-12T03:58:04.527 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.511+0000 7fe6d2ffd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:04.527 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.512+0000 7fe6d2ffd640 1 -- 10.20.193.154:0/4286615491 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1712156129 0 0) 0x7fe6ec163720 con 0x7fe6ec164750 2026-02-12T03:58:04.527 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.512+0000 7fe6d2ffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:04.527 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.512+0000 7fe6d2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:04.527 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.512+0000 7fe6d2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:04.527 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.512+0000 7fe6d2ffd640 10 monclient(hunting): my global_id is 4213 2026-02-12T03:58:04.527 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.512+0000 7fe6d2ffd640 1 -- 10.20.193.154:0/4286615491 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6bc003610 con 0x7fe6ec164750 2026-02-12T03:58:04.527 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.512+0000 7fe6d2ffd640 1 -- 10.20.193.154:0/4286615491 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3031238336 0 0) 0x7fe6ec162540 con 0x7fe6ec058980 2026-02-12T03:58:04.527 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.512+0000 7fe6d2ffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:04.527 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.512+0000 7fe6d2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:04.528 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.512+0000 7fe6d2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:04.528 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.512+0000 7fe6d2ffd640 10 monclient(hunting): my global_id is 4212 2026-02-12T03:58:04.528 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.512+0000 7fe6d2ffd640 1 -- 10.20.193.154:0/4286615491 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6ec163720 con 0x7fe6ec058980 2026-02-12T03:58:04.528 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.512+0000 7fe6d2ffd640 1 -- 10.20.193.154:0/4286615491 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1858063892 0 0) 0x7fe6ec1638f0 con 0x7fe6ec0584c0 2026-02-12T03:58:04.528 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.512+0000 7fe6d2ffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:04.528 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.512+0000 7fe6d2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:04.528 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.512+0000 7fe6d2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:04.528 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.512+0000 7fe6d2ffd640 10 monclient(hunting): my global_id is 4181 2026-02-12T03:58:04.528 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.512+0000 7fe6d2ffd640 1 -- 10.20.193.154:0/4286615491 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6ec162540 con 0x7fe6ec0584c0 2026-02-12T03:58:04.534 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.514+0000 7fe6d2ffd640 1 -- 10.20.193.154:0/4286615491 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2288269482 0 0) 0x7fe6ec163720 con 0x7fe6ec058980 2026-02-12T03:58:04.534 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.514+0000 7fe6d2ffd640 1 -- 10.20.193.154:0/4286615491 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe6ec1638f0 con 0x7fe6ec058980 2026-02-12T03:58:04.535 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.514+0000 7fe6d2ffd640 1 -- 10.20.193.154:0/4286615491 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fe6e0003090 con 0x7fe6ec058980 2026-02-12T03:58:04.535 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.514+0000 7fe6d2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:04.535 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.514+0000 7fe6d2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:04.535 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.514+0000 7fe6d2ffd640 10 monclient(hunting): dump: 2026-02-12T03:58:04.535 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:04.536 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:04.536 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:04.536 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:04.536 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:04.536 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:04.536 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:04.537 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:04.537 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:04.537 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:04.537 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.514+0000 7fe6d2ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:04.537 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.515+0000 7fe6d2ffd640 1 -- 10.20.193.154:0/4286615491 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3515039314 0 0) 0x7fe6bc003610 con 0x7fe6ec164750 2026-02-12T03:58:04.537 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.515+0000 7fe6d2ffd640 1 -- 10.20.193.154:0/4286615491 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe6ec163720 con 0x7fe6ec164750 2026-02-12T03:58:04.538 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.515+0000 7fe6d2ffd640 1 -- 10.20.193.154:0/4286615491 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fe6e8003700 con 0x7fe6ec164750 2026-02-12T03:58:04.538 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.515+0000 7fe6d2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:04.538 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.515+0000 7fe6d2ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:04.538 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.515+0000 7fe6d2ffd640 10 monclient(hunting): dump: 2026-02-12T03:58:04.538 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:04.538 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:04.539 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:04.539 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:04.539 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:04.539 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:04.539 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:04.539 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:04.540 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:04.540 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:04.540 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.515+0000 7fe6d2ffd640 1 -- 10.20.193.154:0/4286615491 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 792939391 0 0) 0x7fe6ec162540 con 0x7fe6ec0584c0 2026-02-12T03:58:04.540 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.515+0000 7fe6d2ffd640 1 -- 10.20.193.154:0/4286615491 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe6bc003610 con 0x7fe6ec0584c0 2026-02-12T03:58:04.540 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.515+0000 7fe6d2ffd640 1 -- 10.20.193.154:0/4286615491 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fe6dc0030b0 con 0x7fe6ec0584c0 2026-02-12T03:58:04.540 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.515+0000 7fe6d2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:04.541 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.515+0000 7fe6d2ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:04.541 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.515+0000 7fe6d2ffd640 10 monclient(hunting): dump: 2026-02-12T03:58:04.541 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:04.541 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:04.541 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:04.541 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:04.542 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:04.542 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:04.542 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:04.542 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:04.542 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:04.542 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:04.543 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.516+0000 7fe6d2ffd640 1 -- 10.20.193.154:0/4286615491 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3127023072 0 0) 0x7fe6ec1638f0 con 0x7fe6ec058980 2026-02-12T03:58:04.543 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.516+0000 7fe6d2ffd640 1 -- 10.20.193.154:0/4286615491 >> v1:10.20.193.111:6789/0 conn(0x7fe6ec0584c0 legacy=0x7fe6ec102810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:04.543 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.516+0000 7fe6d2ffd640 1 -- 10.20.193.154:0/4286615491 >> v1:10.20.193.98:6789/0 conn(0x7fe6ec164750 legacy=0x7fe6ec160e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:04.543 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.516+0000 7fe6d2ffd640 10 monclient: _finish_hunting 0 2026-02-12T03:58:04.543 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.516+0000 7fe6d2ffd640 1 monclient: found mon.a 2026-02-12T03:58:04.544 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.516+0000 7fe6d2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:04.544 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.516+0000 7fe6d2ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:04.544 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.516+0000 7fe6d2ffd640 1 -- 10.20.193.154:0/4286615491 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ec163ac0 con 0x7fe6ec058980 2026-02-12T03:58:04.544 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.516+0000 7fe6d2ffd640 10 monclient: _finish_auth 0 2026-02-12T03:58:04.544 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.516+0000 7fe6d2ffd640 10 monclient: _check_auth_tickets 2026-02-12T03:58:04.544 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.516+0000 7fe6d2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:04.544 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.516+0000 7fe6f4713640 5 monclient: authenticate success, global_id 4212 2026-02-12T03:58:04.545 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.516+0000 7fe6f4713640 10 monclient: _renew_subs 2026-02-12T03:58:04.545 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.516+0000 7fe6f4713640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:04.545 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.516+0000 7fe6f4713640 1 -- 10.20.193.154:0/4286615491 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe6ec163d50 con 0x7fe6ec058980 2026-02-12T03:58:04.545 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.516+0000 7fe6f4713640 10 client.4212.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:04.545 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.516+0000 7fe6f4713640 10 monclient: _renew_subs 2026-02-12T03:58:04.545 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.516+0000 7fe6f4713640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:04.546 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.516+0000 7fe6f4713640 1 -- 10.20.193.154:0/4286615491 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe6ec164340 con 0x7fe6ec058980 2026-02-12T03:58:04.546 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.516+0000 7fe6f4713640 1 librados: init done 2026-02-12T03:58:04.546 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.516+0000 7fe6f4713640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:04.546 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.516+0000 7fe6f4713640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:04.546 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.516+0000 7fe6f4713640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:04.546 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.516+0000 7fe6f4713640 1 -- 10.20.193.154:0/4286615491 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6ec186b80 con 0x7fe6ec058980 2026-02-12T03:58:04.546 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.523+0000 7fe6d2ffd640 1 -- 10.20.193.154:0/4286615491 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe6e0003700 con 0x7fe6ec058980 2026-02-12T03:58:04.547 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.523+0000 7fe6d2ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:04.547 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.523+0000 7fe6d2ffd640 1 -- 10.20.193.154:0/4286615491 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fe6e0003a50 con 0x7fe6ec058980 2026-02-12T03:58:04.547 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.523+0000 7fe6d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:04.547 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.523+0000 7fe6d2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:04.547 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.523+0000 7fe6d2ffd640 10 monclient: dump: 2026-02-12T03:58:04.547 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:04.548 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:04.548 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:04.548 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:04.548 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:04.548 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:04.548 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:04.548 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:04.548 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:04.549 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:04.549 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.523+0000 7fe6f0c85640 4 set_mon_vals no callback set 2026-02-12T03:58:04.549 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.524+0000 7fe6d2ffd640 1 -- 10.20.193.154:0/4286615491 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 3) ==== 103062+0+0 (unknown 3263092698 0 0) 0x7fe6e001ce90 con 0x7fe6ec058980 2026-02-12T03:58:04.549 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.525+0000 7fe6f2488640 10 monclient: get_auth_request con 0x7fe6bc079e50 auth_method 0 2026-02-12T03:58:04.549 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.525+0000 7fe6d2ffd640 10 client.4212.objecter ms_handle_connect 0x7fe6bc079e50 2026-02-12T03:58:04.549 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.525+0000 7fe6d2ffd640 1 -- 10.20.193.154:0/4286615491 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(15..15 src has 1..15) ==== 2215+0+0 (unknown 1483890809 0 0) 0x7fe6e0059a50 con 0x7fe6ec058980 2026-02-12T03:58:04.549 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.525+0000 7fe6d2ffd640 10 client.4212.objecter ms_dispatch2 0x7fe6ec000b90 osd_map(15..15 src has 1..15) 2026-02-12T03:58:04.550 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.525+0000 7fe6d2ffd640 3 client.4212.objecter handle_osd_map got epochs [15,15] > 0 2026-02-12T03:58:04.550 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.525+0000 7fe6d2ffd640 3 client.4212.objecter handle_osd_map decoding full epoch 15 2026-02-12T03:58:04.550 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.525+0000 7fe6d2ffd640 20 client.4212.objecter dump_active .. 0 homeless 2026-02-12T03:58:04.615 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.613+0000 7fe6d2ffd640 1 -- 10.20.193.154:0/4286615491 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7fe6e005e1c0 con 0x7fe6ec058980 2026-02-12T03:58:04.615 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.613+0000 7fe6d2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:04.616 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.613+0000 7fe6d2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:04.726 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.723+0000 7fe6f4713640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "a8215062-521c-47f6-b20a-9e40c1f3f5a6", "id": 13}] 2026-02-12T03:58:04.726 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.723+0000 7fe6f4713640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "a8215062-521c-47f6-b20a-9e40c1f3f5a6", "id": 13}] 2026-02-12T03:58:04.726 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.723+0000 7fe6f4713640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:04.726 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.723+0000 7fe6f4713640 1 -- 10.20.193.154:0/4286615491 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "osd new", "uuid": "a8215062-521c-47f6-b20a-9e40c1f3f5a6", "id": 13} v 0) -- 0x7fe6ec162710 con 0x7fe6ec058980 2026-02-12T03:58:04.795 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.792+0000 7fe6d2ffd640 1 -- 10.20.193.154:0/4286615491 <== mon.0 v1:10.20.193.91:6789/0 10 ==== mgrmap(e 4) ==== 103168+0+0 (unknown 3733604615 0 0) 0x7fe6e005d380 con 0x7fe6ec058980 2026-02-12T03:58:04.811 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.810+0000 7fe6d2ffd640 1 -- 10.20.193.154:0/4286615491 <== mon.0 v1:10.20.193.91:6789/0 11 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a8215062-521c-47f6-b20a-9e40c1f3f5a6", "id": 13}]=0 v16) ==== 113+0+3 (unknown 3302974441 0 736921282) 0x7fe6e0074650 con 0x7fe6ec058980 2026-02-12T03:58:04.812 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.810+0000 7fe6d2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "a8215062-521c-47f6-b20a-9e40c1f3f5a6", "id": 13}] 2026-02-12T03:58:04.812 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.810+0000 7fe6d2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:04.812 INFO:teuthology.orchestra.run.trial154.stdout:13 2026-02-12T03:58:04.814 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.810+0000 7fe6f4713640 10 librados: watch_flush enter 2026-02-12T03:58:04.814 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.810+0000 7fe6f4713640 10 librados: watch_flush exit 2026-02-12T03:58:04.814 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.810+0000 7fe6f4713640 20 client.4212.objecter shutdown clearing up homeless session... 2026-02-12T03:58:04.814 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.810+0000 7fe6f4713640 10 client.4212.objecter successfully canceled tick 2026-02-12T03:58:04.814 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.810+0000 7fe6f4713640 1 -- 10.20.193.154:0/4286615491 >> v1:10.20.193.91:6800/2929217192 conn(0x7fe6bc079e50 legacy=0x7fe6bc09a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:04.814 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.810+0000 7fe6f4713640 10 monclient: shutdown 2026-02-12T03:58:04.814 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.810+0000 7fe6f4713640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:04.814 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.810+0000 7fe6f4713640 1 -- 10.20.193.154:0/4286615491 >> v1:10.20.193.91:6789/0 conn(0x7fe6ec058980 legacy=0x7fe6ec15f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:04.814 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.810+0000 7fe6f4713640 1 -- 10.20.193.154:0/4286615491 shutdown_connections 2026-02-12T03:58:04.815 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.810+0000 7fe6f4713640 1 -- 10.20.193.154:0/4286615491 >> 10.20.193.154:0/4286615491 conn(0x7fe6ec05a750 msgr2=0x7fe6ec184b90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:04.815 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.810+0000 7fe6f4713640 1 -- 10.20.193.154:0/4286615491 shutdown_connections 2026-02-12T03:58:04.815 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.810+0000 7fe6f4713640 1 -- 10.20.193.154:0/4286615491 wait complete. 2026-02-12T03:58:04.815 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.810+0000 7fe6f4713640 1 librados: shutdown 2026-02-12T03:58:04.821 DEBUG:teuthology.orchestra.run.trial154:> sudo ceph --cluster ceph osd new 3cd1bb48-53a2-462e-b7e5-4d6d918dd543 14 2026-02-12T03:58:04.886 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.883+0000 7fd81c0fb640 10 monclient: get_monmap_and_config 2026-02-12T03:58:04.887 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.883+0000 7fd81c0fb640 10 monclient: build_initial_monmap 2026-02-12T03:58:04.887 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.883+0000 7fd81c0fb640 10 monclient: monmap: 2026-02-12T03:58:04.887 INFO:teuthology.orchestra.run.trial154.stderr:epoch 0 2026-02-12T03:58:04.887 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:04.887 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:58:04.884645+0000 2026-02-12T03:58:04.887 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:58:04.884645+0000 2026-02-12T03:58:04.887 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:04.887 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:04.887 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:04.887 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:04.888 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:04.888 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:04.888 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.883+0000 7fd81c0fb640 1 Processor -- start 2026-02-12T03:58:04.888 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.883+0000 7fd81c0fb640 1 -- start start 2026-02-12T03:58:04.888 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.883+0000 7fd81c0fb640 10 monclient: init 2026-02-12T03:58:04.888 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.883+0000 7fd81c0fb640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:04.888 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.883+0000 7fd81c0fb640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T03:58:04.888 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.883+0000 7fd81c0fb640 10 monclient(hunting): picked mon.noname-c con 0x7fd81411cae0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:04.888 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.883+0000 7fd81c0fb640 10 monclient(hunting): picked mon.noname-a con 0x7fd81411ceb0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:04.888 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.883+0000 7fd81c0fb640 10 monclient(hunting): picked mon.noname-b con 0x7fd8141649c0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:04.888 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.883+0000 7fd81c0fb640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8141864c0 con 0x7fd81411ceb0 2026-02-12T03:58:04.889 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.883+0000 7fd81c0fb640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8141876a0 con 0x7fd8141649c0 2026-02-12T03:58:04.889 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.883+0000 7fd81c0fb640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd814188880 con 0x7fd81411cae0 2026-02-12T03:58:04.889 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.883+0000 7fd81c0fb640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:04.889 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.883+0000 7fd81c0fb640 10 monclient(hunting): authenticate will time out at 1085.536910s 2026-02-12T03:58:04.889 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.884+0000 7fd819e70640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7fd81411cae0 0x7fd81411b1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.154:53492/0 (socket says 10.20.193.154:53492) 2026-02-12T03:58:04.889 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.884+0000 7fd81a671640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7fd8141649c0 0x7fd814184da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.154:39502/0 (socket says 10.20.193.154:39502) 2026-02-12T03:58:04.889 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.884+0000 7fd819e70640 1 -- 10.20.193.154:0/3713373115 learned_addr learned my addr 10.20.193.154:0/3713373115 (peer_addr_for_me v1:10.20.193.154:0/0) 2026-02-12T03:58:04.894 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.885+0000 7fd818e6e640 1 -- 10.20.193.154:0/3713373115 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2933737963 0 0) 0x7fd8141876a0 con 0x7fd8141649c0 2026-02-12T03:58:04.894 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.885+0000 7fd818e6e640 10 monclient(hunting): _negotiate 2026-02-12T03:58:04.894 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.885+0000 7fd818e6e640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:04.894 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.885+0000 7fd818e6e640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:04.894 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.885+0000 7fd818e6e640 10 monclient(hunting): my global_id is 4216 2026-02-12T03:58:04.895 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.885+0000 7fd818e6e640 1 -- 10.20.193.154:0/3713373115 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7fc003610 con 0x7fd8141649c0 2026-02-12T03:58:04.895 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.885+0000 7fd818e6e640 1 -- 10.20.193.154:0/3713373115 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2396501129 0 0) 0x7fd814188880 con 0x7fd81411cae0 2026-02-12T03:58:04.895 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.885+0000 7fd818e6e640 10 monclient(hunting): _negotiate 2026-02-12T03:58:04.895 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.885+0000 7fd818e6e640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:04.895 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.885+0000 7fd818e6e640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:04.895 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.885+0000 7fd818e6e640 10 monclient(hunting): my global_id is 4184 2026-02-12T03:58:04.895 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.885+0000 7fd818e6e640 1 -- 10.20.193.154:0/3713373115 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8141876a0 con 0x7fd81411cae0 2026-02-12T03:58:04.895 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.887+0000 7fd818e6e640 1 -- 10.20.193.154:0/3713373115 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1473372072 0 0) 0x7fd7fc003610 con 0x7fd8141649c0 2026-02-12T03:58:04.895 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.887+0000 7fd818e6e640 1 -- 10.20.193.154:0/3713373115 >> v1:10.20.193.111:6789/0 conn(0x7fd81411cae0 legacy=0x7fd81411b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:04.895 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.887+0000 7fd818e6e640 1 -- 10.20.193.154:0/3713373115 >> v1:10.20.193.91:6789/0 conn(0x7fd81411ceb0 legacy=0x7fd81411b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T03:58:04.895 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.887+0000 7fd818e6e640 10 monclient: _finish_hunting 0 2026-02-12T03:58:04.896 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.887+0000 7fd818e6e640 1 monclient: found mon.noname-b 2026-02-12T03:58:04.896 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.887+0000 7fd818e6e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:04.896 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.887+0000 7fd818e6e640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T03:58:04.896 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.887+0000 7fd818e6e640 1 -- 10.20.193.154:0/3713373115 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd814189b20 con 0x7fd8141649c0 2026-02-12T03:58:04.896 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.887+0000 7fd818e6e640 10 monclient: _finish_auth 0 2026-02-12T03:58:04.896 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.887+0000 7fd818e6e640 10 monclient: _check_auth_tickets 2026-02-12T03:58:04.896 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.887+0000 7fd818e6e640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:04.896 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.887+0000 7fd818e6e640 1 -- 10.20.193.154:0/3713373115 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd810003170 con 0x7fd8141649c0 2026-02-12T03:58:04.896 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.887+0000 7fd818e6e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:04.896 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.887+0000 7fd818e6e640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:04.896 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.887+0000 7fd818e6e640 10 monclient: dump: 2026-02-12T03:58:04.896 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:04.897 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:04.897 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:04.897 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:04.897 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:04.897 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:04.897 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:04.897 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:04.897 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:04.897 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:04.897 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.887+0000 7fd81c0fb640 5 monclient: authenticate success, global_id 4216 2026-02-12T03:58:04.897 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.887+0000 7fd81c0fb640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:04.897 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.888+0000 7fd818e6e640 1 -- 10.20.193.154:0/3713373115 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd8100033f0 con 0x7fd8141649c0 2026-02-12T03:58:04.897 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.888+0000 7fd818e6e640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:04.898 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.888+0000 7fd818e6e640 1 -- 10.20.193.154:0/3713373115 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd810003830 con 0x7fd8141649c0 2026-02-12T03:58:04.898 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.888+0000 7fd81c0fb640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:04.898 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.888+0000 7fd81c0fb640 4 set_mon_vals no callback set 2026-02-12T03:58:04.898 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.888+0000 7fd818e6e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:04.898 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.888+0000 7fd818e6e640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:04.898 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.888+0000 7fd818e6e640 10 monclient: dump: 2026-02-12T03:58:04.898 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:04.898 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:04.898 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:04.898 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:04.898 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:04.898 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:04.899 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:04.899 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:04.899 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:04.899 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:04.899 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.888+0000 7fd81c0fb640 10 monclient: shutdown 2026-02-12T03:58:04.899 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.888+0000 7fd81c0fb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:04.899 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.888+0000 7fd81c0fb640 1 -- 10.20.193.154:0/3713373115 >> v1:10.20.193.98:6789/0 conn(0x7fd8141649c0 legacy=0x7fd814184da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:04.899 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.888+0000 7fd81c0fb640 1 -- 10.20.193.154:0/3713373115 shutdown_connections 2026-02-12T03:58:04.899 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.888+0000 7fd81c0fb640 1 -- 10.20.193.154:0/3713373115 >> 10.20.193.154:0/3713373115 conn(0x7fd814058b60 msgr2=0x7fd814058f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:04.899 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.888+0000 7fd81c0fb640 1 -- 10.20.193.154:0/3713373115 shutdown_connections 2026-02-12T03:58:04.899 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.888+0000 7fd81c0fb640 1 -- 10.20.193.154:0/3713373115 wait complete. 2026-02-12T03:58:04.899 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.889+0000 7fd81c0fb640 10 monclient: build_initial_monmap 2026-02-12T03:58:04.900 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.889+0000 7fd81c0fb640 10 monclient: monmap: 2026-02-12T03:58:04.900 INFO:teuthology.orchestra.run.trial154.stderr:epoch 0 2026-02-12T03:58:04.900 INFO:teuthology.orchestra.run.trial154.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:04.900 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 0.000000 2026-02-12T03:58:04.900 INFO:teuthology.orchestra.run.trial154.stderr:created 0.000000 2026-02-12T03:58:04.900 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:04.900 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 1 2026-02-12T03:58:04.900 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:04.900 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:04.900 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:04.900 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:04.900 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.889+0000 7fd81c0fb640 1 librados: starting msgr at 2026-02-12T03:58:04.901 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.889+0000 7fd81c0fb640 1 librados: starting objecter 2026-02-12T03:58:04.901 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.889+0000 7fd81c0fb640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:04.901 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.889+0000 7fd81c0fb640 1 Processor -- start 2026-02-12T03:58:04.901 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.889+0000 7fd81c0fb640 1 -- start start 2026-02-12T03:58:04.901 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.889+0000 7fd81c0fb640 1 librados: setting wanted keys 2026-02-12T03:58:04.901 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.889+0000 7fd81c0fb640 1 librados: calling monclient init 2026-02-12T03:58:04.901 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.889+0000 7fd81c0fb640 10 monclient: init 2026-02-12T03:58:04.901 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.889+0000 7fd81c0fb640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:04.901 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.889+0000 7fd81c0fb640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T03:58:04.901 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.889+0000 7fd81c0fb640 10 monclient(hunting): picked mon.noname-c con 0x7fd81411cae0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:04.901 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.889+0000 7fd81c0fb640 10 monclient(hunting): picked mon.noname-a con 0x7fd81411ceb0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:04.901 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.889+0000 7fd81c0fb640 10 monclient(hunting): picked mon.noname-b con 0x7fd8141649c0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:04.901 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.889+0000 7fd81c0fb640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd81416d870 con 0x7fd81411ceb0 2026-02-12T03:58:04.902 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.889+0000 7fd81c0fb640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd814174700 con 0x7fd8141649c0 2026-02-12T03:58:04.902 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.889+0000 7fd81c0fb640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8141758e0 con 0x7fd81411cae0 2026-02-12T03:58:04.902 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.889+0000 7fd81c0fb640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:04.902 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.889+0000 7fd81c0fb640 10 monclient(hunting): authenticate will time out at 1085.542379s 2026-02-12T03:58:04.902 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.889+0000 7fd819e70640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7fd81411cae0 0x7fd81416cd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.154:53502/0 (socket says 10.20.193.154:53502) 2026-02-12T03:58:04.902 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.889+0000 7fd819e70640 1 -- 10.20.193.154:0/1356133755 learned_addr learned my addr 10.20.193.154:0/1356133755 (peer_addr_for_me v1:10.20.193.154:0/0) 2026-02-12T03:58:04.902 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.890+0000 7fd8027fc640 10 client.?.objecter ms_handle_connect 0x7fd81411cae0 2026-02-12T03:58:04.902 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.890+0000 7fd8027fc640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:04.902 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.890+0000 7fd8027fc640 10 client.?.objecter ms_handle_connect 0x7fd8141649c0 2026-02-12T03:58:04.902 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.890+0000 7fd8027fc640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:04.902 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.890+0000 7fd8027fc640 10 client.?.objecter ms_handle_connect 0x7fd81411ceb0 2026-02-12T03:58:04.902 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.890+0000 7fd8027fc640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:04.903 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.891+0000 7fd8027fc640 1 -- 10.20.193.154:0/1356133755 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3437611226 0 0) 0x7fd8141758e0 con 0x7fd81411cae0 2026-02-12T03:58:04.903 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.891+0000 7fd8027fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:04.903 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.891+0000 7fd8027fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:04.903 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.891+0000 7fd8027fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:04.903 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.891+0000 7fd8027fc640 10 monclient(hunting): my global_id is 4187 2026-02-12T03:58:04.903 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.891+0000 7fd8027fc640 1 -- 10.20.193.154:0/1356133755 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7e4003610 con 0x7fd81411cae0 2026-02-12T03:58:04.903 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.891+0000 7fd8027fc640 1 -- 10.20.193.154:0/1356133755 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 283056359 0 0) 0x7fd814174700 con 0x7fd8141649c0 2026-02-12T03:58:04.903 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.891+0000 7fd8027fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:04.903 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.891+0000 7fd8027fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:04.903 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.891+0000 7fd8027fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:04.903 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.891+0000 7fd8027fc640 10 monclient(hunting): my global_id is 4219 2026-02-12T03:58:04.903 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.891+0000 7fd8027fc640 1 -- 10.20.193.154:0/1356133755 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8141758e0 con 0x7fd8141649c0 2026-02-12T03:58:04.907 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.892+0000 7fd8027fc640 1 -- 10.20.193.154:0/1356133755 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2648765800 0 0) 0x7fd81416d870 con 0x7fd81411ceb0 2026-02-12T03:58:04.907 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.892+0000 7fd8027fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:04.907 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.892+0000 7fd8027fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:04.907 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.892+0000 7fd8027fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:04.907 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.892+0000 7fd8027fc640 10 monclient(hunting): my global_id is 4215 2026-02-12T03:58:04.907 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.892+0000 7fd8027fc640 1 -- 10.20.193.154:0/1356133755 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd814174700 con 0x7fd81411ceb0 2026-02-12T03:58:04.907 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.894+0000 7fd8027fc640 1 -- 10.20.193.154:0/1356133755 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1564526164 0 0) 0x7fd8141758e0 con 0x7fd8141649c0 2026-02-12T03:58:04.907 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.894+0000 7fd8027fc640 1 -- 10.20.193.154:0/1356133755 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd81416d870 con 0x7fd8141649c0 2026-02-12T03:58:04.908 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.894+0000 7fd8027fc640 1 -- 10.20.193.154:0/1356133755 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd810003080 con 0x7fd8141649c0 2026-02-12T03:58:04.908 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.894+0000 7fd8027fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:04.908 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.894+0000 7fd8027fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:04.908 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.894+0000 7fd8027fc640 10 monclient(hunting): dump: 2026-02-12T03:58:04.908 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:04.908 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:04.908 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:04.908 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:04.908 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:04.908 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:04.908 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:04.908 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:04.909 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:04.909 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:04.909 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.894+0000 7fd8027fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:04.909 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.895+0000 7fd8027fc640 1 -- 10.20.193.154:0/1356133755 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1115874001 0 0) 0x7fd814174700 con 0x7fd81411ceb0 2026-02-12T03:58:04.909 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.895+0000 7fd8027fc640 1 -- 10.20.193.154:0/1356133755 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd8141758e0 con 0x7fd81411ceb0 2026-02-12T03:58:04.909 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.895+0000 7fd8027fc640 1 -- 10.20.193.154:0/1356133755 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd808003090 con 0x7fd81411ceb0 2026-02-12T03:58:04.909 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.895+0000 7fd8027fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:04.909 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.895+0000 7fd8027fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:04.909 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.895+0000 7fd8027fc640 10 monclient(hunting): dump: 2026-02-12T03:58:04.909 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:04.909 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:04.909 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:04.910 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:04.910 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:04.910 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:04.910 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:04.910 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:04.910 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:04.910 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:04.910 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.895+0000 7fd8027fc640 1 -- 10.20.193.154:0/1356133755 <== mon.1 v1:10.20.193.98:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1006667064 0 0) 0x7fd81416d870 con 0x7fd8141649c0 2026-02-12T03:58:04.910 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.895+0000 7fd8027fc640 1 -- 10.20.193.154:0/1356133755 >> v1:10.20.193.111:6789/0 conn(0x7fd81411cae0 legacy=0x7fd81416cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:04.910 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.895+0000 7fd8027fc640 1 -- 10.20.193.154:0/1356133755 >> v1:10.20.193.91:6789/0 conn(0x7fd81411ceb0 legacy=0x7fd814161990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:04.910 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.895+0000 7fd8027fc640 10 monclient: _finish_hunting 0 2026-02-12T03:58:04.910 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.895+0000 7fd8027fc640 1 monclient: found mon.b 2026-02-12T03:58:04.911 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.895+0000 7fd8027fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:04.911 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.895+0000 7fd8027fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:04.911 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.895+0000 7fd8027fc640 1 -- 10.20.193.154:0/1356133755 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd814176ac0 con 0x7fd8141649c0 2026-02-12T03:58:04.911 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.895+0000 7fd8027fc640 10 monclient: _finish_auth 0 2026-02-12T03:58:04.911 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.895+0000 7fd8027fc640 10 monclient: _check_auth_tickets 2026-02-12T03:58:04.911 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.895+0000 7fd8027fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:04.911 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.895+0000 7fd81c0fb640 5 monclient: authenticate success, global_id 4219 2026-02-12T03:58:04.911 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.895+0000 7fd81c0fb640 10 monclient: _renew_subs 2026-02-12T03:58:04.911 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.895+0000 7fd81c0fb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:04.911 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.895+0000 7fd81c0fb640 1 -- 10.20.193.154:0/1356133755 --> v1:10.20.193.98:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd8141748d0 con 0x7fd8141649c0 2026-02-12T03:58:04.911 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.896+0000 7fd81c0fb640 10 client.4219.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:04.911 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.896+0000 7fd81c0fb640 10 monclient: _renew_subs 2026-02-12T03:58:04.912 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.896+0000 7fd81c0fb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:04.912 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.896+0000 7fd81c0fb640 1 -- 10.20.193.154:0/1356133755 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd814174f10 con 0x7fd8141649c0 2026-02-12T03:58:04.912 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.896+0000 7fd81c0fb640 1 librados: init done 2026-02-12T03:58:04.912 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.896+0000 7fd81c0fb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:04.912 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.896+0000 7fd81c0fb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:04.912 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.896+0000 7fd81c0fb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:04.912 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.896+0000 7fd81c0fb640 1 -- 10.20.193.154:0/1356133755 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd814187da0 con 0x7fd8141649c0 2026-02-12T03:58:04.912 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.904+0000 7fd8027fc640 1 -- 10.20.193.154:0/1356133755 <== mon.1 v1:10.20.193.98:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd810003290 con 0x7fd8141649c0 2026-02-12T03:58:04.912 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.904+0000 7fd8027fc640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:04.912 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.904+0000 7fd8027fc640 1 -- 10.20.193.154:0/1356133755 <== mon.1 v1:10.20.193.98:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd810005140 con 0x7fd8141649c0 2026-02-12T03:58:04.912 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.904+0000 7fd8027fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:04.912 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.904+0000 7fd8027fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:04.912 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.904+0000 7fd803fff640 4 set_mon_vals no callback set 2026-02-12T03:58:04.912 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.904+0000 7fd8027fc640 10 monclient: dump: 2026-02-12T03:58:04.913 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:04.913 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:04.913 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:04.913 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:04.913 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:04.913 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:04.913 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:04.913 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:04.913 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:04.913 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:04.914 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.905+0000 7fd8027fc640 1 -- 10.20.193.154:0/1356133755 <== mon.1 v1:10.20.193.98:6789/0 7 ==== mgrmap(e 4) ==== 103168+0+0 (unknown 3733604615 0 0) 0x7fd81001e5f0 con 0x7fd8141649c0 2026-02-12T03:58:04.914 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.906+0000 7fd819e70640 10 monclient: get_auth_request con 0x7fd7e4079e10 auth_method 0 2026-02-12T03:58:04.914 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.906+0000 7fd8027fc640 10 client.4219.objecter ms_handle_connect 0x7fd7e4079e10 2026-02-12T03:58:04.915 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.906+0000 7fd8027fc640 1 -- 10.20.193.154:0/1356133755 <== mon.1 v1:10.20.193.98:6789/0 8 ==== osd_map(16..16 src has 1..16) ==== 2330+0+0 (unknown 4245261680 0 0) 0x7fd81005b050 con 0x7fd8141649c0 2026-02-12T03:58:04.915 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.906+0000 7fd8027fc640 10 client.4219.objecter ms_dispatch2 0x7fd814000b90 osd_map(16..16 src has 1..16) 2026-02-12T03:58:04.915 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.906+0000 7fd8027fc640 3 client.4219.objecter handle_osd_map got epochs [16,16] > 0 2026-02-12T03:58:04.915 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.906+0000 7fd8027fc640 3 client.4219.objecter handle_osd_map decoding full epoch 16 2026-02-12T03:58:04.915 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.906+0000 7fd8027fc640 20 client.4219.objecter dump_active .. 0 homeless 2026-02-12T03:58:04.994 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.992+0000 7fd8027fc640 1 -- 10.20.193.154:0/1356133755 <== mon.1 v1:10.20.193.98:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7fd81005f7c0 con 0x7fd8141649c0 2026-02-12T03:58:04.994 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.992+0000 7fd8027fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:04.994 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:04.992+0000 7fd8027fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:05.106 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.104+0000 7fd81c0fb640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "3cd1bb48-53a2-462e-b7e5-4d6d918dd543", "id": 14}] 2026-02-12T03:58:05.107 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.104+0000 7fd81c0fb640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "3cd1bb48-53a2-462e-b7e5-4d6d918dd543", "id": 14}] 2026-02-12T03:58:05.107 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.104+0000 7fd81c0fb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:05.107 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.104+0000 7fd81c0fb640 1 -- 10.20.193.154:0/1356133755 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "osd new", "uuid": "3cd1bb48-53a2-462e-b7e5-4d6d918dd543", "id": 14} v 0) -- 0x7fd814175250 con 0x7fd8141649c0 2026-02-12T03:58:05.153 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.151+0000 7fd8027fc640 1 -- 10.20.193.154:0/1356133755 <== mon.1 v1:10.20.193.98:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3cd1bb48-53a2-462e-b7e5-4d6d918dd543", "id": 14}]=0 v17) ==== 113+0+3 (unknown 1354771571 0 1367428999) 0x7fd81005f0c0 con 0x7fd8141649c0 2026-02-12T03:58:05.153 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.151+0000 7fd8027fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "3cd1bb48-53a2-462e-b7e5-4d6d918dd543", "id": 14}] 2026-02-12T03:58:05.153 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.151+0000 7fd8027fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:05.153 INFO:teuthology.orchestra.run.trial154.stdout:14 2026-02-12T03:58:05.155 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.152+0000 7fd81c0fb640 10 librados: watch_flush enter 2026-02-12T03:58:05.155 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.152+0000 7fd81c0fb640 10 librados: watch_flush exit 2026-02-12T03:58:05.155 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.152+0000 7fd81c0fb640 20 client.4219.objecter shutdown clearing up homeless session... 2026-02-12T03:58:05.156 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.152+0000 7fd81c0fb640 10 client.4219.objecter successfully canceled tick 2026-02-12T03:58:05.156 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.152+0000 7fd81c0fb640 1 -- 10.20.193.154:0/1356133755 >> v1:10.20.193.91:6800/2929217192 conn(0x7fd7e4079e10 legacy=0x7fd7e409a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:05.156 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.152+0000 7fd81c0fb640 10 monclient: shutdown 2026-02-12T03:58:05.156 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.152+0000 7fd81c0fb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:05.156 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.152+0000 7fd81c0fb640 1 -- 10.20.193.154:0/1356133755 >> v1:10.20.193.98:6789/0 conn(0x7fd8141649c0 legacy=0x7fd8141630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:05.156 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.152+0000 7fd81c0fb640 1 -- 10.20.193.154:0/1356133755 shutdown_connections 2026-02-12T03:58:05.156 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.152+0000 7fd81c0fb640 1 -- 10.20.193.154:0/1356133755 >> 10.20.193.154:0/1356133755 conn(0x7fd814058b60 msgr2=0x7fd81405bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:05.156 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.152+0000 7fd81c0fb640 1 -- 10.20.193.154:0/1356133755 shutdown_connections 2026-02-12T03:58:05.156 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.152+0000 7fd81c0fb640 1 -- 10.20.193.154:0/1356133755 wait complete. 2026-02-12T03:58:05.156 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.152+0000 7fd81c0fb640 1 librados: shutdown 2026-02-12T03:58:05.164 DEBUG:teuthology.orchestra.run.trial154:> sudo ceph --cluster ceph osd new 9bd39438-f5e5-4a19-afa4-678395d63c24 15 2026-02-12T03:58:05.230 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.226+0000 7f9dcfa0b640 10 monclient: get_monmap_and_config 2026-02-12T03:58:05.230 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.226+0000 7f9dcfa0b640 10 monclient: build_initial_monmap 2026-02-12T03:58:05.230 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.226+0000 7f9dcfa0b640 10 monclient: monmap: 2026-02-12T03:58:05.230 INFO:teuthology.orchestra.run.trial154.stderr:epoch 0 2026-02-12T03:58:05.231 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:05.231 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:58:05.227808+0000 2026-02-12T03:58:05.231 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:58:05.227808+0000 2026-02-12T03:58:05.231 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:05.231 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:05.231 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:05.231 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:05.231 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:05.231 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:05.231 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.226+0000 7f9dcfa0b640 1 Processor -- start 2026-02-12T03:58:05.231 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.226+0000 7f9dcfa0b640 1 -- start start 2026-02-12T03:58:05.231 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.226+0000 7f9dcfa0b640 10 monclient: init 2026-02-12T03:58:05.232 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.227+0000 7f9dcfa0b640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:05.232 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.227+0000 7f9dcfa0b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T03:58:05.232 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.227+0000 7f9dcfa0b640 10 monclient(hunting): picked mon.noname-a con 0x7f9dc805dce0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:05.232 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.227+0000 7f9dcfa0b640 10 monclient(hunting): picked mon.noname-b con 0x7f9dc805ce10 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:05.232 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.227+0000 7f9dcfa0b640 10 monclient(hunting): picked mon.noname-c con 0x7f9dc805d290 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:05.232 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.227+0000 7f9dcfa0b640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dc8183150 con 0x7f9dc805dce0 2026-02-12T03:58:05.232 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.227+0000 7f9dcfa0b640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dc8184330 con 0x7f9dc805ce10 2026-02-12T03:58:05.232 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.227+0000 7f9dcfa0b640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dc8185530 con 0x7f9dc805d290 2026-02-12T03:58:05.232 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.227+0000 7f9dcfa0b640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:05.232 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.227+0000 7f9dcfa0b640 10 monclient(hunting): authenticate will time out at 1085.880301s 2026-02-12T03:58:05.232 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.227+0000 7f9dccf7f640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f9dc805ce10 0x7f9dc8160240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.154:39518/0 (socket says 10.20.193.154:39518) 2026-02-12T03:58:05.232 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.227+0000 7f9dccf7f640 1 -- 10.20.193.154:0/3071526069 learned_addr learned my addr 10.20.193.154:0/3071526069 (peer_addr_for_me v1:10.20.193.154:0/0) 2026-02-12T03:58:05.233 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.227+0000 7f9dcd780640 1 --1- 10.20.193.154:0/3071526069 >> v1:10.20.193.91:6789/0 conn(0x7f9dc805dce0 0x7f9dc805c700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.154:41856/0 (socket says 10.20.193.154:41856) 2026-02-12T03:58:05.238 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.229+0000 7f9db7fff640 1 -- 10.20.193.154:0/3071526069 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3700625555 0 0) 0x7f9dc8184330 con 0x7f9dc805ce10 2026-02-12T03:58:05.238 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.229+0000 7f9db7fff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:05.238 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.229+0000 7f9db7fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:05.239 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.229+0000 7f9db7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:05.239 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.229+0000 7f9db7fff640 10 monclient(hunting): my global_id is 4222 2026-02-12T03:58:05.239 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.229+0000 7f9db7fff640 1 -- 10.20.193.154:0/3071526069 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9db0003610 con 0x7f9dc805ce10 2026-02-12T03:58:05.239 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.229+0000 7f9db7fff640 1 -- 10.20.193.154:0/3071526069 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 584872000 0 0) 0x7f9dc8183150 con 0x7f9dc805dce0 2026-02-12T03:58:05.239 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.229+0000 7f9db7fff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:05.239 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.229+0000 7f9db7fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:05.239 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.229+0000 7f9db7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:05.239 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.229+0000 7f9db7fff640 10 monclient(hunting): my global_id is 4218 2026-02-12T03:58:05.239 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.229+0000 7f9db7fff640 1 -- 10.20.193.154:0/3071526069 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9dc8184330 con 0x7f9dc805dce0 2026-02-12T03:58:05.239 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.229+0000 7f9db7fff640 1 -- 10.20.193.154:0/3071526069 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3280109599 0 0) 0x7f9dc8185530 con 0x7f9dc805d290 2026-02-12T03:58:05.239 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.229+0000 7f9db7fff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:05.240 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.229+0000 7f9db7fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:05.240 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.229+0000 7f9db7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:05.240 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.229+0000 7f9db7fff640 10 monclient(hunting): my global_id is 4190 2026-02-12T03:58:05.240 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.229+0000 7f9db7fff640 1 -- 10.20.193.154:0/3071526069 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9dc8183150 con 0x7f9dc805d290 2026-02-12T03:58:05.240 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.230+0000 7f9db7fff640 1 -- 10.20.193.154:0/3071526069 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2222136321 0 0) 0x7f9db0003610 con 0x7f9dc805ce10 2026-02-12T03:58:05.240 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.230+0000 7f9db7fff640 1 -- 10.20.193.154:0/3071526069 >> v1:10.20.193.111:6789/0 conn(0x7f9dc805d290 legacy=0x7f9dc8181970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:05.240 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.230+0000 7f9db7fff640 1 -- 10.20.193.154:0/3071526069 >> v1:10.20.193.91:6789/0 conn(0x7f9dc805dce0 legacy=0x7f9dc805c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:05.240 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.230+0000 7f9db7fff640 10 monclient: _finish_hunting 0 2026-02-12T03:58:05.240 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.230+0000 7f9db7fff640 1 monclient: found mon.noname-b 2026-02-12T03:58:05.240 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.230+0000 7f9db7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:05.240 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.230+0000 7f9db7fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T03:58:05.240 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.230+0000 7f9db7fff640 1 -- 10.20.193.154:0/3071526069 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc81867d0 con 0x7f9dc805ce10 2026-02-12T03:58:05.241 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.230+0000 7f9db7fff640 10 monclient: _finish_auth 0 2026-02-12T03:58:05.241 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.230+0000 7f9db7fff640 10 monclient: _check_auth_tickets 2026-02-12T03:58:05.241 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.230+0000 7f9db7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:05.241 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.230+0000 7f9db7fff640 1 -- 10.20.193.154:0/3071526069 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f9dbc002df0 con 0x7f9dc805ce10 2026-02-12T03:58:05.241 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.230+0000 7f9db7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:05.241 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.230+0000 7f9db7fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:05.241 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.230+0000 7f9db7fff640 10 monclient: dump: 2026-02-12T03:58:05.241 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:05.241 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:05.241 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:05.241 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:05.242 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:05.242 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:05.242 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:05.242 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:05.242 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:05.242 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:05.242 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.230+0000 7f9dcfa0b640 5 monclient: authenticate success, global_id 4222 2026-02-12T03:58:05.242 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.230+0000 7f9dcfa0b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:05.242 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.231+0000 7f9db7fff640 1 -- 10.20.193.154:0/3071526069 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9dbc003030 con 0x7f9dc805ce10 2026-02-12T03:58:05.242 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.231+0000 7f9db7fff640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:05.242 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.231+0000 7f9db7fff640 1 -- 10.20.193.154:0/3071526069 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f9dbc003470 con 0x7f9dc805ce10 2026-02-12T03:58:05.242 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.231+0000 7f9db7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:05.242 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.231+0000 7f9db7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:05.243 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.231+0000 7f9db7fff640 10 monclient: dump: 2026-02-12T03:58:05.243 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:05.243 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:05.243 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:05.243 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:05.243 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:05.243 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:05.243 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:05.243 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:05.243 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:05.243 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:05.243 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.231+0000 7f9dcfa0b640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:05.244 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.231+0000 7f9dcfa0b640 4 set_mon_vals no callback set 2026-02-12T03:58:05.244 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.232+0000 7f9dcfa0b640 10 monclient: shutdown 2026-02-12T03:58:05.244 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.232+0000 7f9dcfa0b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:05.244 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.232+0000 7f9dcfa0b640 1 -- 10.20.193.154:0/3071526069 >> v1:10.20.193.98:6789/0 conn(0x7f9dc805ce10 legacy=0x7f9dc8160240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:05.244 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.232+0000 7f9dcfa0b640 1 -- 10.20.193.154:0/3071526069 shutdown_connections 2026-02-12T03:58:05.244 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.232+0000 7f9dcfa0b640 1 -- 10.20.193.154:0/3071526069 >> 10.20.193.154:0/3071526069 conn(0x7f9dc8058b60 msgr2=0x7f9dc8058f60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:05.244 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.232+0000 7f9dcfa0b640 1 -- 10.20.193.154:0/3071526069 shutdown_connections 2026-02-12T03:58:05.244 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.232+0000 7f9dcfa0b640 1 -- 10.20.193.154:0/3071526069 wait complete. 2026-02-12T03:58:05.244 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.232+0000 7f9dcfa0b640 10 monclient: build_initial_monmap 2026-02-12T03:58:05.244 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.232+0000 7f9dcfa0b640 10 monclient: monmap: 2026-02-12T03:58:05.244 INFO:teuthology.orchestra.run.trial154.stderr:epoch 0 2026-02-12T03:58:05.244 INFO:teuthology.orchestra.run.trial154.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:05.245 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 0.000000 2026-02-12T03:58:05.245 INFO:teuthology.orchestra.run.trial154.stderr:created 0.000000 2026-02-12T03:58:05.245 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:05.245 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 1 2026-02-12T03:58:05.245 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:05.245 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:05.245 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:05.245 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:05.245 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.232+0000 7f9dcfa0b640 1 librados: starting msgr at 2026-02-12T03:58:05.245 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.232+0000 7f9dcfa0b640 1 librados: starting objecter 2026-02-12T03:58:05.245 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.232+0000 7f9dcfa0b640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:05.245 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.232+0000 7f9dcfa0b640 1 Processor -- start 2026-02-12T03:58:05.246 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.232+0000 7f9dcfa0b640 1 -- start start 2026-02-12T03:58:05.246 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.232+0000 7f9dcfa0b640 1 librados: setting wanted keys 2026-02-12T03:58:05.246 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.232+0000 7f9dcfa0b640 1 librados: calling monclient init 2026-02-12T03:58:05.246 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.232+0000 7f9dcfa0b640 10 monclient: init 2026-02-12T03:58:05.246 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.232+0000 7f9dcfa0b640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:05.246 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.232+0000 7f9dcfa0b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T03:58:05.246 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.232+0000 7f9dcfa0b640 10 monclient(hunting): picked mon.noname-b con 0x7f9dc805ce10 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:05.246 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.232+0000 7f9dcfa0b640 10 monclient(hunting): picked mon.noname-c con 0x7f9dc805d290 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:05.246 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.232+0000 7f9dcfa0b640 10 monclient(hunting): picked mon.noname-a con 0x7f9dc805dce0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:05.246 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.232+0000 7f9dcfa0b640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dc8218410 con 0x7f9dc805dce0 2026-02-12T03:58:05.246 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.232+0000 7f9dcfa0b640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dc82195f0 con 0x7f9dc805ce10 2026-02-12T03:58:05.246 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.232+0000 7f9dcfa0b640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dc821a7d0 con 0x7f9dc805d290 2026-02-12T03:58:05.247 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.232+0000 7f9dcfa0b640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:05.247 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.232+0000 7f9dcfa0b640 10 monclient(hunting): authenticate will time out at 1085.885926s 2026-02-12T03:58:05.247 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.233+0000 7f9dccf7f640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f9dc805d290 0x7f9dc81f55c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.154:53524/0 (socket says 10.20.193.154:53524) 2026-02-12T03:58:05.247 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.233+0000 7f9dccf7f640 1 -- 10.20.193.154:0/2065554015 learned_addr learned my addr 10.20.193.154:0/2065554015 (peer_addr_for_me v1:10.20.193.154:0/0) 2026-02-12T03:58:05.247 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.233+0000 7f9db5ffb640 10 client.?.objecter ms_handle_connect 0x7f9dc805d290 2026-02-12T03:58:05.247 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.233+0000 7f9db5ffb640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:05.247 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.233+0000 7f9db5ffb640 10 client.?.objecter ms_handle_connect 0x7f9dc805ce10 2026-02-12T03:58:05.247 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.233+0000 7f9db5ffb640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:05.247 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.234+0000 7f9db5ffb640 10 client.?.objecter ms_handle_connect 0x7f9dc805dce0 2026-02-12T03:58:05.247 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.234+0000 7f9db5ffb640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:05.247 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.234+0000 7f9db5ffb640 1 -- 10.20.193.154:0/2065554015 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3863638307 0 0) 0x7f9dc821a7d0 con 0x7f9dc805d290 2026-02-12T03:58:05.247 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.234+0000 7f9db5ffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:05.248 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.234+0000 7f9db5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:05.248 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.234+0000 7f9db5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:05.248 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.234+0000 7f9db5ffb640 10 monclient(hunting): my global_id is 4193 2026-02-12T03:58:05.248 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.234+0000 7f9db5ffb640 1 -- 10.20.193.154:0/2065554015 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d98003610 con 0x7f9dc805d290 2026-02-12T03:58:05.248 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.234+0000 7f9db5ffb640 1 -- 10.20.193.154:0/2065554015 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3300353671 0 0) 0x7f9dc82195f0 con 0x7f9dc805ce10 2026-02-12T03:58:05.248 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.234+0000 7f9db5ffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:05.248 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.234+0000 7f9db5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:05.248 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.234+0000 7f9db5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:05.248 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.234+0000 7f9db5ffb640 10 monclient(hunting): my global_id is 4225 2026-02-12T03:58:05.248 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.234+0000 7f9db5ffb640 1 -- 10.20.193.154:0/2065554015 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9dc821a7d0 con 0x7f9dc805ce10 2026-02-12T03:58:05.248 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.235+0000 7f9db5ffb640 1 -- 10.20.193.154:0/2065554015 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 669458872 0 0) 0x7f9dc8218410 con 0x7f9dc805dce0 2026-02-12T03:58:05.248 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.235+0000 7f9db5ffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:05.249 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.235+0000 7f9db5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:05.249 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.235+0000 7f9db5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:05.249 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.235+0000 7f9db5ffb640 10 monclient(hunting): my global_id is 4221 2026-02-12T03:58:05.249 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.235+0000 7f9db5ffb640 1 -- 10.20.193.154:0/2065554015 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9dc82195f0 con 0x7f9dc805dce0 2026-02-12T03:58:05.253 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.236+0000 7f9db5ffb640 1 -- 10.20.193.154:0/2065554015 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2787438968 0 0) 0x7f9d98003610 con 0x7f9dc805d290 2026-02-12T03:58:05.253 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.236+0000 7f9db5ffb640 1 -- 10.20.193.154:0/2065554015 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9dc8218410 con 0x7f9dc805d290 2026-02-12T03:58:05.253 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.236+0000 7f9db5ffb640 1 -- 10.20.193.154:0/2065554015 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f9dbc003380 con 0x7f9dc805d290 2026-02-12T03:58:05.253 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.236+0000 7f9db5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:05.253 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.236+0000 7f9db5ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:05.253 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.236+0000 7f9db5ffb640 10 monclient(hunting): dump: 2026-02-12T03:58:05.253 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:05.254 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:05.254 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:05.254 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:05.254 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:05.254 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:05.254 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:05.254 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:05.254 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:05.254 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:05.254 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.236+0000 7f9db5ffb640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:05.254 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.236+0000 7f9db5ffb640 1 -- 10.20.193.154:0/2065554015 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4217671609 0 0) 0x7f9dc821a7d0 con 0x7f9dc805ce10 2026-02-12T03:58:05.255 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.236+0000 7f9db5ffb640 1 -- 10.20.193.154:0/2065554015 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d98003610 con 0x7f9dc805ce10 2026-02-12T03:58:05.255 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.236+0000 7f9db5ffb640 1 -- 10.20.193.154:0/2065554015 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f9db80030b0 con 0x7f9dc805ce10 2026-02-12T03:58:05.255 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.236+0000 7f9db5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:05.255 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.236+0000 7f9db5ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:05.255 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.236+0000 7f9db5ffb640 10 monclient(hunting): dump: 2026-02-12T03:58:05.255 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:05.255 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:05.255 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:05.255 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:05.255 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:05.255 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:05.255 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:05.256 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:05.256 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:05.256 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:05.256 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.237+0000 7f9db5ffb640 1 -- 10.20.193.154:0/2065554015 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 123926390 0 0) 0x7f9dc82195f0 con 0x7f9dc805dce0 2026-02-12T03:58:05.256 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.237+0000 7f9db5ffb640 1 -- 10.20.193.154:0/2065554015 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9dc821a7d0 con 0x7f9dc805dce0 2026-02-12T03:58:05.256 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.237+0000 7f9db5ffb640 1 -- 10.20.193.154:0/2065554015 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f9dc4003420 con 0x7f9dc805dce0 2026-02-12T03:58:05.256 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.237+0000 7f9db5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:05.256 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.237+0000 7f9db5ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:05.256 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.237+0000 7f9db5ffb640 10 monclient(hunting): dump: 2026-02-12T03:58:05.256 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:05.256 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:05.256 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:05.257 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:05.257 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:05.257 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:05.257 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:05.257 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:05.257 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:05.257 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:05.257 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.238+0000 7f9db5ffb640 1 -- 10.20.193.154:0/2065554015 <== mon.2 v1:10.20.193.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2770704650 0 0) 0x7f9dc8218410 con 0x7f9dc805d290 2026-02-12T03:58:05.257 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.238+0000 7f9db5ffb640 1 -- 10.20.193.154:0/2065554015 >> v1:10.20.193.98:6789/0 conn(0x7f9dc805ce10 legacy=0x7f9dc81aec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:05.257 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.238+0000 7f9db5ffb640 1 -- 10.20.193.154:0/2065554015 >> v1:10.20.193.91:6789/0 conn(0x7f9dc805dce0 legacy=0x7f9dc8216cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:05.257 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.238+0000 7f9db5ffb640 10 monclient: _finish_hunting 0 2026-02-12T03:58:05.257 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.238+0000 7f9db5ffb640 1 monclient: found mon.c 2026-02-12T03:58:05.258 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.238+0000 7f9db5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:05.258 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.238+0000 7f9db5ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:05.258 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.238+0000 7f9db5ffb640 1 -- 10.20.193.154:0/2065554015 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc821b9b0 con 0x7f9dc805d290 2026-02-12T03:58:05.258 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.238+0000 7f9db5ffb640 10 monclient: _finish_auth 0 2026-02-12T03:58:05.258 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.238+0000 7f9db5ffb640 10 monclient: _check_auth_tickets 2026-02-12T03:58:05.258 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.238+0000 7f9db5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:05.258 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.238+0000 7f9dcfa0b640 5 monclient: authenticate success, global_id 4193 2026-02-12T03:58:05.258 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.238+0000 7f9dcfa0b640 10 monclient: _renew_subs 2026-02-12T03:58:05.258 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.238+0000 7f9dcfa0b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:05.258 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.238+0000 7f9dcfa0b640 1 -- 10.20.193.154:0/2065554015 --> v1:10.20.193.111:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9dc8219820 con 0x7f9dc805d290 2026-02-12T03:58:05.258 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.238+0000 7f9dcfa0b640 10 client.4193.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:05.258 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.238+0000 7f9dcfa0b640 10 monclient: _renew_subs 2026-02-12T03:58:05.258 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.238+0000 7f9dcfa0b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:05.258 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.238+0000 7f9dcfa0b640 1 -- 10.20.193.154:0/2065554015 --> v1:10.20.193.111:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9dc8219e10 con 0x7f9dc805d290 2026-02-12T03:58:05.259 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.238+0000 7f9dcfa0b640 1 librados: init done 2026-02-12T03:58:05.259 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.238+0000 7f9dcfa0b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:05.259 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.238+0000 7f9dcfa0b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:05.259 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.238+0000 7f9dcfa0b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:05.259 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.238+0000 7f9dcfa0b640 1 -- 10.20.193.154:0/2065554015 --> v1:10.20.193.111:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dc8183820 con 0x7f9dc805d290 2026-02-12T03:58:05.259 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.247+0000 7f9db5ffb640 1 -- 10.20.193.154:0/2065554015 <== mon.2 v1:10.20.193.111:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9dbc002f80 con 0x7f9dc805d290 2026-02-12T03:58:05.259 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.247+0000 7f9db5ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:05.259 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.247+0000 7f9db5ffb640 1 -- 10.20.193.154:0/2065554015 <== mon.2 v1:10.20.193.111:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f9dbc004ce0 con 0x7f9dc805d290 2026-02-12T03:58:05.259 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.247+0000 7f9db5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:05.259 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.247+0000 7f9db5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:05.259 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.247+0000 7f9db5ffb640 10 monclient: dump: 2026-02-12T03:58:05.259 INFO:teuthology.orchestra.run.trial154.stderr:epoch 1 2026-02-12T03:58:05.259 INFO:teuthology.orchestra.run.trial154.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:05.259 INFO:teuthology.orchestra.run.trial154.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:05.259 INFO:teuthology.orchestra.run.trial154.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:05.260 INFO:teuthology.orchestra.run.trial154.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:05.260 INFO:teuthology.orchestra.run.trial154.stderr:election_strategy: 3 2026-02-12T03:58:05.260 INFO:teuthology.orchestra.run.trial154.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:05.260 INFO:teuthology.orchestra.run.trial154.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:05.260 INFO:teuthology.orchestra.run.trial154.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:05.260 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T03:58:05.260 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.247+0000 7f9db77fe640 4 set_mon_vals no callback set 2026-02-12T03:58:05.260 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.248+0000 7f9db5ffb640 1 -- 10.20.193.154:0/2065554015 <== mon.2 v1:10.20.193.111:6789/0 7 ==== mgrmap(e 4) ==== 103168+0+0 (unknown 3733604615 0 0) 0x7f9dbc01e190 con 0x7f9dc805d290 2026-02-12T03:58:05.260 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.248+0000 7f9dcd780640 10 monclient: get_auth_request con 0x7f9d98079ff0 auth_method 0 2026-02-12T03:58:05.260 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.248+0000 7f9db5ffb640 10 client.4193.objecter ms_handle_connect 0x7f9d98079ff0 2026-02-12T03:58:05.260 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.249+0000 7f9db5ffb640 1 -- 10.20.193.154:0/2065554015 <== mon.2 v1:10.20.193.111:6789/0 8 ==== osd_map(17..17 src has 1..17) ==== 2445+0+0 (unknown 2922377417 0 0) 0x7f9dbc05abb0 con 0x7f9dc805d290 2026-02-12T03:58:05.260 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.249+0000 7f9db5ffb640 10 client.4193.objecter ms_dispatch2 0x7f9dc8000b90 osd_map(17..17 src has 1..17) 2026-02-12T03:58:05.260 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.249+0000 7f9db5ffb640 3 client.4193.objecter handle_osd_map got epochs [17,17] > 0 2026-02-12T03:58:05.261 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.249+0000 7f9db5ffb640 3 client.4193.objecter handle_osd_map decoding full epoch 17 2026-02-12T03:58:05.261 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.249+0000 7f9db5ffb640 20 client.4193.objecter dump_active .. 0 homeless 2026-02-12T03:58:05.339 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.337+0000 7f9db5ffb640 1 -- 10.20.193.154:0/2065554015 <== mon.2 v1:10.20.193.111:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f9dbc05f320 con 0x7f9dc805d290 2026-02-12T03:58:05.339 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.337+0000 7f9db5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:05.340 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.337+0000 7f9db5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:05.449 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.447+0000 7f9dcfa0b640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "9bd39438-f5e5-4a19-afa4-678395d63c24", "id": 15}] 2026-02-12T03:58:05.449 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.447+0000 7f9dcfa0b640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "9bd39438-f5e5-4a19-afa4-678395d63c24", "id": 15}] 2026-02-12T03:58:05.450 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.447+0000 7f9dcfa0b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:05.450 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.447+0000 7f9dcfa0b640 1 -- 10.20.193.154:0/2065554015 --> v1:10.20.193.111:6789/0 -- mon_command({"prefix": "osd new", "uuid": "9bd39438-f5e5-4a19-afa4-678395d63c24", "id": 15} v 0) -- 0x7f9dc821a150 con 0x7f9dc805d290 2026-02-12T03:58:05.495 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.493+0000 7f9db5ffb640 1 -- 10.20.193.154:0/2065554015 <== mon.2 v1:10.20.193.111:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9bd39438-f5e5-4a19-afa4-678395d63c24", "id": 15}]=0 v18) ==== 113+0+3 (unknown 911164690 0 1109645296) 0x7f9dbc05ec20 con 0x7f9dc805d290 2026-02-12T03:58:05.495 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.493+0000 7f9db5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "9bd39438-f5e5-4a19-afa4-678395d63c24", "id": 15}] 2026-02-12T03:58:05.495 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.493+0000 7f9db5ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:05.495 INFO:teuthology.orchestra.run.trial154.stdout:15 2026-02-12T03:58:05.497 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.493+0000 7f9dcfa0b640 10 librados: watch_flush enter 2026-02-12T03:58:05.497 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.493+0000 7f9dcfa0b640 10 librados: watch_flush exit 2026-02-12T03:58:05.497 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.493+0000 7f9dcfa0b640 20 client.4193.objecter shutdown clearing up homeless session... 2026-02-12T03:58:05.497 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.493+0000 7f9dcfa0b640 10 client.4193.objecter successfully canceled tick 2026-02-12T03:58:05.497 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.493+0000 7f9dcfa0b640 1 -- 10.20.193.154:0/2065554015 >> v1:10.20.193.91:6800/2929217192 conn(0x7f9d98079ff0 legacy=0x7f9d9809a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:05.497 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.493+0000 7f9dcfa0b640 10 monclient: shutdown 2026-02-12T03:58:05.498 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.493+0000 7f9dcfa0b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:05.498 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.493+0000 7f9dcfa0b640 1 -- 10.20.193.154:0/2065554015 >> v1:10.20.193.111:6789/0 conn(0x7f9dc805d290 legacy=0x7f9dc81f55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:05.498 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.493+0000 7f9dcfa0b640 1 -- 10.20.193.154:0/2065554015 shutdown_connections 2026-02-12T03:58:05.498 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.493+0000 7f9dcfa0b640 1 -- 10.20.193.154:0/2065554015 >> 10.20.193.154:0/2065554015 conn(0x7f9dc8058b60 msgr2=0x7f9dc805b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:05.498 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.494+0000 7f9dcfa0b640 1 -- 10.20.193.154:0/2065554015 shutdown_connections 2026-02-12T03:58:05.498 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.494+0000 7f9dcfa0b640 1 -- 10.20.193.154:0/2065554015 wait complete. 2026-02-12T03:58:05.498 INFO:teuthology.orchestra.run.trial154.stderr:2026-02-12T03:58:05.494+0000 7f9dcfa0b640 1 librados: shutdown 2026-02-12T03:58:05.506 DEBUG:tasks.ceph_manager:running osd.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-12T03:58:05.506 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-12T03:58:05.506 DEBUG:teuthology.orchestra.run.trial091:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 0 2026-02-12T03:58:05.509 INFO:tasks.ceph.osd.0:Started 2026-02-12T03:58:05.509 DEBUG:tasks.ceph_manager:running osd.4 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.4.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-12T03:58:05.509 INFO:tasks.ceph.osd.4:Restarting daemon 2026-02-12T03:58:05.509 DEBUG:teuthology.orchestra.run.trial091:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 4 2026-02-12T03:58:05.562 INFO:tasks.ceph.osd.4:Started 2026-02-12T03:58:05.562 DEBUG:tasks.ceph_manager:running osd.8 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.8.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-12T03:58:05.562 INFO:tasks.ceph.osd.8:Restarting daemon 2026-02-12T03:58:05.562 DEBUG:teuthology.orchestra.run.trial091:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.8.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 8 2026-02-12T03:58:05.564 INFO:tasks.ceph.osd.8:Started 2026-02-12T03:58:05.564 DEBUG:tasks.ceph_manager:running osd.12 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.12.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-12T03:58:05.564 INFO:tasks.ceph.osd.12:Restarting daemon 2026-02-12T03:58:05.564 DEBUG:teuthology.orchestra.run.trial091:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.12.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 12 2026-02-12T03:58:05.566 INFO:tasks.ceph.osd.12:Started 2026-02-12T03:58:05.566 DEBUG:tasks.ceph_manager:running osd.1 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.1.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-12T03:58:05.566 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-12T03:58:05.566 DEBUG:teuthology.orchestra.run.trial098:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 1 2026-02-12T03:58:05.568 INFO:tasks.ceph.osd.1:Started 2026-02-12T03:58:05.568 DEBUG:tasks.ceph_manager:running osd.5 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.5.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-12T03:58:05.568 INFO:tasks.ceph.osd.5:Restarting daemon 2026-02-12T03:58:05.568 DEBUG:teuthology.orchestra.run.trial098:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 5 2026-02-12T03:58:05.570 INFO:tasks.ceph.osd.5:Started 2026-02-12T03:58:05.570 DEBUG:tasks.ceph_manager:running osd.9 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.9.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-12T03:58:05.570 INFO:tasks.ceph.osd.9:Restarting daemon 2026-02-12T03:58:05.570 DEBUG:teuthology.orchestra.run.trial098:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.9.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 9 2026-02-12T03:58:05.572 INFO:tasks.ceph.osd.9:Started 2026-02-12T03:58:05.572 DEBUG:tasks.ceph_manager:running osd.13 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.13.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-12T03:58:05.572 INFO:tasks.ceph.osd.13:Restarting daemon 2026-02-12T03:58:05.572 DEBUG:teuthology.orchestra.run.trial098:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.13.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 13 2026-02-12T03:58:05.574 INFO:tasks.ceph.osd.13:Started 2026-02-12T03:58:05.575 DEBUG:tasks.ceph_manager:running osd.2 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.2.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-12T03:58:05.575 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-12T03:58:05.575 DEBUG:teuthology.orchestra.run.trial111:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 2 2026-02-12T03:58:05.577 INFO:tasks.ceph.osd.2:Started 2026-02-12T03:58:05.577 DEBUG:tasks.ceph_manager:running osd.6 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.6.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-12T03:58:05.577 INFO:tasks.ceph.osd.6:Restarting daemon 2026-02-12T03:58:05.577 DEBUG:teuthology.orchestra.run.trial111:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 6 2026-02-12T03:58:05.579 INFO:tasks.ceph.osd.6:Started 2026-02-12T03:58:05.579 DEBUG:tasks.ceph_manager:running osd.10 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.10.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-12T03:58:05.580 INFO:tasks.ceph.osd.10:Restarting daemon 2026-02-12T03:58:05.580 DEBUG:teuthology.orchestra.run.trial111:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.10.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 10 2026-02-12T03:58:05.582 INFO:tasks.ceph.osd.10:Started 2026-02-12T03:58:05.582 DEBUG:tasks.ceph_manager:running osd.14 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.14.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-12T03:58:05.582 INFO:tasks.ceph.osd.14:Restarting daemon 2026-02-12T03:58:05.582 DEBUG:teuthology.orchestra.run.trial111:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.14.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 14 2026-02-12T03:58:05.584 INFO:tasks.ceph.osd.14:Started 2026-02-12T03:58:05.584 DEBUG:tasks.ceph_manager:running osd.3 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.3.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-12T03:58:05.584 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-12T03:58:05.585 DEBUG:teuthology.orchestra.run.trial154:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 3 2026-02-12T03:58:05.587 INFO:tasks.ceph.osd.3:Started 2026-02-12T03:58:05.587 DEBUG:tasks.ceph_manager:running osd.7 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.7.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-12T03:58:05.587 INFO:tasks.ceph.osd.7:Restarting daemon 2026-02-12T03:58:05.587 DEBUG:teuthology.orchestra.run.trial154:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 7 2026-02-12T03:58:05.590 INFO:tasks.ceph.osd.7:Started 2026-02-12T03:58:05.590 DEBUG:tasks.ceph_manager:running osd.11 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.11.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-12T03:58:05.590 INFO:tasks.ceph.osd.11:Restarting daemon 2026-02-12T03:58:05.590 DEBUG:teuthology.orchestra.run.trial154:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.11.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 11 2026-02-12T03:58:05.592 INFO:tasks.ceph.osd.11:Started 2026-02-12T03:58:05.592 DEBUG:tasks.ceph_manager:running osd.15 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.15.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2026-02-12T03:58:05.593 INFO:tasks.ceph.osd.15:Restarting daemon 2026-02-12T03:58:05.593 DEBUG:teuthology.orchestra.run.trial154:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.15.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 15 2026-02-12T03:58:05.595 INFO:tasks.ceph.osd.15:Started 2026-02-12T03:58:05.595 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T03:58:05.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.662+0000 7f61ebe3a640 10 monclient: get_monmap_and_config 2026-02-12T03:58:05.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.662+0000 7f61ebe3a640 10 monclient: build_initial_monmap 2026-02-12T03:58:05.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.662+0000 7f61ebe3a640 10 monclient: monmap: 2026-02-12T03:58:05.665 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:05.665 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:05.665 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:05.664046+0000 2026-02-12T03:58:05.665 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:05.664046+0000 2026-02-12T03:58:05.666 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:05.666 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:05.666 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:05.666 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:05.666 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:05.666 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:05.667 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.662+0000 7f61ebe3a640 1 Processor -- start 2026-02-12T03:58:05.667 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.662+0000 7f61ebe3a640 1 -- start start 2026-02-12T03:58:05.667 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.662+0000 7f61ebe3a640 10 monclient: init 2026-02-12T03:58:05.667 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.663+0000 7f61ebe3a640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:05.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.663+0000 7f61ebe3a640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T03:58:05.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.663+0000 7f61ebe3a640 10 monclient(hunting): picked mon.noname-b con 0x7f61e415d740 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:05.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.663+0000 7f61ebe3a640 10 monclient(hunting): picked mon.noname-c con 0x7f61e40b8090 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:05.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.663+0000 7f61ebe3a640 10 monclient(hunting): picked mon.noname-a con 0x7f61e40b5480 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:05.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.663+0000 7f61ebe3a640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61e40577f0 con 0x7f61e40b5480 2026-02-12T03:58:05.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.663+0000 7f61ebe3a640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61e415db10 con 0x7f61e415d740 2026-02-12T03:58:05.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.663+0000 7f61ebe3a640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61e40b8c50 con 0x7f61e40b8090 2026-02-12T03:58:05.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.663+0000 7f61ebe3a640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:05.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.663+0000 7f61ebe3a640 10 monclient(hunting): authenticate will time out at 1088.407502s 2026-02-12T03:58:05.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.664+0000 7f61ea3b0640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f61e40b5480 0x7f61e41c8dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:52248/0 (socket says 10.20.193.91:52248) 2026-02-12T03:58:05.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.664+0000 7f61ea3b0640 1 -- 10.20.193.91:0/1548708242 learned_addr learned my addr 10.20.193.91:0/1548708242 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:05.669 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.665+0000 7f61e8bad640 1 -- 10.20.193.91:0/1548708242 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3852641883 0 0) 0x7f61e40577f0 con 0x7f61e40b5480 2026-02-12T03:58:05.669 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.665+0000 7f61e8bad640 10 monclient(hunting): _negotiate 2026-02-12T03:58:05.669 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.665+0000 7f61e8bad640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:05.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.665+0000 7f61e8bad640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:05.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.665+0000 7f61e8bad640 10 monclient(hunting): my global_id is 4224 2026-02-12T03:58:05.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.665+0000 7f61e8bad640 1 -- 10.20.193.91:0/1548708242 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61cc003610 con 0x7f61e40b5480 2026-02-12T03:58:05.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.665+0000 7f61e8bad640 1 -- 10.20.193.91:0/1548708242 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2708991275 0 0) 0x7f61e40b8c50 con 0x7f61e40b8090 2026-02-12T03:58:05.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.665+0000 7f61e8bad640 10 monclient(hunting): _negotiate 2026-02-12T03:58:05.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.665+0000 7f61e8bad640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:05.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.665+0000 7f61e8bad640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:05.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.665+0000 7f61e8bad640 10 monclient(hunting): my global_id is 4196 2026-02-12T03:58:05.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.665+0000 7f61e8bad640 1 -- 10.20.193.91:0/1548708242 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61e40577f0 con 0x7f61e40b8090 2026-02-12T03:58:05.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.666+0000 7f61e8bad640 1 -- 10.20.193.91:0/1548708242 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3659972884 0 0) 0x7f61e415db10 con 0x7f61e415d740 2026-02-12T03:58:05.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.666+0000 7f61e8bad640 10 monclient(hunting): _negotiate 2026-02-12T03:58:05.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.666+0000 7f61e8bad640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:05.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.666+0000 7f61e8bad640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:05.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.666+0000 7f61e8bad640 10 monclient(hunting): my global_id is 4228 2026-02-12T03:58:05.671 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.666+0000 7f61e8bad640 1 -- 10.20.193.91:0/1548708242 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61e40b8c50 con 0x7f61e415d740 2026-02-12T03:58:05.673 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.667+0000 7f61e8bad640 1 -- 10.20.193.91:0/1548708242 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4193308320 0 0) 0x7f61cc003610 con 0x7f61e40b5480 2026-02-12T03:58:05.674 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.667+0000 7f61e8bad640 1 -- 10.20.193.91:0/1548708242 >> v1:10.20.193.111:6789/0 conn(0x7f61e40b8090 legacy=0x7f61e40570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:05.674 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.667+0000 7f61e8bad640 1 -- 10.20.193.91:0/1548708242 >> v1:10.20.193.98:6789/0 conn(0x7f61e415d740 legacy=0x7f61e40569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:05.674 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.667+0000 7f61e8bad640 10 monclient: _finish_hunting 0 2026-02-12T03:58:05.674 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.667+0000 7f61e8bad640 1 monclient: found mon.noname-a 2026-02-12T03:58:05.674 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.667+0000 7f61e8bad640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:05.674 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.667+0000 7f61e8bad640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.91:6789/0 2026-02-12T03:58:05.674 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.667+0000 7f61e8bad640 1 -- 10.20.193.91:0/1548708242 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61e40b8f30 con 0x7f61e40b5480 2026-02-12T03:58:05.674 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.667+0000 7f61e8bad640 10 monclient: _finish_auth 0 2026-02-12T03:58:05.674 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.667+0000 7f61e8bad640 10 monclient: _check_auth_tickets 2026-02-12T03:58:05.674 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.667+0000 7f61e8bad640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:05.674 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.667+0000 7f61e8bad640 1 -- 10.20.193.91:0/1548708242 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f61e0003170 con 0x7f61e40b5480 2026-02-12T03:58:05.674 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.667+0000 7f61e8bad640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:05.674 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.667+0000 7f61e8bad640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:05.674 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.667+0000 7f61e8bad640 10 monclient: dump: 2026-02-12T03:58:05.675 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:05.675 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:05.675 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:05.675 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:05.675 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:05.675 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:05.675 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:05.675 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:05.675 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:05.675 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:05.675 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.667+0000 7f61ebe3a640 5 monclient: authenticate success, global_id 4224 2026-02-12T03:58:05.675 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.667+0000 7f61ebe3a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:05.675 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.669+0000 7f61e8bad640 1 -- 10.20.193.91:0/1548708242 <== mon.0 v1:10.20.193.91:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f61e0003340 con 0x7f61e40b5480 2026-02-12T03:58:05.675 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.669+0000 7f61e8bad640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:05.676 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.669+0000 7f61e8bad640 1 -- 10.20.193.91:0/1548708242 <== mon.0 v1:10.20.193.91:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f61e0003780 con 0x7f61e40b5480 2026-02-12T03:58:05.676 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.669+0000 7f61e8bad640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:05.676 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.669+0000 7f61e8bad640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:05.676 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.669+0000 7f61e8bad640 10 monclient: dump: 2026-02-12T03:58:05.676 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:05.676 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:05.676 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:05.676 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:05.676 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:05.676 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:05.676 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:05.676 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:05.676 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:05.676 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:05.676 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.669+0000 7f61ebe3a640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:05.677 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.669+0000 7f61ebe3a640 4 set_mon_vals no callback set 2026-02-12T03:58:05.677 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.669+0000 7f61ebe3a640 10 monclient: shutdown 2026-02-12T03:58:05.677 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.669+0000 7f61ebe3a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:05.677 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.669+0000 7f61ebe3a640 1 -- 10.20.193.91:0/1548708242 >> v1:10.20.193.91:6789/0 conn(0x7f61e40b5480 legacy=0x7f61e41c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:05.677 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.669+0000 7f61ebe3a640 1 -- 10.20.193.91:0/1548708242 shutdown_connections 2026-02-12T03:58:05.677 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.669+0000 7f61ebe3a640 1 -- 10.20.193.91:0/1548708242 >> 10.20.193.91:0/1548708242 conn(0x7f61e40b7580 msgr2=0x7f61e40b7980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:05.677 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.669+0000 7f61ebe3a640 1 -- 10.20.193.91:0/1548708242 shutdown_connections 2026-02-12T03:58:05.677 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.669+0000 7f61ebe3a640 1 -- 10.20.193.91:0/1548708242 wait complete. 2026-02-12T03:58:05.677 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.670+0000 7f61ebe3a640 10 monclient: build_initial_monmap 2026-02-12T03:58:05.677 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.670+0000 7f61ebe3a640 10 monclient: monmap: 2026-02-12T03:58:05.677 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:05.677 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:05.677 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:05.677 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:05.677 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:05.678 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:05.678 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:05.678 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:05.678 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:05.678 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:05.678 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.670+0000 7f61ebe3a640 1 librados: starting msgr at 2026-02-12T03:58:05.678 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.670+0000 7f61ebe3a640 1 librados: starting objecter 2026-02-12T03:58:05.678 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.670+0000 7f61ebe3a640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:05.678 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.670+0000 7f61ebe3a640 1 Processor -- start 2026-02-12T03:58:05.678 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.670+0000 7f61ebe3a640 1 -- start start 2026-02-12T03:58:05.678 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.670+0000 7f61ebe3a640 1 librados: setting wanted keys 2026-02-12T03:58:05.678 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.670+0000 7f61ebe3a640 1 librados: calling monclient init 2026-02-12T03:58:05.678 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.670+0000 7f61ebe3a640 10 monclient: init 2026-02-12T03:58:05.678 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.670+0000 7f61ebe3a640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:05.678 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.670+0000 7f61ebe3a640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T03:58:05.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.670+0000 7f61ebe3a640 10 monclient(hunting): picked mon.noname-c con 0x7f61e40b5480 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:05.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.670+0000 7f61ebe3a640 10 monclient(hunting): picked mon.noname-b con 0x7f61e40b8090 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:05.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.670+0000 7f61ebe3a640 10 monclient(hunting): picked mon.noname-a con 0x7f61e415d740 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:05.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.670+0000 7f61ebe3a640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61e413eb80 con 0x7f61e415d740 2026-02-12T03:58:05.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.670+0000 7f61ebe3a640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61e41fec40 con 0x7f61e40b8090 2026-02-12T03:58:05.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.670+0000 7f61ebe3a640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61e41fef20 con 0x7f61e40b5480 2026-02-12T03:58:05.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.670+0000 7f61ebe3a640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:05.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.670+0000 7f61ebe3a640 10 monclient(hunting): authenticate will time out at 1088.414819s 2026-02-12T03:58:05.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.671+0000 7f61ea3b0640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f61e415d740 0x7f61e41594d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:52250/0 (socket says 10.20.193.91:52250) 2026-02-12T03:58:05.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.671+0000 7f61ea3b0640 1 -- 10.20.193.91:0/1297163842 learned_addr learned my addr 10.20.193.91:0/1297163842 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:05.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.671+0000 7f61d27fc640 10 client.?.objecter ms_handle_connect 0x7f61e415d740 2026-02-12T03:58:05.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.671+0000 7f61d27fc640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:05.682 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.671+0000 7f61d27fc640 10 client.?.objecter ms_handle_connect 0x7f61e40b8090 2026-02-12T03:58:05.682 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.671+0000 7f61d27fc640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:05.682 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.671+0000 7f61d27fc640 10 client.?.objecter ms_handle_connect 0x7f61e40b5480 2026-02-12T03:58:05.682 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.671+0000 7f61d27fc640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:05.682 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.672+0000 7f61d27fc640 1 -- 10.20.193.91:0/1297163842 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1069613815 0 0) 0x7f61e413eb80 con 0x7f61e415d740 2026-02-12T03:58:05.683 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.672+0000 7f61d27fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:05.683 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.672+0000 7f61d27fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:05.683 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.672+0000 7f61d27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:05.683 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.672+0000 7f61d27fc640 10 monclient(hunting): my global_id is 4227 2026-02-12T03:58:05.683 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.672+0000 7f61d27fc640 1 -- 10.20.193.91:0/1297163842 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61b4003610 con 0x7f61e415d740 2026-02-12T03:58:05.683 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.672+0000 7f61d27fc640 1 -- 10.20.193.91:0/1297163842 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1128261682 0 0) 0x7f61e41fec40 con 0x7f61e40b8090 2026-02-12T03:58:05.683 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.672+0000 7f61d27fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:05.683 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.672+0000 7f61d27fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:05.683 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.672+0000 7f61d27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:05.683 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.672+0000 7f61d27fc640 10 monclient(hunting): my global_id is 4231 2026-02-12T03:58:05.683 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.672+0000 7f61d27fc640 1 -- 10.20.193.91:0/1297163842 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61e413eb80 con 0x7f61e40b8090 2026-02-12T03:58:05.683 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.673+0000 7f61d27fc640 1 -- 10.20.193.91:0/1297163842 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 444735688 0 0) 0x7f61e41fef20 con 0x7f61e40b5480 2026-02-12T03:58:05.683 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.673+0000 7f61d27fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:05.683 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.673+0000 7f61d27fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:05.684 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.673+0000 7f61d27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:05.684 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.673+0000 7f61d27fc640 10 monclient(hunting): my global_id is 4199 2026-02-12T03:58:05.684 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.673+0000 7f61d27fc640 1 -- 10.20.193.91:0/1297163842 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61e41fec40 con 0x7f61e40b5480 2026-02-12T03:58:05.684 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.675+0000 7f61d27fc640 1 -- 10.20.193.91:0/1297163842 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1854133520 0 0) 0x7f61e413eb80 con 0x7f61e40b8090 2026-02-12T03:58:05.684 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.675+0000 7f61d27fc640 1 -- 10.20.193.91:0/1297163842 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f61e41fef20 con 0x7f61e40b8090 2026-02-12T03:58:05.684 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.675+0000 7f61d27fc640 1 -- 10.20.193.91:0/1297163842 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f61d80030b0 con 0x7f61e40b8090 2026-02-12T03:58:05.684 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.675+0000 7f61d27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:05.684 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.675+0000 7f61d27fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:05.684 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.675+0000 7f61d27fc640 10 monclient(hunting): dump: 2026-02-12T03:58:05.684 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:05.684 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:05.684 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:05.684 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:05.684 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:05.684 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:05.684 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:05.685 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:05.685 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:05.685 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:05.685 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.675+0000 7f61d27fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:05.685 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.675+0000 7f61d27fc640 1 -- 10.20.193.91:0/1297163842 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3454171757 0 0) 0x7f61b4003610 con 0x7f61e415d740 2026-02-12T03:58:05.685 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.675+0000 7f61d27fc640 1 -- 10.20.193.91:0/1297163842 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f61e413eb80 con 0x7f61e415d740 2026-02-12T03:58:05.685 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.675+0000 7f61d27fc640 1 -- 10.20.193.91:0/1297163842 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f61e0003690 con 0x7f61e415d740 2026-02-12T03:58:05.685 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.675+0000 7f61d27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:05.685 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.675+0000 7f61d27fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:05.685 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.675+0000 7f61d27fc640 10 monclient(hunting): dump: 2026-02-12T03:58:05.685 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:05.685 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:05.685 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:05.685 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:05.686 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:05.686 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:05.686 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:05.686 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:05.686 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:05.686 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:05.686 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.676+0000 7f61d27fc640 1 -- 10.20.193.91:0/1297163842 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 278886017 0 0) 0x7f61e41fec40 con 0x7f61e40b5480 2026-02-12T03:58:05.686 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.676+0000 7f61d27fc640 1 -- 10.20.193.91:0/1297163842 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f61b4003610 con 0x7f61e40b5480 2026-02-12T03:58:05.686 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.676+0000 7f61d27fc640 1 -- 10.20.193.91:0/1297163842 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f61d4002fb0 con 0x7f61e40b5480 2026-02-12T03:58:05.686 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.676+0000 7f61d27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:05.686 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.676+0000 7f61d27fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:05.686 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.676+0000 7f61d27fc640 10 monclient(hunting): dump: 2026-02-12T03:58:05.686 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:05.686 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:05.686 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:05.687 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:05.687 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:05.687 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:05.687 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:05.687 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:05.687 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:05.687 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:05.687 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.677+0000 7f61d27fc640 1 -- 10.20.193.91:0/1297163842 <== mon.1 v1:10.20.193.98:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1720177835 0 0) 0x7f61e41fef20 con 0x7f61e40b8090 2026-02-12T03:58:05.687 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.677+0000 7f61d27fc640 1 -- 10.20.193.91:0/1297163842 >> v1:10.20.193.111:6789/0 conn(0x7f61e40b5480 legacy=0x7f61e413e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:05.687 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.677+0000 7f61d27fc640 1 -- 10.20.193.91:0/1297163842 >> v1:10.20.193.91:6789/0 conn(0x7f61e415d740 legacy=0x7f61e41594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:05.687 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.677+0000 7f61d27fc640 10 monclient: _finish_hunting 0 2026-02-12T03:58:05.687 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.677+0000 7f61d27fc640 1 monclient: found mon.b 2026-02-12T03:58:05.687 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.677+0000 7f61d27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:05.687 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.677+0000 7f61d27fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:05.687 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.677+0000 7f61d27fc640 1 -- 10.20.193.91:0/1297163842 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61e41ff200 con 0x7f61e40b8090 2026-02-12T03:58:05.687 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.677+0000 7f61d27fc640 10 monclient: _finish_auth 0 2026-02-12T03:58:05.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.677+0000 7f61d27fc640 10 monclient: _check_auth_tickets 2026-02-12T03:58:05.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.677+0000 7f61d27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:05.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.677+0000 7f61ebe3a640 5 monclient: authenticate success, global_id 4231 2026-02-12T03:58:05.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.677+0000 7f61ebe3a640 10 monclient: _renew_subs 2026-02-12T03:58:05.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.677+0000 7f61ebe3a640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:05.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.677+0000 7f61ebe3a640 1 -- 10.20.193.91:0/1297163842 --> v1:10.20.193.98:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f61e41ff4e0 con 0x7f61e40b8090 2026-02-12T03:58:05.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.677+0000 7f61ebe3a640 10 client.4231.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:05.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.677+0000 7f61ebe3a640 10 monclient: _renew_subs 2026-02-12T03:58:05.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.677+0000 7f61ebe3a640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:05.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.677+0000 7f61ebe3a640 1 -- 10.20.193.91:0/1297163842 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f61e41fe830 con 0x7f61e40b8090 2026-02-12T03:58:05.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.677+0000 7f61ebe3a640 1 librados: init done 2026-02-12T03:58:05.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.678+0000 7f61ebe3a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:05.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.678+0000 7f61ebe3a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:05.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.678+0000 7f61ebe3a640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:05.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.678+0000 7f61ebe3a640 1 -- 10.20.193.91:0/1297163842 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61e41ff720 con 0x7f61e40b8090 2026-02-12T03:58:05.689 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.683+0000 7f61d27fc640 1 -- 10.20.193.91:0/1297163842 <== mon.1 v1:10.20.193.98:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f61d80036b0 con 0x7f61e40b8090 2026-02-12T03:58:05.689 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.683+0000 7f61d27fc640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:05.689 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.683+0000 7f61d27fc640 1 -- 10.20.193.91:0/1297163842 <== mon.1 v1:10.20.193.98:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f61d8003a00 con 0x7f61e40b8090 2026-02-12T03:58:05.689 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.683+0000 7f61d27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:05.690 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.683+0000 7f61d27fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:05.690 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.683+0000 7f61d27fc640 10 monclient: dump: 2026-02-12T03:58:05.690 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:05.690 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:05.690 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:05.690 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:05.690 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:05.690 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:05.690 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:05.690 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:05.690 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:05.690 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:05.690 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.683+0000 7f61d3fff640 4 set_mon_vals no callback set 2026-02-12T03:58:05.691 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.688+0000 7f61d27fc640 1 -- 10.20.193.91:0/1297163842 <== mon.1 v1:10.20.193.98:6789/0 7 ==== mgrmap(e 4) ==== 103168+0+0 (unknown 3733604615 0 0) 0x7f61d801cd10 con 0x7f61e40b8090 2026-02-12T03:58:05.691 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.689+0000 7f61e9baf640 10 monclient: get_auth_request con 0x7f61b4079fc0 auth_method 0 2026-02-12T03:58:05.692 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.689+0000 7f61d27fc640 10 client.4231.objecter ms_handle_connect 0x7f61b4079fc0 2026-02-12T03:58:05.693 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.690+0000 7f61d27fc640 1 -- 10.20.193.91:0/1297163842 <== mon.1 v1:10.20.193.98:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 2560+0+0 (unknown 3427255071 0 0) 0x7f61d8059a50 con 0x7f61e40b8090 2026-02-12T03:58:05.693 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.690+0000 7f61d27fc640 10 client.4231.objecter ms_dispatch2 0x7f61e4000b90 osd_map(18..18 src has 1..18) 2026-02-12T03:58:05.693 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.690+0000 7f61d27fc640 3 client.4231.objecter handle_osd_map got epochs [18,18] > 0 2026-02-12T03:58:05.693 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.690+0000 7f61d27fc640 3 client.4231.objecter handle_osd_map decoding full epoch 18 2026-02-12T03:58:05.693 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.690+0000 7f61d27fc640 20 client.4231.objecter dump_active .. 0 homeless 2026-02-12T03:58:05.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.778+0000 7f61d27fc640 1 -- 10.20.193.91:0/1297163842 <== mon.1 v1:10.20.193.98:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f61e41ff720 con 0x7f61e40b8090 2026-02-12T03:58:05.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.778+0000 7f61d27fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:05.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.778+0000 7f61d27fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:05.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.892+0000 7f61ebe3a640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-12T03:58:05.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.892+0000 7f61ebe3a640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T03:58:05.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.892+0000 7f61ebe3a640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:05.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.892+0000 7f61ebe3a640 1 -- 10.20.193.91:0/1297163842 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f61e40b2020 con 0x7f61e40b8090 2026-02-12T03:58:05.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.913+0000 7f61d27fc640 1 -- 10.20.193.91:0/1297163842 <== mon.1 v1:10.20.193.98:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12877 (unknown 3338201251 0 3816485227) 0x7f61d805e1c0 con 0x7f61e40b8090 2026-02-12T03:58:05.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.913+0000 7f61d27fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T03:58:05.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.913+0000 7f61d27fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:05.917 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:58:05.917 INFO:teuthology.orchestra.run.trial091.stdout:{"epoch":18,"fsid":"1e356fcf-3d61-462e-a451-82f8dd01e1f3","created":"2026-02-12T03:57:59.014379+0000","modified":"2026-02-12T03:58:05.455425+0000","last_up_change":"0.000000","last_in_change":"2026-02-12T03:58:05.455425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"791c97c5-83f6-4024-9f43-ff3b2ee22a30","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0cf561d6-85aa-428a-bc69-83ce77b1c802","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b3dc78b9-cae6-4b1f-931f-7352a43b9e26","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e164e3ae-cf6a-45ff-b126-3ac739c5b1be","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5583cc8c-83d4-42b4-a997-c056f3b145a0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d7bb6fa1-b042-4dce-9644-00e817a5bc8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"93cd9edf-a000-4d22-8da7-52f4bd547765","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f5e11a47-d746-46ca-85f1-27d3bc586371","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"bb8207ce-22b9-46be-9c89-c77f2690e405","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"e6318a6d-2367-48ce-a3a1-47307de14b99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"cd6c97a2-bdfe-4b86-afeb-217315976d6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"b6c647bb-4e86-4b0e-b79c-b0236a780a66","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"19bb3570-0c0a-48cc-a0b8-ec3194f30fa8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"a8215062-521c-47f6-b20a-9e40c1f3f5a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"3cd1bb48-53a2-462e-b7e5-4d6d918dd543","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"9bd39438-f5e5-4a19-afa4-678395d63c24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T03:58:05.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.916+0000 7f61ebe3a640 10 librados: watch_flush enter 2026-02-12T03:58:05.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.916+0000 7f61ebe3a640 10 librados: watch_flush exit 2026-02-12T03:58:05.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.916+0000 7f61ebe3a640 20 client.4231.objecter shutdown clearing up homeless session... 2026-02-12T03:58:05.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.916+0000 7f61ebe3a640 10 client.4231.objecter successfully canceled tick 2026-02-12T03:58:05.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.916+0000 7f61ebe3a640 1 -- 10.20.193.91:0/1297163842 >> v1:10.20.193.91:6800/2929217192 conn(0x7f61b4079fc0 legacy=0x7f61b409a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:05.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.916+0000 7f61ebe3a640 10 monclient: shutdown 2026-02-12T03:58:05.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.916+0000 7f61ebe3a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:05.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.916+0000 7f61ebe3a640 1 -- 10.20.193.91:0/1297163842 >> v1:10.20.193.98:6789/0 conn(0x7f61e40b8090 legacy=0x7f61e41381d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:05.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.916+0000 7f61ebe3a640 1 -- 10.20.193.91:0/1297163842 shutdown_connections 2026-02-12T03:58:05.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.916+0000 7f61ebe3a640 1 -- 10.20.193.91:0/1297163842 >> 10.20.193.91:0/1297163842 conn(0x7f61e40b7580 msgr2=0x7f61e415bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:05.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.916+0000 7f61ebe3a640 1 -- 10.20.193.91:0/1297163842 shutdown_connections 2026-02-12T03:58:05.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.916+0000 7f61ebe3a640 1 -- 10.20.193.91:0/1297163842 wait complete. 2026-02-12T03:58:05.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:05.916+0000 7f61ebe3a640 1 librados: shutdown 2026-02-12T03:58:05.928 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-12T03:58:05.929 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-12T03:58:07.541 DEBUG:teuthology.orchestra.run.trial091:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-12T03:58:07.601 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.598+0000 7f394e7d2640 10 monclient: get_monmap_and_config 2026-02-12T03:58:07.601 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.598+0000 7f394e7d2640 10 monclient: build_initial_monmap 2026-02-12T03:58:07.601 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.598+0000 7f394e7d2640 10 monclient: monmap: 2026-02-12T03:58:07.601 INFO:teuthology.misc.health.trial091.stderr:epoch 0 2026-02-12T03:58:07.602 INFO:teuthology.misc.health.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:07.602 INFO:teuthology.misc.health.trial091.stderr:last_changed 2026-02-12T03:58:07.599824+0000 2026-02-12T03:58:07.602 INFO:teuthology.misc.health.trial091.stderr:created 2026-02-12T03:58:07.599824+0000 2026-02-12T03:58:07.602 INFO:teuthology.misc.health.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:07.602 INFO:teuthology.misc.health.trial091.stderr:election_strategy: 3 2026-02-12T03:58:07.602 INFO:teuthology.misc.health.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:07.602 INFO:teuthology.misc.health.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:07.602 INFO:teuthology.misc.health.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:07.602 INFO:teuthology.misc.health.trial091.stderr: 2026-02-12T03:58:07.602 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.598+0000 7f394e7d2640 1 Processor -- start 2026-02-12T03:58:07.602 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.598+0000 7f394e7d2640 1 -- start start 2026-02-12T03:58:07.603 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.598+0000 7f394e7d2640 10 monclient: init 2026-02-12T03:58:07.605 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.599+0000 7f394e7d2640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:07.605 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.599+0000 7f394e7d2640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T03:58:07.605 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.599+0000 7f394e7d2640 10 monclient(hunting): picked mon.noname-a con 0x7f39481599b0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:07.605 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.599+0000 7f394e7d2640 10 monclient(hunting): picked mon.noname-b con 0x7f394805d180 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:07.605 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.599+0000 7f394e7d2640 10 monclient(hunting): picked mon.noname-c con 0x7f3948166580 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:07.605 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.599+0000 7f394e7d2640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f394805c0e0 con 0x7f39481599b0 2026-02-12T03:58:07.605 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.599+0000 7f394e7d2640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f394805c3c0 con 0x7f394805d180 2026-02-12T03:58:07.605 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.599+0000 7f394e7d2640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f394805c6a0 con 0x7f3948166580 2026-02-12T03:58:07.606 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.599+0000 7f394e7d2640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:07.606 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.599+0000 7f394e7d2640 10 monclient(hunting): authenticate will time out at 1090.343237s 2026-02-12T03:58:07.606 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.599+0000 7f3947fff640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f39481599b0 0x7f394805b730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:52262/0 (socket says 10.20.193.91:52262) 2026-02-12T03:58:07.606 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.599+0000 7f3947fff640 1 -- 10.20.193.91:0/4092343202 learned_addr learned my addr 10.20.193.91:0/4092343202 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:07.606 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.601+0000 7f3946ffd640 1 -- 10.20.193.91:0/4092343202 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 505443624 0 0) 0x7f394805c6a0 con 0x7f3948166580 2026-02-12T03:58:07.606 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.601+0000 7f3946ffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:07.606 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.601+0000 7f3946ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:07.606 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.601+0000 7f3946ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:07.606 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.601+0000 7f3946ffd640 10 monclient(hunting): my global_id is 4202 2026-02-12T03:58:07.606 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.601+0000 7f3946ffd640 1 -- 10.20.193.91:0/4092343202 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f392c003610 con 0x7f3948166580 2026-02-12T03:58:07.606 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.601+0000 7f3946ffd640 1 -- 10.20.193.91:0/4092343202 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 441817847 0 0) 0x7f394805c0e0 con 0x7f39481599b0 2026-02-12T03:58:07.606 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.601+0000 7f3946ffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:07.607 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.601+0000 7f3946ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:07.607 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.601+0000 7f3946ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:07.607 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.601+0000 7f3946ffd640 10 monclient(hunting): my global_id is 4230 2026-02-12T03:58:07.607 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.601+0000 7f3946ffd640 1 -- 10.20.193.91:0/4092343202 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f394805c6a0 con 0x7f39481599b0 2026-02-12T03:58:07.607 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.601+0000 7f3946ffd640 1 -- 10.20.193.91:0/4092343202 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1019199327 0 0) 0x7f394805c3c0 con 0x7f394805d180 2026-02-12T03:58:07.607 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.601+0000 7f3946ffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:07.607 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.601+0000 7f3946ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:07.607 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.601+0000 7f3946ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:07.607 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.601+0000 7f3946ffd640 10 monclient(hunting): my global_id is 4234 2026-02-12T03:58:07.607 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.601+0000 7f3946ffd640 1 -- 10.20.193.91:0/4092343202 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f394805c0e0 con 0x7f394805d180 2026-02-12T03:58:07.613 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.603+0000 7f3946ffd640 1 -- 10.20.193.91:0/4092343202 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1898941048 0 0) 0x7f392c003610 con 0x7f3948166580 2026-02-12T03:58:07.613 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.603+0000 7f3946ffd640 1 -- 10.20.193.91:0/4092343202 >> v1:10.20.193.98:6789/0 conn(0x7f394805d180 legacy=0x7f394805d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:07.613 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.603+0000 7f3946ffd640 1 -- 10.20.193.91:0/4092343202 >> v1:10.20.193.91:6789/0 conn(0x7f39481599b0 legacy=0x7f394805b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:07.613 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.603+0000 7f3946ffd640 10 monclient: _finish_hunting 0 2026-02-12T03:58:07.613 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.603+0000 7f3946ffd640 1 monclient: found mon.noname-c 2026-02-12T03:58:07.614 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.603+0000 7f3946ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:07.614 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.603+0000 7f3946ffd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.111:6789/0 2026-02-12T03:58:07.614 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.603+0000 7f3946ffd640 1 -- 10.20.193.91:0/4092343202 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f394805c980 con 0x7f3948166580 2026-02-12T03:58:07.614 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.603+0000 7f3946ffd640 10 monclient: _finish_auth 0 2026-02-12T03:58:07.614 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.603+0000 7f3946ffd640 10 monclient: _check_auth_tickets 2026-02-12T03:58:07.614 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.603+0000 7f3946ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:07.614 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.603+0000 7f3946ffd640 1 -- 10.20.193.91:0/4092343202 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f393c003170 con 0x7f3948166580 2026-02-12T03:58:07.614 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.603+0000 7f3946ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:07.614 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.603+0000 7f3946ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:07.614 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.603+0000 7f3946ffd640 10 monclient: dump: 2026-02-12T03:58:07.615 INFO:teuthology.misc.health.trial091.stderr:epoch 1 2026-02-12T03:58:07.615 INFO:teuthology.misc.health.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:07.615 INFO:teuthology.misc.health.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:07.615 INFO:teuthology.misc.health.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:07.615 INFO:teuthology.misc.health.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:07.615 INFO:teuthology.misc.health.trial091.stderr:election_strategy: 3 2026-02-12T03:58:07.615 INFO:teuthology.misc.health.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:07.616 INFO:teuthology.misc.health.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:07.616 INFO:teuthology.misc.health.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:07.616 INFO:teuthology.misc.health.trial091.stderr: 2026-02-12T03:58:07.616 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.603+0000 7f394e7d2640 5 monclient: authenticate success, global_id 4202 2026-02-12T03:58:07.616 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.603+0000 7f394e7d2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:07.616 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.603+0000 7f3946ffd640 1 -- 10.20.193.91:0/4092343202 <== mon.2 v1:10.20.193.111:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f393c003340 con 0x7f3948166580 2026-02-12T03:58:07.616 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.603+0000 7f3946ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:07.616 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.603+0000 7f3946ffd640 1 -- 10.20.193.91:0/4092343202 <== mon.2 v1:10.20.193.111:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f393c003780 con 0x7f3948166580 2026-02-12T03:58:07.617 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.603+0000 7f3946ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:07.617 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.603+0000 7f3946ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:07.617 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.603+0000 7f3946ffd640 10 monclient: dump: 2026-02-12T03:58:07.617 INFO:teuthology.misc.health.trial091.stderr:epoch 1 2026-02-12T03:58:07.617 INFO:teuthology.misc.health.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:07.617 INFO:teuthology.misc.health.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:07.617 INFO:teuthology.misc.health.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:07.617 INFO:teuthology.misc.health.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:07.617 INFO:teuthology.misc.health.trial091.stderr:election_strategy: 3 2026-02-12T03:58:07.617 INFO:teuthology.misc.health.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:07.617 INFO:teuthology.misc.health.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:07.617 INFO:teuthology.misc.health.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:07.618 INFO:teuthology.misc.health.trial091.stderr: 2026-02-12T03:58:07.618 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.603+0000 7f394e7d2640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:07.618 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.603+0000 7f394e7d2640 4 set_mon_vals no callback set 2026-02-12T03:58:07.618 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.604+0000 7f394e7d2640 10 monclient: shutdown 2026-02-12T03:58:07.618 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.604+0000 7f394e7d2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:07.618 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.604+0000 7f394e7d2640 1 -- 10.20.193.91:0/4092343202 >> v1:10.20.193.111:6789/0 conn(0x7f3948166580 legacy=0x7f39481669a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:07.618 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.604+0000 7f394e7d2640 1 -- 10.20.193.91:0/4092343202 shutdown_connections 2026-02-12T03:58:07.618 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.604+0000 7f394e7d2640 1 -- 10.20.193.91:0/4092343202 >> 10.20.193.91:0/4092343202 conn(0x7f39480b6560 msgr2=0x7f39480b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:07.618 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.604+0000 7f394e7d2640 1 -- 10.20.193.91:0/4092343202 shutdown_connections 2026-02-12T03:58:07.618 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.604+0000 7f394e7d2640 1 -- 10.20.193.91:0/4092343202 wait complete. 2026-02-12T03:58:07.618 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.604+0000 7f394e7d2640 10 monclient: build_initial_monmap 2026-02-12T03:58:07.618 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.604+0000 7f394e7d2640 10 monclient: monmap: 2026-02-12T03:58:07.619 INFO:teuthology.misc.health.trial091.stderr:epoch 0 2026-02-12T03:58:07.619 INFO:teuthology.misc.health.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:07.619 INFO:teuthology.misc.health.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:07.619 INFO:teuthology.misc.health.trial091.stderr:created 0.000000 2026-02-12T03:58:07.619 INFO:teuthology.misc.health.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:07.619 INFO:teuthology.misc.health.trial091.stderr:election_strategy: 1 2026-02-12T03:58:07.619 INFO:teuthology.misc.health.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:07.619 INFO:teuthology.misc.health.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:07.619 INFO:teuthology.misc.health.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:07.619 INFO:teuthology.misc.health.trial091.stderr: 2026-02-12T03:58:07.619 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.604+0000 7f394e7d2640 1 librados: starting msgr at 2026-02-12T03:58:07.619 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.604+0000 7f394e7d2640 1 librados: starting objecter 2026-02-12T03:58:07.620 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.604+0000 7f394e7d2640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:07.620 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.604+0000 7f394e7d2640 1 Processor -- start 2026-02-12T03:58:07.620 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.604+0000 7f394e7d2640 1 -- start start 2026-02-12T03:58:07.620 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.604+0000 7f394e7d2640 1 librados: setting wanted keys 2026-02-12T03:58:07.620 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.604+0000 7f394e7d2640 1 librados: calling monclient init 2026-02-12T03:58:07.620 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.604+0000 7f394e7d2640 10 monclient: init 2026-02-12T03:58:07.620 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.605+0000 7f394e7d2640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:07.620 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.605+0000 7f394e7d2640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T03:58:07.620 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.605+0000 7f394e7d2640 10 monclient(hunting): picked mon.noname-a con 0x7f394805d180 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:07.620 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.605+0000 7f394e7d2640 10 monclient(hunting): picked mon.noname-b con 0x7f39481599b0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:07.620 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.605+0000 7f394e7d2640 10 monclient(hunting): picked mon.noname-c con 0x7f3948166580 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:07.620 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.605+0000 7f394e7d2640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3948158e60 con 0x7f394805d180 2026-02-12T03:58:07.620 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.605+0000 7f394e7d2640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3948132530 con 0x7f39481599b0 2026-02-12T03:58:07.621 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.605+0000 7f394e7d2640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3948137cf0 con 0x7f3948166580 2026-02-12T03:58:07.621 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.605+0000 7f394e7d2640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:07.621 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.605+0000 7f394e7d2640 10 monclient(hunting): authenticate will time out at 1090.349324s 2026-02-12T03:58:07.621 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.605+0000 7f3947fff640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f394805d180 0x7f3948153270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:52264/0 (socket says 10.20.193.91:52264) 2026-02-12T03:58:07.621 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.605+0000 7f3947fff640 1 -- 10.20.193.91:0/887013793 learned_addr learned my addr 10.20.193.91:0/887013793 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:07.621 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.605+0000 7f3944ff9640 10 client.?.objecter ms_handle_connect 0x7f394805d180 2026-02-12T03:58:07.621 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.605+0000 7f3944ff9640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:07.621 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.605+0000 7f3944ff9640 10 client.?.objecter ms_handle_connect 0x7f3948166580 2026-02-12T03:58:07.621 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.605+0000 7f3944ff9640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:07.621 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.606+0000 7f3944ff9640 10 client.?.objecter ms_handle_connect 0x7f39481599b0 2026-02-12T03:58:07.621 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.606+0000 7f3944ff9640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:07.621 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.607+0000 7f3944ff9640 1 -- 10.20.193.91:0/887013793 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3329960071 0 0) 0x7f3948158e60 con 0x7f394805d180 2026-02-12T03:58:07.622 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.607+0000 7f3944ff9640 10 monclient(hunting): _negotiate 2026-02-12T03:58:07.622 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.607+0000 7f3944ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:07.622 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.607+0000 7f3944ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:07.622 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.607+0000 7f3944ff9640 10 monclient(hunting): my global_id is 4233 2026-02-12T03:58:07.622 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.607+0000 7f3944ff9640 1 -- 10.20.193.91:0/887013793 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3918003610 con 0x7f394805d180 2026-02-12T03:58:07.622 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.607+0000 7f3944ff9640 1 -- 10.20.193.91:0/887013793 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1444211763 0 0) 0x7f3948137cf0 con 0x7f3948166580 2026-02-12T03:58:07.622 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.607+0000 7f3944ff9640 10 monclient(hunting): _negotiate 2026-02-12T03:58:07.622 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.607+0000 7f3944ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:07.622 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.607+0000 7f3944ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:07.622 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.607+0000 7f3944ff9640 10 monclient(hunting): my global_id is 4205 2026-02-12T03:58:07.622 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.607+0000 7f3944ff9640 1 -- 10.20.193.91:0/887013793 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3948158e60 con 0x7f3948166580 2026-02-12T03:58:07.622 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.607+0000 7f3944ff9640 1 -- 10.20.193.91:0/887013793 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3504475222 0 0) 0x7f3948132530 con 0x7f39481599b0 2026-02-12T03:58:07.623 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.607+0000 7f3944ff9640 10 monclient(hunting): _negotiate 2026-02-12T03:58:07.623 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.607+0000 7f3944ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:07.623 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.607+0000 7f3944ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:07.623 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.607+0000 7f3944ff9640 10 monclient(hunting): my global_id is 4237 2026-02-12T03:58:07.623 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.607+0000 7f3944ff9640 1 -- 10.20.193.91:0/887013793 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3948137cf0 con 0x7f39481599b0 2026-02-12T03:58:07.623 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.610+0000 7f3944ff9640 1 -- 10.20.193.91:0/887013793 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 320556306 0 0) 0x7f3918003610 con 0x7f394805d180 2026-02-12T03:58:07.623 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.610+0000 7f3944ff9640 1 -- 10.20.193.91:0/887013793 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3948132530 con 0x7f394805d180 2026-02-12T03:58:07.623 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.610+0000 7f3944ff9640 1 -- 10.20.193.91:0/887013793 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f39340030a0 con 0x7f394805d180 2026-02-12T03:58:07.623 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.610+0000 7f3944ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:07.623 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.610+0000 7f3944ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:07.623 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.610+0000 7f3944ff9640 10 monclient(hunting): dump: 2026-02-12T03:58:07.623 INFO:teuthology.misc.health.trial091.stderr:epoch 1 2026-02-12T03:58:07.624 INFO:teuthology.misc.health.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:07.624 INFO:teuthology.misc.health.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:07.624 INFO:teuthology.misc.health.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:07.624 INFO:teuthology.misc.health.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:07.624 INFO:teuthology.misc.health.trial091.stderr:election_strategy: 3 2026-02-12T03:58:07.624 INFO:teuthology.misc.health.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:07.624 INFO:teuthology.misc.health.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:07.624 INFO:teuthology.misc.health.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:07.624 INFO:teuthology.misc.health.trial091.stderr: 2026-02-12T03:58:07.624 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.610+0000 7f3944ff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:07.624 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.610+0000 7f3944ff9640 1 -- 10.20.193.91:0/887013793 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2638718538 0 0) 0x7f3948137cf0 con 0x7f39481599b0 2026-02-12T03:58:07.624 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.610+0000 7f3944ff9640 1 -- 10.20.193.91:0/887013793 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3918003610 con 0x7f39481599b0 2026-02-12T03:58:07.625 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.610+0000 7f3944ff9640 1 -- 10.20.193.91:0/887013793 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f3938003060 con 0x7f39481599b0 2026-02-12T03:58:07.625 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.610+0000 7f3944ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:07.625 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.610+0000 7f3944ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:07.625 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.610+0000 7f3944ff9640 10 monclient(hunting): dump: 2026-02-12T03:58:07.625 INFO:teuthology.misc.health.trial091.stderr:epoch 1 2026-02-12T03:58:07.625 INFO:teuthology.misc.health.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:07.625 INFO:teuthology.misc.health.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:07.625 INFO:teuthology.misc.health.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:07.625 INFO:teuthology.misc.health.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:07.625 INFO:teuthology.misc.health.trial091.stderr:election_strategy: 3 2026-02-12T03:58:07.625 INFO:teuthology.misc.health.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:07.625 INFO:teuthology.misc.health.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:07.625 INFO:teuthology.misc.health.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:07.626 INFO:teuthology.misc.health.trial091.stderr: 2026-02-12T03:58:07.626 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.610+0000 7f3944ff9640 1 -- 10.20.193.91:0/887013793 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1652749575 0 0) 0x7f3948158e60 con 0x7f3948166580 2026-02-12T03:58:07.626 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.610+0000 7f3944ff9640 1 -- 10.20.193.91:0/887013793 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3948137cf0 con 0x7f3948166580 2026-02-12T03:58:07.626 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.610+0000 7f3944ff9640 1 -- 10.20.193.91:0/887013793 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f393c0034f0 con 0x7f3948166580 2026-02-12T03:58:07.626 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.610+0000 7f3944ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:07.626 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.610+0000 7f3944ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:07.626 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.610+0000 7f3944ff9640 10 monclient(hunting): dump: 2026-02-12T03:58:07.626 INFO:teuthology.misc.health.trial091.stderr:epoch 1 2026-02-12T03:58:07.626 INFO:teuthology.misc.health.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:07.626 INFO:teuthology.misc.health.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:07.626 INFO:teuthology.misc.health.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:07.626 INFO:teuthology.misc.health.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:07.626 INFO:teuthology.misc.health.trial091.stderr:election_strategy: 3 2026-02-12T03:58:07.627 INFO:teuthology.misc.health.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:07.627 INFO:teuthology.misc.health.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:07.627 INFO:teuthology.misc.health.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:07.627 INFO:teuthology.misc.health.trial091.stderr: 2026-02-12T03:58:07.629 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.611+0000 7f3944ff9640 1 -- 10.20.193.91:0/887013793 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3885219987 0 0) 0x7f3948132530 con 0x7f394805d180 2026-02-12T03:58:07.629 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.611+0000 7f3944ff9640 1 -- 10.20.193.91:0/887013793 >> v1:10.20.193.111:6789/0 conn(0x7f3948166580 legacy=0x7f394814de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:07.629 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.611+0000 7f3944ff9640 1 -- 10.20.193.91:0/887013793 >> v1:10.20.193.98:6789/0 conn(0x7f39481599b0 legacy=0x7f3948158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:07.629 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.611+0000 7f3944ff9640 10 monclient: _finish_hunting 0 2026-02-12T03:58:07.629 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.611+0000 7f3944ff9640 1 monclient: found mon.a 2026-02-12T03:58:07.629 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.611+0000 7f3944ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:07.629 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.611+0000 7f3944ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:07.629 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.611+0000 7f3944ff9640 1 -- 10.20.193.91:0/887013793 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3948120170 con 0x7f394805d180 2026-02-12T03:58:07.629 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.611+0000 7f3944ff9640 10 monclient: _finish_auth 0 2026-02-12T03:58:07.629 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.611+0000 7f3944ff9640 10 monclient: _check_auth_tickets 2026-02-12T03:58:07.630 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.611+0000 7f3944ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:07.630 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.611+0000 7f394e7d2640 5 monclient: authenticate success, global_id 4233 2026-02-12T03:58:07.630 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.611+0000 7f394e7d2640 10 monclient: _renew_subs 2026-02-12T03:58:07.630 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.611+0000 7f394e7d2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:07.630 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.611+0000 7f394e7d2640 1 -- 10.20.193.91:0/887013793 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3948137730 con 0x7f394805d180 2026-02-12T03:58:07.630 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.611+0000 7f394e7d2640 10 client.4233.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:07.630 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.611+0000 7f394e7d2640 10 monclient: _renew_subs 2026-02-12T03:58:07.630 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.611+0000 7f394e7d2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:07.630 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.611+0000 7f394e7d2640 1 -- 10.20.193.91:0/887013793 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f394814d3a0 con 0x7f394805d180 2026-02-12T03:58:07.630 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.611+0000 7f394e7d2640 1 librados: init done 2026-02-12T03:58:07.630 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.612+0000 7f394e7d2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:07.630 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.612+0000 7f394e7d2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:07.631 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.612+0000 7f394e7d2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:07.631 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.612+0000 7f394e7d2640 1 -- 10.20.193.91:0/887013793 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3948138b30 con 0x7f394805d180 2026-02-12T03:58:07.710 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.707+0000 7f3944ff9640 1 -- 10.20.193.91:0/887013793 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f39340048d0 con 0x7f394805d180 2026-02-12T03:58:07.710 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.707+0000 7f3944ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:07.710 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.707+0000 7f3944ff9640 1 -- 10.20.193.91:0/887013793 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f3934004ce0 con 0x7f394805d180 2026-02-12T03:58:07.710 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.707+0000 7f3944ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:07.710 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.707+0000 7f3944ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:07.710 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.707+0000 7f3944ff9640 10 monclient: dump: 2026-02-12T03:58:07.711 INFO:teuthology.misc.health.trial091.stderr:epoch 1 2026-02-12T03:58:07.711 INFO:teuthology.misc.health.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:07.711 INFO:teuthology.misc.health.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:07.711 INFO:teuthology.misc.health.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:07.711 INFO:teuthology.misc.health.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:07.711 INFO:teuthology.misc.health.trial091.stderr:election_strategy: 3 2026-02-12T03:58:07.711 INFO:teuthology.misc.health.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:07.711 INFO:teuthology.misc.health.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:07.711 INFO:teuthology.misc.health.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:07.711 INFO:teuthology.misc.health.trial091.stderr: 2026-02-12T03:58:07.711 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.707+0000 7f39467fc640 4 set_mon_vals no callback set 2026-02-12T03:58:07.712 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.708+0000 7f3944ff9640 1 -- 10.20.193.91:0/887013793 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 4) ==== 103168+0+0 (unknown 3733604615 0 0) 0x7f3934004ec0 con 0x7f394805d180 2026-02-12T03:58:07.712 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.708+0000 7f39477fe640 10 monclient: get_auth_request con 0x7f391807a040 auth_method 0 2026-02-12T03:58:07.712 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.708+0000 7f3944ff9640 10 client.4233.objecter ms_handle_connect 0x7f391807a040 2026-02-12T03:58:07.714 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.711+0000 7f3944ff9640 1 -- 10.20.193.91:0/887013793 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 2560+0+0 (unknown 3427255071 0 0) 0x7f393405acb0 con 0x7f394805d180 2026-02-12T03:58:07.714 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.711+0000 7f3944ff9640 10 client.4233.objecter ms_dispatch2 0x7f3948000b90 osd_map(18..18 src has 1..18) 2026-02-12T03:58:07.714 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.711+0000 7f3944ff9640 3 client.4233.objecter handle_osd_map got epochs [18,18] > 0 2026-02-12T03:58:07.714 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.711+0000 7f3944ff9640 3 client.4233.objecter handle_osd_map decoding full epoch 18 2026-02-12T03:58:07.714 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.711+0000 7f3944ff9640 20 client.4233.objecter dump_active .. 0 homeless 2026-02-12T03:58:07.714 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.711+0000 7f3944ff9640 1 -- 10.20.193.91:0/887013793 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f393405f420 con 0x7f394805d180 2026-02-12T03:58:07.714 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.711+0000 7f3944ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:07.714 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.711+0000 7f3944ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:07.823 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.820+0000 7f394e7d2640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-12T03:58:07.823 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.820+0000 7f394e7d2640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T03:58:07.823 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.820+0000 7f394e7d2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:07.824 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.820+0000 7f394e7d2640 1 -- 10.20.193.91:0/887013793 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3948138850 con 0x7f394805d180 2026-02-12T03:58:07.847 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.845+0000 7f3944ff9640 1 -- 10.20.193.91:0/887013793 <== mon.0 v1:10.20.193.91:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12877 (unknown 3338201251 0 3816485227) 0x7f3934004ce0 con 0x7f394805d180 2026-02-12T03:58:07.848 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.845+0000 7f3944ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T03:58:07.848 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.845+0000 7f3944ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:07.848 INFO:teuthology.misc.health.trial091.stdout: 2026-02-12T03:58:07.848 INFO:teuthology.misc.health.trial091.stdout:{"epoch":18,"fsid":"1e356fcf-3d61-462e-a451-82f8dd01e1f3","created":"2026-02-12T03:57:59.014379+0000","modified":"2026-02-12T03:58:05.455425+0000","last_up_change":"0.000000","last_in_change":"2026-02-12T03:58:05.455425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"791c97c5-83f6-4024-9f43-ff3b2ee22a30","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0cf561d6-85aa-428a-bc69-83ce77b1c802","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b3dc78b9-cae6-4b1f-931f-7352a43b9e26","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e164e3ae-cf6a-45ff-b126-3ac739c5b1be","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5583cc8c-83d4-42b4-a997-c056f3b145a0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d7bb6fa1-b042-4dce-9644-00e817a5bc8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"93cd9edf-a000-4d22-8da7-52f4bd547765","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f5e11a47-d746-46ca-85f1-27d3bc586371","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"bb8207ce-22b9-46be-9c89-c77f2690e405","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"e6318a6d-2367-48ce-a3a1-47307de14b99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"cd6c97a2-bdfe-4b86-afeb-217315976d6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"b6c647bb-4e86-4b0e-b79c-b0236a780a66","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"19bb3570-0c0a-48cc-a0b8-ec3194f30fa8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"a8215062-521c-47f6-b20a-9e40c1f3f5a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"3cd1bb48-53a2-462e-b7e5-4d6d918dd543","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"9bd39438-f5e5-4a19-afa4-678395d63c24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T03:58:07.851 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.848+0000 7f394e7d2640 10 librados: watch_flush enter 2026-02-12T03:58:07.851 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.848+0000 7f394e7d2640 10 librados: watch_flush exit 2026-02-12T03:58:07.851 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.848+0000 7f394e7d2640 20 client.4233.objecter shutdown clearing up homeless session... 2026-02-12T03:58:07.851 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.848+0000 7f394e7d2640 10 client.4233.objecter successfully canceled tick 2026-02-12T03:58:07.851 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.848+0000 7f394e7d2640 1 -- 10.20.193.91:0/887013793 >> v1:10.20.193.91:6800/2929217192 conn(0x7f391807a040 legacy=0x7f391809a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:07.852 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.848+0000 7f394e7d2640 10 monclient: shutdown 2026-02-12T03:58:07.852 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.848+0000 7f394e7d2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:07.852 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.848+0000 7f394e7d2640 1 -- 10.20.193.91:0/887013793 >> v1:10.20.193.91:6789/0 conn(0x7f394805d180 legacy=0x7f3948153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:07.852 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.848+0000 7f394e7d2640 1 -- 10.20.193.91:0/887013793 shutdown_connections 2026-02-12T03:58:07.852 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.848+0000 7f394e7d2640 1 -- 10.20.193.91:0/887013793 >> 10.20.193.91:0/887013793 conn(0x7f39480b6560 msgr2=0x7f394805b730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:07.852 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.848+0000 7f394e7d2640 1 -- 10.20.193.91:0/887013793 shutdown_connections 2026-02-12T03:58:07.852 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.848+0000 7f394e7d2640 1 -- 10.20.193.91:0/887013793 wait complete. 2026-02-12T03:58:07.852 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:07.848+0000 7f394e7d2640 1 librados: shutdown 2026-02-12T03:58:07.860 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-12T03:58:15.473 DEBUG:teuthology.orchestra.run.trial091:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-12T03:58:15.531 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.528+0000 7fe1180fb640 10 monclient: get_monmap_and_config 2026-02-12T03:58:15.531 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.528+0000 7fe1180fb640 10 monclient: build_initial_monmap 2026-02-12T03:58:15.531 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.528+0000 7fe1180fb640 10 monclient: monmap: 2026-02-12T03:58:15.532 INFO:teuthology.misc.health.trial091.stderr:epoch 0 2026-02-12T03:58:15.532 INFO:teuthology.misc.health.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:15.532 INFO:teuthology.misc.health.trial091.stderr:last_changed 2026-02-12T03:58:15.530331+0000 2026-02-12T03:58:15.532 INFO:teuthology.misc.health.trial091.stderr:created 2026-02-12T03:58:15.530331+0000 2026-02-12T03:58:15.532 INFO:teuthology.misc.health.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:15.532 INFO:teuthology.misc.health.trial091.stderr:election_strategy: 3 2026-02-12T03:58:15.532 INFO:teuthology.misc.health.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:15.532 INFO:teuthology.misc.health.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:15.532 INFO:teuthology.misc.health.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:15.532 INFO:teuthology.misc.health.trial091.stderr: 2026-02-12T03:58:15.534 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.529+0000 7fe1180fb640 1 Processor -- start 2026-02-12T03:58:15.534 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.529+0000 7fe1180fb640 1 -- start start 2026-02-12T03:58:15.534 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.529+0000 7fe1180fb640 10 monclient: init 2026-02-12T03:58:15.534 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.529+0000 7fe1180fb640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:15.534 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.529+0000 7fe1180fb640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T03:58:15.534 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.529+0000 7fe1180fb640 10 monclient(hunting): picked mon.noname-b con 0x7fe11015d5e0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:15.534 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.529+0000 7fe1180fb640 10 monclient(hunting): picked mon.noname-a con 0x7fe1100b2980 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:15.535 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.529+0000 7fe1180fb640 10 monclient(hunting): picked mon.noname-c con 0x7fe11015d9b0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:15.535 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.529+0000 7fe1180fb640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1100567e0 con 0x7fe1100b2980 2026-02-12T03:58:15.535 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.529+0000 7fe1180fb640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1100585a0 con 0x7fe11015d5e0 2026-02-12T03:58:15.535 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.529+0000 7fe1180fb640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe110058880 con 0x7fe11015d9b0 2026-02-12T03:58:15.535 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.529+0000 7fe1180fb640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:15.535 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.529+0000 7fe1180fb640 10 monclient(hunting): authenticate will time out at 1098.273876s 2026-02-12T03:58:15.535 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.530+0000 7fe11566f640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7fe1100b2980 0x7fe1100559c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:57790/0 (socket says 10.20.193.91:57790) 2026-02-12T03:58:15.535 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.530+0000 7fe11566f640 1 -- 10.20.193.91:0/443923519 learned_addr learned my addr 10.20.193.91:0/443923519 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:15.537 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.532+0000 7fe114e6e640 1 -- 10.20.193.91:0/443923519 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 625691196 0 0) 0x7fe1100585a0 con 0x7fe11015d5e0 2026-02-12T03:58:15.537 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.532+0000 7fe114e6e640 10 monclient(hunting): _negotiate 2026-02-12T03:58:15.537 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.532+0000 7fe114e6e640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:15.537 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.532+0000 7fe114e6e640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:15.537 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.532+0000 7fe114e6e640 10 monclient(hunting): my global_id is 4240 2026-02-12T03:58:15.537 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.532+0000 7fe114e6e640 1 -- 10.20.193.91:0/443923519 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0f8003610 con 0x7fe11015d5e0 2026-02-12T03:58:15.537 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.532+0000 7fe114e6e640 1 -- 10.20.193.91:0/443923519 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4082365087 0 0) 0x7fe1100567e0 con 0x7fe1100b2980 2026-02-12T03:58:15.537 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.532+0000 7fe114e6e640 10 monclient(hunting): _negotiate 2026-02-12T03:58:15.537 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.532+0000 7fe114e6e640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:15.538 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.532+0000 7fe114e6e640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:15.538 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.532+0000 7fe114e6e640 10 monclient(hunting): my global_id is 4236 2026-02-12T03:58:15.538 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.532+0000 7fe114e6e640 1 -- 10.20.193.91:0/443923519 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1100585a0 con 0x7fe1100b2980 2026-02-12T03:58:15.538 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.532+0000 7fe114e6e640 1 -- 10.20.193.91:0/443923519 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1733257534 0 0) 0x7fe110058880 con 0x7fe11015d9b0 2026-02-12T03:58:15.538 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.532+0000 7fe114e6e640 10 monclient(hunting): _negotiate 2026-02-12T03:58:15.538 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.532+0000 7fe114e6e640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:15.538 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.532+0000 7fe114e6e640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:15.538 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.532+0000 7fe114e6e640 10 monclient(hunting): my global_id is 4208 2026-02-12T03:58:15.538 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.532+0000 7fe114e6e640 1 -- 10.20.193.91:0/443923519 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1100567e0 con 0x7fe11015d9b0 2026-02-12T03:58:15.538 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.533+0000 7fe114e6e640 1 -- 10.20.193.91:0/443923519 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3794138061 0 0) 0x7fe0f8003610 con 0x7fe11015d5e0 2026-02-12T03:58:15.538 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.533+0000 7fe114e6e640 1 -- 10.20.193.91:0/443923519 >> v1:10.20.193.111:6789/0 conn(0x7fe11015d9b0 legacy=0x7fe1100560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:15.538 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.533+0000 7fe114e6e640 1 -- 10.20.193.91:0/443923519 >> v1:10.20.193.91:6789/0 conn(0x7fe1100b2980 legacy=0x7fe1100559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:15.539 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.533+0000 7fe114e6e640 10 monclient: _finish_hunting 0 2026-02-12T03:58:15.539 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.533+0000 7fe114e6e640 1 monclient: found mon.noname-b 2026-02-12T03:58:15.539 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.533+0000 7fe114e6e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:15.539 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.533+0000 7fe114e6e640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T03:58:15.539 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.533+0000 7fe114e6e640 1 -- 10.20.193.91:0/443923519 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe110058b60 con 0x7fe11015d5e0 2026-02-12T03:58:15.539 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.533+0000 7fe114e6e640 10 monclient: _finish_auth 0 2026-02-12T03:58:15.539 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.533+0000 7fe114e6e640 10 monclient: _check_auth_tickets 2026-02-12T03:58:15.539 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.533+0000 7fe114e6e640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:15.539 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.533+0000 7fe114e6e640 1 -- 10.20.193.91:0/443923519 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fe100002df0 con 0x7fe11015d5e0 2026-02-12T03:58:15.539 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.533+0000 7fe114e6e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:15.539 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.533+0000 7fe114e6e640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:15.539 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.533+0000 7fe114e6e640 10 monclient: dump: 2026-02-12T03:58:15.540 INFO:teuthology.misc.health.trial091.stderr:epoch 1 2026-02-12T03:58:15.540 INFO:teuthology.misc.health.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:15.540 INFO:teuthology.misc.health.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:15.540 INFO:teuthology.misc.health.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:15.540 INFO:teuthology.misc.health.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:15.540 INFO:teuthology.misc.health.trial091.stderr:election_strategy: 3 2026-02-12T03:58:15.540 INFO:teuthology.misc.health.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:15.540 INFO:teuthology.misc.health.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:15.540 INFO:teuthology.misc.health.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:15.540 INFO:teuthology.misc.health.trial091.stderr: 2026-02-12T03:58:15.540 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.533+0000 7fe1180fb640 5 monclient: authenticate success, global_id 4240 2026-02-12T03:58:15.540 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.533+0000 7fe1180fb640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:15.546 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.534+0000 7fe114e6e640 1 -- 10.20.193.91:0/443923519 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe100003030 con 0x7fe11015d5e0 2026-02-12T03:58:15.546 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.534+0000 7fe114e6e640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:15.546 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.534+0000 7fe114e6e640 1 -- 10.20.193.91:0/443923519 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fe100003470 con 0x7fe11015d5e0 2026-02-12T03:58:15.546 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.534+0000 7fe114e6e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:15.546 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.534+0000 7fe114e6e640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:15.546 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.534+0000 7fe114e6e640 10 monclient: dump: 2026-02-12T03:58:15.546 INFO:teuthology.misc.health.trial091.stderr:epoch 1 2026-02-12T03:58:15.546 INFO:teuthology.misc.health.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:15.547 INFO:teuthology.misc.health.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:15.547 INFO:teuthology.misc.health.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:15.547 INFO:teuthology.misc.health.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:15.547 INFO:teuthology.misc.health.trial091.stderr:election_strategy: 3 2026-02-12T03:58:15.547 INFO:teuthology.misc.health.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:15.547 INFO:teuthology.misc.health.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:15.547 INFO:teuthology.misc.health.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:15.547 INFO:teuthology.misc.health.trial091.stderr: 2026-02-12T03:58:15.547 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.534+0000 7fe1180fb640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:15.547 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.534+0000 7fe1180fb640 4 set_mon_vals no callback set 2026-02-12T03:58:15.547 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.535+0000 7fe1180fb640 10 monclient: shutdown 2026-02-12T03:58:15.548 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.535+0000 7fe1180fb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:15.548 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.535+0000 7fe1180fb640 1 -- 10.20.193.91:0/443923519 >> v1:10.20.193.98:6789/0 conn(0x7fe11015d5e0 legacy=0x7fe1100b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:15.548 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.535+0000 7fe1180fb640 1 -- 10.20.193.91:0/443923519 shutdown_connections 2026-02-12T03:58:15.548 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.535+0000 7fe1180fb640 1 -- 10.20.193.91:0/443923519 >> 10.20.193.91:0/443923519 conn(0x7fe1100b76b0 msgr2=0x7fe1100b7ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:15.548 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.535+0000 7fe1180fb640 1 -- 10.20.193.91:0/443923519 shutdown_connections 2026-02-12T03:58:15.548 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.535+0000 7fe1180fb640 1 -- 10.20.193.91:0/443923519 wait complete. 2026-02-12T03:58:15.548 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.535+0000 7fe1180fb640 10 monclient: build_initial_monmap 2026-02-12T03:58:15.548 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.535+0000 7fe1180fb640 10 monclient: monmap: 2026-02-12T03:58:15.548 INFO:teuthology.misc.health.trial091.stderr:epoch 0 2026-02-12T03:58:15.548 INFO:teuthology.misc.health.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:15.548 INFO:teuthology.misc.health.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:15.548 INFO:teuthology.misc.health.trial091.stderr:created 0.000000 2026-02-12T03:58:15.548 INFO:teuthology.misc.health.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:15.549 INFO:teuthology.misc.health.trial091.stderr:election_strategy: 1 2026-02-12T03:58:15.549 INFO:teuthology.misc.health.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:15.549 INFO:teuthology.misc.health.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:15.549 INFO:teuthology.misc.health.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:15.549 INFO:teuthology.misc.health.trial091.stderr: 2026-02-12T03:58:15.549 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.535+0000 7fe1180fb640 1 librados: starting msgr at 2026-02-12T03:58:15.549 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.535+0000 7fe1180fb640 1 librados: starting objecter 2026-02-12T03:58:15.549 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.535+0000 7fe1180fb640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:15.549 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.535+0000 7fe1180fb640 1 Processor -- start 2026-02-12T03:58:15.549 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.535+0000 7fe1180fb640 1 -- start start 2026-02-12T03:58:15.549 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.535+0000 7fe1180fb640 1 librados: setting wanted keys 2026-02-12T03:58:15.549 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.535+0000 7fe1180fb640 1 librados: calling monclient init 2026-02-12T03:58:15.550 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.535+0000 7fe1180fb640 10 monclient: init 2026-02-12T03:58:15.550 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.536+0000 7fe1180fb640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:15.550 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.536+0000 7fe1180fb640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T03:58:15.550 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.536+0000 7fe1180fb640 10 monclient(hunting): picked mon.noname-c con 0x7fe1100b2980 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:15.550 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.536+0000 7fe1180fb640 10 monclient(hunting): picked mon.noname-b con 0x7fe11015d5e0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:15.550 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.536+0000 7fe1180fb640 10 monclient(hunting): picked mon.noname-a con 0x7fe11015d9b0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:15.550 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.536+0000 7fe1180fb640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1100af0c0 con 0x7fe11015d9b0 2026-02-12T03:58:15.550 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.536+0000 7fe1180fb640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1100b1200 con 0x7fe11015d5e0 2026-02-12T03:58:15.550 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.536+0000 7fe1180fb640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1100b14e0 con 0x7fe1100b2980 2026-02-12T03:58:15.550 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.536+0000 7fe1180fb640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:15.550 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.536+0000 7fe1180fb640 10 monclient(hunting): authenticate will time out at 1098.280186s 2026-02-12T03:58:15.550 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.536+0000 7fe116671640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7fe11015d9b0 0x7fe11014a510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:57794/0 (socket says 10.20.193.91:57794) 2026-02-12T03:58:15.551 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.536+0000 7fe116671640 1 -- 10.20.193.91:0/1100040429 learned_addr learned my addr 10.20.193.91:0/1100040429 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:15.551 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.536+0000 7fe0fe7fc640 10 client.?.objecter ms_handle_connect 0x7fe11015d9b0 2026-02-12T03:58:15.551 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.536+0000 7fe0fe7fc640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:15.551 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.536+0000 7fe0fe7fc640 10 client.?.objecter ms_handle_connect 0x7fe11015d5e0 2026-02-12T03:58:15.551 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.536+0000 7fe0fe7fc640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:15.551 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.536+0000 7fe0fe7fc640 10 client.?.objecter ms_handle_connect 0x7fe1100b2980 2026-02-12T03:58:15.551 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.536+0000 7fe0fe7fc640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:15.551 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.537+0000 7fe0fe7fc640 1 -- 10.20.193.91:0/1100040429 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1218538065 0 0) 0x7fe1100af0c0 con 0x7fe11015d9b0 2026-02-12T03:58:15.551 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.537+0000 7fe0fe7fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:15.551 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.537+0000 7fe0fe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:15.551 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.537+0000 7fe0fe7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:15.551 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.537+0000 7fe0fe7fc640 10 monclient(hunting): my global_id is 4239 2026-02-12T03:58:15.551 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.537+0000 7fe0fe7fc640 1 -- 10.20.193.91:0/1100040429 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0e0003610 con 0x7fe11015d9b0 2026-02-12T03:58:15.552 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.537+0000 7fe0fe7fc640 1 -- 10.20.193.91:0/1100040429 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1498267389 0 0) 0x7fe1100b1200 con 0x7fe11015d5e0 2026-02-12T03:58:15.552 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.537+0000 7fe0fe7fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:15.552 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.537+0000 7fe0fe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:15.552 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.537+0000 7fe0fe7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:15.552 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.537+0000 7fe0fe7fc640 10 monclient(hunting): my global_id is 4243 2026-02-12T03:58:15.552 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.537+0000 7fe0fe7fc640 1 -- 10.20.193.91:0/1100040429 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1100af0c0 con 0x7fe11015d5e0 2026-02-12T03:58:15.552 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.538+0000 7fe0fe7fc640 1 -- 10.20.193.91:0/1100040429 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 606519990 0 0) 0x7fe1100b14e0 con 0x7fe1100b2980 2026-02-12T03:58:15.552 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.538+0000 7fe0fe7fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:15.552 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.538+0000 7fe0fe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:15.552 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.538+0000 7fe0fe7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:15.552 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.538+0000 7fe0fe7fc640 10 monclient(hunting): my global_id is 4211 2026-02-12T03:58:15.552 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.538+0000 7fe0fe7fc640 1 -- 10.20.193.91:0/1100040429 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1100b1200 con 0x7fe1100b2980 2026-02-12T03:58:15.553 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.540+0000 7fe0fe7fc640 1 -- 10.20.193.91:0/1100040429 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1612051869 0 0) 0x7fe1100af0c0 con 0x7fe11015d5e0 2026-02-12T03:58:15.553 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.540+0000 7fe0fe7fc640 1 -- 10.20.193.91:0/1100040429 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe1100b14e0 con 0x7fe11015d5e0 2026-02-12T03:58:15.553 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.540+0000 7fe0fe7fc640 1 -- 10.20.193.91:0/1100040429 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fe104002ff0 con 0x7fe11015d5e0 2026-02-12T03:58:15.553 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.540+0000 7fe0fe7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:15.553 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.540+0000 7fe0fe7fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:15.553 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.540+0000 7fe0fe7fc640 10 monclient(hunting): dump: 2026-02-12T03:58:15.553 INFO:teuthology.misc.health.trial091.stderr:epoch 1 2026-02-12T03:58:15.553 INFO:teuthology.misc.health.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:15.553 INFO:teuthology.misc.health.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:15.553 INFO:teuthology.misc.health.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:15.553 INFO:teuthology.misc.health.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:15.553 INFO:teuthology.misc.health.trial091.stderr:election_strategy: 3 2026-02-12T03:58:15.554 INFO:teuthology.misc.health.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:15.554 INFO:teuthology.misc.health.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:15.554 INFO:teuthology.misc.health.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:15.554 INFO:teuthology.misc.health.trial091.stderr: 2026-02-12T03:58:15.554 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.540+0000 7fe0fe7fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:15.554 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.540+0000 7fe0fe7fc640 1 -- 10.20.193.91:0/1100040429 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2410441187 0 0) 0x7fe0e0003610 con 0x7fe11015d9b0 2026-02-12T03:58:15.554 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.540+0000 7fe0fe7fc640 1 -- 10.20.193.91:0/1100040429 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe1100af0c0 con 0x7fe11015d9b0 2026-02-12T03:58:15.554 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.540+0000 7fe0fe7fc640 1 -- 10.20.193.91:0/1100040429 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fe10c003420 con 0x7fe11015d9b0 2026-02-12T03:58:15.554 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.540+0000 7fe0fe7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:15.554 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.540+0000 7fe0fe7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:15.554 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.540+0000 7fe0fe7fc640 10 monclient(hunting): dump: 2026-02-12T03:58:15.554 INFO:teuthology.misc.health.trial091.stderr:epoch 1 2026-02-12T03:58:15.555 INFO:teuthology.misc.health.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:15.555 INFO:teuthology.misc.health.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:15.555 INFO:teuthology.misc.health.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:15.555 INFO:teuthology.misc.health.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:15.555 INFO:teuthology.misc.health.trial091.stderr:election_strategy: 3 2026-02-12T03:58:15.555 INFO:teuthology.misc.health.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:15.555 INFO:teuthology.misc.health.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:15.555 INFO:teuthology.misc.health.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:15.555 INFO:teuthology.misc.health.trial091.stderr: 2026-02-12T03:58:15.555 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.541+0000 7fe0fe7fc640 1 -- 10.20.193.91:0/1100040429 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2053122734 0 0) 0x7fe1100b1200 con 0x7fe1100b2980 2026-02-12T03:58:15.555 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.541+0000 7fe0fe7fc640 1 -- 10.20.193.91:0/1100040429 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe0e0003610 con 0x7fe1100b2980 2026-02-12T03:58:15.555 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.541+0000 7fe0fe7fc640 1 -- 10.20.193.91:0/1100040429 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fe100003380 con 0x7fe1100b2980 2026-02-12T03:58:15.555 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.541+0000 7fe0fe7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:15.556 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.541+0000 7fe0fe7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:15.556 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.541+0000 7fe0fe7fc640 10 monclient(hunting): dump: 2026-02-12T03:58:15.556 INFO:teuthology.misc.health.trial091.stderr:epoch 1 2026-02-12T03:58:15.556 INFO:teuthology.misc.health.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:15.556 INFO:teuthology.misc.health.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:15.556 INFO:teuthology.misc.health.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:15.556 INFO:teuthology.misc.health.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:15.556 INFO:teuthology.misc.health.trial091.stderr:election_strategy: 3 2026-02-12T03:58:15.556 INFO:teuthology.misc.health.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:15.556 INFO:teuthology.misc.health.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:15.556 INFO:teuthology.misc.health.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:15.556 INFO:teuthology.misc.health.trial091.stderr: 2026-02-12T03:58:15.557 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.542+0000 7fe0fe7fc640 1 -- 10.20.193.91:0/1100040429 <== mon.1 v1:10.20.193.98:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2632779316 0 0) 0x7fe1100b14e0 con 0x7fe11015d5e0 2026-02-12T03:58:15.557 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.542+0000 7fe0fe7fc640 1 -- 10.20.193.91:0/1100040429 >> v1:10.20.193.111:6789/0 conn(0x7fe1100b2980 legacy=0x7fe1100ae9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:15.557 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.542+0000 7fe0fe7fc640 1 -- 10.20.193.91:0/1100040429 >> v1:10.20.193.91:6789/0 conn(0x7fe11015d9b0 legacy=0x7fe11014a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:15.557 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.542+0000 7fe0fe7fc640 10 monclient: _finish_hunting 0 2026-02-12T03:58:15.557 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.542+0000 7fe0fe7fc640 1 monclient: found mon.b 2026-02-12T03:58:15.557 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.542+0000 7fe0fe7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:15.557 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.542+0000 7fe0fe7fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:15.557 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.542+0000 7fe0fe7fc640 1 -- 10.20.193.91:0/1100040429 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1100b17c0 con 0x7fe11015d5e0 2026-02-12T03:58:15.557 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.542+0000 7fe0fe7fc640 10 monclient: _finish_auth 0 2026-02-12T03:58:15.557 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.542+0000 7fe0fe7fc640 10 monclient: _check_auth_tickets 2026-02-12T03:58:15.557 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.542+0000 7fe0fe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:15.557 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.542+0000 7fe1180fb640 5 monclient: authenticate success, global_id 4243 2026-02-12T03:58:15.558 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.542+0000 7fe1180fb640 10 monclient: _renew_subs 2026-02-12T03:58:15.558 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.542+0000 7fe1180fb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:15.558 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.542+0000 7fe1180fb640 1 -- 10.20.193.91:0/1100040429 --> v1:10.20.193.98:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe1100b1aa0 con 0x7fe11015d5e0 2026-02-12T03:58:15.558 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.542+0000 7fe1180fb640 10 client.4243.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:15.558 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.542+0000 7fe1180fb640 10 monclient: _renew_subs 2026-02-12T03:58:15.558 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.542+0000 7fe1180fb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:15.558 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.542+0000 7fe1180fb640 1 -- 10.20.193.91:0/1100040429 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe11013eb30 con 0x7fe11015d5e0 2026-02-12T03:58:15.558 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.542+0000 7fe1180fb640 1 librados: init done 2026-02-12T03:58:15.558 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.542+0000 7fe1180fb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:15.558 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.542+0000 7fe1180fb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:15.558 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.542+0000 7fe1180fb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:15.558 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.542+0000 7fe1180fb640 1 -- 10.20.193.91:0/1100040429 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1100b25f0 con 0x7fe11015d5e0 2026-02-12T03:58:15.641 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.638+0000 7fe0fe7fc640 1 -- 10.20.193.91:0/1100040429 <== mon.1 v1:10.20.193.98:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe104003190 con 0x7fe11015d5e0 2026-02-12T03:58:15.641 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.638+0000 7fe0fe7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:15.641 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.638+0000 7fe0fe7fc640 1 -- 10.20.193.91:0/1100040429 <== mon.1 v1:10.20.193.98:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fe104004a70 con 0x7fe11015d5e0 2026-02-12T03:58:15.641 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.638+0000 7fe0fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:15.642 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.638+0000 7fe0fe7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:15.642 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.638+0000 7fe0fe7fc640 10 monclient: dump: 2026-02-12T03:58:15.642 INFO:teuthology.misc.health.trial091.stderr:epoch 1 2026-02-12T03:58:15.642 INFO:teuthology.misc.health.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:15.642 INFO:teuthology.misc.health.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:15.642 INFO:teuthology.misc.health.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:15.642 INFO:teuthology.misc.health.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:15.642 INFO:teuthology.misc.health.trial091.stderr:election_strategy: 3 2026-02-12T03:58:15.642 INFO:teuthology.misc.health.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:15.642 INFO:teuthology.misc.health.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:15.642 INFO:teuthology.misc.health.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:15.642 INFO:teuthology.misc.health.trial091.stderr: 2026-02-12T03:58:15.643 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.638+0000 7fe0fffff640 4 set_mon_vals no callback set 2026-02-12T03:58:15.643 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.639+0000 7fe0fe7fc640 1 -- 10.20.193.91:0/1100040429 <== mon.1 v1:10.20.193.98:6789/0 7 ==== mgrmap(e 4) ==== 103168+0+0 (unknown 3733604615 0 0) 0x7fe10401df20 con 0x7fe11015d5e0 2026-02-12T03:58:15.643 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.639+0000 7fe115e70640 10 monclient: get_auth_request con 0x7fe0e0079fe0 auth_method 0 2026-02-12T03:58:15.644 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.640+0000 7fe0fe7fc640 10 client.4243.objecter ms_handle_connect 0x7fe0e0079fe0 2026-02-12T03:58:15.644 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.642+0000 7fe0fe7fc640 1 -- 10.20.193.91:0/1100040429 <== mon.1 v1:10.20.193.98:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 2560+0+0 (unknown 3427255071 0 0) 0x7fe10405ab70 con 0x7fe11015d5e0 2026-02-12T03:58:15.644 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.642+0000 7fe0fe7fc640 10 client.4243.objecter ms_dispatch2 0x7fe110000b90 osd_map(18..18 src has 1..18) 2026-02-12T03:58:15.645 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.642+0000 7fe0fe7fc640 3 client.4243.objecter handle_osd_map got epochs [18,18] > 0 2026-02-12T03:58:15.645 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.642+0000 7fe0fe7fc640 3 client.4243.objecter handle_osd_map decoding full epoch 18 2026-02-12T03:58:15.645 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.642+0000 7fe0fe7fc640 20 client.4243.objecter dump_active .. 0 homeless 2026-02-12T03:58:15.646 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.644+0000 7fe0fe7fc640 1 -- 10.20.193.91:0/1100040429 <== mon.1 v1:10.20.193.98:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7fe10405f2e0 con 0x7fe11015d5e0 2026-02-12T03:58:15.646 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.644+0000 7fe0fe7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:15.647 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.644+0000 7fe0fe7fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:15.759 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.756+0000 7fe1180fb640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-12T03:58:15.759 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.756+0000 7fe1180fb640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T03:58:15.759 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.756+0000 7fe1180fb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:15.759 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.756+0000 7fe1180fb640 1 -- 10.20.193.91:0/1100040429 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe1100b2310 con 0x7fe11015d5e0 2026-02-12T03:58:15.767 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.764+0000 7fe0fe7fc640 1 -- 10.20.193.91:0/1100040429 <== mon.1 v1:10.20.193.98:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12877 (unknown 3338201251 0 3816485227) 0x7fe10405ebe0 con 0x7fe11015d5e0 2026-02-12T03:58:15.767 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.764+0000 7fe0fe7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T03:58:15.768 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.764+0000 7fe0fe7fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:15.768 INFO:teuthology.misc.health.trial091.stdout: 2026-02-12T03:58:15.768 INFO:teuthology.misc.health.trial091.stdout:{"epoch":18,"fsid":"1e356fcf-3d61-462e-a451-82f8dd01e1f3","created":"2026-02-12T03:57:59.014379+0000","modified":"2026-02-12T03:58:05.455425+0000","last_up_change":"0.000000","last_in_change":"2026-02-12T03:58:05.455425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"791c97c5-83f6-4024-9f43-ff3b2ee22a30","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0cf561d6-85aa-428a-bc69-83ce77b1c802","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b3dc78b9-cae6-4b1f-931f-7352a43b9e26","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e164e3ae-cf6a-45ff-b126-3ac739c5b1be","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5583cc8c-83d4-42b4-a997-c056f3b145a0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d7bb6fa1-b042-4dce-9644-00e817a5bc8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"93cd9edf-a000-4d22-8da7-52f4bd547765","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f5e11a47-d746-46ca-85f1-27d3bc586371","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"bb8207ce-22b9-46be-9c89-c77f2690e405","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"e6318a6d-2367-48ce-a3a1-47307de14b99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"cd6c97a2-bdfe-4b86-afeb-217315976d6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"b6c647bb-4e86-4b0e-b79c-b0236a780a66","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"19bb3570-0c0a-48cc-a0b8-ec3194f30fa8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"a8215062-521c-47f6-b20a-9e40c1f3f5a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"3cd1bb48-53a2-462e-b7e5-4d6d918dd543","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"9bd39438-f5e5-4a19-afa4-678395d63c24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T03:58:15.769 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.766+0000 7fe1180fb640 10 librados: watch_flush enter 2026-02-12T03:58:15.769 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.766+0000 7fe1180fb640 10 librados: watch_flush exit 2026-02-12T03:58:15.769 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.766+0000 7fe1180fb640 20 client.4243.objecter shutdown clearing up homeless session... 2026-02-12T03:58:15.770 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.766+0000 7fe1180fb640 10 client.4243.objecter successfully canceled tick 2026-02-12T03:58:15.770 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.766+0000 7fe1180fb640 1 -- 10.20.193.91:0/1100040429 >> v1:10.20.193.91:6800/2929217192 conn(0x7fe0e0079fe0 legacy=0x7fe0e009a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:15.770 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.766+0000 7fe1180fb640 10 monclient: shutdown 2026-02-12T03:58:15.770 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.766+0000 7fe1180fb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:15.770 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.766+0000 7fe1180fb640 1 -- 10.20.193.91:0/1100040429 >> v1:10.20.193.98:6789/0 conn(0x7fe11015d5e0 legacy=0x7fe11013e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:15.770 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.766+0000 7fe1180fb640 1 -- 10.20.193.91:0/1100040429 shutdown_connections 2026-02-12T03:58:15.770 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.766+0000 7fe1180fb640 1 -- 10.20.193.91:0/1100040429 >> 10.20.193.91:0/1100040429 conn(0x7fe1100b76b0 msgr2=0x7fe1100b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:15.770 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.766+0000 7fe1180fb640 1 -- 10.20.193.91:0/1100040429 shutdown_connections 2026-02-12T03:58:15.770 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.766+0000 7fe1180fb640 1 -- 10.20.193.91:0/1100040429 wait complete. 2026-02-12T03:58:15.770 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:15.766+0000 7fe1180fb640 1 librados: shutdown 2026-02-12T03:58:15.776 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-12T03:58:15.948 INFO:tasks.ceph.osd.14.trial111.stderr:--00:00:00:10.318 26494-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/72/4c8a3861eed44174471f8b54d3ec13198133d0.debug 2026-02-12T03:58:16.056 INFO:tasks.ceph.osd.6.trial111.stderr:--00:00:00:10.429 26493-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/72/4c8a3861eed44174471f8b54d3ec13198133d0.debug 2026-02-12T03:58:16.071 INFO:tasks.ceph.osd.2.trial111.stderr:--00:00:00:10.448 26491-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/72/4c8a3861eed44174471f8b54d3ec13198133d0.debug 2026-02-12T03:58:16.101 INFO:tasks.ceph.osd.10.trial111.stderr:--00:00:00:10.475 26492-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/72/4c8a3861eed44174471f8b54d3ec13198133d0.debug 2026-02-12T03:58:16.108 INFO:tasks.ceph.osd.0.trial091.stderr:--00:00:00:10.553 27166-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/72/4c8a3861eed44174471f8b54d3ec13198133d0.debug 2026-02-12T03:58:16.134 INFO:tasks.ceph.osd.13.trial098.stderr:--00:00:00:10.513 26562-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/72/4c8a3861eed44174471f8b54d3ec13198133d0.debug 2026-02-12T03:58:16.137 INFO:tasks.ceph.osd.9.trial098.stderr:--00:00:00:10.520 26561-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/72/4c8a3861eed44174471f8b54d3ec13198133d0.debug 2026-02-12T03:58:16.155 INFO:tasks.ceph.osd.8.trial091.stderr:--00:00:00:10.545 27259-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/72/4c8a3861eed44174471f8b54d3ec13198133d0.debug 2026-02-12T03:58:16.156 INFO:tasks.ceph.osd.4.trial091.stderr:--00:00:00:10.548 27254-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/72/4c8a3861eed44174471f8b54d3ec13198133d0.debug 2026-02-12T03:58:16.218 INFO:tasks.ceph.osd.12.trial091.stderr:--00:00:00:10.606 27267-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/72/4c8a3861eed44174471f8b54d3ec13198133d0.debug 2026-02-12T03:58:16.243 INFO:tasks.ceph.osd.5.trial098.stderr:--00:00:00:10.627 26559-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/72/4c8a3861eed44174471f8b54d3ec13198133d0.debug 2026-02-12T03:58:16.314 INFO:tasks.ceph.osd.1.trial098.stderr:--00:00:00:10.698 26560-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/72/4c8a3861eed44174471f8b54d3ec13198133d0.debug 2026-02-12T03:58:16.341 INFO:tasks.ceph.osd.15.trial154.stderr:--00:00:00:10.699 26174-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/72/4c8a3861eed44174471f8b54d3ec13198133d0.debug 2026-02-12T03:58:16.341 INFO:tasks.ceph.osd.3.trial154.stderr:--00:00:00:10.699 26171-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/72/4c8a3861eed44174471f8b54d3ec13198133d0.debug 2026-02-12T03:58:16.342 INFO:tasks.ceph.osd.11.trial154.stderr:--00:00:00:10.699 26173-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/72/4c8a3861eed44174471f8b54d3ec13198133d0.debug 2026-02-12T03:58:16.342 INFO:tasks.ceph.osd.7.trial154.stderr:--00:00:00:10.700 26172-- Warning: zero subprog, missing DW_AT_abstract_origin in DW_TAG_inlined_subroutine in /usr/lib/debug/.build-id/72/4c8a3861eed44174471f8b54d3ec13198133d0.debug 2026-02-12T03:58:18.109 INFO:tasks.ceph.osd.14.trial111.stderr:==00:00:00:12.479 26494== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.155 INFO:tasks.ceph.osd.6.trial111.stderr:==00:00:00:12.527 26493== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.172 INFO:tasks.ceph.osd.14.trial111.stderr:==00:00:00:12.542 26494== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.201 INFO:tasks.ceph.osd.14.trial111.stderr:==00:00:00:12.572 26494== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.223 INFO:tasks.ceph.osd.0.trial091.stderr:==00:00:00:12.667 27166== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.229 INFO:tasks.ceph.osd.6.trial111.stderr:==00:00:00:12.602 26493== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.231 INFO:tasks.ceph.osd.2.trial111.stderr:==00:00:00:12.607 26491== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.234 INFO:tasks.ceph.osd.10.trial111.stderr:==00:00:00:12.609 26492== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.245 INFO:tasks.ceph.osd.14.trial111.stderr:==00:00:00:12.616 26494== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.262 INFO:tasks.ceph.osd.6.trial111.stderr:==00:00:00:12.634 26493== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.263 INFO:tasks.ceph.osd.4.trial091.stderr:==00:00:00:12.655 27254== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.275 INFO:tasks.ceph.osd.13.trial098.stderr:==00:00:00:12.655 26562== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.286 INFO:tasks.ceph.osd.14.trial111.stderr:==00:00:00:12.656 26494== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.289 INFO:tasks.ceph.osd.9.trial098.stderr:==00:00:00:12.672 26561== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.294 INFO:tasks.ceph.osd.0.trial091.stderr:==00:00:00:12.738 27166== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.294 INFO:tasks.ceph.osd.6.trial111.stderr:==00:00:00:12.666 26493== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.297 INFO:tasks.ceph.osd.2.trial111.stderr:==00:00:00:12.673 26491== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.297 INFO:tasks.ceph.osd.10.trial111.stderr:==00:00:00:12.671 26492== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.303 INFO:tasks.ceph.osd.8.trial091.stderr:==00:00:00:12.693 27259== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.304 INFO:tasks.ceph.osd.14.trial111.stderr:==00:00:00:12.674 26494== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.319 INFO:tasks.ceph.osd.14.trial111.stderr:==00:00:00:12.689 26494== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.322 INFO:tasks.ceph.osd.2.trial111.stderr:==00:00:00:12.698 26491== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.322 INFO:tasks.ceph.osd.6.trial111.stderr:==00:00:00:12.694 26493== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.330 INFO:tasks.ceph.osd.10.trial111.stderr:==00:00:00:12.705 26492== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.333 INFO:tasks.ceph.osd.0.trial091.stderr:==00:00:00:12.778 27166== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.337 INFO:tasks.ceph.osd.4.trial091.stderr:==00:00:00:12.729 27254== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.340 INFO:tasks.ceph.osd.5.trial098.stderr:==00:00:00:12.725 26559== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.353 INFO:tasks.ceph.osd.13.trial098.stderr:==00:00:00:12.733 26562== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.354 INFO:tasks.ceph.osd.2.trial111.stderr:==00:00:00:12.730 26491== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.358 INFO:tasks.ceph.osd.0.trial091.stderr:==00:00:00:12.803 27166== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.360 INFO:tasks.ceph.osd.9.trial098.stderr:==00:00:00:12.744 26561== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.362 INFO:tasks.ceph.osd.4.trial091.stderr:==00:00:00:12.754 27254== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.363 INFO:tasks.ceph.osd.10.trial111.stderr:==00:00:00:12.737 26492== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.364 INFO:tasks.ceph.osd.6.trial111.stderr:==00:00:00:12.737 26493== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.365 INFO:tasks.ceph.osd.12.trial091.stderr:==00:00:00:12.754 27267== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.366 INFO:tasks.ceph.osd.8.trial091.stderr:==00:00:00:12.756 27259== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.378 INFO:tasks.ceph.osd.13.trial098.stderr:==00:00:00:12.757 26562== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.379 INFO:tasks.ceph.osd.6.trial111.stderr:==00:00:00:12.752 26493== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.388 INFO:tasks.ceph.osd.10.trial111.stderr:==00:00:00:12.762 26492== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.388 INFO:tasks.ceph.osd.2.trial111.stderr:==00:00:00:12.764 26491== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.389 INFO:tasks.ceph.osd.4.trial091.stderr:==00:00:00:12.781 27254== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.393 INFO:tasks.ceph.osd.0.trial091.stderr:==00:00:00:12.838 27166== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.401 INFO:tasks.ceph.osd.9.trial098.stderr:==00:00:00:12.784 26561== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.401 INFO:tasks.ceph.osd.8.trial091.stderr:==00:00:00:12.791 27259== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.414 INFO:tasks.ceph.osd.13.trial098.stderr:==00:00:00:12.794 26562== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.417 INFO:tasks.ceph.osd.4.trial091.stderr:==00:00:00:12.809 27254== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.417 INFO:tasks.ceph.osd.5.trial098.stderr:==00:00:00:12.802 26559== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.421 INFO:tasks.ceph.osd.10.trial111.stderr:==00:00:00:12.795 26492== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.421 INFO:tasks.ceph.osd.2.trial111.stderr:==00:00:00:12.797 26491== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.425 INFO:tasks.ceph.osd.1.trial098.stderr:==00:00:00:12.809 26560== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.425 INFO:tasks.ceph.osd.8.trial091.stderr:==00:00:00:12.815 27259== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.427 INFO:tasks.ceph.osd.0.trial091.stderr:==00:00:00:12.872 27166== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.429 INFO:tasks.ceph.osd.12.trial091.stderr:==00:00:00:12.817 27267== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.435 INFO:tasks.ceph.osd.2.trial111.stderr:==00:00:00:12.811 26491== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.436 INFO:tasks.ceph.osd.9.trial098.stderr:==00:00:00:12.819 26561== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.436 INFO:tasks.ceph.osd.10.trial111.stderr:==00:00:00:12.811 26492== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.439 INFO:tasks.ceph.osd.14.trial111.stderr:2026-02-12T03:58:18.434+0000 787b4c0 -1 Falling back to public interface 2026-02-12T03:58:18.442 INFO:tasks.ceph.osd.0.trial091.stderr:==00:00:00:12.887 27166== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.455 INFO:tasks.ceph.osd.4.trial091.stderr:==00:00:00:12.847 27254== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.461 INFO:tasks.ceph.osd.5.trial098.stderr:==00:00:00:12.845 26559== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.461 INFO:tasks.ceph.osd.13.trial098.stderr:==00:00:00:12.841 26562== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.466 INFO:tasks.ceph.osd.12.trial091.stderr:==00:00:00:12.854 27267== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.466 INFO:tasks.ceph.osd.8.trial091.stderr:==00:00:00:12.856 27259== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.469 INFO:tasks.ceph.osd.9.trial098.stderr:==00:00:00:12.852 26561== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.470 INFO:tasks.ceph.osd.4.trial091.stderr:==00:00:00:12.862 27254== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.479 INFO:tasks.ceph.osd.6.trial111.stderr:2026-02-12T03:58:18.474+0000 787b4c0 -1 Falling back to public interface 2026-02-12T03:58:18.481 INFO:tasks.ceph.osd.5.trial098.stderr:==00:00:00:12.865 26559== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.486 INFO:tasks.ceph.osd.13.trial098.stderr:==00:00:00:12.866 26562== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.488 INFO:tasks.ceph.osd.1.trial098.stderr:==00:00:00:12.873 26560== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.494 INFO:tasks.ceph.osd.9.trial098.stderr:==00:00:00:12.878 26561== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.502 INFO:tasks.ceph.osd.13.trial098.stderr:==00:00:00:12.882 26562== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.505 INFO:tasks.ceph.osd.8.trial091.stderr:==00:00:00:12.895 27259== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.507 INFO:tasks.ceph.osd.12.trial091.stderr:==00:00:00:12.895 27267== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.509 INFO:tasks.ceph.osd.9.trial098.stderr:==00:00:00:12.893 26561== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.517 INFO:tasks.ceph.osd.5.trial098.stderr:==00:00:00:12.901 26559== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.517 INFO:tasks.ceph.osd.1.trial098.stderr:==00:00:00:12.901 26560== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.521 INFO:tasks.ceph.osd.8.trial091.stderr:==00:00:00:12.911 27259== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.541 INFO:tasks.ceph.osd.12.trial091.stderr:==00:00:00:12.929 27267== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.543 INFO:tasks.ceph.osd.1.trial098.stderr:==00:00:00:12.927 26560== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.548 INFO:tasks.ceph.osd.5.trial098.stderr:==00:00:00:12.933 26559== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.561 INFO:tasks.ceph.osd.0.trial091.stderr:2026-02-12T03:58:18.557+0000 787b4c0 -1 Falling back to public interface 2026-02-12T03:58:18.564 INFO:tasks.ceph.osd.3.trial154.stderr:==00:00:00:12.922 26171== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.564 INFO:tasks.ceph.osd.5.trial098.stderr:==00:00:00:12.949 26559== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.565 INFO:tasks.ceph.osd.10.trial111.stderr:2026-02-12T03:58:18.560+0000 787b4c0 -1 Falling back to public interface 2026-02-12T03:58:18.566 INFO:tasks.ceph.osd.7.trial154.stderr:==00:00:00:12.924 26172== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.568 INFO:tasks.ceph.osd.11.trial154.stderr:==00:00:00:12.927 26173== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.571 INFO:tasks.ceph.osd.1.trial098.stderr:==00:00:00:12.956 26560== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.575 INFO:tasks.ceph.osd.2.trial111.stderr:2026-02-12T03:58:18.570+0000 787b4c0 -1 Falling back to public interface 2026-02-12T03:58:18.576 INFO:tasks.ceph.osd.12.trial091.stderr:==00:00:00:12.964 27267== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.577 INFO:tasks.ceph.osd.15.trial154.stderr:==00:00:00:12.936 26174== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.581 INFO:tasks.ceph.osd.4.trial091.stderr:2026-02-12T03:58:18.575+0000 787b4c0 -1 Falling back to public interface 2026-02-12T03:58:18.591 INFO:tasks.ceph.osd.12.trial091.stderr:==00:00:00:12.979 27267== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.593 INFO:tasks.ceph.osd.1.trial098.stderr:==00:00:00:12.978 26560== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.607 INFO:tasks.ceph.osd.1.trial098.stderr:==00:00:00:12.992 26560== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.611 INFO:tasks.ceph.osd.13.trial098.stderr:2026-02-12T03:58:18.607+0000 787b4c0 -1 Falling back to public interface 2026-02-12T03:58:18.612 INFO:tasks.ceph.osd.9.trial098.stderr:2026-02-12T03:58:18.608+0000 787b4c0 -1 Falling back to public interface 2026-02-12T03:58:18.616 INFO:tasks.ceph.osd.9.trial098.stderr:2026-02-12T03:58:18.615+0000 a75d640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6803/0: (98) Address already in use 2026-02-12T03:58:18.628 INFO:tasks.ceph.osd.3.trial154.stderr:==00:00:00:12.987 26171== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.633 INFO:tasks.ceph.osd.8.trial091.stderr:2026-02-12T03:58:18.628+0000 787b4c0 -1 Falling back to public interface 2026-02-12T03:58:18.635 INFO:tasks.ceph.osd.7.trial154.stderr:==00:00:00:12.994 26172== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.639 INFO:tasks.ceph.osd.11.trial154.stderr:==00:00:00:12.998 26173== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.648 INFO:tasks.ceph.osd.15.trial154.stderr:==00:00:00:13.007 26174== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.653 INFO:tasks.ceph.osd.3.trial154.stderr:==00:00:00:13.012 26171== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.666 INFO:tasks.ceph.osd.11.trial154.stderr:==00:00:00:13.024 26173== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.666 INFO:tasks.ceph.osd.7.trial154.stderr:==00:00:00:13.024 26172== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.671 INFO:tasks.ceph.osd.15.trial154.stderr:==00:00:00:13.029 26174== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.682 INFO:tasks.ceph.osd.3.trial154.stderr:==00:00:00:13.040 26171== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.694 INFO:tasks.ceph.osd.7.trial154.stderr:==00:00:00:13.052 26172== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.694 INFO:tasks.ceph.osd.5.trial098.stderr:2026-02-12T03:58:18.690+0000 787b4c0 -1 Falling back to public interface 2026-02-12T03:58:18.702 INFO:tasks.ceph.osd.11.trial154.stderr:==00:00:00:13.060 26173== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.709 INFO:tasks.ceph.osd.15.trial154.stderr:==00:00:00:13.068 26174== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.714 INFO:tasks.ceph.osd.3.trial154.stderr:==00:00:00:13.072 26171== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.716 INFO:tasks.ceph.osd.1.trial098.stderr:2026-02-12T03:58:18.712+0000 787b4c0 -1 Falling back to public interface 2026-02-12T03:58:18.717 INFO:tasks.ceph.osd.14.trial111.stderr:==00:00:00:13.088 26494== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.726 INFO:tasks.ceph.osd.7.trial154.stderr:==00:00:00:13.085 26172== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.726 INFO:tasks.ceph.osd.11.trial154.stderr:==00:00:00:13.085 26173== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.730 INFO:tasks.ceph.osd.12.trial091.stderr:2026-02-12T03:58:18.726+0000 787b4c0 -1 Falling back to public interface 2026-02-12T03:58:18.734 INFO:tasks.ceph.osd.15.trial154.stderr:==00:00:00:13.092 26174== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.740 INFO:tasks.ceph.osd.3.trial154.stderr:==00:00:00:13.098 26171== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.748 INFO:tasks.ceph.osd.11.trial154.stderr:==00:00:00:13.107 26173== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.751 INFO:tasks.ceph.osd.7.trial154.stderr:==00:00:00:13.110 26172== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.755 INFO:tasks.ceph.osd.15.trial154.stderr:==00:00:00:13.114 26174== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.756 INFO:tasks.ceph.osd.3.trial154.stderr:==00:00:00:13.115 26171== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.763 INFO:tasks.ceph.osd.11.trial154.stderr:==00:00:00:13.122 26173== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.766 INFO:tasks.ceph.osd.7.trial154.stderr:==00:00:00:13.125 26172== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.770 INFO:tasks.ceph.osd.15.trial154.stderr:==00:00:00:13.128 26174== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.771 INFO:tasks.ceph.osd.6.trial111.stderr:==00:00:00:13.143 26493== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.799 INFO:tasks.ceph.osd.14.trial111.stderr:==00:00:00:13.169 26494== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.843 INFO:tasks.ceph.osd.0.trial091.stderr:==00:00:00:13.288 27166== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.857 INFO:tasks.ceph.osd.3.trial154.stderr:2026-02-12T03:58:18.851+0000 787b4c0 -1 Falling back to public interface 2026-02-12T03:58:18.860 INFO:tasks.ceph.osd.6.trial111.stderr:==00:00:00:13.232 26493== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.861 INFO:tasks.ceph.osd.10.trial111.stderr:==00:00:00:13.235 26492== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.863 INFO:tasks.ceph.osd.2.trial111.stderr:==00:00:00:13.240 26491== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.864 INFO:tasks.ceph.osd.4.trial091.stderr:==00:00:00:13.256 27254== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.867 INFO:tasks.ceph.osd.14.trial111.stderr:==00:00:00:13.238 26494== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.869 INFO:tasks.ceph.osd.11.trial154.stderr:2026-02-12T03:58:18.864+0000 787b4c0 -1 Falling back to public interface 2026-02-12T03:58:18.876 INFO:tasks.ceph.osd.7.trial154.stderr:2026-02-12T03:58:18.871+0000 787b4c0 -1 Falling back to public interface 2026-02-12T03:58:18.876 INFO:tasks.ceph.osd.15.trial154.stderr:2026-02-12T03:58:18.871+0000 787b4c0 -1 Falling back to public interface 2026-02-12T03:58:18.891 INFO:tasks.ceph.osd.13.trial098.stderr:==00:00:00:13.271 26562== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.895 INFO:tasks.ceph.osd.9.trial098.stderr:==00:00:00:13.278 26561== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.907 INFO:tasks.ceph.osd.14.trial111.stderr:==00:00:00:13.278 26494== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.918 INFO:tasks.ceph.osd.8.trial091.stderr:==00:00:00:13.308 27259== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.930 INFO:tasks.ceph.osd.14.trial111.stderr:==00:00:00:13.301 26494== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.933 INFO:tasks.ceph.osd.0.trial091.stderr:==00:00:00:13.377 27166== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.940 INFO:tasks.ceph.osd.6.trial111.stderr:==00:00:00:13.312 26493== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.943 INFO:tasks.ceph.osd.4.trial091.stderr:==00:00:00:13.335 27254== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.958 INFO:tasks.ceph.osd.10.trial111.stderr:==00:00:00:13.332 26492== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.965 INFO:tasks.ceph.osd.2.trial111.stderr:==00:00:00:13.341 26491== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.972 INFO:tasks.ceph.osd.14.trial111.stderr:==00:00:00:13.343 26494== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.981 INFO:tasks.ceph.osd.13.trial098.stderr:==00:00:00:13.361 26562== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.982 INFO:tasks.ceph.osd.5.trial098.stderr:==00:00:00:13.367 26559== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.986 INFO:tasks.ceph.osd.6.trial111.stderr:==00:00:00:13.358 26493== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.991 INFO:tasks.ceph.osd.9.trial098.stderr:==00:00:00:13.374 26561== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:18.997 INFO:tasks.ceph.osd.0.trial091.stderr:==00:00:00:13.441 27166== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.001 INFO:tasks.ceph.osd.1.trial098.stderr:==00:00:00:13.386 26560== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.004 INFO:tasks.ceph.osd.4.trial091.stderr:==00:00:00:13.396 27254== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.006 INFO:tasks.ceph.osd.10.trial111.stderr:==00:00:00:13.380 26492== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.008 INFO:tasks.ceph.osd.14.trial111.stderr:==00:00:00:13.379 26494== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.014 INFO:tasks.ceph.osd.12.trial091.stderr:==00:00:00:13.402 27267== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.014 INFO:tasks.ceph.osd.2.trial111.stderr:==00:00:00:13.390 26491== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.017 INFO:tasks.ceph.osd.6.trial111.stderr:==00:00:00:13.389 26493== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.021 INFO:tasks.ceph.osd.0.trial091.stderr:==00:00:00:13.466 27166== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.023 INFO:tasks.ceph.osd.8.trial091.stderr:==00:00:00:13.413 27259== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.024 INFO:tasks.ceph.osd.13.trial098.stderr:==00:00:00:13.404 26562== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.024 INFO:tasks.ceph.osd.10.trial111.stderr:==00:00:00:13.399 26492== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.036 INFO:tasks.ceph.osd.4.trial091.stderr:==00:00:00:13.428 27254== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.036 INFO:tasks.ceph.osd.14.trial111.stderr:==00:00:00:13.407 26494== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.037 INFO:tasks.ceph.osd.2.trial111.stderr:==00:00:00:13.413 26491== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.047 INFO:tasks.ceph.osd.9.trial098.stderr:==00:00:00:13.430 26561== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.049 INFO:tasks.ceph.osd.0.trial091.stderr:==00:00:00:13.494 27166== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.052 INFO:tasks.ceph.osd.14.trial111.stderr:==00:00:00:13.423 26494== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.053 INFO:tasks.ceph.osd.10.trial111.stderr:==00:00:00:13.427 26492== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.053 INFO:tasks.ceph.osd.6.trial111.stderr:==00:00:00:13.425 26493== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.058 INFO:tasks.ceph.osd.13.trial098.stderr:==00:00:00:13.438 26562== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.060 INFO:tasks.ceph.osd.2.trial111.stderr:==00:00:00:13.437 26491== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.068 INFO:tasks.ceph.osd.5.trial098.stderr:==00:00:00:13.453 26559== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.069 INFO:tasks.ceph.osd.4.trial091.stderr:==00:00:00:13.461 27254== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.072 INFO:tasks.ceph.osd.9.trial098.stderr:==00:00:00:13.456 26561== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.087 INFO:tasks.ceph.osd.0.trial091.stderr:==00:00:00:13.532 27166== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.089 INFO:tasks.ceph.osd.1.trial098.stderr:==00:00:00:13.474 26560== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.092 INFO:tasks.ceph.osd.12.trial091.stderr:==00:00:00:13.480 27267== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.093 INFO:tasks.ceph.osd.10.trial111.stderr:==00:00:00:13.467 26492== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.100 INFO:tasks.ceph.osd.9.trial098.stderr:==00:00:00:13.484 26561== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.101 INFO:tasks.ceph.osd.13.trial098.stderr:==00:00:00:13.480 26562== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.101 INFO:tasks.ceph.osd.2.trial111.stderr:==00:00:00:13.477 26491== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.101 INFO:tasks.ceph.osd.6.trial111.stderr:==00:00:00:13.473 26493== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.103 INFO:tasks.ceph.osd.8.trial091.stderr:==00:00:00:13.493 27259== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.104 INFO:tasks.ceph.osd.4.trial091.stderr:==00:00:00:13.496 27254== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.124 INFO:tasks.ceph.osd.0.trial091.stderr:==00:00:00:13.568 27166== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.125 INFO:tasks.ceph.osd.10.trial111.stderr:==00:00:00:13.500 26492== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.126 INFO:tasks.ceph.osd.5.trial098.stderr:==00:00:00:13.511 26559== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.137 INFO:tasks.ceph.osd.9.trial098.stderr:==00:00:00:13.520 26561== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.137 INFO:tasks.ceph.osd.13.trial098.stderr:==00:00:00:13.516 26562== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.139 INFO:tasks.ceph.osd.12.trial091.stderr:==00:00:00:13.527 27267== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.139 INFO:tasks.ceph.osd.2.trial111.stderr:==00:00:00:13.515 26491== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.142 INFO:tasks.ceph.osd.4.trial091.stderr:==00:00:00:13.534 27254== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.147 INFO:tasks.ceph.osd.6.trial111.stderr:==00:00:00:13.519 26493== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.150 INFO:tasks.ceph.osd.3.trial154.stderr:==00:00:00:13.508 26171== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.151 INFO:tasks.ceph.osd.0.trial091.stderr:==00:00:00:13.596 27166== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.151 INFO:tasks.ceph.osd.8.trial091.stderr:==00:00:00:13.541 27259== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.153 INFO:tasks.ceph.osd.5.trial098.stderr:==00:00:00:13.538 26559== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.159 INFO:tasks.ceph.osd.10.trial111.stderr:==00:00:00:13.534 26492== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.164 INFO:tasks.ceph.osd.9.trial098.stderr:==00:00:00:13.547 26561== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.164 INFO:tasks.ceph.osd.13.trial098.stderr:==00:00:00:13.543 26562== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.164 INFO:tasks.ceph.osd.11.trial154.stderr:==00:00:00:13.522 26173== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.165 INFO:tasks.ceph.osd.1.trial098.stderr:==00:00:00:13.550 26560== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.171 INFO:tasks.ceph.osd.2.trial111.stderr:==00:00:00:13.548 26491== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.172 INFO:tasks.ceph.osd.7.trial154.stderr:==00:00:00:13.531 26172== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.173 INFO:tasks.ceph.osd.15.trial154.stderr:==00:00:00:13.531 26174== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.175 INFO:tasks.ceph.osd.5.trial098.stderr:==00:00:00:13.560 26559== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.177 INFO:tasks.ceph.osd.14.trial111.stderr:==00:00:00:13.547 26494== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.181 INFO:tasks.ceph.osd.4.trial091.stderr:==00:00:00:13.573 27254== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.185 INFO:tasks.ceph.osd.12.trial091.stderr:==00:00:00:13.573 27267== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.185 INFO:tasks.ceph.osd.0.trial091.stderr:==00:00:00:13.630 27166== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.193 INFO:tasks.ceph.osd.8.trial091.stderr:==00:00:00:13.583 27259== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.196 INFO:tasks.ceph.osd.10.trial111.stderr:==00:00:00:13.571 26492== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.197 INFO:tasks.ceph.osd.13.trial098.stderr:==00:00:00:13.576 26562== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.197 INFO:tasks.ceph.osd.6.trial111.stderr:==00:00:00:13.569 26493== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.197 INFO:tasks.ceph.osd.4.trial091.stderr:==00:00:00:13.589 27254== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.198 INFO:tasks.ceph.osd.9.trial098.stderr:==00:00:00:13.582 26561== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.206 INFO:tasks.ceph.osd.1.trial098.stderr:==00:00:00:13.591 26560== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.208 INFO:tasks.ceph.osd.2.trial111.stderr:==00:00:00:13.585 26491== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.212 INFO:tasks.ceph.osd.5.trial098.stderr:==00:00:00:13.597 26559== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.219 INFO:tasks.ceph.osd.12.trial091.stderr:==00:00:00:13.607 27267== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.227 INFO:tasks.ceph.osd.14.trial111.stderr:==00:00:00:13.598 26494== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.229 INFO:tasks.ceph.osd.13.trial098.stderr:==00:00:00:13.609 26562== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.232 INFO:tasks.ceph.osd.5.trial098.stderr:==00:00:00:13.617 26559== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.233 INFO:tasks.ceph.osd.9.trial098.stderr:==00:00:00:13.616 26561== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.242 INFO:tasks.ceph.osd.1.trial098.stderr:==00:00:00:13.626 26560== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.242 INFO:tasks.ceph.osd.8.trial091.stderr:==00:00:00:13.632 27259== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.243 INFO:tasks.ceph.osd.3.trial154.stderr:==00:00:00:13.601 26171== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.246 INFO:tasks.ceph.osd.12.trial091.stderr:==00:00:00:13.634 27267== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.260 INFO:tasks.ceph.osd.11.trial154.stderr:==00:00:00:13.618 26173== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.260 INFO:tasks.ceph.osd.15.trial154.stderr:==00:00:00:13.619 26174== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.263 INFO:tasks.ceph.osd.7.trial154.stderr:==00:00:00:13.622 26172== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.269 INFO:tasks.ceph.osd.5.trial098.stderr:==00:00:00:13.654 26559== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.274 INFO:tasks.ceph.osd.14.trial111.stderr:==00:00:00:13.644 26494== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.279 INFO:tasks.ceph.osd.12.trial091.stderr:==00:00:00:13.667 27267== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.283 INFO:tasks.ceph.osd.8.trial091.stderr:==00:00:00:13.673 27259== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.285 INFO:tasks.ceph.osd.1.trial098.stderr:==00:00:00:13.670 26560== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.301 INFO:tasks.ceph.osd.0.trial091.stderr:==00:00:00:13.746 27166== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.308 INFO:tasks.ceph.osd.14.trial111.stderr:==00:00:00:13.678 26494== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.309 INFO:tasks.ceph.osd.5.trial098.stderr:==00:00:00:13.694 26559== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.314 INFO:tasks.ceph.osd.12.trial091.stderr:==00:00:00:13.702 27267== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.314 INFO:tasks.ceph.osd.14.trial111.stderr:==00:00:00:13.685 26494== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.315 INFO:tasks.ceph.osd.3.trial154.stderr:==00:00:00:13.673 26171== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.318 INFO:tasks.ceph.osd.10.trial111.stderr:==00:00:00:13.692 26492== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.322 INFO:tasks.ceph.osd.4.trial091.stderr:==00:00:00:13.714 27254== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.324 INFO:tasks.ceph.osd.11.trial154.stderr:==00:00:00:13.683 26173== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.326 INFO:tasks.ceph.osd.1.trial098.stderr:==00:00:00:13.710 26560== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.326 INFO:tasks.ceph.osd.8.trial091.stderr:==00:00:00:13.716 27259== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.328 INFO:tasks.ceph.osd.15.trial154.stderr:==00:00:00:13.687 26174== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.333 INFO:tasks.ceph.osd.7.trial154.stderr:==00:00:00:13.692 26172== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.335 INFO:tasks.ceph.osd.6.trial111.stderr:==00:00:00:13.707 26493== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.338 INFO:tasks.ceph.osd.2.trial111.stderr:==00:00:00:13.714 26491== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.345 INFO:tasks.ceph.osd.13.trial098.stderr:==00:00:00:13.724 26562== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.349 INFO:tasks.ceph.osd.3.trial154.stderr:==00:00:00:13.707 26171== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.350 INFO:tasks.ceph.osd.12.trial091.stderr:==00:00:00:13.738 27267== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.353 INFO:tasks.ceph.osd.0.trial091.stderr:==00:00:00:13.798 27166== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.362 INFO:tasks.ceph.osd.4.trial091.stderr:==00:00:00:13.754 27254== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.363 INFO:tasks.ceph.osd.9.trial098.stderr:==00:00:00:13.746 26561== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.364 INFO:tasks.ceph.osd.11.trial154.stderr:==00:00:00:13.722 26173== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.367 INFO:tasks.ceph.osd.1.trial098.stderr:==00:00:00:13.751 26560== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.368 INFO:tasks.ceph.osd.15.trial154.stderr:==00:00:00:13.727 26174== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.368 INFO:tasks.ceph.osd.7.trial154.stderr:==00:00:00:13.727 26172== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.369 INFO:tasks.ceph.osd.8.trial091.stderr:==00:00:00:13.758 27259== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.369 INFO:tasks.ceph.osd.10.trial111.stderr:==00:00:00:13.743 26492== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.385 INFO:tasks.ceph.osd.13.trial098.stderr:==00:00:00:13.764 26562== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.385 INFO:tasks.ceph.osd.0.trial091.stderr:==00:00:00:13.830 27166== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.387 INFO:tasks.ceph.osd.2.trial111.stderr:==00:00:00:13.763 26491== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.389 INFO:tasks.ceph.osd.10.trial111.stderr:==00:00:00:13.763 26492== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.389 INFO:tasks.ceph.osd.4.trial091.stderr:==00:00:00:13.781 27254== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.391 INFO:tasks.ceph.osd.6.trial111.stderr:==00:00:00:13.763 26493== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.392 INFO:tasks.ceph.osd.3.trial154.stderr:==00:00:00:13.751 26171== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.406 INFO:tasks.ceph.osd.1.trial098.stderr:==00:00:00:13.790 26560== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.414 INFO:tasks.ceph.osd.10.trial111.stderr:==00:00:00:13.788 26492== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.415 INFO:tasks.ceph.osd.13.trial098.stderr:==00:00:00:13.795 26562== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.415 INFO:tasks.ceph.osd.15.trial154.stderr:==00:00:00:13.774 26174== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.415 INFO:tasks.ceph.osd.7.trial154.stderr:==00:00:00:13.774 26172== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.416 INFO:tasks.ceph.osd.11.trial154.stderr:==00:00:00:13.774 26173== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.416 INFO:tasks.ceph.osd.9.trial098.stderr:==00:00:00:13.800 26561== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.417 INFO:tasks.ceph.osd.4.trial091.stderr:==00:00:00:13.809 27254== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.419 INFO:tasks.ceph.osd.2.trial111.stderr:==00:00:00:13.795 26491== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.419 INFO:tasks.ceph.osd.10.trial111.stderr:==00:00:00:13.794 26492== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.420 INFO:tasks.ceph.osd.0.trial091.stderr:==00:00:00:13.865 27166== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.422 INFO:tasks.ceph.osd.4.trial091.stderr:==00:00:00:13.814 27254== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.422 INFO:tasks.ceph.osd.6.trial111.stderr:==00:00:00:13.795 26493== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.425 INFO:tasks.ceph.osd.3.trial154.stderr:==00:00:00:13.784 26171== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.426 INFO:tasks.ceph.osd.0.trial091.stderr:==00:00:00:13.870 27166== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.434 INFO:tasks.ceph.osd.5.trial098.stderr:==00:00:00:13.819 26559== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.437 INFO:tasks.ceph.osd.9.trial098.stderr:==00:00:00:13.820 26561== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.448 INFO:tasks.ceph.osd.13.trial098.stderr:==00:00:00:13.828 26562== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.451 INFO:tasks.ceph.osd.11.trial154.stderr:==00:00:00:13.810 26173== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.451 INFO:tasks.ceph.osd.7.trial154.stderr:==00:00:00:13.810 26172== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.452 INFO:tasks.ceph.osd.15.trial154.stderr:==00:00:00:13.811 26174== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.454 INFO:tasks.ceph.osd.13.trial098.stderr:==00:00:00:13.834 26562== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.454 INFO:tasks.ceph.osd.6.trial111.stderr:==00:00:00:13.827 26493== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.456 INFO:tasks.ceph.osd.3.trial154.stderr:==00:00:00:13.815 26171== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.457 INFO:tasks.ceph.osd.2.trial111.stderr:==00:00:00:13.833 26491== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.460 INFO:tasks.ceph.osd.6.trial111.stderr:==00:00:00:13.832 26493== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.462 INFO:tasks.ceph.osd.2.trial111.stderr:==00:00:00:13.839 26491== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.465 INFO:tasks.ceph.osd.9.trial098.stderr:==00:00:00:13.849 26561== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.470 INFO:tasks.ceph.osd.9.trial098.stderr:==00:00:00:13.854 26561== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.473 INFO:tasks.ceph.osd.12.trial091.stderr:==00:00:00:13.861 27267== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.482 INFO:tasks.ceph.osd.5.trial098.stderr:==00:00:00:13.867 26559== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.488 INFO:tasks.ceph.osd.11.trial154.stderr:==00:00:00:13.846 26173== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.488 INFO:tasks.ceph.osd.7.trial154.stderr:==00:00:00:13.847 26172== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.489 INFO:tasks.ceph.osd.15.trial154.stderr:==00:00:00:13.847 26174== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.496 INFO:tasks.ceph.osd.3.trial154.stderr:==00:00:00:13.855 26171== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.516 INFO:tasks.ceph.osd.7.trial154.stderr:==00:00:00:13.874 26172== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.516 INFO:tasks.ceph.osd.8.trial091.stderr:==00:00:00:13.906 27259== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.517 INFO:tasks.ceph.osd.12.trial091.stderr:==00:00:00:13.906 27267== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.522 INFO:tasks.ceph.osd.5.trial098.stderr:==00:00:00:13.906 26559== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.524 INFO:tasks.ceph.osd.15.trial154.stderr:==00:00:00:13.883 26174== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.524 INFO:tasks.ceph.osd.11.trial154.stderr:==00:00:00:13.883 26173== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.525 INFO:tasks.ceph.osd.3.trial154.stderr:==00:00:00:13.883 26171== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.546 INFO:tasks.ceph.osd.1.trial098.stderr:==00:00:00:13.931 26560== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.548 INFO:tasks.ceph.osd.5.trial098.stderr:==00:00:00:13.933 26559== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.551 INFO:tasks.ceph.osd.12.trial091.stderr:==00:00:00:13.939 27267== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.553 INFO:tasks.ceph.osd.5.trial098.stderr:==00:00:00:13.938 26559== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.557 INFO:tasks.ceph.osd.7.trial154.stderr:==00:00:00:13.916 26172== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.561 INFO:tasks.ceph.osd.11.trial154.stderr:==00:00:00:13.919 26173== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.561 INFO:tasks.ceph.osd.15.trial154.stderr:==00:00:00:13.919 26174== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.578 INFO:tasks.ceph.osd.8.trial091.stderr:==00:00:00:13.967 27259== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.578 INFO:tasks.ceph.osd.12.trial091.stderr:==00:00:00:13.966 27267== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.582 INFO:tasks.ceph.osd.12.trial091.stderr:==00:00:00:13.971 27267== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.601 INFO:tasks.ceph.osd.1.trial098.stderr:==00:00:00:13.985 26560== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.610 INFO:tasks.ceph.osd.8.trial091.stderr:==00:00:00:14.000 27259== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.634 INFO:tasks.ceph.osd.8.trial091.stderr:==00:00:00:14.024 27259== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.638 INFO:tasks.ceph.osd.8.trial091.stderr:==00:00:00:14.028 27259== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.642 INFO:tasks.ceph.osd.1.trial098.stderr:==00:00:00:14.026 26560== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.666 INFO:tasks.ceph.osd.3.trial154.stderr:==00:00:00:14.024 26171== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.673 INFO:tasks.ceph.osd.1.trial098.stderr:==00:00:00:14.058 26560== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.678 INFO:tasks.ceph.osd.1.trial098.stderr:==00:00:00:14.063 26560== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.699 INFO:tasks.ceph.osd.11.trial154.stderr:==00:00:00:14.057 26173== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.706 INFO:tasks.ceph.osd.15.trial154.stderr:==00:00:00:14.064 26174== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.707 INFO:tasks.ceph.osd.7.trial154.stderr:==00:00:00:14.066 26172== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.723 INFO:tasks.ceph.osd.3.trial154.stderr:==00:00:00:14.081 26171== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.755 INFO:tasks.ceph.osd.11.trial154.stderr:==00:00:00:14.114 26173== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.760 INFO:tasks.ceph.osd.3.trial154.stderr:==00:00:00:14.118 26171== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.763 INFO:tasks.ceph.osd.7.trial154.stderr:==00:00:00:14.121 26172== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.763 INFO:tasks.ceph.osd.15.trial154.stderr:==00:00:00:14.121 26174== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.786 INFO:tasks.ceph.osd.11.trial154.stderr:==00:00:00:14.144 26173== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.793 INFO:tasks.ceph.osd.3.trial154.stderr:==00:00:00:14.152 26171== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.794 INFO:tasks.ceph.osd.7.trial154.stderr:==00:00:00:14.152 26172== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.794 INFO:tasks.ceph.osd.15.trial154.stderr:==00:00:00:14.153 26174== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.798 INFO:tasks.ceph.osd.3.trial154.stderr:==00:00:00:14.157 26171== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.825 INFO:tasks.ceph.osd.11.trial154.stderr:==00:00:00:14.184 26173== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.830 INFO:tasks.ceph.osd.11.trial154.stderr:==00:00:00:14.189 26173== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.838 INFO:tasks.ceph.osd.15.trial154.stderr:==00:00:00:14.197 26174== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.838 INFO:tasks.ceph.osd.7.trial154.stderr:==00:00:00:14.197 26172== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.843 INFO:tasks.ceph.osd.15.trial154.stderr:==00:00:00:14.202 26174== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:19.843 INFO:tasks.ceph.osd.7.trial154.stderr:==00:00:00:14.202 26172== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:21.607 INFO:tasks.ceph.osd.14.trial111.stderr:==00:00:00:15.977 26494== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:21.677 INFO:tasks.ceph.osd.4.trial091.stderr:==00:00:00:16.069 27254== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:21.686 INFO:tasks.ceph.osd.0.trial091.stderr:==00:00:00:16.130 27166== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:21.719 INFO:tasks.ceph.osd.10.trial111.stderr:==00:00:00:16.092 26492== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:21.724 INFO:tasks.ceph.osd.13.trial098.stderr:==00:00:00:16.104 26562== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:21.733 INFO:tasks.ceph.osd.9.trial098.stderr:==00:00:00:16.116 26561== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:21.744 INFO:tasks.ceph.osd.6.trial111.stderr:==00:00:00:16.117 26493== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:21.755 INFO:tasks.ceph.osd.2.trial111.stderr:==00:00:00:16.132 26491== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:21.821 INFO:tasks.ceph.osd.5.trial098.stderr:==00:00:00:16.206 26559== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:21.870 INFO:tasks.ceph.osd.12.trial091.stderr:==00:00:00:16.258 27267== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:21.913 INFO:tasks.ceph.osd.8.trial091.stderr:==00:00:00:16.303 27259== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:21.958 INFO:tasks.ceph.osd.1.trial098.stderr:==00:00:00:16.342 26560== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:22.144 INFO:tasks.ceph.osd.3.trial154.stderr:==00:00:00:16.503 26171== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:22.180 INFO:tasks.ceph.osd.11.trial154.stderr:==00:00:00:16.539 26173== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:22.195 INFO:tasks.ceph.osd.7.trial154.stderr:==00:00:00:16.554 26172== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:22.196 INFO:tasks.ceph.osd.15.trial154.stderr:==00:00:00:16.554 26174== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:23.388 DEBUG:teuthology.orchestra.run.trial091:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-12T03:58:23.446 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.444+0000 7f68913cf640 10 monclient: get_monmap_and_config 2026-02-12T03:58:23.446 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.444+0000 7f68913cf640 10 monclient: build_initial_monmap 2026-02-12T03:58:23.446 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.444+0000 7f68913cf640 10 monclient: monmap: 2026-02-12T03:58:23.446 INFO:teuthology.misc.health.trial091.stderr:epoch 0 2026-02-12T03:58:23.446 INFO:teuthology.misc.health.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:23.446 INFO:teuthology.misc.health.trial091.stderr:last_changed 2026-02-12T03:58:23.444703+0000 2026-02-12T03:58:23.446 INFO:teuthology.misc.health.trial091.stderr:created 2026-02-12T03:58:23.444703+0000 2026-02-12T03:58:23.447 INFO:teuthology.misc.health.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:23.447 INFO:teuthology.misc.health.trial091.stderr:election_strategy: 3 2026-02-12T03:58:23.447 INFO:teuthology.misc.health.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:23.447 INFO:teuthology.misc.health.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:23.447 INFO:teuthology.misc.health.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:23.447 INFO:teuthology.misc.health.trial091.stderr: 2026-02-12T03:58:23.450 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.444+0000 7f68913cf640 1 Processor -- start 2026-02-12T03:58:23.450 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.444+0000 7f68913cf640 1 -- start start 2026-02-12T03:58:23.450 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.444+0000 7f68913cf640 10 monclient: init 2026-02-12T03:58:23.450 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.445+0000 7f68913cf640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:23.450 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.445+0000 7f68913cf640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T03:58:23.450 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.445+0000 7f68913cf640 10 monclient(hunting): picked mon.noname-b con 0x7f688c1575d0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:23.450 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.445+0000 7f68913cf640 10 monclient(hunting): picked mon.noname-a con 0x7f688c163310 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:23.450 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.445+0000 7f68913cf640 10 monclient(hunting): picked mon.noname-c con 0x7f688c0560d0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:23.450 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.445+0000 7f68913cf640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f688c0b20b0 con 0x7f688c163310 2026-02-12T03:58:23.450 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.445+0000 7f68913cf640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f688c0b2390 con 0x7f688c1575d0 2026-02-12T03:58:23.451 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.445+0000 7f68913cf640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f688c0b2670 con 0x7f688c0560d0 2026-02-12T03:58:23.451 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.445+0000 7f68913cf640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:23.451 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.445+0000 7f68913cf640 10 monclient(hunting): authenticate will time out at 1106.188225s 2026-02-12T03:58:23.451 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.445+0000 7f688a7fc640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f688c163310 0x7f688c0559c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:36746/0 (socket says 10.20.193.91:36746) 2026-02-12T03:58:23.451 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.445+0000 7f688a7fc640 1 -- 10.20.193.91:0/2090875864 learned_addr learned my addr 10.20.193.91:0/2090875864 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:23.451 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.446+0000 7f6889ffb640 1 -- 10.20.193.91:0/2090875864 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 572315878 0 0) 0x7f688c0b20b0 con 0x7f688c163310 2026-02-12T03:58:23.451 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.446+0000 7f6889ffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:23.451 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.446+0000 7f6889ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:23.451 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.446+0000 7f6889ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:23.451 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.446+0000 7f6889ffb640 10 monclient(hunting): my global_id is 4290 2026-02-12T03:58:23.451 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.446+0000 7f6889ffb640 1 -- 10.20.193.91:0/2090875864 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6878003610 con 0x7f688c163310 2026-02-12T03:58:23.452 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.447+0000 7f6889ffb640 1 -- 10.20.193.91:0/2090875864 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 712783383 0 0) 0x7f688c0b2670 con 0x7f688c0560d0 2026-02-12T03:58:23.452 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.447+0000 7f6889ffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:23.452 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.447+0000 7f6889ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:23.452 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.447+0000 7f6889ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:23.452 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.447+0000 7f6889ffb640 10 monclient(hunting): my global_id is 4262 2026-02-12T03:58:23.452 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.447+0000 7f6889ffb640 1 -- 10.20.193.91:0/2090875864 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f688c0b20b0 con 0x7f688c0560d0 2026-02-12T03:58:23.452 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.447+0000 7f6889ffb640 1 -- 10.20.193.91:0/2090875864 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 497654958 0 0) 0x7f688c0b2390 con 0x7f688c1575d0 2026-02-12T03:58:23.452 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.447+0000 7f6889ffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:23.452 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.447+0000 7f6889ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:23.452 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.447+0000 7f6889ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:23.453 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.447+0000 7f6889ffb640 10 monclient(hunting): my global_id is 4294 2026-02-12T03:58:23.453 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.447+0000 7f6889ffb640 1 -- 10.20.193.91:0/2090875864 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f688c0b2670 con 0x7f688c1575d0 2026-02-12T03:58:23.457 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.449+0000 7f6889ffb640 1 -- 10.20.193.91:0/2090875864 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1072505814 0 0) 0x7f688c0b20b0 con 0x7f688c0560d0 2026-02-12T03:58:23.457 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.449+0000 7f6889ffb640 1 -- 10.20.193.91:0/2090875864 >> v1:10.20.193.98:6789/0 conn(0x7f688c1575d0 legacy=0x7f688c162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:23.457 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.449+0000 7f6889ffb640 1 -- 10.20.193.91:0/2090875864 >> v1:10.20.193.91:6789/0 conn(0x7f688c163310 legacy=0x7f688c0559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:23.458 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.449+0000 7f6889ffb640 10 monclient: _finish_hunting 0 2026-02-12T03:58:23.458 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.449+0000 7f6889ffb640 1 monclient: found mon.noname-c 2026-02-12T03:58:23.458 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.449+0000 7f6889ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:23.458 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.449+0000 7f6889ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.111:6789/0 2026-02-12T03:58:23.458 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.449+0000 7f6889ffb640 1 -- 10.20.193.91:0/2090875864 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f688c162400 con 0x7f688c0560d0 2026-02-12T03:58:23.458 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.449+0000 7f6889ffb640 10 monclient: _finish_auth 0 2026-02-12T03:58:23.458 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.449+0000 7f6889ffb640 10 monclient: _check_auth_tickets 2026-02-12T03:58:23.458 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.449+0000 7f6889ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:23.458 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.449+0000 7f6889ffb640 1 -- 10.20.193.91:0/2090875864 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f687c003170 con 0x7f688c0560d0 2026-02-12T03:58:23.458 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.449+0000 7f6889ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:23.458 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.449+0000 7f6889ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:23.459 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.449+0000 7f6889ffb640 10 monclient: dump: 2026-02-12T03:58:23.459 INFO:teuthology.misc.health.trial091.stderr:epoch 1 2026-02-12T03:58:23.459 INFO:teuthology.misc.health.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:23.459 INFO:teuthology.misc.health.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:23.459 INFO:teuthology.misc.health.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:23.459 INFO:teuthology.misc.health.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:23.459 INFO:teuthology.misc.health.trial091.stderr:election_strategy: 3 2026-02-12T03:58:23.459 INFO:teuthology.misc.health.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:23.459 INFO:teuthology.misc.health.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:23.459 INFO:teuthology.misc.health.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:23.459 INFO:teuthology.misc.health.trial091.stderr: 2026-02-12T03:58:23.460 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.449+0000 7f68913cf640 5 monclient: authenticate success, global_id 4262 2026-02-12T03:58:23.460 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.449+0000 7f68913cf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:23.460 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.450+0000 7f6889ffb640 1 -- 10.20.193.91:0/2090875864 <== mon.2 v1:10.20.193.111:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f687c003340 con 0x7f688c0560d0 2026-02-12T03:58:23.460 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.450+0000 7f6889ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:23.460 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.450+0000 7f6889ffb640 1 -- 10.20.193.91:0/2090875864 <== mon.2 v1:10.20.193.111:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f687c003780 con 0x7f688c0560d0 2026-02-12T03:58:23.460 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.450+0000 7f6889ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:23.460 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.450+0000 7f6889ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:23.460 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.450+0000 7f6889ffb640 10 monclient: dump: 2026-02-12T03:58:23.460 INFO:teuthology.misc.health.trial091.stderr:epoch 1 2026-02-12T03:58:23.460 INFO:teuthology.misc.health.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:23.460 INFO:teuthology.misc.health.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:23.461 INFO:teuthology.misc.health.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:23.461 INFO:teuthology.misc.health.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:23.461 INFO:teuthology.misc.health.trial091.stderr:election_strategy: 3 2026-02-12T03:58:23.461 INFO:teuthology.misc.health.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:23.461 INFO:teuthology.misc.health.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:23.461 INFO:teuthology.misc.health.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:23.461 INFO:teuthology.misc.health.trial091.stderr: 2026-02-12T03:58:23.461 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.450+0000 7f68913cf640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:23.461 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.450+0000 7f68913cf640 4 set_mon_vals no callback set 2026-02-12T03:58:23.461 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.450+0000 7f68913cf640 10 monclient: shutdown 2026-02-12T03:58:23.462 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.450+0000 7f68913cf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:23.462 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.450+0000 7f68913cf640 1 -- 10.20.193.91:0/2090875864 >> v1:10.20.193.111:6789/0 conn(0x7f688c0560d0 legacy=0x7f688c1c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:23.462 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.450+0000 7f68913cf640 1 -- 10.20.193.91:0/2090875864 shutdown_connections 2026-02-12T03:58:23.462 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.450+0000 7f68913cf640 1 -- 10.20.193.91:0/2090875864 >> 10.20.193.91:0/2090875864 conn(0x7f688c0b6560 msgr2=0x7f688c0b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:23.462 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.450+0000 7f68913cf640 1 -- 10.20.193.91:0/2090875864 shutdown_connections 2026-02-12T03:58:23.462 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.450+0000 7f68913cf640 1 -- 10.20.193.91:0/2090875864 wait complete. 2026-02-12T03:58:23.462 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.451+0000 7f68913cf640 10 monclient: build_initial_monmap 2026-02-12T03:58:23.462 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.451+0000 7f68913cf640 10 monclient: monmap: 2026-02-12T03:58:23.462 INFO:teuthology.misc.health.trial091.stderr:epoch 0 2026-02-12T03:58:23.462 INFO:teuthology.misc.health.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:23.462 INFO:teuthology.misc.health.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:23.462 INFO:teuthology.misc.health.trial091.stderr:created 0.000000 2026-02-12T03:58:23.463 INFO:teuthology.misc.health.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:23.463 INFO:teuthology.misc.health.trial091.stderr:election_strategy: 1 2026-02-12T03:58:23.463 INFO:teuthology.misc.health.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:23.463 INFO:teuthology.misc.health.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:23.463 INFO:teuthology.misc.health.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:23.463 INFO:teuthology.misc.health.trial091.stderr: 2026-02-12T03:58:23.463 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.451+0000 7f68913cf640 1 librados: starting msgr at 2026-02-12T03:58:23.463 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.451+0000 7f68913cf640 1 librados: starting objecter 2026-02-12T03:58:23.463 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.451+0000 7f68913cf640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:23.463 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.451+0000 7f68913cf640 1 Processor -- start 2026-02-12T03:58:23.463 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.451+0000 7f68913cf640 1 -- start start 2026-02-12T03:58:23.463 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.451+0000 7f68913cf640 1 librados: setting wanted keys 2026-02-12T03:58:23.464 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.451+0000 7f68913cf640 1 librados: calling monclient init 2026-02-12T03:58:23.464 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.451+0000 7f68913cf640 10 monclient: init 2026-02-12T03:58:23.464 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.451+0000 7f68913cf640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:23.464 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.451+0000 7f68913cf640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T03:58:23.464 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.451+0000 7f68913cf640 10 monclient(hunting): picked mon.noname-b con 0x7f688c0560d0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:23.464 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.451+0000 7f68913cf640 10 monclient(hunting): picked mon.noname-a con 0x7f688c1575d0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:23.464 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.452+0000 7f68913cf640 10 monclient(hunting): picked mon.noname-c con 0x7f688c163310 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:23.464 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.452+0000 7f68913cf640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f688c15fb00 con 0x7f688c1575d0 2026-02-12T03:58:23.464 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.452+0000 7f68913cf640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f688c15fde0 con 0x7f688c0560d0 2026-02-12T03:58:23.464 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.452+0000 7f68913cf640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f688c1600c0 con 0x7f688c163310 2026-02-12T03:58:23.464 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.452+0000 7f68913cf640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:23.464 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.452+0000 7f68913cf640 10 monclient(hunting): authenticate will time out at 1106.195021s 2026-02-12T03:58:23.465 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.452+0000 7f688a7fc640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f688c1575d0 0x7f688c15e990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:36748/0 (socket says 10.20.193.91:36748) 2026-02-12T03:58:23.465 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.452+0000 7f688a7fc640 1 -- 10.20.193.91:0/2907492161 learned_addr learned my addr 10.20.193.91:0/2907492161 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:23.465 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.452+0000 7f686b7fe640 10 client.?.objecter ms_handle_connect 0x7f688c1575d0 2026-02-12T03:58:23.465 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.452+0000 7f686b7fe640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:23.465 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.452+0000 7f686b7fe640 10 client.?.objecter ms_handle_connect 0x7f688c163310 2026-02-12T03:58:23.465 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.452+0000 7f686b7fe640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:23.465 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.452+0000 7f686b7fe640 10 client.?.objecter ms_handle_connect 0x7f688c0560d0 2026-02-12T03:58:23.465 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.452+0000 7f686b7fe640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:23.465 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.453+0000 7f686b7fe640 1 -- 10.20.193.91:0/2907492161 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3347040980 0 0) 0x7f688c15fb00 con 0x7f688c1575d0 2026-02-12T03:58:23.465 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.453+0000 7f686b7fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:23.465 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.453+0000 7f686b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:23.465 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.453+0000 7f686b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:23.465 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.453+0000 7f686b7fe640 10 monclient(hunting): my global_id is 4293 2026-02-12T03:58:23.466 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.453+0000 7f686b7fe640 1 -- 10.20.193.91:0/2907492161 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6858003610 con 0x7f688c1575d0 2026-02-12T03:58:23.466 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.453+0000 7f686b7fe640 1 -- 10.20.193.91:0/2907492161 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1037873794 0 0) 0x7f688c1600c0 con 0x7f688c163310 2026-02-12T03:58:23.466 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.453+0000 7f686b7fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:23.466 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.453+0000 7f686b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:23.466 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.453+0000 7f686b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:23.466 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.453+0000 7f686b7fe640 10 monclient(hunting): my global_id is 4265 2026-02-12T03:58:23.466 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.453+0000 7f686b7fe640 1 -- 10.20.193.91:0/2907492161 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f688c15fb00 con 0x7f688c163310 2026-02-12T03:58:23.466 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.453+0000 7f686b7fe640 1 -- 10.20.193.91:0/2907492161 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2679513873 0 0) 0x7f688c15fde0 con 0x7f688c0560d0 2026-02-12T03:58:23.466 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.453+0000 7f686b7fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:23.466 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.453+0000 7f686b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:23.466 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.453+0000 7f686b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:23.467 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.453+0000 7f686b7fe640 10 monclient(hunting): my global_id is 4297 2026-02-12T03:58:23.467 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.453+0000 7f686b7fe640 1 -- 10.20.193.91:0/2907492161 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f688c1600c0 con 0x7f688c0560d0 2026-02-12T03:58:23.469 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.456+0000 7f686b7fe640 1 -- 10.20.193.91:0/2907492161 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1002830342 0 0) 0x7f6858003610 con 0x7f688c1575d0 2026-02-12T03:58:23.469 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.456+0000 7f686b7fe640 1 -- 10.20.193.91:0/2907492161 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f688c15fde0 con 0x7f688c1575d0 2026-02-12T03:58:23.469 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.456+0000 7f686b7fe640 1 -- 10.20.193.91:0/2907492161 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f6874002f60 con 0x7f688c1575d0 2026-02-12T03:58:23.469 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.456+0000 7f686b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:23.469 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.456+0000 7f686b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:23.469 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.456+0000 7f686b7fe640 10 monclient(hunting): dump: 2026-02-12T03:58:23.470 INFO:teuthology.misc.health.trial091.stderr:epoch 1 2026-02-12T03:58:23.470 INFO:teuthology.misc.health.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:23.470 INFO:teuthology.misc.health.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:23.470 INFO:teuthology.misc.health.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:23.470 INFO:teuthology.misc.health.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:23.470 INFO:teuthology.misc.health.trial091.stderr:election_strategy: 3 2026-02-12T03:58:23.470 INFO:teuthology.misc.health.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:23.470 INFO:teuthology.misc.health.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:23.470 INFO:teuthology.misc.health.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:23.470 INFO:teuthology.misc.health.trial091.stderr: 2026-02-12T03:58:23.470 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.456+0000 7f686b7fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:23.470 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.456+0000 7f686b7fe640 1 -- 10.20.193.91:0/2907492161 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 521794687 0 0) 0x7f688c15fb00 con 0x7f688c163310 2026-02-12T03:58:23.471 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.456+0000 7f686b7fe640 1 -- 10.20.193.91:0/2907492161 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6858003610 con 0x7f688c163310 2026-02-12T03:58:23.471 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.456+0000 7f686b7fe640 1 -- 10.20.193.91:0/2907492161 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f687c003690 con 0x7f688c163310 2026-02-12T03:58:23.471 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.456+0000 7f686b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:23.471 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.456+0000 7f686b7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:23.471 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.456+0000 7f686b7fe640 10 monclient(hunting): dump: 2026-02-12T03:58:23.471 INFO:teuthology.misc.health.trial091.stderr:epoch 1 2026-02-12T03:58:23.471 INFO:teuthology.misc.health.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:23.471 INFO:teuthology.misc.health.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:23.471 INFO:teuthology.misc.health.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:23.471 INFO:teuthology.misc.health.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:23.471 INFO:teuthology.misc.health.trial091.stderr:election_strategy: 3 2026-02-12T03:58:23.471 INFO:teuthology.misc.health.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:23.472 INFO:teuthology.misc.health.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:23.472 INFO:teuthology.misc.health.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:23.472 INFO:teuthology.misc.health.trial091.stderr: 2026-02-12T03:58:23.472 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.456+0000 7f686b7fe640 1 -- 10.20.193.91:0/2907492161 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3834256088 0 0) 0x7f688c1600c0 con 0x7f688c0560d0 2026-02-12T03:58:23.472 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.456+0000 7f686b7fe640 1 -- 10.20.193.91:0/2907492161 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f688c15fb00 con 0x7f688c0560d0 2026-02-12T03:58:23.472 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.456+0000 7f686b7fe640 1 -- 10.20.193.91:0/2907492161 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f6880003060 con 0x7f688c0560d0 2026-02-12T03:58:23.472 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.456+0000 7f686b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:23.472 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.456+0000 7f686b7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:23.472 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.456+0000 7f686b7fe640 10 monclient(hunting): dump: 2026-02-12T03:58:23.472 INFO:teuthology.misc.health.trial091.stderr:epoch 1 2026-02-12T03:58:23.472 INFO:teuthology.misc.health.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:23.472 INFO:teuthology.misc.health.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:23.473 INFO:teuthology.misc.health.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:23.473 INFO:teuthology.misc.health.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:23.473 INFO:teuthology.misc.health.trial091.stderr:election_strategy: 3 2026-02-12T03:58:23.473 INFO:teuthology.misc.health.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:23.473 INFO:teuthology.misc.health.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:23.473 INFO:teuthology.misc.health.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:23.473 INFO:teuthology.misc.health.trial091.stderr: 2026-02-12T03:58:23.473 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.458+0000 7f686b7fe640 1 -- 10.20.193.91:0/2907492161 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 42415954 0 0) 0x7f688c15fde0 con 0x7f688c1575d0 2026-02-12T03:58:23.473 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.458+0000 7f686b7fe640 1 -- 10.20.193.91:0/2907492161 >> v1:10.20.193.111:6789/0 conn(0x7f688c163310 legacy=0x7f688c15f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:23.473 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.458+0000 7f686b7fe640 1 -- 10.20.193.91:0/2907492161 >> v1:10.20.193.98:6789/0 conn(0x7f688c0560d0 legacy=0x7f688c058910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:23.473 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.458+0000 7f686b7fe640 10 monclient: _finish_hunting 0 2026-02-12T03:58:23.473 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.458+0000 7f686b7fe640 1 monclient: found mon.a 2026-02-12T03:58:23.474 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.458+0000 7f686b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:23.474 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.458+0000 7f686b7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:23.474 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.458+0000 7f686b7fe640 1 -- 10.20.193.91:0/2907492161 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f688c1603a0 con 0x7f688c1575d0 2026-02-12T03:58:23.474 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.458+0000 7f686b7fe640 10 monclient: _finish_auth 0 2026-02-12T03:58:23.474 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.458+0000 7f686b7fe640 10 monclient: _check_auth_tickets 2026-02-12T03:58:23.474 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.458+0000 7f686b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:23.474 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.458+0000 7f68913cf640 5 monclient: authenticate success, global_id 4293 2026-02-12T03:58:23.474 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.458+0000 7f68913cf640 10 monclient: _renew_subs 2026-02-12T03:58:23.474 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.458+0000 7f68913cf640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:23.474 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.458+0000 7f68913cf640 1 -- 10.20.193.91:0/2907492161 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f688c143490 con 0x7f688c1575d0 2026-02-12T03:58:23.474 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.458+0000 7f68913cf640 10 client.4293.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:23.474 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.458+0000 7f68913cf640 10 monclient: _renew_subs 2026-02-12T03:58:23.475 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.458+0000 7f68913cf640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:23.475 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.458+0000 7f68913cf640 1 -- 10.20.193.91:0/2907492161 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f688c145530 con 0x7f688c1575d0 2026-02-12T03:58:23.475 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.458+0000 7f68913cf640 1 librados: init done 2026-02-12T03:58:23.475 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.459+0000 7f68913cf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:23.475 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.459+0000 7f68913cf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:23.475 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.459+0000 7f68913cf640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:23.475 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.459+0000 7f68913cf640 1 -- 10.20.193.91:0/2907492161 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f688c143660 con 0x7f688c1575d0 2026-02-12T03:58:23.556 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.554+0000 7f686b7fe640 1 -- 10.20.193.91:0/2907492161 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f68740048d0 con 0x7f688c1575d0 2026-02-12T03:58:23.556 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.554+0000 7f686b7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:23.556 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.554+0000 7f686b7fe640 1 -- 10.20.193.91:0/2907492161 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f6874004a80 con 0x7f688c1575d0 2026-02-12T03:58:23.557 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.554+0000 7f686b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:23.557 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.554+0000 7f686b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:23.557 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.554+0000 7f686b7fe640 10 monclient: dump: 2026-02-12T03:58:23.557 INFO:teuthology.misc.health.trial091.stderr:epoch 1 2026-02-12T03:58:23.557 INFO:teuthology.misc.health.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:23.557 INFO:teuthology.misc.health.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:23.557 INFO:teuthology.misc.health.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:23.557 INFO:teuthology.misc.health.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:23.557 INFO:teuthology.misc.health.trial091.stderr:election_strategy: 3 2026-02-12T03:58:23.557 INFO:teuthology.misc.health.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:23.557 INFO:teuthology.misc.health.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:23.558 INFO:teuthology.misc.health.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:23.558 INFO:teuthology.misc.health.trial091.stderr: 2026-02-12T03:58:23.558 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.554+0000 7f68897fa640 4 set_mon_vals no callback set 2026-02-12T03:58:23.558 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.554+0000 7f686b7fe640 1 -- 10.20.193.91:0/2907492161 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 4) ==== 103168+0+0 (unknown 3733604615 0 0) 0x7f687401df30 con 0x7f688c1575d0 2026-02-12T03:58:23.558 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.555+0000 7f688affd640 10 monclient: get_auth_request con 0x7f6858079fa0 auth_method 0 2026-02-12T03:58:23.559 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.555+0000 7f686b7fe640 10 client.4293.objecter ms_handle_connect 0x7f6858079fa0 2026-02-12T03:58:23.559 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.557+0000 7f686b7fe640 1 -- 10.20.193.91:0/2907492161 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 2560+0+0 (unknown 3427255071 0 0) 0x7f687405abe0 con 0x7f688c1575d0 2026-02-12T03:58:23.560 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.557+0000 7f686b7fe640 10 client.4293.objecter ms_dispatch2 0x7f688c000b90 osd_map(18..18 src has 1..18) 2026-02-12T03:58:23.560 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.557+0000 7f686b7fe640 3 client.4293.objecter handle_osd_map got epochs [18,18] > 0 2026-02-12T03:58:23.560 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.557+0000 7f686b7fe640 3 client.4293.objecter handle_osd_map decoding full epoch 18 2026-02-12T03:58:23.560 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.557+0000 7f686b7fe640 20 client.4293.objecter dump_active .. 0 homeless 2026-02-12T03:58:23.560 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.557+0000 7f686b7fe640 1 -- 10.20.193.91:0/2907492161 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f687405f350 con 0x7f688c1575d0 2026-02-12T03:58:23.560 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.557+0000 7f686b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:23.560 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.557+0000 7f686b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:23.669 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.667+0000 7f68913cf640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-12T03:58:23.670 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.667+0000 7f68913cf640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T03:58:23.670 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.667+0000 7f68913cf640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:23.670 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.667+0000 7f68913cf640 1 -- 10.20.193.91:0/2907492161 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f688c055b50 con 0x7f688c1575d0 2026-02-12T03:58:23.679 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.677+0000 7f686b7fe640 1 -- 10.20.193.91:0/2907492161 <== mon.0 v1:10.20.193.91:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12877 (unknown 3338201251 0 3816485227) 0x7f687405ec50 con 0x7f688c1575d0 2026-02-12T03:58:23.679 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.677+0000 7f686b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T03:58:23.679 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.677+0000 7f686b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:23.679 INFO:teuthology.misc.health.trial091.stdout: 2026-02-12T03:58:23.680 INFO:teuthology.misc.health.trial091.stdout:{"epoch":18,"fsid":"1e356fcf-3d61-462e-a451-82f8dd01e1f3","created":"2026-02-12T03:57:59.014379+0000","modified":"2026-02-12T03:58:05.455425+0000","last_up_change":"0.000000","last_in_change":"2026-02-12T03:58:05.455425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"791c97c5-83f6-4024-9f43-ff3b2ee22a30","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0cf561d6-85aa-428a-bc69-83ce77b1c802","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b3dc78b9-cae6-4b1f-931f-7352a43b9e26","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e164e3ae-cf6a-45ff-b126-3ac739c5b1be","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5583cc8c-83d4-42b4-a997-c056f3b145a0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d7bb6fa1-b042-4dce-9644-00e817a5bc8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"93cd9edf-a000-4d22-8da7-52f4bd547765","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f5e11a47-d746-46ca-85f1-27d3bc586371","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"bb8207ce-22b9-46be-9c89-c77f2690e405","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"e6318a6d-2367-48ce-a3a1-47307de14b99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"cd6c97a2-bdfe-4b86-afeb-217315976d6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"b6c647bb-4e86-4b0e-b79c-b0236a780a66","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"19bb3570-0c0a-48cc-a0b8-ec3194f30fa8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"a8215062-521c-47f6-b20a-9e40c1f3f5a6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":14,"uuid":"3cd1bb48-53a2-462e-b7e5-4d6d918dd543","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":15,"uuid":"9bd39438-f5e5-4a19-afa4-678395d63c24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T03:58:23.682 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.679+0000 7f68913cf640 10 librados: watch_flush enter 2026-02-12T03:58:23.682 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.679+0000 7f68913cf640 10 librados: watch_flush exit 2026-02-12T03:58:23.682 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.679+0000 7f68913cf640 20 client.4293.objecter shutdown clearing up homeless session... 2026-02-12T03:58:23.683 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.679+0000 7f68913cf640 10 client.4293.objecter successfully canceled tick 2026-02-12T03:58:23.683 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.679+0000 7f68913cf640 1 -- 10.20.193.91:0/2907492161 >> v1:10.20.193.91:6800/2929217192 conn(0x7f6858079fa0 legacy=0x7f685809a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:23.683 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.679+0000 7f68913cf640 10 monclient: shutdown 2026-02-12T03:58:23.683 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.679+0000 7f68913cf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:23.683 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.679+0000 7f68913cf640 1 -- 10.20.193.91:0/2907492161 >> v1:10.20.193.91:6789/0 conn(0x7f688c1575d0 legacy=0x7f688c15e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:23.683 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.679+0000 7f68913cf640 1 -- 10.20.193.91:0/2907492161 shutdown_connections 2026-02-12T03:58:23.683 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.679+0000 7f68913cf640 1 -- 10.20.193.91:0/2907492161 >> 10.20.193.91:0/2907492161 conn(0x7f688c0b6560 msgr2=0x7f688c0b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:23.683 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.679+0000 7f68913cf640 1 -- 10.20.193.91:0/2907492161 shutdown_connections 2026-02-12T03:58:23.683 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.679+0000 7f68913cf640 1 -- 10.20.193.91:0/2907492161 wait complete. 2026-02-12T03:58:23.684 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:23.679+0000 7f68913cf640 1 librados: shutdown 2026-02-12T03:58:23.691 DEBUG:teuthology.misc:0 of 16 OSDs are up 2026-02-12T03:58:23.866 INFO:tasks.ceph.osd.14.trial111.stderr:==00:00:00:18.236 26494== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:23.906 INFO:tasks.ceph.osd.14.trial111.stderr:==00:00:00:18.276 26494== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:23.908 INFO:tasks.ceph.osd.14.trial111.stderr:==00:00:00:18.279 26494== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:23.924 INFO:tasks.ceph.osd.0.trial091.stderr:==00:00:00:18.369 27166== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:23.931 INFO:tasks.ceph.osd.4.trial091.stderr:==00:00:00:18.322 27254== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:23.956 INFO:tasks.ceph.osd.9.trial098.stderr:==00:00:00:18.339 26561== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:23.957 INFO:tasks.ceph.osd.0.trial091.stderr:==00:00:00:18.402 27166== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:23.960 INFO:tasks.ceph.osd.0.trial091.stderr:==00:00:00:18.405 27166== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:23.961 INFO:tasks.ceph.osd.4.trial091.stderr:==00:00:00:18.353 27254== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:23.964 INFO:tasks.ceph.osd.4.trial091.stderr:==00:00:00:18.356 27254== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:23.972 INFO:tasks.ceph.osd.6.trial111.stderr:==00:00:00:18.345 26493== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:23.991 INFO:tasks.ceph.osd.10.trial111.stderr:==00:00:00:18.365 26492== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:23.993 INFO:tasks.ceph.osd.9.trial098.stderr:==00:00:00:18.376 26561== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:23.996 INFO:tasks.ceph.osd.9.trial098.stderr:==00:00:00:18.379 26561== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:23.997 INFO:tasks.ceph.osd.6.trial111.stderr:==00:00:00:18.370 26493== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:24.000 INFO:tasks.ceph.osd.6.trial111.stderr:==00:00:00:18.373 26493== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:24.010 INFO:tasks.ceph.osd.13.trial098.stderr:==00:00:00:18.390 26562== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:24.015 INFO:tasks.ceph.osd.2.trial111.stderr:==00:00:00:18.391 26491== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:24.026 INFO:tasks.ceph.osd.10.trial111.stderr:==00:00:00:18.401 26492== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:24.029 INFO:tasks.ceph.osd.10.trial111.stderr:==00:00:00:18.404 26492== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:24.036 INFO:tasks.ceph.osd.13.trial098.stderr:==00:00:00:18.416 26562== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:24.039 INFO:tasks.ceph.osd.13.trial098.stderr:==00:00:00:18.419 26562== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:24.052 INFO:tasks.ceph.osd.2.trial111.stderr:==00:00:00:18.429 26491== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:24.055 INFO:tasks.ceph.osd.2.trial111.stderr:==00:00:00:18.432 26491== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:24.122 INFO:tasks.ceph.osd.5.trial098.stderr:==00:00:00:18.507 26559== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:24.127 INFO:tasks.ceph.osd.12.trial091.stderr:==00:00:00:18.515 27267== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:24.151 INFO:tasks.ceph.osd.12.trial091.stderr:==00:00:00:18.539 27267== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:24.154 INFO:tasks.ceph.osd.12.trial091.stderr:==00:00:00:18.542 27267== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:24.162 INFO:tasks.ceph.osd.5.trial098.stderr:==00:00:00:18.547 26559== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:24.166 INFO:tasks.ceph.osd.5.trial098.stderr:==00:00:00:18.551 26559== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:24.180 INFO:tasks.ceph.osd.8.trial091.stderr:==00:00:00:18.570 27259== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:24.198 INFO:tasks.ceph.osd.1.trial098.stderr:==00:00:00:18.583 26560== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:24.215 INFO:tasks.ceph.osd.8.trial091.stderr:==00:00:00:18.605 27259== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:24.218 INFO:tasks.ceph.osd.8.trial091.stderr:==00:00:00:18.608 27259== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:24.229 INFO:tasks.ceph.osd.1.trial098.stderr:==00:00:00:18.614 26560== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:24.232 INFO:tasks.ceph.osd.1.trial098.stderr:==00:00:00:18.617 26560== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:24.401 INFO:tasks.ceph.osd.3.trial154.stderr:==00:00:00:18.759 26171== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:24.425 INFO:tasks.ceph.osd.3.trial154.stderr:==00:00:00:18.784 26171== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:24.428 INFO:tasks.ceph.osd.3.trial154.stderr:==00:00:00:18.787 26171== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:24.475 INFO:tasks.ceph.osd.7.trial154.stderr:==00:00:00:18.834 26172== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:24.495 INFO:tasks.ceph.osd.11.trial154.stderr:==00:00:00:18.854 26173== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:24.514 INFO:tasks.ceph.osd.7.trial154.stderr:==00:00:00:18.872 26172== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:24.516 INFO:tasks.ceph.osd.7.trial154.stderr:==00:00:00:18.875 26172== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:24.527 INFO:tasks.ceph.osd.15.trial154.stderr:==00:00:00:18.886 26174== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:24.529 INFO:tasks.ceph.osd.11.trial154.stderr:==00:00:00:18.888 26173== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:24.533 INFO:tasks.ceph.osd.11.trial154.stderr:==00:00:00:18.891 26173== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:24.558 INFO:tasks.ceph.osd.15.trial154.stderr:==00:00:00:18.917 26174== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:24.562 INFO:tasks.ceph.osd.15.trial154.stderr:==00:00:00:18.920 26174== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:25.528 INFO:tasks.ceph.osd.14.trial111.stderr:==00:00:00:19.898 26494== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:25.556 INFO:tasks.ceph.osd.0.trial091.stderr:==00:00:00:20.001 27166== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:25.564 INFO:tasks.ceph.osd.4.trial091.stderr:==00:00:00:19.956 27254== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:25.577 INFO:tasks.ceph.osd.9.trial098.stderr:==00:00:00:19.960 26561== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:25.608 INFO:tasks.ceph.osd.6.trial111.stderr:==00:00:00:19.980 26493== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:25.656 INFO:tasks.ceph.osd.13.trial098.stderr:==00:00:00:20.036 26562== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:25.657 INFO:tasks.ceph.osd.10.trial111.stderr:==00:00:00:20.031 26492== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:25.666 INFO:tasks.ceph.osd.2.trial111.stderr:==00:00:00:20.042 26491== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:25.751 INFO:tasks.ceph.osd.5.trial098.stderr:==00:00:00:20.135 26559== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:25.761 INFO:tasks.ceph.osd.12.trial091.stderr:==00:00:00:20.149 27267== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:25.809 INFO:tasks.ceph.osd.8.trial091.stderr:==00:00:00:20.199 27259== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:25.842 INFO:tasks.ceph.osd.1.trial098.stderr:==00:00:00:20.226 26560== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:26.071 INFO:tasks.ceph.osd.3.trial154.stderr:==00:00:00:20.429 26171== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:26.166 INFO:tasks.ceph.osd.7.trial154.stderr:==00:00:00:20.525 26172== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:26.192 INFO:tasks.ceph.osd.11.trial154.stderr:==00:00:00:20.550 26173== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:26.232 INFO:tasks.ceph.osd.15.trial154.stderr:==00:00:00:20.591 26174== Warning: unimplemented fcntl command: 1038 2026-02-12T03:58:28.373 INFO:tasks.ceph.osd.4.trial091.stderr:2026-02-12T03:58:28.369+0000 787b4c0 -1 osd.4 0 log_to_monitors true 2026-02-12T03:58:28.375 INFO:tasks.ceph.osd.0.trial091.stderr:2026-02-12T03:58:28.372+0000 787b4c0 -1 osd.0 0 log_to_monitors true 2026-02-12T03:58:28.386 INFO:tasks.ceph.osd.9.trial098.stderr:2026-02-12T03:58:28.381+0000 787b4c0 -1 osd.9 0 log_to_monitors true 2026-02-12T03:58:28.412 INFO:tasks.ceph.osd.14.trial111.stderr:2026-02-12T03:58:28.407+0000 787b4c0 -1 osd.14 0 log_to_monitors true 2026-02-12T03:58:28.463 INFO:tasks.ceph.osd.6.trial111.stderr:2026-02-12T03:58:28.459+0000 787b4c0 -1 osd.6 0 log_to_monitors true 2026-02-12T03:58:28.490 INFO:tasks.ceph.osd.2.trial111.stderr:2026-02-12T03:58:28.485+0000 787b4c0 -1 osd.2 0 log_to_monitors true 2026-02-12T03:58:28.505 INFO:tasks.ceph.osd.13.trial098.stderr:2026-02-12T03:58:28.501+0000 787b4c0 -1 osd.13 0 log_to_monitors true 2026-02-12T03:58:28.506 INFO:tasks.ceph.osd.10.trial111.stderr:2026-02-12T03:58:28.502+0000 787b4c0 -1 osd.10 0 log_to_monitors true 2026-02-12T03:58:28.519 INFO:tasks.ceph.osd.5.trial098.stderr:2026-02-12T03:58:28.515+0000 787b4c0 -1 osd.5 0 log_to_monitors true 2026-02-12T03:58:28.592 INFO:tasks.ceph.osd.8.trial091.stderr:2026-02-12T03:58:28.588+0000 787b4c0 -1 osd.8 0 log_to_monitors true 2026-02-12T03:58:28.612 INFO:tasks.ceph.osd.12.trial091.stderr:2026-02-12T03:58:28.608+0000 787b4c0 -1 osd.12 0 log_to_monitors true 2026-02-12T03:58:28.647 INFO:tasks.ceph.osd.1.trial098.stderr:2026-02-12T03:58:28.644+0000 787b4c0 -1 osd.1 0 log_to_monitors true 2026-02-12T03:58:28.948 INFO:tasks.ceph.osd.3.trial154.stderr:2026-02-12T03:58:28.944+0000 787b4c0 -1 osd.3 0 log_to_monitors true 2026-02-12T03:58:29.084 INFO:tasks.ceph.osd.7.trial154.stderr:2026-02-12T03:58:29.079+0000 787b4c0 -1 osd.7 0 log_to_monitors true 2026-02-12T03:58:29.118 INFO:tasks.ceph.osd.11.trial154.stderr:2026-02-12T03:58:29.113+0000 787b4c0 -1 osd.11 0 log_to_monitors true 2026-02-12T03:58:29.156 INFO:tasks.ceph.osd.15.trial154.stderr:2026-02-12T03:58:29.152+0000 787b4c0 -1 osd.15 0 log_to_monitors true 2026-02-12T03:58:30.419 INFO:tasks.ceph.osd.13.trial098.stderr:2026-02-12T03:58:30.416+0000 df75640 -1 osd.13 0 waiting for initial osdmap 2026-02-12T03:58:30.434 INFO:tasks.ceph.osd.12.trial091.stderr:2026-02-12T03:58:30.430+0000 cf62640 -1 osd.12 0 waiting for initial osdmap 2026-02-12T03:58:30.436 INFO:tasks.ceph.osd.4.trial091.stderr:2026-02-12T03:58:30.433+0000 df75640 -1 osd.4 0 waiting for initial osdmap 2026-02-12T03:58:30.448 INFO:tasks.ceph.osd.10.trial111.stderr:2026-02-12T03:58:30.445+0000 cf62640 -1 osd.10 0 waiting for initial osdmap 2026-02-12T03:58:30.454 INFO:tasks.ceph.osd.5.trial098.stderr:2026-02-12T03:58:30.451+0000 cf62640 -1 osd.5 0 waiting for initial osdmap 2026-02-12T03:58:30.460 INFO:tasks.ceph.osd.6.trial111.stderr:2026-02-12T03:58:30.455+0000 df75640 -1 osd.6 0 waiting for initial osdmap 2026-02-12T03:58:30.465 INFO:tasks.ceph.osd.9.trial098.stderr:2026-02-12T03:58:30.462+0000 cf62640 -1 osd.9 0 waiting for initial osdmap 2026-02-12T03:58:30.466 INFO:tasks.ceph.osd.2.trial111.stderr:2026-02-12T03:58:30.462+0000 df75640 -1 osd.2 0 waiting for initial osdmap 2026-02-12T03:58:30.474 INFO:tasks.ceph.osd.14.trial111.stderr:2026-02-12T03:58:30.470+0000 df75640 -1 osd.14 0 waiting for initial osdmap 2026-02-12T03:58:30.475 INFO:tasks.ceph.osd.0.trial091.stderr:2026-02-12T03:58:30.473+0000 cf62640 -1 osd.0 0 waiting for initial osdmap 2026-02-12T03:58:30.480 INFO:tasks.ceph.osd.8.trial091.stderr:2026-02-12T03:58:30.478+0000 df75640 -1 osd.8 0 waiting for initial osdmap 2026-02-12T03:58:30.650 INFO:tasks.ceph.osd.13.trial098.stderr:2026-02-12T03:58:30.641+0000 1255d640 -1 osd.13 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T03:58:30.672 INFO:tasks.ceph.osd.4.trial091.stderr:2026-02-12T03:58:30.664+0000 1255d640 -1 osd.4 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T03:58:30.680 INFO:tasks.ceph.osd.10.trial111.stderr:2026-02-12T03:58:30.671+0000 1255d640 -1 osd.10 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T03:58:30.682 INFO:tasks.ceph.osd.12.trial091.stderr:2026-02-12T03:58:30.674+0000 1255d640 -1 osd.12 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T03:58:30.690 INFO:tasks.ceph.osd.6.trial111.stderr:2026-02-12T03:58:30.681+0000 16965640 -1 osd.6 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T03:58:30.695 INFO:tasks.ceph.osd.9.trial098.stderr:2026-02-12T03:58:30.686+0000 1255d640 -1 osd.9 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T03:58:30.697 INFO:tasks.ceph.osd.2.trial111.stderr:2026-02-12T03:58:30.689+0000 1255d640 -1 osd.2 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T03:58:30.702 INFO:tasks.ceph.osd.14.trial111.stderr:2026-02-12T03:58:30.694+0000 1255d640 -1 osd.14 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T03:58:30.702 INFO:tasks.ceph.osd.0.trial091.stderr:2026-02-12T03:58:30.695+0000 1255d640 -1 osd.0 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T03:58:30.703 INFO:tasks.ceph.osd.5.trial098.stderr:2026-02-12T03:58:30.695+0000 1255d640 -1 osd.5 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T03:58:30.711 INFO:tasks.ceph.osd.8.trial091.stderr:2026-02-12T03:58:30.703+0000 16965640 -1 osd.8 20 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T03:58:31.304 DEBUG:teuthology.orchestra.run.trial091:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-12T03:58:31.364 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.362+0000 7f1d75d4b640 10 monclient: get_monmap_and_config 2026-02-12T03:58:31.365 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.363+0000 7f1d75d4b640 10 monclient: build_initial_monmap 2026-02-12T03:58:31.365 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.363+0000 7f1d75d4b640 10 monclient: monmap: 2026-02-12T03:58:31.365 INFO:teuthology.misc.health.trial091.stderr:epoch 0 2026-02-12T03:58:31.365 INFO:teuthology.misc.health.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:31.365 INFO:teuthology.misc.health.trial091.stderr:last_changed 2026-02-12T03:58:31.363582+0000 2026-02-12T03:58:31.365 INFO:teuthology.misc.health.trial091.stderr:created 2026-02-12T03:58:31.363582+0000 2026-02-12T03:58:31.365 INFO:teuthology.misc.health.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:31.365 INFO:teuthology.misc.health.trial091.stderr:election_strategy: 3 2026-02-12T03:58:31.365 INFO:teuthology.misc.health.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:31.365 INFO:teuthology.misc.health.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:31.366 INFO:teuthology.misc.health.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:31.366 INFO:teuthology.misc.health.trial091.stderr: 2026-02-12T03:58:31.367 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.363+0000 7f1d75d4b640 1 Processor -- start 2026-02-12T03:58:31.367 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.363+0000 7f1d75d4b640 1 -- start start 2026-02-12T03:58:31.367 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.363+0000 7f1d75d4b640 10 monclient: init 2026-02-12T03:58:31.368 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.364+0000 7f1d75d4b640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:31.368 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.364+0000 7f1d75d4b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T03:58:31.368 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.364+0000 7f1d75d4b640 10 monclient(hunting): picked mon.noname-b con 0x7f1d701575d0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:31.368 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.364+0000 7f1d75d4b640 10 monclient(hunting): picked mon.noname-a con 0x7f1d70163310 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:31.368 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.364+0000 7f1d75d4b640 10 monclient(hunting): picked mon.noname-c con 0x7f1d700560d0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:31.368 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.364+0000 7f1d75d4b640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d700b20b0 con 0x7f1d70163310 2026-02-12T03:58:31.368 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.364+0000 7f1d75d4b640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d700b2390 con 0x7f1d701575d0 2026-02-12T03:58:31.368 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.364+0000 7f1d75d4b640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d700b2670 con 0x7f1d700560d0 2026-02-12T03:58:31.368 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.364+0000 7f1d75d4b640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:31.368 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.364+0000 7f1d75d4b640 10 monclient(hunting): authenticate will time out at 1114.107171s 2026-02-12T03:58:31.368 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.364+0000 7f1d6f7fe640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f1d701575d0 0x7f1d70162c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:56914/0 (socket says 10.20.193.91:56914) 2026-02-12T03:58:31.369 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.364+0000 7f1d6f7fe640 1 -- 10.20.193.91:0/2140178968 learned_addr learned my addr 10.20.193.91:0/2140178968 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:31.437 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.435+0000 7f1d6e7fc640 1 -- 10.20.193.91:0/2140178968 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 52919722 0 0) 0x7f1d700b2390 con 0x7f1d701575d0 2026-02-12T03:58:31.437 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.435+0000 7f1d6e7fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:31.437 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.435+0000 7f1d6e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:31.437 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.435+0000 7f1d6e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:31.437 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.435+0000 7f1d6e7fc640 10 monclient(hunting): my global_id is 4348 2026-02-12T03:58:31.437 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.435+0000 7f1d6e7fc640 1 -- 10.20.193.91:0/2140178968 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d54003610 con 0x7f1d701575d0 2026-02-12T03:58:31.442 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.440+0000 7f1d6e7fc640 1 -- 10.20.193.91:0/2140178968 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1437448853 0 0) 0x7f1d54003610 con 0x7f1d701575d0 2026-02-12T03:58:31.442 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.440+0000 7f1d6e7fc640 1 -- 10.20.193.91:0/2140178968 >> v1:10.20.193.111:6789/0 conn(0x7f1d700560d0 legacy=0x7f1d701c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:31.442 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.440+0000 7f1d6e7fc640 1 -- 10.20.193.91:0/2140178968 >> v1:10.20.193.91:6789/0 conn(0x7f1d70163310 legacy=0x7f1d700559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:31.442 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.440+0000 7f1d6e7fc640 10 monclient: _finish_hunting 0 2026-02-12T03:58:31.442 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.440+0000 7f1d6e7fc640 1 monclient: found mon.noname-b 2026-02-12T03:58:31.443 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.440+0000 7f1d6e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:31.443 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.440+0000 7f1d6e7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T03:58:31.443 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.440+0000 7f1d6e7fc640 1 -- 10.20.193.91:0/2140178968 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d70162400 con 0x7f1d701575d0 2026-02-12T03:58:31.443 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.440+0000 7f1d6e7fc640 10 monclient: _finish_auth 0 2026-02-12T03:58:31.443 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.440+0000 7f1d6e7fc640 10 monclient: _check_auth_tickets 2026-02-12T03:58:31.443 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.440+0000 7f1d6e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:31.443 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.440+0000 7f1d6e7fc640 1 -- 10.20.193.91:0/2140178968 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f1d5c002df0 con 0x7f1d701575d0 2026-02-12T03:58:31.443 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.440+0000 7f1d6e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:31.443 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.440+0000 7f1d6e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:31.443 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.440+0000 7f1d6e7fc640 10 monclient: dump: 2026-02-12T03:58:31.443 INFO:teuthology.misc.health.trial091.stderr:epoch 1 2026-02-12T03:58:31.443 INFO:teuthology.misc.health.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:31.444 INFO:teuthology.misc.health.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:31.444 INFO:teuthology.misc.health.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:31.444 INFO:teuthology.misc.health.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:31.444 INFO:teuthology.misc.health.trial091.stderr:election_strategy: 3 2026-02-12T03:58:31.444 INFO:teuthology.misc.health.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:31.444 INFO:teuthology.misc.health.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:31.444 INFO:teuthology.misc.health.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:31.444 INFO:teuthology.misc.health.trial091.stderr: 2026-02-12T03:58:31.444 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.440+0000 7f1d75d4b640 5 monclient: authenticate success, global_id 4348 2026-02-12T03:58:31.444 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.440+0000 7f1d75d4b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:31.447 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.441+0000 7f1d6e7fc640 1 -- 10.20.193.91:0/2140178968 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1d5c003000 con 0x7f1d701575d0 2026-02-12T03:58:31.447 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.441+0000 7f1d6e7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:31.447 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.441+0000 7f1d6e7fc640 1 -- 10.20.193.91:0/2140178968 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f1d5c003440 con 0x7f1d701575d0 2026-02-12T03:58:31.448 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.441+0000 7f1d6e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:31.448 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.441+0000 7f1d6e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:31.448 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.441+0000 7f1d6e7fc640 10 monclient: dump: 2026-02-12T03:58:31.448 INFO:teuthology.misc.health.trial091.stderr:epoch 1 2026-02-12T03:58:31.448 INFO:teuthology.misc.health.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:31.448 INFO:teuthology.misc.health.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:31.448 INFO:teuthology.misc.health.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:31.448 INFO:teuthology.misc.health.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:31.448 INFO:teuthology.misc.health.trial091.stderr:election_strategy: 3 2026-02-12T03:58:31.448 INFO:teuthology.misc.health.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:31.448 INFO:teuthology.misc.health.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:31.448 INFO:teuthology.misc.health.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:31.449 INFO:teuthology.misc.health.trial091.stderr: 2026-02-12T03:58:31.449 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.441+0000 7f1d75d4b640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:31.449 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.441+0000 7f1d75d4b640 4 set_mon_vals no callback set 2026-02-12T03:58:31.449 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.441+0000 7f1d75d4b640 10 monclient: shutdown 2026-02-12T03:58:31.449 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.441+0000 7f1d75d4b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:31.449 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.441+0000 7f1d75d4b640 1 -- 10.20.193.91:0/2140178968 >> v1:10.20.193.98:6789/0 conn(0x7f1d701575d0 legacy=0x7f1d70162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:31.449 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.441+0000 7f1d75d4b640 1 -- 10.20.193.91:0/2140178968 shutdown_connections 2026-02-12T03:58:31.449 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.441+0000 7f1d75d4b640 1 -- 10.20.193.91:0/2140178968 >> 10.20.193.91:0/2140178968 conn(0x7f1d700b6560 msgr2=0x7f1d700b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:31.449 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.441+0000 7f1d75d4b640 1 -- 10.20.193.91:0/2140178968 shutdown_connections 2026-02-12T03:58:31.449 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.441+0000 7f1d75d4b640 1 -- 10.20.193.91:0/2140178968 wait complete. 2026-02-12T03:58:31.449 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.442+0000 7f1d75d4b640 10 monclient: build_initial_monmap 2026-02-12T03:58:31.449 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.442+0000 7f1d75d4b640 10 monclient: monmap: 2026-02-12T03:58:31.450 INFO:teuthology.misc.health.trial091.stderr:epoch 0 2026-02-12T03:58:31.450 INFO:teuthology.misc.health.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:31.450 INFO:teuthology.misc.health.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:31.450 INFO:teuthology.misc.health.trial091.stderr:created 0.000000 2026-02-12T03:58:31.450 INFO:teuthology.misc.health.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:31.450 INFO:teuthology.misc.health.trial091.stderr:election_strategy: 1 2026-02-12T03:58:31.450 INFO:teuthology.misc.health.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:31.450 INFO:teuthology.misc.health.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:31.450 INFO:teuthology.misc.health.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:31.450 INFO:teuthology.misc.health.trial091.stderr: 2026-02-12T03:58:31.450 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.442+0000 7f1d75d4b640 1 librados: starting msgr at 2026-02-12T03:58:31.450 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.442+0000 7f1d75d4b640 1 librados: starting objecter 2026-02-12T03:58:31.450 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.442+0000 7f1d75d4b640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:31.451 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.442+0000 7f1d75d4b640 1 Processor -- start 2026-02-12T03:58:31.451 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.442+0000 7f1d75d4b640 1 -- start start 2026-02-12T03:58:31.451 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.442+0000 7f1d75d4b640 1 librados: setting wanted keys 2026-02-12T03:58:31.451 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.442+0000 7f1d75d4b640 1 librados: calling monclient init 2026-02-12T03:58:31.451 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.442+0000 7f1d75d4b640 10 monclient: init 2026-02-12T03:58:31.451 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.443+0000 7f1d75d4b640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:31.451 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.443+0000 7f1d75d4b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T03:58:31.451 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.443+0000 7f1d75d4b640 10 monclient(hunting): picked mon.noname-c con 0x7f1d700560d0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:31.451 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.443+0000 7f1d75d4b640 10 monclient(hunting): picked mon.noname-a con 0x7f1d701575d0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:31.451 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.443+0000 7f1d75d4b640 10 monclient(hunting): picked mon.noname-b con 0x7f1d70163310 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:31.451 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.443+0000 7f1d75d4b640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d70155770 con 0x7f1d701575d0 2026-02-12T03:58:31.451 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.443+0000 7f1d75d4b640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d700b0060 con 0x7f1d70163310 2026-02-12T03:58:31.452 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.443+0000 7f1d75d4b640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d700b0340 con 0x7f1d700560d0 2026-02-12T03:58:31.452 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.443+0000 7f1d75d4b640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:31.452 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.443+0000 7f1d75d4b640 10 monclient(hunting): authenticate will time out at 1114.186179s 2026-02-12T03:58:31.452 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.443+0000 7f1d6ffff640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f1d70163310 0x7f1d700af5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:56928/0 (socket says 10.20.193.91:56928) 2026-02-12T03:58:31.452 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.443+0000 7f1d6ffff640 1 -- 10.20.193.91:0/2393629279 learned_addr learned my addr 10.20.193.91:0/2393629279 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:31.452 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.443+0000 7f1d4bfff640 10 client.?.objecter ms_handle_connect 0x7f1d70163310 2026-02-12T03:58:31.452 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.443+0000 7f1d4bfff640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:31.452 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.444+0000 7f1d4bfff640 1 -- 10.20.193.91:0/2393629279 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3009025954 0 0) 0x7f1d700b0060 con 0x7f1d70163310 2026-02-12T03:58:31.452 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.444+0000 7f1d4bfff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:31.452 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.444+0000 7f1d4bfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:31.452 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.444+0000 7f1d4bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:31.452 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.444+0000 7f1d4bfff640 10 monclient(hunting): my global_id is 4351 2026-02-12T03:58:31.453 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.444+0000 7f1d4bfff640 1 -- 10.20.193.91:0/2393629279 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d40003610 con 0x7f1d70163310 2026-02-12T03:58:31.453 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.447+0000 7f1d4bfff640 1 -- 10.20.193.91:0/2393629279 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3781595790 0 0) 0x7f1d40003610 con 0x7f1d70163310 2026-02-12T03:58:31.453 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.447+0000 7f1d4bfff640 1 -- 10.20.193.91:0/2393629279 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1d700b0060 con 0x7f1d70163310 2026-02-12T03:58:31.453 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.447+0000 7f1d4bfff640 1 -- 10.20.193.91:0/2393629279 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f1d64003400 con 0x7f1d70163310 2026-02-12T03:58:31.454 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.447+0000 7f1d4bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:31.454 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.447+0000 7f1d4bfff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:31.454 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.447+0000 7f1d4bfff640 10 monclient(hunting): dump: 2026-02-12T03:58:31.454 INFO:teuthology.misc.health.trial091.stderr:epoch 1 2026-02-12T03:58:31.454 INFO:teuthology.misc.health.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:31.454 INFO:teuthology.misc.health.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:31.454 INFO:teuthology.misc.health.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:31.454 INFO:teuthology.misc.health.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:31.454 INFO:teuthology.misc.health.trial091.stderr:election_strategy: 3 2026-02-12T03:58:31.454 INFO:teuthology.misc.health.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:31.454 INFO:teuthology.misc.health.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:31.455 INFO:teuthology.misc.health.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:31.455 INFO:teuthology.misc.health.trial091.stderr: 2026-02-12T03:58:31.455 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.447+0000 7f1d4bfff640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:31.463 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.461+0000 7f1d4bfff640 10 client.?.objecter ms_handle_connect 0x7f1d701575d0 2026-02-12T03:58:31.463 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.461+0000 7f1d4bfff640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:31.465 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.463+0000 7f1d4bfff640 1 -- 10.20.193.91:0/2393629279 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1653204394 0 0) 0x7f1d70155770 con 0x7f1d701575d0 2026-02-12T03:58:31.465 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.463+0000 7f1d4bfff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:31.465 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.463+0000 7f1d4bfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:31.465 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.463+0000 7f1d4bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:31.465 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.463+0000 7f1d4bfff640 10 monclient(hunting): my global_id is 4347 2026-02-12T03:58:31.465 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.463+0000 7f1d4bfff640 1 -- 10.20.193.91:0/2393629279 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d40003610 con 0x7f1d701575d0 2026-02-12T03:58:31.467 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.466+0000 7f1d4bfff640 1 -- 10.20.193.91:0/2393629279 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 229392575 0 0) 0x7f1d40003610 con 0x7f1d701575d0 2026-02-12T03:58:31.467 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.466+0000 7f1d4bfff640 1 -- 10.20.193.91:0/2393629279 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1d70155770 con 0x7f1d701575d0 2026-02-12T03:58:31.468 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.466+0000 7f1d4bfff640 1 -- 10.20.193.91:0/2393629279 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f1d60002fc0 con 0x7f1d701575d0 2026-02-12T03:58:31.468 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.466+0000 7f1d4bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:31.468 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.466+0000 7f1d4bfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:31.468 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.466+0000 7f1d4bfff640 10 monclient(hunting): dump: 2026-02-12T03:58:31.468 INFO:teuthology.misc.health.trial091.stderr:epoch 1 2026-02-12T03:58:31.468 INFO:teuthology.misc.health.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:31.468 INFO:teuthology.misc.health.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:31.468 INFO:teuthology.misc.health.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:31.468 INFO:teuthology.misc.health.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:31.468 INFO:teuthology.misc.health.trial091.stderr:election_strategy: 3 2026-02-12T03:58:31.468 INFO:teuthology.misc.health.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:31.469 INFO:teuthology.misc.health.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:31.469 INFO:teuthology.misc.health.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:31.469 INFO:teuthology.misc.health.trial091.stderr: 2026-02-12T03:58:31.470 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.467+0000 7f1d4bfff640 1 -- 10.20.193.91:0/2393629279 <== mon.1 v1:10.20.193.98:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2787852573 0 0) 0x7f1d700b0060 con 0x7f1d70163310 2026-02-12T03:58:31.470 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.467+0000 7f1d4bfff640 1 -- 10.20.193.91:0/2393629279 >> v1:10.20.193.111:6789/0 conn(0x7f1d700560d0 legacy=0x7f1d70155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:31.470 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.467+0000 7f1d4bfff640 1 -- 10.20.193.91:0/2393629279 >> v1:10.20.193.91:6789/0 conn(0x7f1d701575d0 legacy=0x7f1d700ad860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:31.470 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.467+0000 7f1d4bfff640 10 monclient: _finish_hunting 0 2026-02-12T03:58:31.471 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.467+0000 7f1d4bfff640 1 monclient: found mon.b 2026-02-12T03:58:31.471 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.467+0000 7f1d4bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:31.471 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.467+0000 7f1d4bfff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:31.471 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.467+0000 7f1d4bfff640 1 -- 10.20.193.91:0/2393629279 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d700b0620 con 0x7f1d70163310 2026-02-12T03:58:31.471 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.467+0000 7f1d4bfff640 10 monclient: _finish_auth 0 2026-02-12T03:58:31.471 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.467+0000 7f1d4bfff640 10 monclient: _check_auth_tickets 2026-02-12T03:58:31.471 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.467+0000 7f1d4bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:31.471 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.467+0000 7f1d75d4b640 5 monclient: authenticate success, global_id 4351 2026-02-12T03:58:31.471 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.467+0000 7f1d75d4b640 10 monclient: _renew_subs 2026-02-12T03:58:31.471 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.467+0000 7f1d75d4b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:31.471 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.467+0000 7f1d75d4b640 1 -- 10.20.193.91:0/2393629279 --> v1:10.20.193.98:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1d70139ac0 con 0x7f1d70163310 2026-02-12T03:58:31.472 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.467+0000 7f1d75d4b640 10 client.4351.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:31.472 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.467+0000 7f1d75d4b640 10 monclient: _renew_subs 2026-02-12T03:58:31.472 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.467+0000 7f1d75d4b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:31.472 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.467+0000 7f1d75d4b640 1 -- 10.20.193.91:0/2393629279 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1d700afcc0 con 0x7f1d70163310 2026-02-12T03:58:31.472 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.467+0000 7f1d75d4b640 1 librados: init done 2026-02-12T03:58:31.472 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.468+0000 7f1d75d4b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:31.472 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.468+0000 7f1d75d4b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:31.472 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.468+0000 7f1d75d4b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:31.472 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.468+0000 7f1d75d4b640 1 -- 10.20.193.91:0/2393629279 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d700b7290 con 0x7f1d70163310 2026-02-12T03:58:31.502 INFO:tasks.ceph.osd.15.trial154.stderr:2026-02-12T03:58:31.499+0000 cf62640 -1 osd.15 0 waiting for initial osdmap 2026-02-12T03:58:31.521 INFO:tasks.ceph.osd.7.trial154.stderr:2026-02-12T03:58:31.517+0000 cf62640 -1 osd.7 0 waiting for initial osdmap 2026-02-12T03:58:31.527 INFO:tasks.ceph.osd.3.trial154.stderr:2026-02-12T03:58:31.524+0000 df75640 -1 osd.3 0 waiting for initial osdmap 2026-02-12T03:58:31.538 INFO:tasks.ceph.osd.11.trial154.stderr:2026-02-12T03:58:31.534+0000 cf62640 -1 osd.11 0 waiting for initial osdmap 2026-02-12T03:58:31.541 INFO:tasks.ceph.osd.1.trial098.stderr:2026-02-12T03:58:31.536+0000 cf62640 -1 osd.1 0 waiting for initial osdmap 2026-02-12T03:58:31.576 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.574+0000 7f1d4bfff640 1 -- 10.20.193.91:0/2393629279 <== mon.1 v1:10.20.193.98:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1d64003a80 con 0x7f1d70163310 2026-02-12T03:58:31.576 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.574+0000 7f1d4bfff640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:31.576 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.574+0000 7f1d4bfff640 1 -- 10.20.193.91:0/2393629279 <== mon.1 v1:10.20.193.98:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f1d64003e90 con 0x7f1d70163310 2026-02-12T03:58:31.576 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.574+0000 7f1d4bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:31.576 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.574+0000 7f1d4bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:31.576 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.574+0000 7f1d4bfff640 10 monclient: dump: 2026-02-12T03:58:31.576 INFO:teuthology.misc.health.trial091.stderr:epoch 1 2026-02-12T03:58:31.576 INFO:teuthology.misc.health.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:31.576 INFO:teuthology.misc.health.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:31.577 INFO:teuthology.misc.health.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:31.577 INFO:teuthology.misc.health.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:31.577 INFO:teuthology.misc.health.trial091.stderr:election_strategy: 3 2026-02-12T03:58:31.577 INFO:teuthology.misc.health.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:31.577 INFO:teuthology.misc.health.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:31.577 INFO:teuthology.misc.health.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:31.577 INFO:teuthology.misc.health.trial091.stderr: 2026-02-12T03:58:31.577 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.574+0000 7f1d6dffb640 4 set_mon_vals no callback set 2026-02-12T03:58:31.578 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.575+0000 7f1d4bfff640 1 -- 10.20.193.91:0/2393629279 <== mon.1 v1:10.20.193.98:6789/0 7 ==== mgrmap(e 4) ==== 103168+0+0 (unknown 3733604615 0 0) 0x7f1d64004070 con 0x7f1d70163310 2026-02-12T03:58:31.578 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.575+0000 7f1d6f7fe640 10 monclient: get_auth_request con 0x7f1d40079e50 auth_method 0 2026-02-12T03:58:31.578 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.575+0000 7f1d4bfff640 10 client.4351.objecter ms_handle_connect 0x7f1d40079e50 2026-02-12T03:58:31.578 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.576+0000 7f1d4bfff640 1 -- 10.20.193.91:0/2393629279 <== mon.1 v1:10.20.193.98:6789/0 8 ==== osd_map(21..21 src has 1..21) ==== 6668+0+0 (unknown 3095839785 0 0) 0x7f1d640958f0 con 0x7f1d70163310 2026-02-12T03:58:31.579 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.576+0000 7f1d4bfff640 10 client.4351.objecter ms_dispatch2 0x7f1d70000b90 osd_map(21..21 src has 1..21) 2026-02-12T03:58:31.579 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.576+0000 7f1d4bfff640 3 client.4351.objecter handle_osd_map got epochs [21,21] > 0 2026-02-12T03:58:31.579 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.576+0000 7f1d4bfff640 3 client.4351.objecter handle_osd_map decoding full epoch 21 2026-02-12T03:58:31.579 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.576+0000 7f1d4bfff640 20 client.4351.objecter dump_active .. 0 homeless 2026-02-12T03:58:31.580 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.579+0000 7f1d4bfff640 1 -- 10.20.193.91:0/2393629279 <== mon.1 v1:10.20.193.98:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f1d6405f780 con 0x7f1d70163310 2026-02-12T03:58:31.581 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.579+0000 7f1d4bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:31.581 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.579+0000 7f1d4bfff640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:31.689 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.687+0000 7f1d75d4b640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-12T03:58:31.690 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.687+0000 7f1d75d4b640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T03:58:31.690 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.687+0000 7f1d75d4b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:31.690 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.687+0000 7f1d75d4b640 1 -- 10.20.193.91:0/2393629279 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1d700b31e0 con 0x7f1d70163310 2026-02-12T03:58:31.699 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.697+0000 7f1d4bfff640 1 -- 10.20.193.91:0/2393629279 <== mon.1 v1:10.20.193.98:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+15482 (unknown 898900276 0 3778584149) 0x7f1d6405f080 con 0x7f1d70163310 2026-02-12T03:58:31.699 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.697+0000 7f1d4bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T03:58:31.699 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.697+0000 7f1d4bfff640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:31.700 INFO:teuthology.misc.health.trial091.stdout: 2026-02-12T03:58:31.700 INFO:teuthology.misc.health.trial091.stdout:{"epoch":21,"fsid":"1e356fcf-3d61-462e-a451-82f8dd01e1f3","created":"2026-02-12T03:57:59.014379+0000","modified":"2026-02-12T03:58:31.276700+0000","last_up_change":"2026-02-12T03:58:31.276700+0000","last_in_change":"2026-02-12T03:58:05.455425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"791c97c5-83f6-4024-9f43-ff3b2ee22a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6801","nonce":1203233578}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6802","nonce":1203233578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6804","nonce":1203233578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6803","nonce":1203233578}]},"public_addr":"10.20.193.91:6801/1203233578","cluster_addr":"10.20.193.91:6802/1203233578","heartbeat_back_addr":"10.20.193.91:6804/1203233578","heartbeat_front_addr":"10.20.193.91:6803/1203233578","state":["exists","up"]},{"osd":1,"uuid":"0cf561d6-85aa-428a-bc69-83ce77b1c802","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b3dc78b9-cae6-4b1f-931f-7352a43b9e26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6812","nonce":350848222}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6813","nonce":350848222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6815","nonce":350848222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6814","nonce":350848222}]},"public_addr":"10.20.193.111:6812/350848222","cluster_addr":"10.20.193.111:6813/350848222","heartbeat_back_addr":"10.20.193.111:6815/350848222","heartbeat_front_addr":"10.20.193.111:6814/350848222","state":["exists","up"]},{"osd":3,"uuid":"e164e3ae-cf6a-45ff-b126-3ac739c5b1be","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5583cc8c-83d4-42b4-a997-c056f3b145a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6805","nonce":1766507926}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6806","nonce":1766507926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6808","nonce":1766507926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6807","nonce":1766507926}]},"public_addr":"10.20.193.91:6805/1766507926","cluster_addr":"10.20.193.91:6806/1766507926","heartbeat_back_addr":"10.20.193.91:6808/1766507926","heartbeat_front_addr":"10.20.193.91:6807/1766507926","state":["exists","up"]},{"osd":5,"uuid":"d7bb6fa1-b042-4dce-9644-00e817a5bc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6808","nonce":3918277953}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6809","nonce":3918277953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6811","nonce":3918277953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6810","nonce":3918277953}]},"public_addr":"10.20.193.98:6808/3918277953","cluster_addr":"10.20.193.98:6809/3918277953","heartbeat_back_addr":"10.20.193.98:6811/3918277953","heartbeat_front_addr":"10.20.193.98:6810/3918277953","state":["exists","up"]},{"osd":6,"uuid":"93cd9edf-a000-4d22-8da7-52f4bd547765","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6804","nonce":727190484}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6805","nonce":727190484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6807","nonce":727190484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6806","nonce":727190484}]},"public_addr":"10.20.193.111:6804/727190484","cluster_addr":"10.20.193.111:6805/727190484","heartbeat_back_addr":"10.20.193.111:6807/727190484","heartbeat_front_addr":"10.20.193.111:6806/727190484","state":["exists","up"]},{"osd":7,"uuid":"f5e11a47-d746-46ca-85f1-27d3bc586371","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"bb8207ce-22b9-46be-9c89-c77f2690e405","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6809","nonce":443384425}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6810","nonce":443384425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6812","nonce":443384425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6811","nonce":443384425}]},"public_addr":"10.20.193.91:6809/443384425","cluster_addr":"10.20.193.91:6810/443384425","heartbeat_back_addr":"10.20.193.91:6812/443384425","heartbeat_front_addr":"10.20.193.91:6811/443384425","state":["exists","up"]},{"osd":9,"uuid":"e6318a6d-2367-48ce-a3a1-47307de14b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6801","nonce":4165741185}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6804","nonce":4165741185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6807","nonce":4165741185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6806","nonce":4165741185}]},"public_addr":"10.20.193.98:6801/4165741185","cluster_addr":"10.20.193.98:6804/4165741185","heartbeat_back_addr":"10.20.193.98:6807/4165741185","heartbeat_front_addr":"10.20.193.98:6806/4165741185","state":["exists","up"]},{"osd":10,"uuid":"cd6c97a2-bdfe-4b86-afeb-217315976d6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6808","nonce":1268343515}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6809","nonce":1268343515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6811","nonce":1268343515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6810","nonce":1268343515}]},"public_addr":"10.20.193.111:6808/1268343515","cluster_addr":"10.20.193.111:6809/1268343515","heartbeat_back_addr":"10.20.193.111:6811/1268343515","heartbeat_front_addr":"10.20.193.111:6810/1268343515","state":["exists","up"]},{"osd":11,"uuid":"b6c647bb-4e86-4b0e-b79c-b0236a780a66","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"19bb3570-0c0a-48cc-a0b8-ec3194f30fa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6813","nonce":3587007397}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6814","nonce":3587007397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6816","nonce":3587007397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6815","nonce":3587007397}]},"public_addr":"10.20.193.91:6813/3587007397","cluster_addr":"10.20.193.91:6814/3587007397","heartbeat_back_addr":"10.20.193.91:6816/3587007397","heartbeat_front_addr":"10.20.193.91:6815/3587007397","state":["exists","up"]},{"osd":13,"uuid":"a8215062-521c-47f6-b20a-9e40c1f3f5a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6800","nonce":1665089474}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6802","nonce":1665089474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6805","nonce":1665089474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6803","nonce":1665089474}]},"public_addr":"10.20.193.98:6800/1665089474","cluster_addr":"10.20.193.98:6802/1665089474","heartbeat_back_addr":"10.20.193.98:6805/1665089474","heartbeat_front_addr":"10.20.193.98:6803/1665089474","state":["exists","up"]},{"osd":14,"uuid":"3cd1bb48-53a2-462e-b7e5-4d6d918dd543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6800","nonce":1665676360}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6801","nonce":1665676360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6803","nonce":1665676360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6802","nonce":1665676360}]},"public_addr":"10.20.193.111:6800/1665676360","cluster_addr":"10.20.193.111:6801/1665676360","heartbeat_back_addr":"10.20.193.111:6803/1665676360","heartbeat_front_addr":"10.20.193.111:6802/1665676360","state":["exists","up"]},{"osd":15,"uuid":"9bd39438-f5e5-4a19-afa4-678395d63c24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T03:58:31.702 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.699+0000 7f1d75d4b640 10 librados: watch_flush enter 2026-02-12T03:58:31.702 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.699+0000 7f1d75d4b640 10 librados: watch_flush exit 2026-02-12T03:58:31.702 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.699+0000 7f1d75d4b640 20 client.4351.objecter shutdown clearing up homeless session... 2026-02-12T03:58:31.702 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.699+0000 7f1d75d4b640 10 client.4351.objecter successfully canceled tick 2026-02-12T03:58:31.702 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.699+0000 7f1d75d4b640 1 -- 10.20.193.91:0/2393629279 >> v1:10.20.193.91:6800/2929217192 conn(0x7f1d40079e50 legacy=0x7f1d4009a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:31.702 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.699+0000 7f1d75d4b640 10 monclient: shutdown 2026-02-12T03:58:31.702 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.699+0000 7f1d75d4b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:31.702 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.699+0000 7f1d75d4b640 1 -- 10.20.193.91:0/2393629279 >> v1:10.20.193.98:6789/0 conn(0x7f1d70163310 legacy=0x7f1d700af5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:31.702 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.699+0000 7f1d75d4b640 1 -- 10.20.193.91:0/2393629279 shutdown_connections 2026-02-12T03:58:31.703 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.699+0000 7f1d75d4b640 1 -- 10.20.193.91:0/2393629279 >> 10.20.193.91:0/2393629279 conn(0x7f1d700b6560 msgr2=0x7f1d701637a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:31.703 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.699+0000 7f1d75d4b640 1 -- 10.20.193.91:0/2393629279 shutdown_connections 2026-02-12T03:58:31.703 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.699+0000 7f1d75d4b640 1 -- 10.20.193.91:0/2393629279 wait complete. 2026-02-12T03:58:31.703 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:31.699+0000 7f1d75d4b640 1 librados: shutdown 2026-02-12T03:58:31.709 DEBUG:teuthology.misc:11 of 16 OSDs are up 2026-02-12T03:58:31.771 INFO:tasks.ceph.osd.7.trial154.stderr:2026-02-12T03:58:31.762+0000 16565640 -1 osd.7 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T03:58:31.778 INFO:tasks.ceph.osd.15.trial154.stderr:2026-02-12T03:58:31.768+0000 16965640 -1 osd.15 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T03:58:31.782 INFO:tasks.ceph.osd.11.trial154.stderr:2026-02-12T03:58:31.773+0000 16565640 -1 osd.11 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T03:58:31.810 INFO:tasks.ceph.osd.3.trial154.stderr:2026-02-12T03:58:31.800+0000 16565640 -1 osd.3 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T03:58:31.821 INFO:tasks.ceph.osd.1.trial098.stderr:2026-02-12T03:58:31.813+0000 16965640 -1 osd.1 21 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T03:58:39.322 DEBUG:teuthology.orchestra.run.trial091:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-12T03:58:39.383 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.381+0000 7f5fb84f3640 10 monclient: get_monmap_and_config 2026-02-12T03:58:39.383 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.381+0000 7f5fb84f3640 10 monclient: build_initial_monmap 2026-02-12T03:58:39.383 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.381+0000 7f5fb84f3640 10 monclient: monmap: 2026-02-12T03:58:39.383 INFO:teuthology.misc.health.trial091.stderr:epoch 0 2026-02-12T03:58:39.384 INFO:teuthology.misc.health.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:39.384 INFO:teuthology.misc.health.trial091.stderr:last_changed 2026-02-12T03:58:39.381825+0000 2026-02-12T03:58:39.384 INFO:teuthology.misc.health.trial091.stderr:created 2026-02-12T03:58:39.381825+0000 2026-02-12T03:58:39.384 INFO:teuthology.misc.health.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:39.384 INFO:teuthology.misc.health.trial091.stderr:election_strategy: 3 2026-02-12T03:58:39.384 INFO:teuthology.misc.health.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:39.384 INFO:teuthology.misc.health.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:39.384 INFO:teuthology.misc.health.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:39.384 INFO:teuthology.misc.health.trial091.stderr: 2026-02-12T03:58:39.384 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.381+0000 7f5fb84f3640 1 Processor -- start 2026-02-12T03:58:39.384 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.381+0000 7f5fb84f3640 1 -- start start 2026-02-12T03:58:39.385 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.381+0000 7f5fb84f3640 10 monclient: init 2026-02-12T03:58:39.386 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.382+0000 7f5fb84f3640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:39.386 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.382+0000 7f5fb84f3640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T03:58:39.386 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.382+0000 7f5fb84f3640 10 monclient(hunting): picked mon.noname-c con 0x7f5fb01575d0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:39.386 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.382+0000 7f5fb84f3640 10 monclient(hunting): picked mon.noname-b con 0x7f5fb0163310 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:39.386 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.382+0000 7f5fb84f3640 10 monclient(hunting): picked mon.noname-a con 0x7f5fb00560d0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:39.387 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.382+0000 7f5fb84f3640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fb00b20b0 con 0x7f5fb00560d0 2026-02-12T03:58:39.387 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.382+0000 7f5fb84f3640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fb00b2390 con 0x7f5fb0163310 2026-02-12T03:58:39.387 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.382+0000 7f5fb84f3640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fb00b2670 con 0x7f5fb01575d0 2026-02-12T03:58:39.387 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.382+0000 7f5fb84f3640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:39.387 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.382+0000 7f5fb84f3640 10 monclient(hunting): authenticate will time out at 1122.125247s 2026-02-12T03:58:39.387 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.382+0000 7f5fb6a69640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f5fb00560d0 0x7f5fb01c56f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:39080/0 (socket says 10.20.193.91:39080) 2026-02-12T03:58:39.387 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.382+0000 7f5fb6a69640 1 -- 10.20.193.91:0/1296481482 learned_addr learned my addr 10.20.193.91:0/1296481482 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:39.387 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.383+0000 7f5fb5266640 1 -- 10.20.193.91:0/1296481482 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3828302693 0 0) 0x7f5fb00b20b0 con 0x7f5fb00560d0 2026-02-12T03:58:39.387 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.383+0000 7f5fb5266640 10 monclient(hunting): _negotiate 2026-02-12T03:58:39.387 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.383+0000 7f5fb5266640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:39.387 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.383+0000 7f5fb5266640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:39.387 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.383+0000 7f5fb5266640 10 monclient(hunting): my global_id is 4359 2026-02-12T03:58:39.388 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.383+0000 7f5fb5266640 1 -- 10.20.193.91:0/1296481482 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f98003610 con 0x7f5fb00560d0 2026-02-12T03:58:39.392 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.385+0000 7f5fb5266640 1 -- 10.20.193.91:0/1296481482 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1409763973 0 0) 0x7f5f98003610 con 0x7f5fb00560d0 2026-02-12T03:58:39.392 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.385+0000 7f5fb5266640 1 -- 10.20.193.91:0/1296481482 >> v1:10.20.193.111:6789/0 conn(0x7f5fb01575d0 legacy=0x7f5fb0162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:39.393 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.385+0000 7f5fb5266640 1 -- 10.20.193.91:0/1296481482 >> v1:10.20.193.98:6789/0 conn(0x7f5fb0163310 legacy=0x7f5fb00559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:39.393 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.385+0000 7f5fb5266640 10 monclient: _finish_hunting 0 2026-02-12T03:58:39.393 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.385+0000 7f5fb5266640 1 monclient: found mon.noname-a 2026-02-12T03:58:39.393 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.385+0000 7f5fb5266640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:39.393 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.385+0000 7f5fb5266640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.91:6789/0 2026-02-12T03:58:39.393 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.385+0000 7f5fb5266640 1 -- 10.20.193.91:0/1296481482 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fb0162400 con 0x7f5fb00560d0 2026-02-12T03:58:39.393 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.385+0000 7f5fb5266640 10 monclient: _finish_auth 0 2026-02-12T03:58:39.393 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.385+0000 7f5fb5266640 10 monclient: _check_auth_tickets 2026-02-12T03:58:39.393 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.385+0000 7f5fb5266640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:39.393 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.385+0000 7f5fb5266640 1 -- 10.20.193.91:0/1296481482 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f5fac003170 con 0x7f5fb00560d0 2026-02-12T03:58:39.393 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.385+0000 7f5fb5266640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:39.393 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.385+0000 7f5fb5266640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:39.394 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.385+0000 7f5fb5266640 10 monclient: dump: 2026-02-12T03:58:39.394 INFO:teuthology.misc.health.trial091.stderr:epoch 1 2026-02-12T03:58:39.394 INFO:teuthology.misc.health.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:39.394 INFO:teuthology.misc.health.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:39.394 INFO:teuthology.misc.health.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:39.394 INFO:teuthology.misc.health.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:39.394 INFO:teuthology.misc.health.trial091.stderr:election_strategy: 3 2026-02-12T03:58:39.394 INFO:teuthology.misc.health.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:39.394 INFO:teuthology.misc.health.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:39.394 INFO:teuthology.misc.health.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:39.394 INFO:teuthology.misc.health.trial091.stderr: 2026-02-12T03:58:39.395 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.385+0000 7f5fb84f3640 5 monclient: authenticate success, global_id 4359 2026-02-12T03:58:39.395 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.385+0000 7f5fb84f3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:39.395 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.386+0000 7f5fb5266640 1 -- 10.20.193.91:0/1296481482 <== mon.0 v1:10.20.193.91:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5fac003380 con 0x7f5fb00560d0 2026-02-12T03:58:39.395 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.386+0000 7f5fb5266640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:39.395 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.386+0000 7f5fb5266640 1 -- 10.20.193.91:0/1296481482 <== mon.0 v1:10.20.193.91:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f5fac0037c0 con 0x7f5fb00560d0 2026-02-12T03:58:39.395 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.386+0000 7f5fb5266640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:39.395 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.386+0000 7f5fb5266640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:39.395 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.386+0000 7f5fb5266640 10 monclient: dump: 2026-02-12T03:58:39.395 INFO:teuthology.misc.health.trial091.stderr:epoch 1 2026-02-12T03:58:39.395 INFO:teuthology.misc.health.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:39.395 INFO:teuthology.misc.health.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:39.395 INFO:teuthology.misc.health.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:39.396 INFO:teuthology.misc.health.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:39.396 INFO:teuthology.misc.health.trial091.stderr:election_strategy: 3 2026-02-12T03:58:39.396 INFO:teuthology.misc.health.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:39.396 INFO:teuthology.misc.health.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:39.396 INFO:teuthology.misc.health.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:39.396 INFO:teuthology.misc.health.trial091.stderr: 2026-02-12T03:58:39.396 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.387+0000 7f5fb84f3640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:39.396 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.387+0000 7f5fb84f3640 4 set_mon_vals no callback set 2026-02-12T03:58:39.396 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.387+0000 7f5fb84f3640 10 monclient: shutdown 2026-02-12T03:58:39.396 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.387+0000 7f5fb84f3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:39.396 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.387+0000 7f5fb84f3640 1 -- 10.20.193.91:0/1296481482 >> v1:10.20.193.91:6789/0 conn(0x7f5fb00560d0 legacy=0x7f5fb01c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:39.396 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.387+0000 7f5fb84f3640 1 -- 10.20.193.91:0/1296481482 shutdown_connections 2026-02-12T03:58:39.397 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.387+0000 7f5fb84f3640 1 -- 10.20.193.91:0/1296481482 >> 10.20.193.91:0/1296481482 conn(0x7f5fb00b6560 msgr2=0x7f5fb00b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:39.397 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.387+0000 7f5fb84f3640 1 -- 10.20.193.91:0/1296481482 shutdown_connections 2026-02-12T03:58:39.397 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.387+0000 7f5fb84f3640 1 -- 10.20.193.91:0/1296481482 wait complete. 2026-02-12T03:58:39.397 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.387+0000 7f5fb84f3640 10 monclient: build_initial_monmap 2026-02-12T03:58:39.397 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.387+0000 7f5fb84f3640 10 monclient: monmap: 2026-02-12T03:58:39.397 INFO:teuthology.misc.health.trial091.stderr:epoch 0 2026-02-12T03:58:39.397 INFO:teuthology.misc.health.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:39.397 INFO:teuthology.misc.health.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:39.397 INFO:teuthology.misc.health.trial091.stderr:created 0.000000 2026-02-12T03:58:39.397 INFO:teuthology.misc.health.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:39.397 INFO:teuthology.misc.health.trial091.stderr:election_strategy: 1 2026-02-12T03:58:39.397 INFO:teuthology.misc.health.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:39.398 INFO:teuthology.misc.health.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:39.398 INFO:teuthology.misc.health.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:39.398 INFO:teuthology.misc.health.trial091.stderr: 2026-02-12T03:58:39.398 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.387+0000 7f5fb84f3640 1 librados: starting msgr at 2026-02-12T03:58:39.398 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.387+0000 7f5fb84f3640 1 librados: starting objecter 2026-02-12T03:58:39.398 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.387+0000 7f5fb84f3640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:39.398 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.387+0000 7f5fb84f3640 1 Processor -- start 2026-02-12T03:58:39.398 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.387+0000 7f5fb84f3640 1 -- start start 2026-02-12T03:58:39.398 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.387+0000 7f5fb84f3640 1 librados: setting wanted keys 2026-02-12T03:58:39.398 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.387+0000 7f5fb84f3640 1 librados: calling monclient init 2026-02-12T03:58:39.398 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.387+0000 7f5fb84f3640 10 monclient: init 2026-02-12T03:58:39.398 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.388+0000 7f5fb84f3640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:39.399 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.388+0000 7f5fb84f3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T03:58:39.399 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.388+0000 7f5fb84f3640 10 monclient(hunting): picked mon.noname-c con 0x7f5fb00560d0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:39.399 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.388+0000 7f5fb84f3640 10 monclient(hunting): picked mon.noname-a con 0x7f5fb01575d0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:39.399 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.388+0000 7f5fb84f3640 10 monclient(hunting): picked mon.noname-b con 0x7f5fb0163310 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:39.399 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.388+0000 7f5fb84f3640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fb0058160 con 0x7f5fb01575d0 2026-02-12T03:58:39.399 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.388+0000 7f5fb84f3640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fb015f0f0 con 0x7f5fb0163310 2026-02-12T03:58:39.399 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.388+0000 7f5fb84f3640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fb015f3d0 con 0x7f5fb00560d0 2026-02-12T03:58:39.399 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.388+0000 7f5fb84f3640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:39.399 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.388+0000 7f5fb84f3640 10 monclient(hunting): authenticate will time out at 1122.131349s 2026-02-12T03:58:39.399 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.388+0000 7f5fb5a67640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f5fb01575d0 0x7f5fb0133ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:39088/0 (socket says 10.20.193.91:39088) 2026-02-12T03:58:39.399 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.388+0000 7f5fb5a67640 1 -- 10.20.193.91:0/747388020 learned_addr learned my addr 10.20.193.91:0/747388020 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:39.399 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.388+0000 7f5f96ffd640 10 client.?.objecter ms_handle_connect 0x7f5fb01575d0 2026-02-12T03:58:39.400 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.388+0000 7f5f96ffd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:39.400 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.388+0000 7f5f96ffd640 10 client.?.objecter ms_handle_connect 0x7f5fb00560d0 2026-02-12T03:58:39.400 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.388+0000 7f5f96ffd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:39.400 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.389+0000 7f5f96ffd640 10 client.?.objecter ms_handle_connect 0x7f5fb0163310 2026-02-12T03:58:39.400 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.389+0000 7f5f96ffd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:39.400 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.389+0000 7f5f96ffd640 1 -- 10.20.193.91:0/747388020 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 382428642 0 0) 0x7f5fb0058160 con 0x7f5fb01575d0 2026-02-12T03:58:39.400 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.389+0000 7f5f96ffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:39.400 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.389+0000 7f5f96ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:39.400 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.389+0000 7f5f96ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:39.400 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.389+0000 7f5f96ffd640 10 monclient(hunting): my global_id is 4362 2026-02-12T03:58:39.400 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.389+0000 7f5f96ffd640 1 -- 10.20.193.91:0/747388020 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f80003610 con 0x7f5fb01575d0 2026-02-12T03:58:39.402 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.392+0000 7f5f96ffd640 1 -- 10.20.193.91:0/747388020 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 40332458 0 0) 0x7f5f80003610 con 0x7f5fb01575d0 2026-02-12T03:58:39.402 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.392+0000 7f5f96ffd640 1 -- 10.20.193.91:0/747388020 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5fb0058160 con 0x7f5fb01575d0 2026-02-12T03:58:39.402 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.392+0000 7f5f96ffd640 1 -- 10.20.193.91:0/747388020 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f5fa40030c0 con 0x7f5fb01575d0 2026-02-12T03:58:39.403 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.392+0000 7f5f96ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:39.403 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.392+0000 7f5f96ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:39.403 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.392+0000 7f5f96ffd640 10 monclient(hunting): dump: 2026-02-12T03:58:39.403 INFO:teuthology.misc.health.trial091.stderr:epoch 1 2026-02-12T03:58:39.403 INFO:teuthology.misc.health.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:39.403 INFO:teuthology.misc.health.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:39.403 INFO:teuthology.misc.health.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:39.403 INFO:teuthology.misc.health.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:39.403 INFO:teuthology.misc.health.trial091.stderr:election_strategy: 3 2026-02-12T03:58:39.403 INFO:teuthology.misc.health.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:39.403 INFO:teuthology.misc.health.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:39.404 INFO:teuthology.misc.health.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:39.404 INFO:teuthology.misc.health.trial091.stderr: 2026-02-12T03:58:39.404 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.392+0000 7f5f96ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:39.404 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.394+0000 7f5f96ffd640 1 -- 10.20.193.91:0/747388020 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3807771253 0 0) 0x7f5fb0058160 con 0x7f5fb01575d0 2026-02-12T03:58:39.404 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.394+0000 7f5f96ffd640 1 -- 10.20.193.91:0/747388020 >> v1:10.20.193.111:6789/0 conn(0x7f5fb00560d0 legacy=0x7f5fb0057820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:39.404 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.394+0000 7f5f96ffd640 1 -- 10.20.193.91:0/747388020 >> v1:10.20.193.98:6789/0 conn(0x7f5fb0163310 legacy=0x7f5fb015feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:39.404 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.394+0000 7f5f96ffd640 10 monclient: _finish_hunting 0 2026-02-12T03:58:39.404 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.394+0000 7f5f96ffd640 1 monclient: found mon.a 2026-02-12T03:58:39.404 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.394+0000 7f5f96ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:39.404 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.394+0000 7f5f96ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:39.404 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.394+0000 7f5f96ffd640 1 -- 10.20.193.91:0/747388020 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fb015f6b0 con 0x7f5fb01575d0 2026-02-12T03:58:39.404 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.394+0000 7f5f96ffd640 10 monclient: _finish_auth 0 2026-02-12T03:58:39.405 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.394+0000 7f5f96ffd640 10 monclient: _check_auth_tickets 2026-02-12T03:58:39.405 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.394+0000 7f5f96ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:39.405 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.394+0000 7f5fb84f3640 5 monclient: authenticate success, global_id 4362 2026-02-12T03:58:39.405 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.394+0000 7f5fb84f3640 10 monclient: _renew_subs 2026-02-12T03:58:39.405 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.394+0000 7f5fb84f3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:39.405 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.394+0000 7f5fb84f3640 1 -- 10.20.193.91:0/747388020 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5fb0134700 con 0x7f5fb01575d0 2026-02-12T03:58:39.405 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.394+0000 7f5fb84f3640 10 client.4362.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:39.405 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.394+0000 7f5fb84f3640 10 monclient: _renew_subs 2026-02-12T03:58:39.405 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.394+0000 7f5fb84f3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:39.405 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.394+0000 7f5fb84f3640 1 -- 10.20.193.91:0/747388020 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5fb01607a0 con 0x7f5fb01575d0 2026-02-12T03:58:39.405 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.394+0000 7f5fb84f3640 1 librados: init done 2026-02-12T03:58:39.405 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.395+0000 7f5fb84f3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:39.405 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.395+0000 7f5fb84f3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:39.406 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.395+0000 7f5fb84f3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:39.406 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.395+0000 7f5fb84f3640 1 -- 10.20.193.91:0/747388020 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fb00b7290 con 0x7f5fb01575d0 2026-02-12T03:58:39.493 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.491+0000 7f5f96ffd640 1 -- 10.20.193.91:0/747388020 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5fa4003470 con 0x7f5fb01575d0 2026-02-12T03:58:39.493 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.491+0000 7f5f96ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:39.493 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.491+0000 7f5fb4a65640 4 set_mon_vals no callback set 2026-02-12T03:58:39.493 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.491+0000 7f5f96ffd640 1 -- 10.20.193.91:0/747388020 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f5fa4003b90 con 0x7f5fb01575d0 2026-02-12T03:58:39.493 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.491+0000 7f5f96ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:39.494 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.491+0000 7f5f96ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:39.494 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.491+0000 7f5f96ffd640 10 monclient: dump: 2026-02-12T03:58:39.494 INFO:teuthology.misc.health.trial091.stderr:epoch 1 2026-02-12T03:58:39.494 INFO:teuthology.misc.health.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:39.494 INFO:teuthology.misc.health.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:39.494 INFO:teuthology.misc.health.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:39.494 INFO:teuthology.misc.health.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:39.494 INFO:teuthology.misc.health.trial091.stderr:election_strategy: 3 2026-02-12T03:58:39.494 INFO:teuthology.misc.health.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:39.494 INFO:teuthology.misc.health.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:39.494 INFO:teuthology.misc.health.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:39.495 INFO:teuthology.misc.health.trial091.stderr: 2026-02-12T03:58:39.495 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.491+0000 7f5f96ffd640 1 -- 10.20.193.91:0/747388020 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f5fa4003d30 con 0x7f5fb01575d0 2026-02-12T03:58:39.495 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.492+0000 7f5fb6268640 10 monclient: get_auth_request con 0x7f5f80079ed0 auth_method 0 2026-02-12T03:58:39.495 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.492+0000 7f5f96ffd640 10 client.4362.objecter ms_handle_connect 0x7f5f80079ed0 2026-02-12T03:58:39.496 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.494+0000 7f5f96ffd640 1 -- 10.20.193.91:0/747388020 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(24..24 src has 1..24) ==== 7757+0+0 (unknown 2648483762 0 0) 0x7f5fa4095cd0 con 0x7f5fb01575d0 2026-02-12T03:58:39.497 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.494+0000 7f5f96ffd640 10 client.4362.objecter ms_dispatch2 0x7f5fb0000b90 osd_map(24..24 src has 1..24) 2026-02-12T03:58:39.497 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.494+0000 7f5f96ffd640 3 client.4362.objecter handle_osd_map got epochs [24,24] > 0 2026-02-12T03:58:39.497 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.494+0000 7f5f96ffd640 3 client.4362.objecter handle_osd_map decoding full epoch 24 2026-02-12T03:58:39.497 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.495+0000 7f5f96ffd640 20 client.4362.objecter dump_active .. 0 homeless 2026-02-12T03:58:39.497 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.495+0000 7f5f96ffd640 1 -- 10.20.193.91:0/747388020 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f5fa405f630 con 0x7f5fb01575d0 2026-02-12T03:58:39.497 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.495+0000 7f5f96ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:39.497 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.495+0000 7f5f96ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:39.603 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.601+0000 7f5fb84f3640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-12T03:58:39.603 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.601+0000 7f5fb84f3640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T03:58:39.603 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.601+0000 7f5fb84f3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:39.603 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.601+0000 7f5fb84f3640 1 -- 10.20.193.91:0/747388020 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5fb0155950 con 0x7f5fb01575d0 2026-02-12T03:58:39.642 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.640+0000 7f5f96ffd640 1 -- 10.20.193.91:0/747388020 <== mon.0 v1:10.20.193.91:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18909 (unknown 3496218867 0 3747624100) 0x7f5fa405ef30 con 0x7f5fb01575d0 2026-02-12T03:58:39.642 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.640+0000 7f5f96ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T03:58:39.642 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.640+0000 7f5f96ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:39.642 INFO:teuthology.misc.health.trial091.stdout: 2026-02-12T03:58:39.642 INFO:teuthology.misc.health.trial091.stdout:{"epoch":24,"fsid":"1e356fcf-3d61-462e-a451-82f8dd01e1f3","created":"2026-02-12T03:57:59.014379+0000","modified":"2026-02-12T03:58:34.546415+0000","last_up_change":"2026-02-12T03:58:32.372907+0000","last_in_change":"2026-02-12T03:58:05.455425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-12T03:58:32.248062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"791c97c5-83f6-4024-9f43-ff3b2ee22a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6801","nonce":1203233578}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6802","nonce":1203233578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6804","nonce":1203233578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6803","nonce":1203233578}]},"public_addr":"10.20.193.91:6801/1203233578","cluster_addr":"10.20.193.91:6802/1203233578","heartbeat_back_addr":"10.20.193.91:6804/1203233578","heartbeat_front_addr":"10.20.193.91:6803/1203233578","state":["exists","up"]},{"osd":1,"uuid":"0cf561d6-85aa-428a-bc69-83ce77b1c802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6812","nonce":2011281833}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6813","nonce":2011281833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6815","nonce":2011281833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6814","nonce":2011281833}]},"public_addr":"10.20.193.98:6812/2011281833","cluster_addr":"10.20.193.98:6813/2011281833","heartbeat_back_addr":"10.20.193.98:6815/2011281833","heartbeat_front_addr":"10.20.193.98:6814/2011281833","state":["exists","up"]},{"osd":2,"uuid":"b3dc78b9-cae6-4b1f-931f-7352a43b9e26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6812","nonce":350848222}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6813","nonce":350848222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6815","nonce":350848222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6814","nonce":350848222}]},"public_addr":"10.20.193.111:6812/350848222","cluster_addr":"10.20.193.111:6813/350848222","heartbeat_back_addr":"10.20.193.111:6815/350848222","heartbeat_front_addr":"10.20.193.111:6814/350848222","state":["exists","up"]},{"osd":3,"uuid":"e164e3ae-cf6a-45ff-b126-3ac739c5b1be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6800","nonce":4779434}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6801","nonce":4779434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6803","nonce":4779434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6802","nonce":4779434}]},"public_addr":"10.20.193.154:6800/4779434","cluster_addr":"10.20.193.154:6801/4779434","heartbeat_back_addr":"10.20.193.154:6803/4779434","heartbeat_front_addr":"10.20.193.154:6802/4779434","state":["exists","up"]},{"osd":4,"uuid":"5583cc8c-83d4-42b4-a997-c056f3b145a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6805","nonce":1766507926}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6806","nonce":1766507926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6808","nonce":1766507926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6807","nonce":1766507926}]},"public_addr":"10.20.193.91:6805/1766507926","cluster_addr":"10.20.193.91:6806/1766507926","heartbeat_back_addr":"10.20.193.91:6808/1766507926","heartbeat_front_addr":"10.20.193.91:6807/1766507926","state":["exists","up"]},{"osd":5,"uuid":"d7bb6fa1-b042-4dce-9644-00e817a5bc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6808","nonce":3918277953}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6809","nonce":3918277953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6811","nonce":3918277953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6810","nonce":3918277953}]},"public_addr":"10.20.193.98:6808/3918277953","cluster_addr":"10.20.193.98:6809/3918277953","heartbeat_back_addr":"10.20.193.98:6811/3918277953","heartbeat_front_addr":"10.20.193.98:6810/3918277953","state":["exists","up"]},{"osd":6,"uuid":"93cd9edf-a000-4d22-8da7-52f4bd547765","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6804","nonce":727190484}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6805","nonce":727190484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6807","nonce":727190484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6806","nonce":727190484}]},"public_addr":"10.20.193.111:6804/727190484","cluster_addr":"10.20.193.111:6805/727190484","heartbeat_back_addr":"10.20.193.111:6807/727190484","heartbeat_front_addr":"10.20.193.111:6806/727190484","state":["exists","up"]},{"osd":7,"uuid":"f5e11a47-d746-46ca-85f1-27d3bc586371","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6808","nonce":903276772}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6810","nonce":903276772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6813","nonce":903276772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6811","nonce":903276772}]},"public_addr":"10.20.193.154:6808/903276772","cluster_addr":"10.20.193.154:6810/903276772","heartbeat_back_addr":"10.20.193.154:6813/903276772","heartbeat_front_addr":"10.20.193.154:6811/903276772","state":["exists","up"]},{"osd":8,"uuid":"bb8207ce-22b9-46be-9c89-c77f2690e405","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6809","nonce":443384425}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6810","nonce":443384425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6812","nonce":443384425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6811","nonce":443384425}]},"public_addr":"10.20.193.91:6809/443384425","cluster_addr":"10.20.193.91:6810/443384425","heartbeat_back_addr":"10.20.193.91:6812/443384425","heartbeat_front_addr":"10.20.193.91:6811/443384425","state":["exists","up"]},{"osd":9,"uuid":"e6318a6d-2367-48ce-a3a1-47307de14b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6801","nonce":4165741185}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6804","nonce":4165741185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6807","nonce":4165741185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6806","nonce":4165741185}]},"public_addr":"10.20.193.98:6801/4165741185","cluster_addr":"10.20.193.98:6804/4165741185","heartbeat_back_addr":"10.20.193.98:6807/4165741185","heartbeat_front_addr":"10.20.193.98:6806/4165741185","state":["exists","up"]},{"osd":10,"uuid":"cd6c97a2-bdfe-4b86-afeb-217315976d6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6808","nonce":1268343515}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6809","nonce":1268343515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6811","nonce":1268343515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6810","nonce":1268343515}]},"public_addr":"10.20.193.111:6808/1268343515","cluster_addr":"10.20.193.111:6809/1268343515","heartbeat_back_addr":"10.20.193.111:6811/1268343515","heartbeat_front_addr":"10.20.193.111:6810/1268343515","state":["exists","up"]},{"osd":11,"uuid":"b6c647bb-4e86-4b0e-b79c-b0236a780a66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6804","nonce":2902069275}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6805","nonce":2902069275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6807","nonce":2902069275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6806","nonce":2902069275}]},"public_addr":"10.20.193.154:6804/2902069275","cluster_addr":"10.20.193.154:6805/2902069275","heartbeat_back_addr":"10.20.193.154:6807/2902069275","heartbeat_front_addr":"10.20.193.154:6806/2902069275","state":["exists","up"]},{"osd":12,"uuid":"19bb3570-0c0a-48cc-a0b8-ec3194f30fa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6813","nonce":3587007397}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6814","nonce":3587007397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6816","nonce":3587007397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6815","nonce":3587007397}]},"public_addr":"10.20.193.91:6813/3587007397","cluster_addr":"10.20.193.91:6814/3587007397","heartbeat_back_addr":"10.20.193.91:6816/3587007397","heartbeat_front_addr":"10.20.193.91:6815/3587007397","state":["exists","up"]},{"osd":13,"uuid":"a8215062-521c-47f6-b20a-9e40c1f3f5a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6800","nonce":1665089474}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6802","nonce":1665089474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6805","nonce":1665089474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6803","nonce":1665089474}]},"public_addr":"10.20.193.98:6800/1665089474","cluster_addr":"10.20.193.98:6802/1665089474","heartbeat_back_addr":"10.20.193.98:6805/1665089474","heartbeat_front_addr":"10.20.193.98:6803/1665089474","state":["exists","up"]},{"osd":14,"uuid":"3cd1bb48-53a2-462e-b7e5-4d6d918dd543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6800","nonce":1665676360}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6801","nonce":1665676360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6803","nonce":1665676360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6802","nonce":1665676360}]},"public_addr":"10.20.193.111:6800/1665676360","cluster_addr":"10.20.193.111:6801/1665676360","heartbeat_back_addr":"10.20.193.111:6803/1665676360","heartbeat_front_addr":"10.20.193.111:6802/1665676360","state":["exists","up"]},{"osd":15,"uuid":"9bd39438-f5e5-4a19-afa4-678395d63c24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6809","nonce":2343771552}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6812","nonce":2343771552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6815","nonce":2343771552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6814","nonce":2343771552}]},"public_addr":"10.20.193.154:6809/2343771552","cluster_addr":"10.20.193.154:6812/2343771552","heartbeat_back_addr":"10.20.193.154:6815/2343771552","heartbeat_front_addr":"10.20.193.154:6814/2343771552","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.723024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:30.073947+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.930180+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:30.325123+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.735688+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.923661+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.879912+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:30.480032+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.983654+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.730948+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.899878+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:30.549254+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.968146+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.918456+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.803753+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:30.518611+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T03:58:39.644 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.641+0000 7f5fb84f3640 10 librados: watch_flush enter 2026-02-12T03:58:39.644 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.641+0000 7f5fb84f3640 10 librados: watch_flush exit 2026-02-12T03:58:39.644 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.641+0000 7f5fb84f3640 20 client.4362.objecter shutdown clearing up homeless session... 2026-02-12T03:58:39.644 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.641+0000 7f5fb84f3640 10 client.4362.objecter successfully canceled tick 2026-02-12T03:58:39.644 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.641+0000 7f5fb84f3640 1 -- 10.20.193.91:0/747388020 >> v1:10.20.193.91:6800/2929217192 conn(0x7f5f80079ed0 legacy=0x7f5f8009a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:39.644 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.641+0000 7f5fb84f3640 10 monclient: shutdown 2026-02-12T03:58:39.644 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.641+0000 7f5fb84f3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:39.645 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.641+0000 7f5fb84f3640 1 -- 10.20.193.91:0/747388020 >> v1:10.20.193.91:6789/0 conn(0x7f5fb01575d0 legacy=0x7f5fb0133ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:39.645 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.641+0000 7f5fb84f3640 1 -- 10.20.193.91:0/747388020 shutdown_connections 2026-02-12T03:58:39.645 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.641+0000 7f5fb84f3640 1 -- 10.20.193.91:0/747388020 >> 10.20.193.91:0/747388020 conn(0x7f5fb00b6560 msgr2=0x7f5fb0155c30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:39.645 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.641+0000 7f5fb84f3640 1 -- 10.20.193.91:0/747388020 shutdown_connections 2026-02-12T03:58:39.645 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.641+0000 7f5fb84f3640 1 -- 10.20.193.91:0/747388020 wait complete. 2026-02-12T03:58:39.645 INFO:teuthology.misc.health.trial091.stderr:2026-02-12T03:58:39.641+0000 7f5fb84f3640 1 librados: shutdown 2026-02-12T03:58:39.652 DEBUG:teuthology.misc:16 of 16 OSDs are up 2026-02-12T03:58:39.652 INFO:tasks.ceph:Creating RBD pool 2026-02-12T03:58:39.652 DEBUG:teuthology.orchestra.run.trial091:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-12T03:58:39.717 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.715+0000 7fa84fff9640 10 monclient: get_monmap_and_config 2026-02-12T03:58:39.717 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.715+0000 7fa84fff9640 10 monclient: build_initial_monmap 2026-02-12T03:58:39.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.715+0000 7fa84fff9640 10 monclient: monmap: 2026-02-12T03:58:39.718 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:39.718 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:39.718 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:39.716367+0000 2026-02-12T03:58:39.718 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:39.716367+0000 2026-02-12T03:58:39.718 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:39.718 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:39.718 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:39.718 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:39.718 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:39.718 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:39.720 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.716+0000 7fa84fff9640 1 Processor -- start 2026-02-12T03:58:39.720 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.716+0000 7fa84fff9640 1 -- start start 2026-02-12T03:58:39.720 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.716+0000 7fa84fff9640 10 monclient: init 2026-02-12T03:58:39.720 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.716+0000 7fa84fff9640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:39.720 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.716+0000 7fa84fff9640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T03:58:39.720 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.716+0000 7fa84fff9640 10 monclient(hunting): picked mon.noname-a con 0x7fa84815e1c0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:39.720 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.716+0000 7fa84fff9640 10 monclient(hunting): picked mon.noname-b con 0x7fa848058750 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:39.720 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.716+0000 7fa84fff9640 10 monclient(hunting): picked mon.noname-c con 0x7fa8480560d0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:39.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.716+0000 7fa84fff9640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8480b1ec0 con 0x7fa84815e1c0 2026-02-12T03:58:39.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.716+0000 7fa84fff9640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8480566d0 con 0x7fa848058750 2026-02-12T03:58:39.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.716+0000 7fa84fff9640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8480569b0 con 0x7fa8480560d0 2026-02-12T03:58:39.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.716+0000 7fa84fff9640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:39.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.716+0000 7fa84fff9640 10 monclient(hunting): authenticate will time out at 1122.459858s 2026-02-12T03:58:39.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.717+0000 7fa84e56f640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7fa8480560d0 0x7fa8481c5810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:56858/0 (socket says 10.20.193.91:56858) 2026-02-12T03:58:39.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.717+0000 7fa84e56f640 1 -- 10.20.193.91:0/615665438 learned_addr learned my addr 10.20.193.91:0/615665438 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:39.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.719+0000 7fa84cd6c640 1 -- 10.20.193.91:0/615665438 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3557690463 0 0) 0x7fa8480b1ec0 con 0x7fa84815e1c0 2026-02-12T03:58:39.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.719+0000 7fa84cd6c640 10 monclient(hunting): _negotiate 2026-02-12T03:58:39.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.719+0000 7fa84cd6c640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:39.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.719+0000 7fa84cd6c640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:39.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.719+0000 7fa84cd6c640 10 monclient(hunting): my global_id is 4365 2026-02-12T03:58:39.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.719+0000 7fa84cd6c640 1 -- 10.20.193.91:0/615665438 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa830003610 con 0x7fa84815e1c0 2026-02-12T03:58:39.723 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.721+0000 7fa84cd6c640 1 -- 10.20.193.91:0/615665438 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 556506675 0 0) 0x7fa830003610 con 0x7fa84815e1c0 2026-02-12T03:58:39.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.721+0000 7fa84cd6c640 1 -- 10.20.193.91:0/615665438 >> v1:10.20.193.111:6789/0 conn(0x7fa8480560d0 legacy=0x7fa8481c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:39.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.721+0000 7fa84cd6c640 1 -- 10.20.193.91:0/615665438 >> v1:10.20.193.98:6789/0 conn(0x7fa848058750 legacy=0x7fa8480559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T03:58:39.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.721+0000 7fa84cd6c640 10 monclient: _finish_hunting 0 2026-02-12T03:58:39.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.721+0000 7fa84cd6c640 1 monclient: found mon.noname-a 2026-02-12T03:58:39.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.721+0000 7fa84cd6c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:39.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.721+0000 7fa84cd6c640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.91:6789/0 2026-02-12T03:58:39.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.721+0000 7fa84cd6c640 1 -- 10.20.193.91:0/615665438 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa848056c90 con 0x7fa84815e1c0 2026-02-12T03:58:39.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.721+0000 7fa84cd6c640 10 monclient: _finish_auth 0 2026-02-12T03:58:39.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.721+0000 7fa84cd6c640 10 monclient: _check_auth_tickets 2026-02-12T03:58:39.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.721+0000 7fa84cd6c640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:39.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.721+0000 7fa84fff9640 5 monclient: authenticate success, global_id 4365 2026-02-12T03:58:39.725 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.721+0000 7fa84fff9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:39.725 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.721+0000 7fa84cd6c640 1 -- 10.20.193.91:0/615665438 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fa838002df0 con 0x7fa84815e1c0 2026-02-12T03:58:39.725 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.721+0000 7fa84cd6c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:39.725 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.721+0000 7fa84cd6c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:39.725 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.721+0000 7fa84cd6c640 10 monclient: dump: 2026-02-12T03:58:39.725 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:39.725 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:39.725 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:39.725 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:39.725 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:39.725 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:39.725 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:39.726 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:39.726 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:39.726 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:39.726 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.721+0000 7fa84fff9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:39.729 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.722+0000 7fa84cd6c640 1 -- 10.20.193.91:0/615665438 <== mon.0 v1:10.20.193.91:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa838003080 con 0x7fa84815e1c0 2026-02-12T03:58:39.730 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.722+0000 7fa84cd6c640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:39.730 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.722+0000 7fa84cd6c640 1 -- 10.20.193.91:0/615665438 <== mon.0 v1:10.20.193.91:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fa8380034c0 con 0x7fa84815e1c0 2026-02-12T03:58:39.730 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.722+0000 7fa84fff9640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:39.730 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.722+0000 7fa84fff9640 4 set_mon_vals no callback set 2026-02-12T03:58:39.730 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.722+0000 7fa84cd6c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:39.730 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.722+0000 7fa84cd6c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:39.730 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.722+0000 7fa84cd6c640 10 monclient: dump: 2026-02-12T03:58:39.730 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:39.730 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:39.730 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:39.730 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:39.731 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:39.731 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:39.731 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:39.731 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:39.731 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:39.731 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:39.731 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.722+0000 7fa84fff9640 10 monclient: shutdown 2026-02-12T03:58:39.732 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.722+0000 7fa84fff9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:39.732 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.722+0000 7fa84fff9640 1 -- 10.20.193.91:0/615665438 >> v1:10.20.193.91:6789/0 conn(0x7fa84815e1c0 legacy=0x7fa848057770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:39.732 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.723+0000 7fa84fff9640 1 -- 10.20.193.91:0/615665438 shutdown_connections 2026-02-12T03:58:39.732 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.723+0000 7fa84fff9640 1 -- 10.20.193.91:0/615665438 >> 10.20.193.91:0/615665438 conn(0x7fa8480b6530 msgr2=0x7fa8480b6930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:39.732 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.723+0000 7fa84fff9640 1 -- 10.20.193.91:0/615665438 shutdown_connections 2026-02-12T03:58:39.732 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.723+0000 7fa84fff9640 1 -- 10.20.193.91:0/615665438 wait complete. 2026-02-12T03:58:39.732 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.723+0000 7fa84fff9640 10 monclient: build_initial_monmap 2026-02-12T03:58:39.732 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.723+0000 7fa84fff9640 10 monclient: monmap: 2026-02-12T03:58:39.733 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:39.733 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:39.733 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:39.733 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:39.733 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:39.733 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:39.733 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:39.733 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:39.733 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:39.734 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:39.734 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.723+0000 7fa84fff9640 1 librados: starting msgr at 2026-02-12T03:58:39.734 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.723+0000 7fa84fff9640 1 librados: starting objecter 2026-02-12T03:58:39.734 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.723+0000 7fa84fff9640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:39.734 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.723+0000 7fa84fff9640 1 Processor -- start 2026-02-12T03:58:39.734 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.724+0000 7fa84fff9640 1 -- start start 2026-02-12T03:58:39.735 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.724+0000 7fa84fff9640 1 librados: setting wanted keys 2026-02-12T03:58:39.735 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.724+0000 7fa84fff9640 1 librados: calling monclient init 2026-02-12T03:58:39.735 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.724+0000 7fa84fff9640 10 monclient: init 2026-02-12T03:58:39.735 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.724+0000 7fa84fff9640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:39.735 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.724+0000 7fa84fff9640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T03:58:39.735 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.724+0000 7fa84fff9640 10 monclient(hunting): picked mon.noname-a con 0x7fa8480560d0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:39.736 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.724+0000 7fa84fff9640 10 monclient(hunting): picked mon.noname-b con 0x7fa848058750 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:39.736 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.724+0000 7fa84fff9640 10 monclient(hunting): picked mon.noname-c con 0x7fa84815e1c0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:39.736 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.724+0000 7fa84fff9640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa84814de60 con 0x7fa8480560d0 2026-02-12T03:58:39.736 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.724+0000 7fa84fff9640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa84805cf20 con 0x7fa848058750 2026-02-12T03:58:39.736 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.724+0000 7fa84fff9640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa84805d200 con 0x7fa84815e1c0 2026-02-12T03:58:39.736 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.724+0000 7fa84fff9640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:39.736 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.724+0000 7fa84fff9640 10 monclient(hunting): authenticate will time out at 1122.467405s 2026-02-12T03:58:39.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.724+0000 7fa84e56f640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7fa84815e1c0 0x7fa8481241f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:56872/0 (socket says 10.20.193.91:56872) 2026-02-12T03:58:39.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.724+0000 7fa84e56f640 1 -- 10.20.193.91:0/1953301655 learned_addr learned my addr 10.20.193.91:0/1953301655 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:39.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.725+0000 7fa8367fc640 10 client.?.objecter ms_handle_connect 0x7fa84815e1c0 2026-02-12T03:58:39.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.725+0000 7fa8367fc640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:39.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.725+0000 7fa8367fc640 10 client.?.objecter ms_handle_connect 0x7fa8480560d0 2026-02-12T03:58:39.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.725+0000 7fa8367fc640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:39.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.726+0000 7fa8367fc640 1 -- 10.20.193.91:0/1953301655 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3813200205 0 0) 0x7fa84814de60 con 0x7fa8480560d0 2026-02-12T03:58:39.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.726+0000 7fa8367fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:39.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.726+0000 7fa8367fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:39.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.726+0000 7fa8367fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:39.738 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.726+0000 7fa8367fc640 10 monclient(hunting): my global_id is 4368 2026-02-12T03:58:39.738 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.726+0000 7fa8367fc640 1 -- 10.20.193.91:0/1953301655 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa818003610 con 0x7fa8480560d0 2026-02-12T03:58:39.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.728+0000 7fa8367fc640 10 client.?.objecter ms_handle_connect 0x7fa848058750 2026-02-12T03:58:39.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.728+0000 7fa8367fc640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:39.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.729+0000 7fa8367fc640 1 -- 10.20.193.91:0/1953301655 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 809783957 0 0) 0x7fa818003610 con 0x7fa8480560d0 2026-02-12T03:58:39.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.729+0000 7fa8367fc640 1 -- 10.20.193.91:0/1953301655 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa84814de60 con 0x7fa8480560d0 2026-02-12T03:58:39.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.729+0000 7fa8367fc640 1 -- 10.20.193.91:0/1953301655 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fa8380033d0 con 0x7fa8480560d0 2026-02-12T03:58:39.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.729+0000 7fa8367fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:39.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.729+0000 7fa8367fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:39.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.729+0000 7fa8367fc640 10 monclient(hunting): dump: 2026-02-12T03:58:39.741 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:39.741 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:39.741 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:39.741 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:39.741 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:39.741 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:39.741 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:39.741 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:39.741 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:39.741 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:39.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.729+0000 7fa8367fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:39.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.731+0000 7fa8367fc640 1 -- 10.20.193.91:0/1953301655 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3005913160 0 0) 0x7fa84814de60 con 0x7fa8480560d0 2026-02-12T03:58:39.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.731+0000 7fa8367fc640 1 -- 10.20.193.91:0/1953301655 >> v1:10.20.193.111:6789/0 conn(0x7fa84815e1c0 legacy=0x7fa8481241f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:39.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.731+0000 7fa8367fc640 1 -- 10.20.193.91:0/1953301655 >> v1:10.20.193.98:6789/0 conn(0x7fa848058750 legacy=0x7fa8480a7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:39.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.731+0000 7fa8367fc640 10 monclient: _finish_hunting 0 2026-02-12T03:58:39.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.731+0000 7fa8367fc640 1 monclient: found mon.a 2026-02-12T03:58:39.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.731+0000 7fa8367fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:39.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.731+0000 7fa8367fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:39.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.731+0000 7fa8367fc640 1 -- 10.20.193.91:0/1953301655 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa84805d4e0 con 0x7fa8480560d0 2026-02-12T03:58:39.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.731+0000 7fa8367fc640 10 monclient: _finish_auth 0 2026-02-12T03:58:39.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.731+0000 7fa8367fc640 10 monclient: _check_auth_tickets 2026-02-12T03:58:39.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.732+0000 7fa8367fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:39.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.732+0000 7fa84fff9640 5 monclient: authenticate success, global_id 4368 2026-02-12T03:58:39.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.732+0000 7fa84fff9640 10 monclient: _renew_subs 2026-02-12T03:58:39.743 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.732+0000 7fa84fff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:39.743 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.732+0000 7fa84fff9640 1 -- 10.20.193.91:0/1953301655 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa84805d7c0 con 0x7fa8480560d0 2026-02-12T03:58:39.743 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.732+0000 7fa84fff9640 10 client.4368.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:39.743 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.732+0000 7fa84fff9640 10 monclient: _renew_subs 2026-02-12T03:58:39.743 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.732+0000 7fa84fff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:39.743 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.732+0000 7fa84fff9640 1 -- 10.20.193.91:0/1953301655 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa848123cd0 con 0x7fa8480560d0 2026-02-12T03:58:39.743 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.732+0000 7fa84fff9640 1 librados: init done 2026-02-12T03:58:39.743 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.732+0000 7fa84fff9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:39.743 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.732+0000 7fa84fff9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:39.743 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.732+0000 7fa84fff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:39.743 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.732+0000 7fa84fff9640 1 -- 10.20.193.91:0/1953301655 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8480a7f60 con 0x7fa8480560d0 2026-02-12T03:58:39.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.861+0000 7fa8367fc640 1 -- 10.20.193.91:0/1953301655 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa838003030 con 0x7fa8480560d0 2026-02-12T03:58:39.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.861+0000 7fa8367fc640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:39.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.861+0000 7fa8367fc640 1 -- 10.20.193.91:0/1953301655 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fa838003bf0 con 0x7fa8480560d0 2026-02-12T03:58:39.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.861+0000 7fa8367fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:39.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.861+0000 7fa8367fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:39.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.861+0000 7fa8367fc640 10 monclient: dump: 2026-02-12T03:58:39.864 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:39.865 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:39.865 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:39.865 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:39.865 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:39.865 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:39.865 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:39.865 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:39.865 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:39.865 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:39.865 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.861+0000 7fa837fff640 4 set_mon_vals no callback set 2026-02-12T03:58:39.865 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.862+0000 7fa8367fc640 1 -- 10.20.193.91:0/1953301655 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7fa838003dd0 con 0x7fa8480560d0 2026-02-12T03:58:39.866 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.862+0000 7fa84d56d640 10 monclient: get_auth_request con 0x7fa818079f50 auth_method 0 2026-02-12T03:58:39.866 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.863+0000 7fa8367fc640 10 client.4368.objecter ms_handle_connect 0x7fa818079f50 2026-02-12T03:58:39.867 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.865+0000 7fa8367fc640 1 -- 10.20.193.91:0/1953301655 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(24..24 src has 1..24) ==== 7757+0+0 (unknown 2648483762 0 0) 0x7fa838094b60 con 0x7fa8480560d0 2026-02-12T03:58:39.867 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.865+0000 7fa8367fc640 10 client.4368.objecter ms_dispatch2 0x7fa848000b90 osd_map(24..24 src has 1..24) 2026-02-12T03:58:39.867 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.865+0000 7fa8367fc640 3 client.4368.objecter handle_osd_map got epochs [24,24] > 0 2026-02-12T03:58:39.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.865+0000 7fa8367fc640 3 client.4368.objecter handle_osd_map decoding full epoch 24 2026-02-12T03:58:39.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.865+0000 7fa8367fc640 20 client.4368.objecter dump_active .. 0 homeless 2026-02-12T03:58:39.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.865+0000 7fa8367fc640 1 -- 10.20.193.91:0/1953301655 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7fa83805e4c0 con 0x7fa8480560d0 2026-02-12T03:58:39.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.865+0000 7fa8367fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:39.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.865+0000 7fa8367fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:39.972 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.970+0000 7fa84fff9640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-12T03:58:39.972 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.970+0000 7fa84fff9640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-12T03:58:39.972 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.970+0000 7fa84fff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:39.973 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:39.970+0000 7fa84fff9640 1 -- 10.20.193.91:0/1953301655 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7fa84815ce30 con 0x7fa8480560d0 2026-02-12T03:58:40.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.806+0000 7fa8367fc640 1 -- 10.20.193.91:0/1953301655 <== mon.0 v1:10.20.193.91:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v25) ==== 109+0+0 (unknown 2655803957 0 0) 0x7fa83805ddc0 con 0x7fa8480560d0 2026-02-12T03:58:40.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.806+0000 7fa8367fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-12T03:58:40.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.806+0000 7fa8367fc640 10 monclient: _finish_command 2 = system:0 pool 'rbd' created 2026-02-12T03:58:40.808 INFO:teuthology.orchestra.run.trial091.stderr:pool 'rbd' created 2026-02-12T03:58:40.811 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.808+0000 7fa84fff9640 10 librados: watch_flush enter 2026-02-12T03:58:40.811 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.808+0000 7fa84fff9640 10 librados: watch_flush exit 2026-02-12T03:58:40.811 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.808+0000 7fa84fff9640 20 client.4368.objecter shutdown clearing up homeless session... 2026-02-12T03:58:40.811 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.808+0000 7fa84fff9640 10 client.4368.objecter successfully canceled tick 2026-02-12T03:58:40.811 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.808+0000 7fa84fff9640 1 -- 10.20.193.91:0/1953301655 >> v1:10.20.193.91:6800/2929217192 conn(0x7fa818079f50 legacy=0x7fa81809a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:40.811 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.808+0000 7fa84fff9640 10 monclient: shutdown 2026-02-12T03:58:40.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.808+0000 7fa84fff9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:40.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.808+0000 7fa84fff9640 1 -- 10.20.193.91:0/1953301655 >> v1:10.20.193.91:6789/0 conn(0x7fa8480560d0 legacy=0x7fa84814d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:40.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.808+0000 7fa84fff9640 1 -- 10.20.193.91:0/1953301655 shutdown_connections 2026-02-12T03:58:40.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.808+0000 7fa84fff9640 1 -- 10.20.193.91:0/1953301655 >> 10.20.193.91:0/1953301655 conn(0x7fa8480b6530 msgr2=0x7fa84815d110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:40.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.808+0000 7fa84fff9640 1 -- 10.20.193.91:0/1953301655 shutdown_connections 2026-02-12T03:58:40.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.808+0000 7fa84fff9640 1 -- 10.20.193.91:0/1953301655 wait complete. 2026-02-12T03:58:40.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.809+0000 7fa84fff9640 1 librados: shutdown 2026-02-12T03:58:40.819 DEBUG:teuthology.orchestra.run.trial091:> rbd --cluster ceph pool init rbd 2026-02-12T03:58:40.854 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.852+0000 7f0986ca4300 10 monclient: get_monmap_and_config 2026-02-12T03:58:40.854 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.852+0000 7f0986ca4300 10 monclient: build_initial_monmap 2026-02-12T03:58:40.854 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.852+0000 7f0986ca4300 10 monclient: monmap: 2026-02-12T03:58:40.854 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:40.854 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:40.854 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:40.852802+0000 2026-02-12T03:58:40.854 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:40.852802+0000 2026-02-12T03:58:40.855 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:40.855 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:40.855 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:40.855 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:40.855 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:40.855 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:40.857 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.852+0000 7f0986ca4300 1 Processor -- start 2026-02-12T03:58:40.857 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.852+0000 7f0986ca4300 1 -- start start 2026-02-12T03:58:40.858 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.852+0000 7f0986ca4300 10 monclient: init 2026-02-12T03:58:40.858 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.853+0000 7f0986ca4300 10 monclient: _reopen_session rank -1 2026-02-12T03:58:40.858 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.853+0000 7f0986ca4300 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T03:58:40.858 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.853+0000 7f0986ca4300 10 monclient(hunting): picked mon.noname-c con 0x55d2e74aff10 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:40.858 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.853+0000 7f0986ca4300 10 monclient(hunting): picked mon.noname-b con 0x55d2e7409050 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:40.858 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.853+0000 7f0986ca4300 10 monclient(hunting): picked mon.noname-a con 0x55d2e740e5c0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:40.859 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.853+0000 7f0986ca4300 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55d2e72220c0 con 0x55d2e740e5c0 2026-02-12T03:58:40.859 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.853+0000 7f0986ca4300 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55d2e7231a80 con 0x55d2e7409050 2026-02-12T03:58:40.859 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.853+0000 7f0986ca4300 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55d2e740ea60 con 0x55d2e74aff10 2026-02-12T03:58:40.859 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.853+0000 7f0986ca4300 10 monclient(hunting): _renew_subs 2026-02-12T03:58:40.859 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.853+0000 7f0986ca4300 10 monclient(hunting): authenticate will time out at 1123.596431s 2026-02-12T03:58:40.859 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.853+0000 7f09869e4640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x55d2e740e5c0 0x55d2e74bcaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:59042/0 (socket says 10.20.193.91:59042) 2026-02-12T03:58:40.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.853+0000 7f09869e4640 1 -- 10.20.193.91:0/1026725629 learned_addr learned my addr 10.20.193.91:0/1026725629 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:40.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.855+0000 7f0977fff640 1 -- 10.20.193.91:0/1026725629 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2917511426 0 0) 0x55d2e72220c0 con 0x55d2e740e5c0 2026-02-12T03:58:40.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.855+0000 7f0977fff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:40.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.855+0000 7f0977fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:40.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.855+0000 7f0977fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:40.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.855+0000 7f0977fff640 10 monclient(hunting): my global_id is 4371 2026-02-12T03:58:40.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.855+0000 7f0977fff640 1 -- 10.20.193.91:0/1026725629 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f096c001e10 con 0x55d2e740e5c0 2026-02-12T03:58:40.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.855+0000 7f0977fff640 1 -- 10.20.193.91:0/1026725629 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3480972756 0 0) 0x55d2e7231a80 con 0x55d2e7409050 2026-02-12T03:58:40.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.855+0000 7f0977fff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:40.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.855+0000 7f0977fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:40.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.855+0000 7f0977fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:40.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.855+0000 7f0977fff640 10 monclient(hunting): my global_id is 4363 2026-02-12T03:58:40.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.855+0000 7f0977fff640 1 -- 10.20.193.91:0/1026725629 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x55d2e72220c0 con 0x55d2e7409050 2026-02-12T03:58:40.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.856+0000 7f0977fff640 1 -- 10.20.193.91:0/1026725629 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 587023393 0 0) 0x55d2e72220c0 con 0x55d2e7409050 2026-02-12T03:58:40.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.856+0000 7f0977fff640 1 -- 10.20.193.91:0/1026725629 >> v1:10.20.193.111:6789/0 conn(0x55d2e74aff10 legacy=0x55d2e73c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T03:58:40.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.856+0000 7f0977fff640 1 -- 10.20.193.91:0/1026725629 >> v1:10.20.193.91:6789/0 conn(0x55d2e740e5c0 legacy=0x55d2e74bcaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:40.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.856+0000 7f0977fff640 10 monclient: _finish_hunting 0 2026-02-12T03:58:40.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.856+0000 7f0977fff640 1 monclient: found mon.noname-b 2026-02-12T03:58:40.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.856+0000 7f0977fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:40.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.856+0000 7f0977fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T03:58:40.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.856+0000 7f0977fff640 1 -- 10.20.193.91:0/1026725629 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2e74094d0 con 0x55d2e7409050 2026-02-12T03:58:40.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.856+0000 7f0977fff640 10 monclient: _finish_auth 0 2026-02-12T03:58:40.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.857+0000 7f0977fff640 10 monclient: _check_auth_tickets 2026-02-12T03:58:40.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.857+0000 7f0977fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:40.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.857+0000 7f0977fff640 1 -- 10.20.193.91:0/1026725629 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f09700015f0 con 0x55d2e7409050 2026-02-12T03:58:40.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.857+0000 7f0977fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:40.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.857+0000 7f0977fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:40.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.857+0000 7f0977fff640 10 monclient: dump: 2026-02-12T03:58:40.876 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:40.876 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:40.877 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:40.877 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:40.877 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:40.877 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:40.877 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:40.877 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:40.878 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:40.878 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:40.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.857+0000 7f0986ca4300 5 monclient: authenticate success, global_id 4363 2026-02-12T03:58:40.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.857+0000 7f0986ca4300 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:40.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.857+0000 7f0977fff640 1 -- 10.20.193.91:0/1026725629 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0970001800 con 0x55d2e7409050 2026-02-12T03:58:40.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.857+0000 7f0977fff640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:40.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.857+0000 7f0977fff640 1 -- 10.20.193.91:0/1026725629 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f0970001c40 con 0x55d2e7409050 2026-02-12T03:58:40.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.857+0000 7f0977fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:40.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.857+0000 7f0977fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:40.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.857+0000 7f0977fff640 10 monclient: dump: 2026-02-12T03:58:40.879 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:40.880 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:40.880 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:40.880 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:40.880 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:40.880 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:40.881 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:40.881 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:40.881 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:40.881 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:40.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.857+0000 7f0986ca4300 10 monclient: get_monmap_and_config success 2026-02-12T03:58:40.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.857+0000 7f0986ca4300 4 set_mon_vals no callback set 2026-02-12T03:58:40.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.858+0000 7f0986ca4300 10 monclient: shutdown 2026-02-12T03:58:40.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.858+0000 7f0986ca4300 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:40.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.858+0000 7f0986ca4300 1 -- 10.20.193.91:0/1026725629 >> v1:10.20.193.98:6789/0 conn(0x55d2e7409050 legacy=0x55d2e740f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:40.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.858+0000 7f0986ca4300 1 -- 10.20.193.91:0/1026725629 shutdown_connections 2026-02-12T03:58:40.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.858+0000 7f0986ca4300 1 -- 10.20.193.91:0/1026725629 >> 10.20.193.91:0/1026725629 conn(0x55d2e740d060 msgr2=0x55d2e740d460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:40.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.858+0000 7f0986ca4300 1 -- 10.20.193.91:0/1026725629 shutdown_connections 2026-02-12T03:58:40.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.858+0000 7f0986ca4300 1 -- 10.20.193.91:0/1026725629 wait complete. 2026-02-12T03:58:40.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.858+0000 7f0986ca4300 10 monclient: build_initial_monmap 2026-02-12T03:58:40.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.858+0000 7f0986ca4300 10 monclient: monmap: 2026-02-12T03:58:40.883 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:40.883 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:40.884 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:40.884 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:40.884 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:40.884 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:40.884 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:40.884 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:40.885 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:40.885 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:40.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.858+0000 7f0986ca4300 1 librados: starting msgr at 2026-02-12T03:58:40.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.858+0000 7f0986ca4300 1 librados: starting objecter 2026-02-12T03:58:40.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.858+0000 7f0986ca4300 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:40.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.859+0000 7f0986ca4300 1 Processor -- start 2026-02-12T03:58:40.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.859+0000 7f0986ca4300 1 -- start start 2026-02-12T03:58:40.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.859+0000 7f0986ca4300 1 librados: setting wanted keys 2026-02-12T03:58:40.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.859+0000 7f0986ca4300 1 librados: calling monclient init 2026-02-12T03:58:40.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.859+0000 7f0986ca4300 10 monclient: init 2026-02-12T03:58:40.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.859+0000 7f0986ca4300 10 monclient: _reopen_session rank -1 2026-02-12T03:58:40.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.859+0000 7f0986ca4300 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T03:58:40.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.859+0000 7f0986ca4300 10 monclient(hunting): picked mon.noname-b con 0x55d2e740e5c0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:40.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.859+0000 7f0986ca4300 10 monclient(hunting): picked mon.noname-a con 0x55d2e74aff10 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:40.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.859+0000 7f0986ca4300 10 monclient(hunting): picked mon.noname-c con 0x55d2e740f940 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:40.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.859+0000 7f0986ca4300 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55d2e7486ee0 con 0x55d2e74aff10 2026-02-12T03:58:40.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.859+0000 7f0986ca4300 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55d2e748a3d0 con 0x55d2e740e5c0 2026-02-12T03:58:40.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.859+0000 7f0986ca4300 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55d2e7491610 con 0x55d2e740f940 2026-02-12T03:58:40.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.859+0000 7f0986ca4300 10 monclient(hunting): _renew_subs 2026-02-12T03:58:40.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.859+0000 7f0986ca4300 10 monclient(hunting): authenticate will time out at 1123.602460s 2026-02-12T03:58:40.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.859+0000 7f098575b640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x55d2e740e5c0 0x55d2e748ab70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:48226/0 (socket says 10.20.193.91:48226) 2026-02-12T03:58:40.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.859+0000 7f098575b640 1 -- 10.20.193.91:0/2422294212 learned_addr learned my addr 10.20.193.91:0/2422294212 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:40.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.860+0000 7f09757fa640 10 client.?.objecter ms_handle_connect 0x55d2e740e5c0 2026-02-12T03:58:40.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.860+0000 7f09757fa640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:40.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.860+0000 7f09757fa640 10 client.?.objecter ms_handle_connect 0x55d2e74aff10 2026-02-12T03:58:40.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.860+0000 7f09757fa640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:40.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.861+0000 7f09757fa640 1 -- 10.20.193.91:0/2422294212 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1151617522 0 0) 0x55d2e748a3d0 con 0x55d2e740e5c0 2026-02-12T03:58:40.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.861+0000 7f09757fa640 10 monclient(hunting): _negotiate 2026-02-12T03:58:40.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.861+0000 7f09757fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:40.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.861+0000 7f09757fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:40.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.861+0000 7f09757fa640 10 monclient(hunting): my global_id is 4366 2026-02-12T03:58:40.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.861+0000 7f09757fa640 1 -- 10.20.193.91:0/2422294212 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0964001e10 con 0x55d2e740e5c0 2026-02-12T03:58:40.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.861+0000 7f09757fa640 10 client.?.objecter ms_handle_connect 0x55d2e740f940 2026-02-12T03:58:40.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.861+0000 7f09757fa640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:40.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.862+0000 7f09757fa640 1 -- 10.20.193.91:0/2422294212 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2899867682 0 0) 0x55d2e7491610 con 0x55d2e740f940 2026-02-12T03:58:40.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.862+0000 7f09757fa640 10 monclient(hunting): _negotiate 2026-02-12T03:58:40.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.862+0000 7f09757fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:40.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.862+0000 7f09757fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:40.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.862+0000 7f09757fa640 10 monclient(hunting): my global_id is 4328 2026-02-12T03:58:40.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.862+0000 7f09757fa640 1 -- 10.20.193.91:0/2422294212 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x55d2e748a3d0 con 0x55d2e740f940 2026-02-12T03:58:40.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.862+0000 7f09757fa640 1 -- 10.20.193.91:0/2422294212 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 837982197 0 0) 0x55d2e7486ee0 con 0x55d2e74aff10 2026-02-12T03:58:40.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.862+0000 7f09757fa640 10 monclient(hunting): _negotiate 2026-02-12T03:58:40.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.862+0000 7f09757fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:40.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.862+0000 7f09757fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:40.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.862+0000 7f09757fa640 10 monclient(hunting): my global_id is 4374 2026-02-12T03:58:40.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.862+0000 7f09757fa640 1 -- 10.20.193.91:0/2422294212 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x55d2e7491610 con 0x55d2e74aff10 2026-02-12T03:58:40.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.863+0000 7f09757fa640 1 -- 10.20.193.91:0/2422294212 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3302977617 0 0) 0x7f0964001e10 con 0x55d2e740e5c0 2026-02-12T03:58:40.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.863+0000 7f09757fa640 1 -- 10.20.193.91:0/2422294212 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x55d2e7486ee0 con 0x55d2e740e5c0 2026-02-12T03:58:40.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.863+0000 7f09757fa640 1 -- 10.20.193.91:0/2422294212 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f097c001730 con 0x55d2e740e5c0 2026-02-12T03:58:40.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.863+0000 7f09757fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:40.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.863+0000 7f09757fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:40.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.863+0000 7f09757fa640 10 monclient(hunting): dump: 2026-02-12T03:58:40.893 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:40.893 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:40.893 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:40.893 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:40.893 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:40.894 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:40.894 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:40.894 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:40.894 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:40.894 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:40.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.863+0000 7f09757fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:40.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.865+0000 7f09757fa640 1 -- 10.20.193.91:0/2422294212 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2989261496 0 0) 0x55d2e748a3d0 con 0x55d2e740f940 2026-02-12T03:58:40.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.865+0000 7f09757fa640 1 -- 10.20.193.91:0/2422294212 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0964001e10 con 0x55d2e740f940 2026-02-12T03:58:40.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.865+0000 7f09757fa640 1 -- 10.20.193.91:0/2422294212 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f0978001b80 con 0x55d2e740f940 2026-02-12T03:58:40.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.865+0000 7f09757fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:40.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.865+0000 7f09757fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:40.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.865+0000 7f09757fa640 10 monclient(hunting): dump: 2026-02-12T03:58:40.895 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:40.895 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:40.895 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:40.896 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:40.896 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:40.896 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:40.896 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:40.896 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:40.896 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:40.896 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:40.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.865+0000 7f09757fa640 1 -- 10.20.193.91:0/2422294212 <== mon.1 v1:10.20.193.98:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3028283215 0 0) 0x55d2e7486ee0 con 0x55d2e740e5c0 2026-02-12T03:58:40.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.865+0000 7f09757fa640 1 -- 10.20.193.91:0/2422294212 >> v1:10.20.193.111:6789/0 conn(0x55d2e740f940 legacy=0x55d2e7494710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:40.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.865+0000 7f09757fa640 1 -- 10.20.193.91:0/2422294212 >> v1:10.20.193.91:6789/0 conn(0x55d2e74aff10 legacy=0x55d2e740f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:40.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.865+0000 7f09757fa640 10 monclient: _finish_hunting 0 2026-02-12T03:58:40.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.865+0000 7f09757fa640 1 monclient: found mon.b 2026-02-12T03:58:40.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.865+0000 7f09757fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:40.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.865+0000 7f09757fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:40.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.865+0000 7f09757fa640 1 -- 10.20.193.91:0/2422294212 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2e74918f0 con 0x55d2e740e5c0 2026-02-12T03:58:40.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.865+0000 7f09757fa640 10 monclient: _finish_auth 0 2026-02-12T03:58:40.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.865+0000 7f09757fa640 10 monclient: _check_auth_tickets 2026-02-12T03:58:40.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.865+0000 7f09757fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:40.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.865+0000 7f0986ca4300 5 monclient: authenticate success, global_id 4366 2026-02-12T03:58:40.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.865+0000 7f0986ca4300 10 monclient: _renew_subs 2026-02-12T03:58:40.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.865+0000 7f0986ca4300 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:40.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.865+0000 7f0986ca4300 1 -- 10.20.193.91:0/2422294212 --> v1:10.20.193.98:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x55d2e7491bd0 con 0x55d2e740e5c0 2026-02-12T03:58:40.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.865+0000 7f0986ca4300 10 client.4366.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:40.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.865+0000 7f0986ca4300 10 monclient: _renew_subs 2026-02-12T03:58:40.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.865+0000 7f0986ca4300 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:40.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.865+0000 7f0986ca4300 1 -- 10.20.193.91:0/2422294212 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=0}) -- 0x55d2e748b280 con 0x55d2e740e5c0 2026-02-12T03:58:40.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.865+0000 7f0986ca4300 1 librados: init done 2026-02-12T03:58:40.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.865+0000 7f0986ca4300 10 librados: wait_for_osdmap waiting 2026-02-12T03:58:40.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.873+0000 7f09757fa640 1 -- 10.20.193.91:0/2422294212 <== mon.1 v1:10.20.193.98:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f097c0018d0 con 0x55d2e740e5c0 2026-02-12T03:58:40.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.873+0000 7f09757fa640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:40.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.873+0000 7f09757fa640 1 -- 10.20.193.91:0/2422294212 <== mon.1 v1:10.20.193.98:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f097c0032f0 con 0x55d2e740e5c0 2026-02-12T03:58:40.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.873+0000 7f09757fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:40.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.873+0000 7f09757fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:40.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.873+0000 7f09757fa640 10 monclient: dump: 2026-02-12T03:58:40.902 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:40.902 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:40.902 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:40.902 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:40.903 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:40.903 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:40.903 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:40.903 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:40.903 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:40.903 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:40.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.873+0000 7f09777fe640 4 set_mon_vals no callback set 2026-02-12T03:58:40.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.874+0000 7f09757fa640 1 -- 10.20.193.91:0/2422294212 <== mon.1 v1:10.20.193.98:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f097c01c7d0 con 0x55d2e740e5c0 2026-02-12T03:58:40.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.875+0000 7f0984f5a640 10 monclient: get_auth_request con 0x7f0964078750 auth_method 0 2026-02-12T03:58:40.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.875+0000 7f09757fa640 10 client.4366.objecter ms_handle_connect 0x7f0964078750 2026-02-12T03:58:40.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.875+0000 7f09757fa640 1 -- 10.20.193.91:0/2422294212 <== mon.1 v1:10.20.193.98:6789/0 8 ==== osd_map(25..25 src has 1..25) ==== 8102+0+0 (unknown 1693589480 0 0) 0x7f097c094370 con 0x55d2e740e5c0 2026-02-12T03:58:40.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.875+0000 7f09757fa640 10 client.4366.objecter ms_dispatch2 0x55d2e72ded30 osd_map(25..25 src has 1..25) 2026-02-12T03:58:40.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.875+0000 7f09757fa640 3 client.4366.objecter handle_osd_map got epochs [25,25] > 0 2026-02-12T03:58:40.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.875+0000 7f09757fa640 3 client.4366.objecter handle_osd_map decoding full epoch 25 2026-02-12T03:58:40.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.875+0000 7f09757fa640 20 client.4366.objecter dump_active .. 0 homeless 2026-02-12T03:58:40.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.875+0000 7f0986ca4300 10 librados: wait_for_osdmap done waiting 2026-02-12T03:58:40.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.875+0000 7f0986ca4300 10 start_mon_command cmd=[{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-12T03:58:40.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.875+0000 7f0986ca4300 10 monclient: _send_command 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-12T03:58:40.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.875+0000 7f0986ca4300 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:40.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:40.875+0000 7f0986ca4300 1 -- 10.20.193.91:0/2422294212 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x55d2e7485750 con 0x55d2e740e5c0 2026-02-12T03:58:41.850 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:41.847+0000 7f09757fa640 1 -- 10.20.193.91:0/2422294212 <== mon.1 v1:10.20.193.98:6789/0 9 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v26) ==== 141+0+0 (unknown 433528931 0 0) 0x7f097c05dcd0 con 0x55d2e740e5c0 2026-02-12T03:58:41.850 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:41.847+0000 7f09757fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-12T03:58:41.850 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:41.847+0000 7f09757fa640 10 monclient: _finish_command 1 = system:0 enabled application 'rbd' on pool 'rbd' 2026-02-12T03:58:41.850 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:41.848+0000 7f0986ca4300 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:41.850 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:41.848+0000 7f0986ca4300 1 -- 10.20.193.91:0/2422294212 --> v1:10.20.193.98:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x55d2e72bafb0 con 0x55d2e740e5c0 2026-02-12T03:58:41.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:41.886+0000 7f09757fa640 1 -- 10.20.193.91:0/2422294212 <== mon.1 v1:10.20.193.98:6789/0 10 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (unknown 2370098492 0 0) 0x7f097c05d3a0 con 0x55d2e740e5c0 2026-02-12T03:58:41.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:41.886+0000 7f09757fa640 10 monclient: handle_get_version_reply finishing 1 version 26 2026-02-12T03:58:41.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:41.886+0000 7f09777fe640 10 client.4366.objecter _get_latest_version latest 26, waiting 2026-02-12T03:58:41.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:41.886+0000 7f09777fe640 10 client.4366.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:41.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:41.886+0000 7f09777fe640 10 monclient: _renew_subs 2026-02-12T03:58:41.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:41.886+0000 7f09777fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:41.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:41.886+0000 7f09777fe640 1 -- 10.20.193.91:0/2422294212 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=26}) -- 0x7f095c002ae0 con 0x55d2e740e5c0 2026-02-12T03:58:41.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:41.888+0000 7f09757fa640 1 -- 10.20.193.91:0/2422294212 <== mon.1 v1:10.20.193.98:6789/0 11 ==== osd_map(26..26 src has 1..26) ==== 669+0+0 (unknown 478192764 0 0) 0x7f097c05ce90 con 0x55d2e740e5c0 2026-02-12T03:58:41.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:41.888+0000 7f09757fa640 10 client.4366.objecter ms_dispatch2 0x55d2e72ded30 osd_map(26..26 src has 1..26) 2026-02-12T03:58:41.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:41.888+0000 7f09757fa640 3 client.4366.objecter handle_osd_map got epochs [26,26] > 25 2026-02-12T03:58:41.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:41.888+0000 7f09757fa640 3 client.4366.objecter handle_osd_map decoding incremental epoch 26 2026-02-12T03:58:41.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:41.888+0000 7f09757fa640 20 client.4366.objecter dump_active .. 0 homeless 2026-02-12T03:58:41.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:41.888+0000 7f0986ca4300 10 librados: create oid=rbd_trash nspace= 2026-02-12T03:58:41.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:41.888+0000 7f0986ca4300 10 client.4366.objecter _op_submit op 0x55d2e7491030 2026-02-12T03:58:41.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:41.888+0000 7f0986ca4300 20 client.4366.objecter _calc_target epoch 26 base rbd_trash @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-12T03:58:41.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:41.888+0000 7f0986ca4300 20 client.4366.objecter _calc_target target rbd_trash @2 -> pgid 2.5a749323 2026-02-12T03:58:41.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:41.888+0000 7f0986ca4300 10 client.4366.objecter _calc_target raw pgid 2.5a749323 -> actual 2.3 acting [8,6] primary 8 2026-02-12T03:58:41.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:41.888+0000 7f0986ca4300 20 client.4366.objecter _get_session s=0x55d2e723b280 osd=8 3 2026-02-12T03:58:41.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:41.888+0000 7f0986ca4300 10 client.4366.objecter _op_submit oid rbd_trash '@2' '@2' [create] tid 1 osd.8 2026-02-12T03:58:41.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:41.888+0000 7f0986ca4300 20 client.4366.objecter get_session s=0x55d2e723b280 osd=8 3 2026-02-12T03:58:41.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:41.888+0000 7f0986ca4300 15 client.4366.objecter _session_op_assign 8 1 2026-02-12T03:58:41.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:41.888+0000 7f0986ca4300 15 client.4366.objecter _send_op 1 to 2.3 on osd.8 2026-02-12T03:58:41.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:41.888+0000 7f0986ca4300 1 -- 10.20.193.91:0/2422294212 --> v1:10.20.193.91:6809/443384425 -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26) -- 0x55d2e7473330 con 0x55d2e7471840 2026-02-12T03:58:41.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:41.888+0000 7f0986ca4300 20 client.4366.objecter put_session s=0x55d2e723b280 osd=8 4 2026-02-12T03:58:41.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:41.888+0000 7f0986ca4300 5 client.4366.objecter 1 in flight 2026-02-12T03:58:41.934 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:41.932+0000 7f09869e4640 10 monclient: get_auth_request con 0x55d2e7471840 auth_method 0 2026-02-12T03:58:41.936 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:41.935+0000 7f09757fa640 10 client.4366.objecter ms_handle_connect 0x55d2e7471840 2026-02-12T03:58:42.414 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.412+0000 7f09869e4640 1 -- 10.20.193.91:0/2422294212 <== osd.8 v1:10.20.193.91:6809/443384425 1 ==== osd_op_reply(1 rbd_trash [create] v26'1 uv1 ondisk = 0) ==== 153+0+0 (unknown 504360132 0 0) 0x7f0978004540 con 0x55d2e7471840 2026-02-12T03:58:42.415 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.412+0000 7f09869e4640 10 client.4366.objecter ms_dispatch2 0x55d2e72ded30 osd_op_reply(1 rbd_trash [create] v26'1 uv1 ondisk = 0) 2026-02-12T03:58:42.415 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.412+0000 7f09869e4640 10 client.4366.objecter in handle_osd_op_reply 2026-02-12T03:58:42.415 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.412+0000 7f09869e4640 7 client.4366.objecter handle_osd_op_reply 1 ondisk uv 1 in 2.3 attempt 0 2026-02-12T03:58:42.415 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.412+0000 7f09869e4640 10 client.4366.objecter op 0 rval 0 len 0 2026-02-12T03:58:42.415 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.412+0000 7f09869e4640 15 client.4366.objecter handle_osd_op_reply completed tid 1 2026-02-12T03:58:42.415 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.412+0000 7f09869e4640 15 client.4366.objecter _finish_op 1 2026-02-12T03:58:42.415 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.412+0000 7f09869e4640 20 client.4366.objecter put_session s=0x55d2e723b280 osd=8 4 2026-02-12T03:58:42.415 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.412+0000 7f09869e4640 15 client.4366.objecter _session_op_remove 8 1 2026-02-12T03:58:42.415 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.412+0000 7f09869e4640 5 client.4366.objecter 0 in flight 2026-02-12T03:58:42.416 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.412+0000 7f0986ca4300 10 librados: Objecter returned from create r=0 2026-02-12T03:58:42.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.414+0000 7f0986ca4300 10 client.4366.objecter _op_submit op 0x55d2e758a7c0 2026-02-12T03:58:42.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.414+0000 7f0986ca4300 20 client.4366.objecter _calc_target epoch 26 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:58:42.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.414+0000 7f0986ca4300 20 client.4366.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-12T03:58:42.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.414+0000 7f0986ca4300 10 client.4366.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [8,11] primary 8 2026-02-12T03:58:42.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.414+0000 7f0986ca4300 10 client.4366.objecter chose random osd.11 of [8,11] 2026-02-12T03:58:42.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.414+0000 7f0986ca4300 20 client.4366.objecter _get_session s=0x55d2e758acd0 osd=11 3 2026-02-12T03:58:42.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.414+0000 7f0986ca4300 10 client.4366.objecter _op_submit oid rbd_info '@2' '@2' [call rbd.metadata_list in=33b] tid 2 osd.11 2026-02-12T03:58:42.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.414+0000 7f0986ca4300 20 client.4366.objecter get_session s=0x55d2e758acd0 osd=11 3 2026-02-12T03:58:42.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.414+0000 7f0986ca4300 15 client.4366.objecter _session_op_assign 11 2 2026-02-12T03:58:42.418 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.414+0000 7f0986ca4300 15 client.4366.objecter _send_op 2 to 2.2 on osd.11 2026-02-12T03:58:42.418 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.414+0000 7f0986ca4300 1 -- 10.20.193.91:0/2422294212 --> v1:10.20.193.154:6804/2902069275 -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e26) -- 0x55d2e75ad210 con 0x55d2e758b710 2026-02-12T03:58:42.418 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.414+0000 7f0986ca4300 20 client.4366.objecter put_session s=0x55d2e758acd0 osd=11 4 2026-02-12T03:58:42.418 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.414+0000 7f0986ca4300 5 client.4366.objecter 1 in flight 2026-02-12T03:58:42.440 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.438+0000 7f098575b640 10 monclient: get_auth_request con 0x55d2e758b710 auth_method 0 2026-02-12T03:58:42.442 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.440+0000 7f09757fa640 10 client.4366.objecter ms_handle_connect 0x55d2e758b710 2026-02-12T03:58:42.509 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.507+0000 7f098575b640 1 -- 10.20.193.91:0/2422294212 <== osd.11 v1:10.20.193.154:6804/2902069275 1 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) ==== 152+0+0 (unknown 3207948 0 0) 0x7f097c05d830 con 0x55d2e758b710 2026-02-12T03:58:42.509 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.507+0000 7f098575b640 10 client.4366.objecter ms_dispatch2 0x55d2e72ded30 osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) 2026-02-12T03:58:42.509 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.507+0000 7f098575b640 10 client.4366.objecter in handle_osd_op_reply 2026-02-12T03:58:42.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.507+0000 7f098575b640 7 client.4366.objecter handle_osd_op_reply 2 ondisk uv 0 in 2.2 attempt 0 2026-02-12T03:58:42.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.507+0000 7f098575b640 7 client.4366.objecter got -EAGAIN, resubmitting 2026-02-12T03:58:42.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.507+0000 7f098575b640 20 client.4366.objecter put_session s=0x55d2e758acd0 osd=11 4 2026-02-12T03:58:42.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.507+0000 7f098575b640 15 client.4366.objecter _session_op_remove 11 2 2026-02-12T03:58:42.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.507+0000 7f098575b640 10 client.4366.objecter _op_submit op 0x55d2e758a7c0 2026-02-12T03:58:42.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.507+0000 7f098575b640 20 client.4366.objecter _calc_target epoch 26 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:58:42.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.507+0000 7f098575b640 20 client.4366.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-12T03:58:42.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.507+0000 7f098575b640 10 client.4366.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [8,11] primary 8 2026-02-12T03:58:42.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.507+0000 7f098575b640 20 client.4366.objecter _get_session s=0x55d2e723b280 osd=8 3 2026-02-12T03:58:42.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.507+0000 7f098575b640 10 client.4366.objecter _op_submit oid rbd_info '@2' '@2' [call rbd.metadata_list in=33b] tid 3 osd.8 2026-02-12T03:58:42.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.507+0000 7f098575b640 20 client.4366.objecter get_session s=0x55d2e723b280 osd=8 3 2026-02-12T03:58:42.511 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.507+0000 7f098575b640 15 client.4366.objecter _session_op_assign 8 3 2026-02-12T03:58:42.511 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.507+0000 7f098575b640 15 client.4366.objecter _send_op 3 to 2.2 on osd.8 2026-02-12T03:58:42.511 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.507+0000 7f098575b640 1 -- 10.20.193.91:0/2422294212 --> v1:10.20.193.91:6809/443384425 -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e26) -- 0x55d2e75ad210 con 0x55d2e7471840 2026-02-12T03:58:42.511 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.507+0000 7f098575b640 20 client.4366.objecter put_session s=0x55d2e723b280 osd=8 4 2026-02-12T03:58:42.511 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.507+0000 7f098575b640 5 client.4366.objecter 1 in flight 2026-02-12T03:58:42.524 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.521+0000 7f09869e4640 1 -- 10.20.193.91:0/2422294212 <== osd.8 v1:10.20.193.91:6809/443384425 2 ==== osd_op_reply(3 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (unknown 1625984120 0 0) 0x7f0978004540 con 0x55d2e7471840 2026-02-12T03:58:42.524 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.521+0000 7f09869e4640 10 client.4366.objecter ms_dispatch2 0x55d2e72ded30 osd_op_reply(3 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-12T03:58:42.525 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.521+0000 7f09869e4640 10 client.4366.objecter in handle_osd_op_reply 2026-02-12T03:58:42.525 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.521+0000 7f09869e4640 7 client.4366.objecter handle_osd_op_reply 3 ondisk uv 0 in 2.2 attempt 1 2026-02-12T03:58:42.525 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.521+0000 7f09869e4640 10 client.4366.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-12T03:58:42.525 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.521+0000 7f09869e4640 10 client.4366.objecter op 0 rval 0 len 0 2026-02-12T03:58:42.525 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.521+0000 7f09869e4640 15 client.4366.objecter handle_osd_op_reply completed tid 3 2026-02-12T03:58:42.525 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.521+0000 7f09869e4640 15 client.4366.objecter _finish_op 3 2026-02-12T03:58:42.525 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.521+0000 7f09869e4640 20 client.4366.objecter put_session s=0x55d2e723b280 osd=8 4 2026-02-12T03:58:42.526 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.521+0000 7f09869e4640 15 client.4366.objecter _session_op_remove 8 3 2026-02-12T03:58:42.526 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.521+0000 7f09869e4640 5 client.4366.objecter 0 in flight 2026-02-12T03:58:42.526 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.521+0000 7f0986ca4300 10 client.4366.objecter _op_submit op 0x55d2e7589920 2026-02-12T03:58:42.526 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.521+0000 7f0986ca4300 20 client.4366.objecter _calc_target epoch 26 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:58:42.526 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.521+0000 7f0986ca4300 20 client.4366.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-12T03:58:42.526 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.521+0000 7f0986ca4300 10 client.4366.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [8,11] primary 8 2026-02-12T03:58:42.526 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.521+0000 7f0986ca4300 10 client.4366.objecter chose random osd.8 of [8,11] 2026-02-12T03:58:42.526 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.521+0000 7f0986ca4300 20 client.4366.objecter _get_session s=0x55d2e723b280 osd=8 3 2026-02-12T03:58:42.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.521+0000 7f0986ca4300 10 client.4366.objecter _op_submit oid rbd_info '@2' '@2' [read 0~0] tid 4 osd.8 2026-02-12T03:58:42.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.521+0000 7f0986ca4300 20 client.4366.objecter get_session s=0x55d2e723b280 osd=8 3 2026-02-12T03:58:42.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.521+0000 7f0986ca4300 15 client.4366.objecter _session_op_assign 8 4 2026-02-12T03:58:42.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.521+0000 7f0986ca4300 15 client.4366.objecter _send_op 4 to 2.2 on osd.8 2026-02-12T03:58:42.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.521+0000 7f0986ca4300 1 -- 10.20.193.91:0/2422294212 --> v1:10.20.193.91:6809/443384425 -- osd_op(unknown.0.0:4 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e26) -- 0x55d2e7589dd0 con 0x55d2e7471840 2026-02-12T03:58:42.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.521+0000 7f0986ca4300 20 client.4366.objecter put_session s=0x55d2e723b280 osd=8 4 2026-02-12T03:58:42.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.521+0000 7f0986ca4300 5 client.4366.objecter 1 in flight 2026-02-12T03:58:42.529 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.526+0000 7f09869e4640 1 -- 10.20.193.91:0/2422294212 <== osd.8 v1:10.20.193.91:6809/443384425 3 ==== osd_op_reply(4 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (unknown 3580297533 0 0) 0x7f0978004540 con 0x55d2e7471840 2026-02-12T03:58:42.529 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.526+0000 7f09869e4640 10 client.4366.objecter ms_dispatch2 0x55d2e72ded30 osd_op_reply(4 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-12T03:58:42.529 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.526+0000 7f09869e4640 10 client.4366.objecter in handle_osd_op_reply 2026-02-12T03:58:42.529 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.526+0000 7f09869e4640 7 client.4366.objecter handle_osd_op_reply 4 ondisk uv 0 in 2.2 attempt 0 2026-02-12T03:58:42.529 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.526+0000 7f09869e4640 10 client.4366.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-12T03:58:42.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.526+0000 7f09869e4640 10 client.4366.objecter op 0 rval 0 len 0 2026-02-12T03:58:42.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.526+0000 7f09869e4640 15 client.4366.objecter handle_osd_op_reply completed tid 4 2026-02-12T03:58:42.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.526+0000 7f09869e4640 15 client.4366.objecter _finish_op 4 2026-02-12T03:58:42.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.526+0000 7f09869e4640 20 client.4366.objecter put_session s=0x55d2e723b280 osd=8 4 2026-02-12T03:58:42.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.526+0000 7f09869e4640 15 client.4366.objecter _session_op_remove 8 4 2026-02-12T03:58:42.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.526+0000 7f09869e4640 5 client.4366.objecter 0 in flight 2026-02-12T03:58:42.530 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.526+0000 7f0976ffd640 10 client.4366.objecter allocate_selfmanaged_snap; pool: 2 2026-02-12T03:58:42.531 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.526+0000 7f0976ffd640 10 client.4366.objecter pool_op_submit 5 2026-02-12T03:58:42.531 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.526+0000 7f0976ffd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:42.531 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.526+0000 7f0976ffd640 1 -- 10.20.193.91:0/2422294212 --> v1:10.20.193.98:6789/0 -- pool_op(create unmanaged snap pool 2 tid 5 name v0) -- 0x7f0960003110 con 0x55d2e740e5c0 2026-02-12T03:58:42.961 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.958+0000 7f09757fa640 1 -- 10.20.193.91:0/2422294212 <== mon.1 v1:10.20.193.98:6789/0 12 ==== pool_op_reply(tid 5 (0) Success v27) ==== 55+0+0 (unknown 1249227188 0 0) 0x7f097c062cb0 con 0x55d2e740e5c0 2026-02-12T03:58:42.961 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.958+0000 7f09757fa640 10 client.4366.objecter ms_dispatch2 0x55d2e72ded30 pool_op_reply(tid 5 (0) Success v27) 2026-02-12T03:58:42.961 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.958+0000 7f09757fa640 10 client.4366.objecter handle_pool_op_reply pool_op_reply(tid 5 (0) Success v27) 2026-02-12T03:58:42.961 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.958+0000 7f09757fa640 10 client.4366.objecter have request 5 at 0x7f09600030a0 Op: create unmanaged snap 2026-02-12T03:58:42.961 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.958+0000 7f09757fa640 20 client.4366.objecter waiting for client to reach epoch 27 before calling back 2026-02-12T03:58:42.961 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.958+0000 7f09757fa640 10 client.4366.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:42.961 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.958+0000 7f09757fa640 10 monclient: _renew_subs 2026-02-12T03:58:42.961 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.958+0000 7f09757fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:42.962 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.958+0000 7f09757fa640 1 -- 10.20.193.91:0/2422294212 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=27}) -- 0x55d2e7486ee0 con 0x55d2e740e5c0 2026-02-12T03:58:42.962 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.958+0000 7f09757fa640 10 client.4366.objecter done 2026-02-12T03:58:42.963 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.960+0000 7f09757fa640 1 -- 10.20.193.91:0/2422294212 <== mon.1 v1:10.20.193.98:6789/0 13 ==== osd_map(27..27 src has 1..27) ==== 629+0+0 (unknown 127584990 0 0) 0x7f097c05b2d0 con 0x55d2e740e5c0 2026-02-12T03:58:42.963 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.960+0000 7f09757fa640 10 client.4366.objecter ms_dispatch2 0x55d2e72ded30 osd_map(27..27 src has 1..27) 2026-02-12T03:58:42.963 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.960+0000 7f09757fa640 3 client.4366.objecter handle_osd_map got epochs [27,27] > 26 2026-02-12T03:58:42.963 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.960+0000 7f09757fa640 3 client.4366.objecter handle_osd_map decoding incremental epoch 27 2026-02-12T03:58:42.963 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.960+0000 7f09757fa640 20 client.4366.objecter dump_active .. 0 homeless 2026-02-12T03:58:42.963 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.960+0000 7f09777fe640 20 librados: queue_aio_write 0x55d2e7585d50 completion 0x55d2e74ba5b0 write_seq 1 2026-02-12T03:58:42.963 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.960+0000 7f09777fe640 10 client.4366.objecter _op_submit op 0x7f095c0063b0 2026-02-12T03:58:42.963 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.960+0000 7f09777fe640 20 client.4366.objecter _calc_target epoch 27 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-12T03:58:42.964 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.960+0000 7f09777fe640 20 client.4366.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-12T03:58:42.964 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.960+0000 7f09777fe640 10 client.4366.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [8,11] primary 8 2026-02-12T03:58:42.964 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.960+0000 7f09777fe640 20 client.4366.objecter _get_session s=0x55d2e723b280 osd=8 3 2026-02-12T03:58:42.964 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.960+0000 7f09777fe640 10 client.4366.objecter _op_submit oid rbd_info '@2' '@2' [create,write 0~8 in=8b] tid 6 osd.8 2026-02-12T03:58:42.964 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.960+0000 7f09777fe640 20 client.4366.objecter get_session s=0x55d2e723b280 osd=8 3 2026-02-12T03:58:42.964 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.960+0000 7f09777fe640 15 client.4366.objecter _session_op_assign 8 6 2026-02-12T03:58:42.964 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.960+0000 7f09777fe640 15 client.4366.objecter _send_op 6 to 2.2 on osd.8 2026-02-12T03:58:42.964 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.960+0000 7f09777fe640 1 -- 10.20.193.91:0/2422294212 --> v1:10.20.193.91:6809/443384425 -- osd_op(unknown.0.0:6 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x7f095c0068c0 con 0x55d2e7471840 2026-02-12T03:58:42.964 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.960+0000 7f09777fe640 20 client.4366.objecter put_session s=0x55d2e723b280 osd=8 4 2026-02-12T03:58:42.964 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:42.960+0000 7f09777fe640 5 client.4366.objecter 1 in flight 2026-02-12T03:58:43.074 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.072+0000 7f09869e4640 1 -- 10.20.193.91:0/2422294212 <== osd.8 v1:10.20.193.91:6809/443384425 4 ==== osd_op_reply(6 rbd_info [create,write 0~8] v27'1 uv1 ondisk = 0) ==== 194+0+0 (unknown 3272180499 0 0) 0x7f0978004540 con 0x55d2e7471840 2026-02-12T03:58:43.075 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.072+0000 7f09869e4640 10 client.4366.objecter ms_dispatch2 0x55d2e72ded30 osd_op_reply(6 rbd_info [create,write 0~8] v27'1 uv1 ondisk = 0) 2026-02-12T03:58:43.075 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.072+0000 7f09869e4640 10 client.4366.objecter in handle_osd_op_reply 2026-02-12T03:58:43.075 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.072+0000 7f09869e4640 7 client.4366.objecter handle_osd_op_reply 6 ondisk uv 1 in 2.2 attempt 0 2026-02-12T03:58:43.075 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.072+0000 7f09869e4640 10 client.4366.objecter op 0 rval 0 len 0 2026-02-12T03:58:43.075 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.072+0000 7f09869e4640 10 client.4366.objecter op 1 rval 0 len 0 2026-02-12T03:58:43.075 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.072+0000 7f09869e4640 15 client.4366.objecter handle_osd_op_reply completed tid 6 2026-02-12T03:58:43.075 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.072+0000 7f09869e4640 15 client.4366.objecter _finish_op 6 2026-02-12T03:58:43.075 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.072+0000 7f09869e4640 20 client.4366.objecter put_session s=0x55d2e723b280 osd=8 4 2026-02-12T03:58:43.075 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.072+0000 7f09869e4640 15 client.4366.objecter _session_op_remove 8 6 2026-02-12T03:58:43.075 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.072+0000 7f09869e4640 5 client.4366.objecter 0 in flight 2026-02-12T03:58:43.076 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.072+0000 7f09869e4640 20 librados: complete_aio_write 0x55d2e74ba5b0 2026-02-12T03:58:43.076 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.072+0000 7f0976ffd640 10 client.4366.objecter delete_selfmanaged_snap; pool: 2; snap: 2 2026-02-12T03:58:43.076 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.072+0000 7f0976ffd640 10 client.4366.objecter pool_op_submit 7 2026-02-12T03:58:43.076 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.072+0000 7f0976ffd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:43.076 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.072+0000 7f0976ffd640 1 -- 10.20.193.91:0/2422294212 --> v1:10.20.193.98:6789/0 -- pool_op(delete unmanaged snap pool 2 tid 7 name v27) -- 0x7f09600033b0 con 0x55d2e740e5c0 2026-02-12T03:58:43.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.859+0000 7f096bfff640 10 monclient: tick 2026-02-12T03:58:43.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.859+0000 7f096bfff640 10 monclient: _check_auth_tickets 2026-02-12T03:58:43.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.859+0000 7f096bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:43.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.859+0000 7f096bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:43.975 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.973+0000 7f09757fa640 1 -- 10.20.193.91:0/2422294212 <== mon.1 v1:10.20.193.98:6789/0 14 ==== pool_op_reply(tid 7 (0) Success v28) ==== 43+0+0 (unknown 1580289707 0 0) 0x7f097c067e40 con 0x55d2e740e5c0 2026-02-12T03:58:43.975 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.973+0000 7f09757fa640 10 client.4366.objecter ms_dispatch2 0x55d2e72ded30 pool_op_reply(tid 7 (0) Success v28) 2026-02-12T03:58:43.975 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.973+0000 7f09757fa640 10 client.4366.objecter handle_pool_op_reply pool_op_reply(tid 7 (0) Success v28) 2026-02-12T03:58:43.975 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.973+0000 7f09757fa640 10 client.4366.objecter have request 7 at 0x7f09600030a0 Op: delete unmanaged snap 2026-02-12T03:58:43.975 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.973+0000 7f09757fa640 20 client.4366.objecter waiting for client to reach epoch 28 before calling back 2026-02-12T03:58:43.975 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.973+0000 7f09757fa640 10 client.4366.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:43.975 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.973+0000 7f09757fa640 10 monclient: _renew_subs 2026-02-12T03:58:43.976 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.973+0000 7f09757fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:43.976 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.973+0000 7f09757fa640 1 -- 10.20.193.91:0/2422294212 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=28}) -- 0x55d2e748a3d0 con 0x55d2e740e5c0 2026-02-12T03:58:43.976 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.973+0000 7f09757fa640 10 client.4366.objecter done 2026-02-12T03:58:43.978 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.974+0000 7f09757fa640 1 -- 10.20.193.91:0/2422294212 <== mon.1 v1:10.20.193.98:6789/0 15 ==== osd_map(28..28 src has 1..28) ==== 657+0+0 (unknown 3983280302 0 0) 0x7f097c05b4d0 con 0x55d2e740e5c0 2026-02-12T03:58:43.978 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.974+0000 7f09757fa640 10 client.4366.objecter ms_dispatch2 0x55d2e72ded30 osd_map(28..28 src has 1..28) 2026-02-12T03:58:43.978 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.974+0000 7f09757fa640 3 client.4366.objecter handle_osd_map got epochs [28,28] > 27 2026-02-12T03:58:43.978 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.974+0000 7f09757fa640 3 client.4366.objecter handle_osd_map decoding incremental epoch 28 2026-02-12T03:58:43.978 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.974+0000 7f09757fa640 20 client.4366.objecter dump_active .. 0 homeless 2026-02-12T03:58:43.979 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.974+0000 7f09777fe640 20 librados: queue_aio_write 0x55d2e7585d50 completion 0x7f0960001da0 write_seq 2 2026-02-12T03:58:43.979 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.974+0000 7f09777fe640 10 client.4366.objecter _op_submit op 0x7f095c0063b0 2026-02-12T03:58:43.979 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.974+0000 7f09777fe640 20 client.4366.objecter _calc_target epoch 28 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-12T03:58:43.979 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.974+0000 7f09777fe640 20 client.4366.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-12T03:58:43.979 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.974+0000 7f09777fe640 10 client.4366.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [8,11] primary 8 2026-02-12T03:58:43.979 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.974+0000 7f09777fe640 20 client.4366.objecter _get_session s=0x55d2e723b280 osd=8 3 2026-02-12T03:58:43.979 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.974+0000 7f09777fe640 10 client.4366.objecter _op_submit oid rbd_info '@2' '@2' [write 0~19 in=19b] tid 8 osd.8 2026-02-12T03:58:43.979 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.974+0000 7f09777fe640 20 client.4366.objecter get_session s=0x55d2e723b280 osd=8 3 2026-02-12T03:58:43.979 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.974+0000 7f09777fe640 15 client.4366.objecter _session_op_assign 8 8 2026-02-12T03:58:43.980 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.974+0000 7f09777fe640 15 client.4366.objecter _send_op 8 to 2.2 on osd.8 2026-02-12T03:58:43.980 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.974+0000 7f09777fe640 1 -- 10.20.193.91:0/2422294212 --> v1:10.20.193.91:6809/443384425 -- osd_op(unknown.0.0:8 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28) -- 0x7f095c006df0 con 0x55d2e7471840 2026-02-12T03:58:43.980 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.974+0000 7f09777fe640 20 client.4366.objecter put_session s=0x55d2e723b280 osd=8 4 2026-02-12T03:58:43.980 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:43.974+0000 7f09777fe640 5 client.4366.objecter 1 in flight 2026-02-12T03:58:44.101 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.097+0000 7f09869e4640 1 -- 10.20.193.91:0/2422294212 <== osd.8 v1:10.20.193.91:6809/443384425 5 ==== osd_op_reply(8 rbd_info [write 0~19] v28'2 uv2 ondisk = 0) ==== 152+0+0 (unknown 1447781391 0 0) 0x7f0978004540 con 0x55d2e7471840 2026-02-12T03:58:44.101 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.097+0000 7f09869e4640 10 client.4366.objecter ms_dispatch2 0x55d2e72ded30 osd_op_reply(8 rbd_info [write 0~19] v28'2 uv2 ondisk = 0) 2026-02-12T03:58:44.101 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.097+0000 7f09869e4640 10 client.4366.objecter in handle_osd_op_reply 2026-02-12T03:58:44.101 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.097+0000 7f09869e4640 7 client.4366.objecter handle_osd_op_reply 8 ondisk uv 2 in 2.2 attempt 0 2026-02-12T03:58:44.101 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.097+0000 7f09869e4640 10 client.4366.objecter op 0 rval 0 len 0 2026-02-12T03:58:44.101 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.097+0000 7f09869e4640 15 client.4366.objecter handle_osd_op_reply completed tid 8 2026-02-12T03:58:44.101 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.097+0000 7f09869e4640 15 client.4366.objecter _finish_op 8 2026-02-12T03:58:44.101 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.097+0000 7f09869e4640 20 client.4366.objecter put_session s=0x55d2e723b280 osd=8 4 2026-02-12T03:58:44.101 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.097+0000 7f09869e4640 15 client.4366.objecter _session_op_remove 8 8 2026-02-12T03:58:44.102 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.097+0000 7f09869e4640 5 client.4366.objecter 0 in flight 2026-02-12T03:58:44.102 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.097+0000 7f09869e4640 20 librados: complete_aio_write 0x7f0960001da0 2026-02-12T03:58:44.102 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.097+0000 7f0986ca4300 10 librados: watch_flush enter 2026-02-12T03:58:44.102 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.097+0000 7f0986ca4300 10 librados: watch_flush exit 2026-02-12T03:58:44.102 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.097+0000 7f0986ca4300 10 client.4366.objecter close_session for osd.8 2026-02-12T03:58:44.102 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.097+0000 7f0986ca4300 1 -- 10.20.193.91:0/2422294212 >> v1:10.20.193.91:6809/443384425 conn(0x55d2e7471840 legacy=0x55d2e7471c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:44.102 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.097+0000 7f0986ca4300 20 client.4366.objecter put_session s=0x55d2e723b280 osd=8 1 2026-02-12T03:58:44.102 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.097+0000 7f0986ca4300 10 client.4366.objecter close_session for osd.11 2026-02-12T03:58:44.102 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.097+0000 7f0986ca4300 1 -- 10.20.193.91:0/2422294212 >> v1:10.20.193.154:6804/2902069275 conn(0x55d2e758b710 legacy=0x55d2e75abaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:44.102 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.097+0000 7f0986ca4300 20 client.4366.objecter put_session s=0x55d2e758acd0 osd=11 1 2026-02-12T03:58:44.102 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.097+0000 7f0986ca4300 20 client.4366.objecter shutdown clearing up homeless session... 2026-02-12T03:58:44.102 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.097+0000 7f0986ca4300 10 client.4366.objecter successfully canceled tick 2026-02-12T03:58:44.103 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.097+0000 7f0986ca4300 1 -- 10.20.193.91:0/2422294212 >> v1:10.20.193.91:6800/2929217192 conn(0x7f0964078750 legacy=0x7f0964098c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:44.103 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.097+0000 7f0986ca4300 10 monclient: shutdown 2026-02-12T03:58:44.103 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.097+0000 7f09869e4640 1 -- 10.20.193.91:0/2422294212 reap_dead start 2026-02-12T03:58:44.103 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.097+0000 7f0986ca4300 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:44.103 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.097+0000 7f0986ca4300 1 -- 10.20.193.91:0/2422294212 >> v1:10.20.193.98:6789/0 conn(0x55d2e740e5c0 legacy=0x55d2e748ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:44.103 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.097+0000 7f0986ca4300 1 -- 10.20.193.91:0/2422294212 shutdown_connections 2026-02-12T03:58:44.103 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.097+0000 7f0986ca4300 1 -- 10.20.193.91:0/2422294212 >> 10.20.193.91:0/2422294212 conn(0x55d2e740d060 msgr2=0x55d2e73c9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:44.103 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.097+0000 7f0986ca4300 1 -- 10.20.193.91:0/2422294212 shutdown_connections 2026-02-12T03:58:44.103 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.097+0000 7f0986ca4300 1 -- 10.20.193.91:0/2422294212 wait complete. 2026-02-12T03:58:44.103 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.098+0000 7f0986ca4300 1 librados: shutdown 2026-02-12T03:58:44.104 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-12T03:58:44.105 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-12T03:58:44.106 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-12T03:58:44.212 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.210+0000 7f2efd49d640 10 monclient: get_monmap_and_config 2026-02-12T03:58:44.212 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.210+0000 7f2efd49d640 10 monclient: build_initial_monmap 2026-02-12T03:58:44.212 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.210+0000 7f2efd49d640 10 monclient: monmap: 2026-02-12T03:58:44.212 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:44.212 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:44.212 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:44.210935+0000 2026-02-12T03:58:44.212 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:44.210935+0000 2026-02-12T03:58:44.213 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:44.213 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:44.213 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:44.213 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:44.213 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:44.213 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:44.215 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.210+0000 7f2efd49d640 1 Processor -- start 2026-02-12T03:58:44.215 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.210+0000 7f2efd49d640 1 -- start start 2026-02-12T03:58:44.215 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.210+0000 7f2efd49d640 10 monclient: init 2026-02-12T03:58:44.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.211+0000 7f2efd49d640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:44.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.211+0000 7f2efd49d640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T03:58:44.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.211+0000 7f2efd49d640 10 monclient(hunting): picked mon.noname-a con 0x7f2ef81575d0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:44.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.211+0000 7f2efd49d640 10 monclient(hunting): picked mon.noname-c con 0x7f2ef8163310 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:44.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.211+0000 7f2efd49d640 10 monclient(hunting): picked mon.noname-b con 0x7f2ef80560d0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:44.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.211+0000 7f2efd49d640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ef80b20b0 con 0x7f2ef81575d0 2026-02-12T03:58:44.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.211+0000 7f2efd49d640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ef80b2390 con 0x7f2ef80560d0 2026-02-12T03:58:44.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.211+0000 7f2efd49d640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ef80b2670 con 0x7f2ef8163310 2026-02-12T03:58:44.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.211+0000 7f2efd49d640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:44.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.211+0000 7f2efd49d640 10 monclient(hunting): authenticate will time out at 1126.954389s 2026-02-12T03:58:44.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.211+0000 7f2ef6ffd640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f2ef81575d0 0x7f2ef8162c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:59066/0 (socket says 10.20.193.91:59066) 2026-02-12T03:58:44.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.211+0000 7f2ef6ffd640 1 -- 10.20.193.91:0/1766536780 learned_addr learned my addr 10.20.193.91:0/1766536780 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:44.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.213+0000 7f2ef5ffb640 1 -- 10.20.193.91:0/1766536780 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3812412578 0 0) 0x7f2ef80b2390 con 0x7f2ef80560d0 2026-02-12T03:58:44.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.213+0000 7f2ef5ffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:44.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.213+0000 7f2ef5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:44.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.213+0000 7f2ef5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:44.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.213+0000 7f2ef5ffb640 10 monclient(hunting): my global_id is 4369 2026-02-12T03:58:44.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.213+0000 7f2ef5ffb640 1 -- 10.20.193.91:0/1766536780 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ee4003610 con 0x7f2ef80560d0 2026-02-12T03:58:44.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.213+0000 7f2ef5ffb640 1 -- 10.20.193.91:0/1766536780 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1678478270 0 0) 0x7f2ef80b20b0 con 0x7f2ef81575d0 2026-02-12T03:58:44.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.213+0000 7f2ef5ffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:44.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.213+0000 7f2ef5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:44.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.213+0000 7f2ef5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:44.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.213+0000 7f2ef5ffb640 10 monclient(hunting): my global_id is 4377 2026-02-12T03:58:44.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.213+0000 7f2ef5ffb640 1 -- 10.20.193.91:0/1766536780 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ef80b2390 con 0x7f2ef81575d0 2026-02-12T03:58:44.219 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.213+0000 7f2ef5ffb640 1 -- 10.20.193.91:0/1766536780 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1773492141 0 0) 0x7f2ef80b2670 con 0x7f2ef8163310 2026-02-12T03:58:44.219 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.213+0000 7f2ef5ffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:44.219 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.213+0000 7f2ef5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:44.219 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.213+0000 7f2ef5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:44.219 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.213+0000 7f2ef5ffb640 10 monclient(hunting): my global_id is 4331 2026-02-12T03:58:44.219 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.213+0000 7f2ef5ffb640 1 -- 10.20.193.91:0/1766536780 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ef80b20b0 con 0x7f2ef8163310 2026-02-12T03:58:44.228 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.215+0000 7f2ef5ffb640 1 -- 10.20.193.91:0/1766536780 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4118377192 0 0) 0x7f2ee4003610 con 0x7f2ef80560d0 2026-02-12T03:58:44.228 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.215+0000 7f2ef5ffb640 1 -- 10.20.193.91:0/1766536780 >> v1:10.20.193.111:6789/0 conn(0x7f2ef8163310 legacy=0x7f2ef80559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:44.228 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.215+0000 7f2ef5ffb640 1 -- 10.20.193.91:0/1766536780 >> v1:10.20.193.91:6789/0 conn(0x7f2ef81575d0 legacy=0x7f2ef8162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:44.228 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.215+0000 7f2ef5ffb640 10 monclient: _finish_hunting 0 2026-02-12T03:58:44.228 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.215+0000 7f2ef5ffb640 1 monclient: found mon.noname-b 2026-02-12T03:58:44.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.215+0000 7f2ef5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:44.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.215+0000 7f2ef5ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T03:58:44.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.215+0000 7f2ef5ffb640 1 -- 10.20.193.91:0/1766536780 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef8162400 con 0x7f2ef80560d0 2026-02-12T03:58:44.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.215+0000 7f2ef5ffb640 10 monclient: _finish_auth 0 2026-02-12T03:58:44.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.215+0000 7f2ef5ffb640 10 monclient: _check_auth_tickets 2026-02-12T03:58:44.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.215+0000 7f2ef5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:44.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.215+0000 7f2ef5ffb640 1 -- 10.20.193.91:0/1766536780 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f2ee8003170 con 0x7f2ef80560d0 2026-02-12T03:58:44.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.215+0000 7f2ef5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:44.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.215+0000 7f2ef5ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:44.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.215+0000 7f2ef5ffb640 10 monclient: dump: 2026-02-12T03:58:44.229 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:44.230 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:44.230 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:44.230 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:44.230 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:44.230 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:44.230 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:44.230 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:44.230 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:44.230 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:44.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.215+0000 7f2efd49d640 5 monclient: authenticate success, global_id 4369 2026-02-12T03:58:44.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.215+0000 7f2efd49d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:44.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.216+0000 7f2ef5ffb640 1 -- 10.20.193.91:0/1766536780 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2ee8003340 con 0x7f2ef80560d0 2026-02-12T03:58:44.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.216+0000 7f2ef5ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:44.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.216+0000 7f2ef5ffb640 1 -- 10.20.193.91:0/1766536780 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f2ee8003780 con 0x7f2ef80560d0 2026-02-12T03:58:44.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.216+0000 7f2ef5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:44.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.216+0000 7f2ef5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:44.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.216+0000 7f2ef5ffb640 10 monclient: dump: 2026-02-12T03:58:44.231 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:44.231 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:44.231 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:44.231 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:44.231 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:44.231 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:44.232 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:44.232 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:44.232 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:44.232 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:44.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.216+0000 7f2efd49d640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:44.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.216+0000 7f2efd49d640 4 set_mon_vals no callback set 2026-02-12T03:58:44.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.216+0000 7f2efd49d640 10 monclient: shutdown 2026-02-12T03:58:44.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.216+0000 7f2efd49d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:44.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.216+0000 7f2efd49d640 1 -- 10.20.193.91:0/1766536780 >> v1:10.20.193.98:6789/0 conn(0x7f2ef80560d0 legacy=0x7f2ef81c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:44.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.216+0000 7f2efd49d640 1 -- 10.20.193.91:0/1766536780 shutdown_connections 2026-02-12T03:58:44.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.216+0000 7f2efd49d640 1 -- 10.20.193.91:0/1766536780 >> 10.20.193.91:0/1766536780 conn(0x7f2ef80b6560 msgr2=0x7f2ef80b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:44.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.216+0000 7f2efd49d640 1 -- 10.20.193.91:0/1766536780 shutdown_connections 2026-02-12T03:58:44.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.216+0000 7f2efd49d640 1 -- 10.20.193.91:0/1766536780 wait complete. 2026-02-12T03:58:44.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.217+0000 7f2efd49d640 10 monclient: build_initial_monmap 2026-02-12T03:58:44.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.217+0000 7f2efd49d640 10 monclient: monmap: 2026-02-12T03:58:44.233 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:44.233 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:44.233 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:44.233 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:44.233 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:44.233 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:44.233 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:44.233 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:44.234 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:44.234 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:44.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.217+0000 7f2efd49d640 1 librados: starting msgr at 2026-02-12T03:58:44.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.217+0000 7f2efd49d640 1 librados: starting objecter 2026-02-12T03:58:44.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.217+0000 7f2efd49d640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:44.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.217+0000 7f2efd49d640 1 Processor -- start 2026-02-12T03:58:44.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.217+0000 7f2efd49d640 1 -- start start 2026-02-12T03:58:44.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.217+0000 7f2efd49d640 1 librados: setting wanted keys 2026-02-12T03:58:44.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.217+0000 7f2efd49d640 1 librados: calling monclient init 2026-02-12T03:58:44.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.217+0000 7f2efd49d640 10 monclient: init 2026-02-12T03:58:44.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.217+0000 7f2efd49d640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:44.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.217+0000 7f2efd49d640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T03:58:44.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.217+0000 7f2efd49d640 10 monclient(hunting): picked mon.noname-a con 0x7f2ef80560d0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:44.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.217+0000 7f2efd49d640 10 monclient(hunting): picked mon.noname-b con 0x7f2ef81575d0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:44.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.217+0000 7f2efd49d640 10 monclient(hunting): picked mon.noname-c con 0x7f2ef8163310 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:44.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.217+0000 7f2efd49d640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ef811a9f0 con 0x7f2ef80560d0 2026-02-12T03:58:44.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.217+0000 7f2efd49d640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ef815f1a0 con 0x7f2ef81575d0 2026-02-12T03:58:44.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.217+0000 7f2efd49d640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ef815f480 con 0x7f2ef8163310 2026-02-12T03:58:44.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.217+0000 7f2efd49d640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:44.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.217+0000 7f2efd49d640 10 monclient(hunting): authenticate will time out at 1126.960692s 2026-02-12T03:58:44.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.217+0000 7f2ef6ffd640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f2ef80560d0 0x7f2ef811a2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:59080/0 (socket says 10.20.193.91:59080) 2026-02-12T03:58:44.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.217+0000 7f2ef6ffd640 1 -- 10.20.193.91:0/1094396291 learned_addr learned my addr 10.20.193.91:0/1094396291 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:44.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.218+0000 7f2ed77fe640 10 client.?.objecter ms_handle_connect 0x7f2ef80560d0 2026-02-12T03:58:44.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.218+0000 7f2ed77fe640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:44.236 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.218+0000 7f2ed77fe640 10 client.?.objecter ms_handle_connect 0x7f2ef8163310 2026-02-12T03:58:44.236 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.218+0000 7f2ed77fe640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:44.236 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.218+0000 7f2ed77fe640 10 client.?.objecter ms_handle_connect 0x7f2ef81575d0 2026-02-12T03:58:44.236 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.218+0000 7f2ed77fe640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:44.236 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.219+0000 7f2ed77fe640 1 -- 10.20.193.91:0/1094396291 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 543230917 0 0) 0x7f2ef811a9f0 con 0x7f2ef80560d0 2026-02-12T03:58:44.236 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.219+0000 7f2ed77fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:44.236 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.219+0000 7f2ed77fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:44.236 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.219+0000 7f2ed77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:44.236 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.219+0000 7f2ed77fe640 10 monclient(hunting): my global_id is 4380 2026-02-12T03:58:44.236 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.219+0000 7f2ed77fe640 1 -- 10.20.193.91:0/1094396291 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ec4003610 con 0x7f2ef80560d0 2026-02-12T03:58:44.236 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.219+0000 7f2ed77fe640 1 -- 10.20.193.91:0/1094396291 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 559038709 0 0) 0x7f2ef815f480 con 0x7f2ef8163310 2026-02-12T03:58:44.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.219+0000 7f2ed77fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:44.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.219+0000 7f2ed77fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:44.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.219+0000 7f2ed77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:44.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.219+0000 7f2ed77fe640 10 monclient(hunting): my global_id is 4334 2026-02-12T03:58:44.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.219+0000 7f2ed77fe640 1 -- 10.20.193.91:0/1094396291 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ef811a9f0 con 0x7f2ef8163310 2026-02-12T03:58:44.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.219+0000 7f2ed77fe640 1 -- 10.20.193.91:0/1094396291 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2088340087 0 0) 0x7f2ef815f1a0 con 0x7f2ef81575d0 2026-02-12T03:58:44.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.219+0000 7f2ed77fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:44.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.219+0000 7f2ed77fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:44.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.219+0000 7f2ed77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:44.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.219+0000 7f2ed77fe640 10 monclient(hunting): my global_id is 4372 2026-02-12T03:58:44.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.219+0000 7f2ed77fe640 1 -- 10.20.193.91:0/1094396291 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ef815f480 con 0x7f2ef81575d0 2026-02-12T03:58:44.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.221+0000 7f2ed77fe640 1 -- 10.20.193.91:0/1094396291 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1460546267 0 0) 0x7f2ec4003610 con 0x7f2ef80560d0 2026-02-12T03:58:44.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.221+0000 7f2ed77fe640 1 -- 10.20.193.91:0/1094396291 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2ef815f1a0 con 0x7f2ef80560d0 2026-02-12T03:58:44.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.221+0000 7f2ed77fe640 1 -- 10.20.193.91:0/1094396291 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f2eec003170 con 0x7f2ef80560d0 2026-02-12T03:58:44.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.221+0000 7f2ed77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:44.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.221+0000 7f2ed77fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:44.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.221+0000 7f2ed77fe640 10 monclient(hunting): dump: 2026-02-12T03:58:44.238 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:44.238 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:44.238 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:44.238 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:44.238 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:44.238 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:44.238 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:44.239 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:44.239 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:44.239 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:44.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.221+0000 7f2ed77fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:44.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.221+0000 7f2ed77fe640 1 -- 10.20.193.91:0/1094396291 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2478959436 0 0) 0x7f2ef815f480 con 0x7f2ef81575d0 2026-02-12T03:58:44.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.221+0000 7f2ed77fe640 1 -- 10.20.193.91:0/1094396291 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2ec4003610 con 0x7f2ef81575d0 2026-02-12T03:58:44.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.221+0000 7f2ed77fe640 1 -- 10.20.193.91:0/1094396291 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f2ee0002fb0 con 0x7f2ef81575d0 2026-02-12T03:58:44.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.221+0000 7f2ed77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:44.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.221+0000 7f2ed77fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:44.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.221+0000 7f2ed77fe640 10 monclient(hunting): dump: 2026-02-12T03:58:44.239 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:44.240 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:44.240 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:44.240 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:44.240 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:44.240 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:44.240 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:44.240 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:44.240 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:44.240 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:44.240 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.222+0000 7f2ed77fe640 1 -- 10.20.193.91:0/1094396291 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1517273192 0 0) 0x7f2ef811a9f0 con 0x7f2ef8163310 2026-02-12T03:58:44.240 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.222+0000 7f2ed77fe640 1 -- 10.20.193.91:0/1094396291 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2ef815f480 con 0x7f2ef8163310 2026-02-12T03:58:44.240 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.222+0000 7f2ed77fe640 1 -- 10.20.193.91:0/1094396291 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f2ee80034f0 con 0x7f2ef8163310 2026-02-12T03:58:44.241 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.222+0000 7f2ed77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:44.241 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.222+0000 7f2ed77fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:44.241 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.222+0000 7f2ed77fe640 10 monclient(hunting): dump: 2026-02-12T03:58:44.241 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:44.241 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:44.241 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:44.241 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:44.241 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:44.241 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:44.241 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:44.241 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:44.241 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:44.242 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:44.242 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.223+0000 7f2ed77fe640 1 -- 10.20.193.91:0/1094396291 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2354201667 0 0) 0x7f2ef815f1a0 con 0x7f2ef80560d0 2026-02-12T03:58:44.242 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.223+0000 7f2ed77fe640 1 -- 10.20.193.91:0/1094396291 >> v1:10.20.193.111:6789/0 conn(0x7f2ef8163310 legacy=0x7f2ef8124ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:44.242 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.223+0000 7f2ed77fe640 1 -- 10.20.193.91:0/1094396291 >> v1:10.20.193.98:6789/0 conn(0x7f2ef81575d0 legacy=0x7f2ef8142350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:44.242 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.223+0000 7f2ed77fe640 10 monclient: _finish_hunting 0 2026-02-12T03:58:44.242 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.223+0000 7f2ed77fe640 1 monclient: found mon.a 2026-02-12T03:58:44.242 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.223+0000 7f2ed77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:44.242 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.223+0000 7f2ed77fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:44.242 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.223+0000 7f2ed77fe640 1 -- 10.20.193.91:0/1094396291 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef815f760 con 0x7f2ef80560d0 2026-02-12T03:58:44.242 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.223+0000 7f2ed77fe640 10 monclient: _finish_auth 0 2026-02-12T03:58:44.242 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.223+0000 7f2ed77fe640 10 monclient: _check_auth_tickets 2026-02-12T03:58:44.243 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.223+0000 7f2ed77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:44.243 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.223+0000 7f2efd49d640 5 monclient: authenticate success, global_id 4380 2026-02-12T03:58:44.243 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.223+0000 7f2efd49d640 10 monclient: _renew_subs 2026-02-12T03:58:44.243 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.223+0000 7f2efd49d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:44.243 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.223+0000 7f2efd49d640 1 -- 10.20.193.91:0/1094396291 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2ef815fa40 con 0x7f2ef80560d0 2026-02-12T03:58:44.243 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.223+0000 7f2efd49d640 10 client.4380.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:44.243 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.223+0000 7f2efd49d640 10 monclient: _renew_subs 2026-02-12T03:58:44.243 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.223+0000 7f2efd49d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:44.243 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.223+0000 7f2efd49d640 1 -- 10.20.193.91:0/1094396291 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2ef8119b80 con 0x7f2ef80560d0 2026-02-12T03:58:44.243 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.223+0000 7f2efd49d640 1 librados: init done 2026-02-12T03:58:44.243 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.223+0000 7f2efd49d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:44.243 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.223+0000 7f2efd49d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:44.243 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.223+0000 7f2efd49d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:44.244 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.223+0000 7f2efd49d640 1 -- 10.20.193.91:0/1094396291 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ef80b7290 con 0x7f2ef80560d0 2026-02-12T03:58:44.244 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.224+0000 7f2ed77fe640 1 -- 10.20.193.91:0/1094396291 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2eec003500 con 0x7f2ef80560d0 2026-02-12T03:58:44.244 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.224+0000 7f2ed77fe640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:44.244 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.224+0000 7f2ef57fa640 4 set_mon_vals no callback set 2026-02-12T03:58:44.267 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.265+0000 7f2ed77fe640 1 -- 10.20.193.91:0/1094396291 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f2eec004d20 con 0x7f2ef80560d0 2026-02-12T03:58:44.267 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.265+0000 7f2ed77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:44.267 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.265+0000 7f2ed77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:44.267 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.265+0000 7f2ed77fe640 10 monclient: dump: 2026-02-12T03:58:44.267 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:44.267 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:44.267 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:44.268 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:44.268 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:44.268 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:44.268 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:44.268 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:44.268 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:44.268 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:44.321 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.319+0000 7f2ed77fe640 1 -- 10.20.193.91:0/1094396291 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f2eec01e200 con 0x7f2ef80560d0 2026-02-12T03:58:44.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.320+0000 7f2ef67fc640 10 monclient: get_auth_request con 0x7f2ec407a090 auth_method 0 2026-02-12T03:58:44.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.320+0000 7f2ed77fe640 10 client.4380.objecter ms_handle_connect 0x7f2ec407a090 2026-02-12T03:58:44.326 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.324+0000 7f2ed77fe640 1 -- 10.20.193.91:0/1094396291 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7f2eec05af30 con 0x7f2ef80560d0 2026-02-12T03:58:44.326 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.324+0000 7f2ed77fe640 10 client.4380.objecter ms_dispatch2 0x7f2ef8000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:44.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.324+0000 7f2ed77fe640 3 client.4380.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:44.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.324+0000 7f2ed77fe640 3 client.4380.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:44.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.324+0000 7f2ed77fe640 20 client.4380.objecter dump_active .. 0 homeless 2026-02-12T03:58:44.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.324+0000 7f2ed77fe640 1 -- 10.20.193.91:0/1094396291 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f2eec05f6a0 con 0x7f2ef80560d0 2026-02-12T03:58:44.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.324+0000 7f2ed77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:44.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.324+0000 7f2ed77fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:44.434 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.432+0000 7f2efd49d640 10 start_mon_command cmd=[{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-12T03:58:44.434 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.432+0000 7f2efd49d640 10 monclient: _send_command 2 [{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-12T03:58:44.434 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.432+0000 7f2efd49d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:44.435 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.432+0000 7f2efd49d640 1 -- 10.20.193.91:0/1094396291 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f2ef8138600 con 0x7f2ef80560d0 2026-02-12T03:58:44.440 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.439+0000 7f2ed77fe640 1 -- 10.20.193.91:0/1094396291 <== mon.0 v1:10.20.193.91:6789/0 10 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v1) ==== 86+0+61 (unknown 4269106227 0 102270264) 0x7f2eec05efa0 con 0x7f2ef80560d0 2026-02-12T03:58:44.441 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.439+0000 7f2ed77fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-12T03:58:44.441 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.439+0000 7f2ed77fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:44.441 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:58:44.443 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.440+0000 7f2efd49d640 10 librados: watch_flush enter 2026-02-12T03:58:44.443 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.440+0000 7f2efd49d640 10 librados: watch_flush exit 2026-02-12T03:58:44.443 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.440+0000 7f2efd49d640 20 client.4380.objecter shutdown clearing up homeless session... 2026-02-12T03:58:44.443 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.440+0000 7f2efd49d640 10 client.4380.objecter successfully canceled tick 2026-02-12T03:58:44.443 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.440+0000 7f2efd49d640 1 -- 10.20.193.91:0/1094396291 >> v1:10.20.193.91:6800/2929217192 conn(0x7f2ec407a090 legacy=0x7f2ec409a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:44.443 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.440+0000 7f2efd49d640 10 monclient: shutdown 2026-02-12T03:58:44.443 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.440+0000 7f2efd49d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:44.444 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.440+0000 7f2efd49d640 1 -- 10.20.193.91:0/1094396291 >> v1:10.20.193.91:6789/0 conn(0x7f2ef80560d0 legacy=0x7f2ef811a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:44.444 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.440+0000 7f2efd49d640 1 -- 10.20.193.91:0/1094396291 shutdown_connections 2026-02-12T03:58:44.444 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.440+0000 7f2efd49d640 1 -- 10.20.193.91:0/1094396291 >> 10.20.193.91:0/1094396291 conn(0x7f2ef80b6560 msgr2=0x7f2ef81563f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:44.444 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.440+0000 7f2efd49d640 1 -- 10.20.193.91:0/1094396291 shutdown_connections 2026-02-12T03:58:44.444 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.440+0000 7f2efd49d640 1 -- 10.20.193.91:0/1094396291 wait complete. 2026-02-12T03:58:44.444 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.441+0000 7f2efd49d640 1 librados: shutdown 2026-02-12T03:58:44.451 INFO:teuthology.orchestra.run.trial091.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2026-02-12T03:58:44.451 INFO:tasks.ceph_manager:config epoch is 1 2026-02-12T03:58:44.451 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-12T03:58:44.452 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-12T03:58:44.452 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-12T03:58:44.521 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.519+0000 7f4d773b9640 10 monclient: get_monmap_and_config 2026-02-12T03:58:44.521 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.519+0000 7f4d773b9640 10 monclient: build_initial_monmap 2026-02-12T03:58:44.522 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.519+0000 7f4d773b9640 10 monclient: monmap: 2026-02-12T03:58:44.522 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:44.522 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:44.522 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:44.519934+0000 2026-02-12T03:58:44.522 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:44.519934+0000 2026-02-12T03:58:44.522 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:44.522 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:44.522 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:44.522 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:44.522 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:44.522 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:44.522 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.519+0000 7f4d773b9640 1 Processor -- start 2026-02-12T03:58:44.523 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.519+0000 7f4d773b9640 1 -- start start 2026-02-12T03:58:44.523 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.519+0000 7f4d773b9640 10 monclient: init 2026-02-12T03:58:44.524 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.520+0000 7f4d773b9640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:44.525 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.520+0000 7f4d773b9640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T03:58:44.525 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.520+0000 7f4d773b9640 10 monclient(hunting): picked mon.noname-b con 0x7f4d701575d0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:44.525 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.520+0000 7f4d773b9640 10 monclient(hunting): picked mon.noname-a con 0x7f4d70163310 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:44.525 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.520+0000 7f4d773b9640 10 monclient(hunting): picked mon.noname-c con 0x7f4d700560d0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:44.525 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.520+0000 7f4d773b9640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d700b20b0 con 0x7f4d70163310 2026-02-12T03:58:44.525 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.520+0000 7f4d773b9640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d700b2390 con 0x7f4d701575d0 2026-02-12T03:58:44.525 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.520+0000 7f4d773b9640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d700b2670 con 0x7f4d700560d0 2026-02-12T03:58:44.525 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.520+0000 7f4d773b9640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:44.525 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.520+0000 7f4d773b9640 10 monclient(hunting): authenticate will time out at 1127.263351s 2026-02-12T03:58:44.525 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.520+0000 7f4d7492d640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f4d70163310 0x7f4d700559c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:59082/0 (socket says 10.20.193.91:59082) 2026-02-12T03:58:44.525 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.520+0000 7f4d7492d640 1 -- 10.20.193.91:0/2567700431 learned_addr learned my addr 10.20.193.91:0/2567700431 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:44.526 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.520+0000 7f4d7592f640 1 --1- 10.20.193.91:0/2567700431 >> v1:10.20.193.111:6789/0 conn(0x7f4d700560d0 0x7f4d701c56f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:37536/0 (socket says 10.20.193.91:37536) 2026-02-12T03:58:44.526 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.522+0000 7f4d5ffff640 1 -- 10.20.193.91:0/2567700431 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3057359153 0 0) 0x7f4d700b20b0 con 0x7f4d70163310 2026-02-12T03:58:44.526 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.522+0000 7f4d5ffff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:44.526 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.522+0000 7f4d5ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:44.526 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.522+0000 7f4d5ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:44.526 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.522+0000 7f4d5ffff640 10 monclient(hunting): my global_id is 4383 2026-02-12T03:58:44.526 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.522+0000 7f4d5ffff640 1 -- 10.20.193.91:0/2567700431 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d58003610 con 0x7f4d70163310 2026-02-12T03:58:44.526 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.522+0000 7f4d5ffff640 1 -- 10.20.193.91:0/2567700431 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 150554127 0 0) 0x7f4d700b2390 con 0x7f4d701575d0 2026-02-12T03:58:44.526 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.522+0000 7f4d5ffff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:44.526 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.522+0000 7f4d5ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:44.526 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.522+0000 7f4d5ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:44.526 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.522+0000 7f4d5ffff640 10 monclient(hunting): my global_id is 4375 2026-02-12T03:58:44.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.522+0000 7f4d5ffff640 1 -- 10.20.193.91:0/2567700431 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d700b20b0 con 0x7f4d701575d0 2026-02-12T03:58:44.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.522+0000 7f4d5ffff640 1 -- 10.20.193.91:0/2567700431 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 130145513 0 0) 0x7f4d700b2670 con 0x7f4d700560d0 2026-02-12T03:58:44.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.522+0000 7f4d5ffff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:44.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.522+0000 7f4d5ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:44.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.522+0000 7f4d5ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:44.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.522+0000 7f4d5ffff640 10 monclient(hunting): my global_id is 4337 2026-02-12T03:58:44.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.522+0000 7f4d5ffff640 1 -- 10.20.193.91:0/2567700431 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d700b2390 con 0x7f4d700560d0 2026-02-12T03:58:44.533 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.523+0000 7f4d5ffff640 1 -- 10.20.193.91:0/2567700431 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4172320387 0 0) 0x7f4d700b20b0 con 0x7f4d701575d0 2026-02-12T03:58:44.533 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.523+0000 7f4d5ffff640 1 -- 10.20.193.91:0/2567700431 >> v1:10.20.193.111:6789/0 conn(0x7f4d700560d0 legacy=0x7f4d701c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:44.533 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.523+0000 7f4d5ffff640 1 -- 10.20.193.91:0/2567700431 >> v1:10.20.193.91:6789/0 conn(0x7f4d70163310 legacy=0x7f4d700559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:44.533 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.523+0000 7f4d5ffff640 10 monclient: _finish_hunting 0 2026-02-12T03:58:44.533 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.523+0000 7f4d5ffff640 1 monclient: found mon.noname-b 2026-02-12T03:58:44.533 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.523+0000 7f4d5ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:44.533 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.523+0000 7f4d5ffff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T03:58:44.533 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.523+0000 7f4d5ffff640 1 -- 10.20.193.91:0/2567700431 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d70162400 con 0x7f4d701575d0 2026-02-12T03:58:44.533 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.523+0000 7f4d5ffff640 10 monclient: _finish_auth 0 2026-02-12T03:58:44.534 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.523+0000 7f4d5ffff640 10 monclient: _check_auth_tickets 2026-02-12T03:58:44.534 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.523+0000 7f4d5ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:44.534 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.524+0000 7f4d5ffff640 1 -- 10.20.193.91:0/2567700431 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f4d60002df0 con 0x7f4d701575d0 2026-02-12T03:58:44.534 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.524+0000 7f4d5ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:44.534 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.524+0000 7f4d5ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:44.534 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.524+0000 7f4d5ffff640 10 monclient: dump: 2026-02-12T03:58:44.534 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:44.534 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:44.534 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:44.534 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:44.534 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:44.534 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:44.535 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:44.535 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:44.535 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:44.535 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:44.535 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.524+0000 7f4d773b9640 5 monclient: authenticate success, global_id 4375 2026-02-12T03:58:44.535 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.524+0000 7f4d773b9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:44.535 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.524+0000 7f4d5ffff640 1 -- 10.20.193.91:0/2567700431 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4d60002fc0 con 0x7f4d701575d0 2026-02-12T03:58:44.535 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.524+0000 7f4d5ffff640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:44.535 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.524+0000 7f4d5ffff640 1 -- 10.20.193.91:0/2567700431 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f4d60003400 con 0x7f4d701575d0 2026-02-12T03:58:44.535 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.524+0000 7f4d5ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:44.535 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.524+0000 7f4d5ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:44.535 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.524+0000 7f4d5ffff640 10 monclient: dump: 2026-02-12T03:58:44.536 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:44.536 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:44.536 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:44.536 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:44.536 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:44.536 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:44.536 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:44.536 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:44.536 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:44.536 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:44.536 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.524+0000 7f4d773b9640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:44.536 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.524+0000 7f4d773b9640 4 set_mon_vals no callback set 2026-02-12T03:58:44.537 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.525+0000 7f4d773b9640 10 monclient: shutdown 2026-02-12T03:58:44.537 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.525+0000 7f4d773b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:44.537 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.525+0000 7f4d773b9640 1 -- 10.20.193.91:0/2567700431 >> v1:10.20.193.98:6789/0 conn(0x7f4d701575d0 legacy=0x7f4d70162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:44.537 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.525+0000 7f4d773b9640 1 -- 10.20.193.91:0/2567700431 shutdown_connections 2026-02-12T03:58:44.537 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.525+0000 7f4d773b9640 1 -- 10.20.193.91:0/2567700431 >> 10.20.193.91:0/2567700431 conn(0x7f4d700b6560 msgr2=0x7f4d700b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:44.537 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.525+0000 7f4d773b9640 1 -- 10.20.193.91:0/2567700431 shutdown_connections 2026-02-12T03:58:44.537 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.525+0000 7f4d773b9640 1 -- 10.20.193.91:0/2567700431 wait complete. 2026-02-12T03:58:44.537 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.525+0000 7f4d773b9640 10 monclient: build_initial_monmap 2026-02-12T03:58:44.537 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.525+0000 7f4d773b9640 10 monclient: monmap: 2026-02-12T03:58:44.537 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:44.537 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:44.537 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:44.537 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:44.538 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:44.538 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:44.538 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:44.538 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:44.538 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:44.538 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:44.538 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.525+0000 7f4d773b9640 1 librados: starting msgr at 2026-02-12T03:58:44.538 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.525+0000 7f4d773b9640 1 librados: starting objecter 2026-02-12T03:58:44.538 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.525+0000 7f4d773b9640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:44.538 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.525+0000 7f4d773b9640 1 Processor -- start 2026-02-12T03:58:44.538 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.525+0000 7f4d773b9640 1 -- start start 2026-02-12T03:58:44.538 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.525+0000 7f4d773b9640 1 librados: setting wanted keys 2026-02-12T03:58:44.538 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.525+0000 7f4d773b9640 1 librados: calling monclient init 2026-02-12T03:58:44.539 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.525+0000 7f4d773b9640 10 monclient: init 2026-02-12T03:58:44.539 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.526+0000 7f4d773b9640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:44.539 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.526+0000 7f4d773b9640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T03:58:44.539 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.526+0000 7f4d773b9640 10 monclient(hunting): picked mon.noname-c con 0x7f4d700560d0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:44.539 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.526+0000 7f4d773b9640 10 monclient(hunting): picked mon.noname-b con 0x7f4d701575d0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:44.539 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.526+0000 7f4d773b9640 10 monclient(hunting): picked mon.noname-a con 0x7f4d70163310 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:44.539 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.526+0000 7f4d773b9640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d7015bfc0 con 0x7f4d70163310 2026-02-12T03:58:44.539 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.526+0000 7f4d773b9640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d700af4b0 con 0x7f4d701575d0 2026-02-12T03:58:44.539 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.526+0000 7f4d773b9640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d700af790 con 0x7f4d700560d0 2026-02-12T03:58:44.539 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.526+0000 7f4d773b9640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:44.539 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.526+0000 7f4d773b9640 10 monclient(hunting): authenticate will time out at 1127.269352s 2026-02-12T03:58:44.539 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.526+0000 7f4d7592f640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f4d70163310 0x7f4d70141320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:59090/0 (socket says 10.20.193.91:59090) 2026-02-12T03:58:44.540 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.526+0000 7f4d7592f640 1 -- 10.20.193.91:0/2527252028 learned_addr learned my addr 10.20.193.91:0/2527252028 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:44.540 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.526+0000 7f4d5dffb640 10 client.?.objecter ms_handle_connect 0x7f4d70163310 2026-02-12T03:58:44.540 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.526+0000 7f4d5dffb640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:44.540 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.526+0000 7f4d5dffb640 10 client.?.objecter ms_handle_connect 0x7f4d700560d0 2026-02-12T03:58:44.540 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.526+0000 7f4d5dffb640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:44.540 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.527+0000 7f4d5dffb640 10 client.?.objecter ms_handle_connect 0x7f4d701575d0 2026-02-12T03:58:44.540 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.527+0000 7f4d5dffb640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:44.540 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.527+0000 7f4d5dffb640 1 -- 10.20.193.91:0/2527252028 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 578459590 0 0) 0x7f4d7015bfc0 con 0x7f4d70163310 2026-02-12T03:58:44.540 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.527+0000 7f4d5dffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:44.540 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.527+0000 7f4d5dffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:44.540 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.527+0000 7f4d5dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:44.540 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.527+0000 7f4d5dffb640 10 monclient(hunting): my global_id is 4386 2026-02-12T03:58:44.541 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.527+0000 7f4d5dffb640 1 -- 10.20.193.91:0/2527252028 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d40003610 con 0x7f4d70163310 2026-02-12T03:58:44.541 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.527+0000 7f4d5dffb640 1 -- 10.20.193.91:0/2527252028 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3302375014 0 0) 0x7f4d700af790 con 0x7f4d700560d0 2026-02-12T03:58:44.541 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.527+0000 7f4d5dffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:44.541 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.527+0000 7f4d5dffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:44.541 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.527+0000 7f4d5dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:44.541 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.527+0000 7f4d5dffb640 10 monclient(hunting): my global_id is 4340 2026-02-12T03:58:44.541 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.528+0000 7f4d5dffb640 1 -- 10.20.193.91:0/2527252028 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d7015bfc0 con 0x7f4d700560d0 2026-02-12T03:58:44.541 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.528+0000 7f4d5dffb640 1 -- 10.20.193.91:0/2527252028 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 296790706 0 0) 0x7f4d700af4b0 con 0x7f4d701575d0 2026-02-12T03:58:44.541 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.528+0000 7f4d5dffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:44.541 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.528+0000 7f4d5dffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:44.541 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.528+0000 7f4d5dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:44.541 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.528+0000 7f4d5dffb640 10 monclient(hunting): my global_id is 4378 2026-02-12T03:58:44.541 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.528+0000 7f4d5dffb640 1 -- 10.20.193.91:0/2527252028 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d700af790 con 0x7f4d701575d0 2026-02-12T03:58:44.542 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.530+0000 7f4d5dffb640 1 -- 10.20.193.91:0/2527252028 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 178152193 0 0) 0x7f4d40003610 con 0x7f4d70163310 2026-02-12T03:58:44.542 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.530+0000 7f4d5dffb640 1 -- 10.20.193.91:0/2527252028 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4d700af4b0 con 0x7f4d70163310 2026-02-12T03:58:44.542 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.530+0000 7f4d5dffb640 1 -- 10.20.193.91:0/2527252028 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f4d6c003410 con 0x7f4d70163310 2026-02-12T03:58:44.542 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.530+0000 7f4d5dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:44.542 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.530+0000 7f4d5dffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:44.542 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.530+0000 7f4d5dffb640 10 monclient(hunting): dump: 2026-02-12T03:58:44.542 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:44.542 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:44.542 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:44.542 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:44.542 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:44.542 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:44.543 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:44.543 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:44.543 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:44.543 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:44.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.530+0000 7f4d5dffb640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:44.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.530+0000 7f4d5dffb640 1 -- 10.20.193.91:0/2527252028 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4140820838 0 0) 0x7f4d7015bfc0 con 0x7f4d700560d0 2026-02-12T03:58:44.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.530+0000 7f4d5dffb640 1 -- 10.20.193.91:0/2527252028 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4d40003610 con 0x7f4d700560d0 2026-02-12T03:58:44.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.530+0000 7f4d5dffb640 1 -- 10.20.193.91:0/2527252028 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f4d60003310 con 0x7f4d700560d0 2026-02-12T03:58:44.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.530+0000 7f4d5dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:44.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.530+0000 7f4d5dffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:44.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.530+0000 7f4d5dffb640 10 monclient(hunting): dump: 2026-02-12T03:58:44.543 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:44.544 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:44.544 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:44.544 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:44.544 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:44.544 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:44.544 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:44.544 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:44.544 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:44.544 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:44.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.531+0000 7f4d5dffb640 1 -- 10.20.193.91:0/2527252028 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3477568867 0 0) 0x7f4d700af790 con 0x7f4d701575d0 2026-02-12T03:58:44.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.531+0000 7f4d5dffb640 1 -- 10.20.193.91:0/2527252028 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4d7015bfc0 con 0x7f4d701575d0 2026-02-12T03:58:44.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.531+0000 7f4d5dffb640 1 -- 10.20.193.91:0/2527252028 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f4d64002f00 con 0x7f4d701575d0 2026-02-12T03:58:44.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.531+0000 7f4d5dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:44.545 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.531+0000 7f4d5dffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:44.545 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.531+0000 7f4d5dffb640 10 monclient(hunting): dump: 2026-02-12T03:58:44.545 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:44.545 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:44.545 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:44.545 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:44.545 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:44.545 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:44.545 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:44.545 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:44.545 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:44.545 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:44.547 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.532+0000 7f4d5dffb640 1 -- 10.20.193.91:0/2527252028 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3950687019 0 0) 0x7f4d700af4b0 con 0x7f4d70163310 2026-02-12T03:58:44.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.532+0000 7f4d5dffb640 1 -- 10.20.193.91:0/2527252028 >> v1:10.20.193.111:6789/0 conn(0x7f4d700560d0 legacy=0x7f4d7015b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:44.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.532+0000 7f4d5dffb640 1 -- 10.20.193.91:0/2527252028 >> v1:10.20.193.98:6789/0 conn(0x7f4d701575d0 legacy=0x7f4d700ae970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:44.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.532+0000 7f4d5dffb640 10 monclient: _finish_hunting 0 2026-02-12T03:58:44.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.532+0000 7f4d5dffb640 1 monclient: found mon.a 2026-02-12T03:58:44.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.532+0000 7f4d5dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:44.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.532+0000 7f4d5dffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:44.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.532+0000 7f4d5dffb640 1 -- 10.20.193.91:0/2527252028 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d700afa70 con 0x7f4d70163310 2026-02-12T03:58:44.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.532+0000 7f4d5dffb640 10 monclient: _finish_auth 0 2026-02-12T03:58:44.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.532+0000 7f4d5dffb640 10 monclient: _check_auth_tickets 2026-02-12T03:58:44.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.532+0000 7f4d5dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:44.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.532+0000 7f4d773b9640 5 monclient: authenticate success, global_id 4386 2026-02-12T03:58:44.549 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.532+0000 7f4d773b9640 10 monclient: _renew_subs 2026-02-12T03:58:44.549 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.532+0000 7f4d773b9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:44.549 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.532+0000 7f4d773b9640 1 -- 10.20.193.91:0/2527252028 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4d700afd50 con 0x7f4d70163310 2026-02-12T03:58:44.549 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.532+0000 7f4d773b9640 10 client.4386.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:44.549 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.532+0000 7f4d773b9640 10 monclient: _renew_subs 2026-02-12T03:58:44.549 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.532+0000 7f4d773b9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:44.549 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.532+0000 7f4d773b9640 1 -- 10.20.193.91:0/2527252028 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4d700af080 con 0x7f4d70163310 2026-02-12T03:58:44.550 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.532+0000 7f4d773b9640 1 librados: init done 2026-02-12T03:58:44.550 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.532+0000 7f4d773b9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:44.550 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.532+0000 7f4d773b9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:44.550 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.532+0000 7f4d773b9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:44.550 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.532+0000 7f4d773b9640 1 -- 10.20.193.91:0/2527252028 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d700b7290 con 0x7f4d70163310 2026-02-12T03:58:44.628 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.626+0000 7f4d5dffb640 1 -- 10.20.193.91:0/2527252028 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4d6c0035b0 con 0x7f4d70163310 2026-02-12T03:58:44.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.626+0000 7f4d5dffb640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:44.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.626+0000 7f4d5dffb640 1 -- 10.20.193.91:0/2527252028 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f4d6c004e70 con 0x7f4d70163310 2026-02-12T03:58:44.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.626+0000 7f4d5dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:44.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.626+0000 7f4d5dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:44.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.626+0000 7f4d5dffb640 10 monclient: dump: 2026-02-12T03:58:44.629 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:44.629 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:44.629 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:44.629 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:44.629 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:44.630 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:44.630 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:44.630 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:44.630 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:44.630 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:44.630 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.626+0000 7f4d5f7fe640 4 set_mon_vals no callback set 2026-02-12T03:58:44.631 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.627+0000 7f4d5dffb640 1 -- 10.20.193.91:0/2527252028 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f4d6c01e390 con 0x7f4d70163310 2026-02-12T03:58:44.631 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.628+0000 7f4d7512e640 10 monclient: get_auth_request con 0x7f4d4007a090 auth_method 0 2026-02-12T03:58:44.631 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.628+0000 7f4d5dffb640 10 client.4386.objecter ms_handle_connect 0x7f4d4007a090 2026-02-12T03:58:44.632 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.630+0000 7f4d5dffb640 1 -- 10.20.193.91:0/2527252028 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7f4d6c095df0 con 0x7f4d70163310 2026-02-12T03:58:44.632 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.630+0000 7f4d5dffb640 10 client.4386.objecter ms_dispatch2 0x7f4d70000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:44.632 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.630+0000 7f4d5dffb640 3 client.4386.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:44.632 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.630+0000 7f4d5dffb640 3 client.4386.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:44.632 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.630+0000 7f4d5dffb640 20 client.4386.objecter dump_active .. 0 homeless 2026-02-12T03:58:44.633 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.630+0000 7f4d5dffb640 1 -- 10.20.193.91:0/2527252028 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f4d6c05f750 con 0x7f4d70163310 2026-02-12T03:58:44.633 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.630+0000 7f4d5dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:44.633 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.630+0000 7f4d5dffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:44.771 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.769+0000 7f4d773b9640 10 start_mon_command cmd=[{"prefix": "mgr dump", "format": "json"}] 2026-02-12T03:58:44.771 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.769+0000 7f4d773b9640 10 monclient: _send_command 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-12T03:58:44.772 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.769+0000 7f4d773b9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:44.772 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.769+0000 7f4d773b9640 1 -- 10.20.193.91:0/2527252028 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f4d700b03a0 con 0x7f4d70163310 2026-02-12T03:58:44.819 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.817+0000 7f4d5dffb640 1 -- 10.20.193.91:0/2527252028 <== mon.0 v1:10.20.193.91:6789/0 10 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+196440 (unknown 481731318 0 1016384043) 0x7f4d6c05f050 con 0x7f4d70163310 2026-02-12T03:58:44.819 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.817+0000 7f4d5dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-12T03:58:44.820 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.817+0000 7f4d5dffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:44.822 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:58:44.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.820+0000 7f4d773b9640 10 librados: watch_flush enter 2026-02-12T03:58:44.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.820+0000 7f4d773b9640 10 librados: watch_flush exit 2026-02-12T03:58:44.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.820+0000 7f4d773b9640 20 client.4386.objecter shutdown clearing up homeless session... 2026-02-12T03:58:44.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.820+0000 7f4d773b9640 10 client.4386.objecter successfully canceled tick 2026-02-12T03:58:44.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.820+0000 7f4d773b9640 1 -- 10.20.193.91:0/2527252028 >> v1:10.20.193.91:6800/2929217192 conn(0x7f4d4007a090 legacy=0x7f4d4009a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:44.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.820+0000 7f4d773b9640 10 monclient: shutdown 2026-02-12T03:58:44.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.820+0000 7f4d773b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:44.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.820+0000 7f4d773b9640 1 -- 10.20.193.91:0/2527252028 >> v1:10.20.193.91:6789/0 conn(0x7f4d70163310 legacy=0x7f4d70141320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:44.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.820+0000 7f4d773b9640 1 -- 10.20.193.91:0/2527252028 shutdown_connections 2026-02-12T03:58:44.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.820+0000 7f4d773b9640 1 -- 10.20.193.91:0/2527252028 >> 10.20.193.91:0/2527252028 conn(0x7f4d700b6560 msgr2=0x7f4d700b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:44.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.820+0000 7f4d773b9640 1 -- 10.20.193.91:0/2527252028 shutdown_connections 2026-02-12T03:58:44.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.820+0000 7f4d773b9640 1 -- 10.20.193.91:0/2527252028 wait complete. 2026-02-12T03:58:44.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.820+0000 7f4d773b9640 1 librados: shutdown 2026-02-12T03:58:44.831 INFO:teuthology.orchestra.run.trial091.stdout:{"epoch":5,"flags":0,"active_gid":4113,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6800","nonce":2929217192}]},"active_addr":"10.20.193.91:6800/2929217192","active_change":"2026-02-12T03:58:01.908150+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[{"gid":4107,"name":"x","mgr_features":4544132024016699391,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self certificates generated and signed by cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.5","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"how frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self certificates generated and signed by cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.5","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"how frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":true,"error_string":"","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.91:0","nonce":2553703455}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.91:0","nonce":562586043}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.91:0","nonce":3619541731}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.91:0","nonce":1178225888}]}]} 2026-02-12T03:58:44.838 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-12T03:58:44.838 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-12T03:58:44.839 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T03:58:44.938 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.936+0000 7f579aaf7640 10 monclient: get_monmap_and_config 2026-02-12T03:58:44.938 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.936+0000 7f579aaf7640 10 monclient: build_initial_monmap 2026-02-12T03:58:44.939 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.936+0000 7f579aaf7640 10 monclient: monmap: 2026-02-12T03:58:44.939 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:44.939 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:44.939 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:44.937194+0000 2026-02-12T03:58:44.939 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:44.937194+0000 2026-02-12T03:58:44.939 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:44.939 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:44.940 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:44.940 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:44.940 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:44.940 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:44.942 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.937+0000 7f579aaf7640 1 Processor -- start 2026-02-12T03:58:44.942 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.937+0000 7f579aaf7640 1 -- start start 2026-02-12T03:58:44.943 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.937+0000 7f579aaf7640 10 monclient: init 2026-02-12T03:58:44.943 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.937+0000 7f579aaf7640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:44.943 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.937+0000 7f579aaf7640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T03:58:44.943 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.937+0000 7f579aaf7640 10 monclient(hunting): picked mon.noname-b con 0x7f57941575d0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:44.943 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.937+0000 7f579aaf7640 10 monclient(hunting): picked mon.noname-c con 0x7f5794163310 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:44.943 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.937+0000 7f579aaf7640 10 monclient(hunting): picked mon.noname-a con 0x7f57940560d0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:44.943 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.937+0000 7f579aaf7640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57940b20b0 con 0x7f57940560d0 2026-02-12T03:58:44.944 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.937+0000 7f579aaf7640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57940b2390 con 0x7f57941575d0 2026-02-12T03:58:44.944 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.937+0000 7f579aaf7640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57940b2670 con 0x7f5794163310 2026-02-12T03:58:44.944 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.937+0000 7f579aaf7640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:44.944 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.937+0000 7f579aaf7640 10 monclient(hunting): authenticate will time out at 1127.680727s 2026-02-12T03:58:44.944 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.938+0000 7f578bfff640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f5794163310 0x7f57940559c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:37554/0 (socket says 10.20.193.91:37554) 2026-02-12T03:58:44.944 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.938+0000 7f578bfff640 1 -- 10.20.193.91:0/4044015278 learned_addr learned my addr 10.20.193.91:0/4044015278 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:44.945 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.939+0000 7f578b7fe640 1 -- 10.20.193.91:0/4044015278 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4279724482 0 0) 0x7f57940b2670 con 0x7f5794163310 2026-02-12T03:58:44.945 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.939+0000 7f578b7fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:44.945 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.939+0000 7f578b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:44.945 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.939+0000 7f578b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:44.945 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.939+0000 7f578b7fe640 10 monclient(hunting): my global_id is 4343 2026-02-12T03:58:44.945 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.939+0000 7f578b7fe640 1 -- 10.20.193.91:0/4044015278 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5780003610 con 0x7f5794163310 2026-02-12T03:58:44.945 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.939+0000 7f578b7fe640 1 -- 10.20.193.91:0/4044015278 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 289807668 0 0) 0x7f57940b2390 con 0x7f57941575d0 2026-02-12T03:58:44.945 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.939+0000 7f578b7fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:44.946 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.939+0000 7f578b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:44.946 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.939+0000 7f578b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:44.946 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.939+0000 7f578b7fe640 10 monclient(hunting): my global_id is 4381 2026-02-12T03:58:44.946 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.939+0000 7f578b7fe640 1 -- 10.20.193.91:0/4044015278 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57940b2670 con 0x7f57941575d0 2026-02-12T03:58:44.946 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.940+0000 7f578b7fe640 1 -- 10.20.193.91:0/4044015278 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2403342278 0 0) 0x7f57940b20b0 con 0x7f57940560d0 2026-02-12T03:58:44.946 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.940+0000 7f578b7fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:44.946 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.940+0000 7f578b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:44.946 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.940+0000 7f578b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:44.946 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.940+0000 7f578b7fe640 10 monclient(hunting): my global_id is 4389 2026-02-12T03:58:44.946 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.940+0000 7f578b7fe640 1 -- 10.20.193.91:0/4044015278 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57940b2390 con 0x7f57940560d0 2026-02-12T03:58:44.955 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.941+0000 7f578b7fe640 1 -- 10.20.193.91:0/4044015278 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1259479823 0 0) 0x7f5780003610 con 0x7f5794163310 2026-02-12T03:58:44.956 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.941+0000 7f578b7fe640 1 -- 10.20.193.91:0/4044015278 >> v1:10.20.193.98:6789/0 conn(0x7f57941575d0 legacy=0x7f5794162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:44.956 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.941+0000 7f578b7fe640 1 -- 10.20.193.91:0/4044015278 >> v1:10.20.193.91:6789/0 conn(0x7f57940560d0 legacy=0x7f57941c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:44.956 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.941+0000 7f578b7fe640 10 monclient: _finish_hunting 0 2026-02-12T03:58:44.956 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.941+0000 7f578b7fe640 1 monclient: found mon.noname-c 2026-02-12T03:58:44.956 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.941+0000 7f578b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:44.956 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.941+0000 7f578b7fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.111:6789/0 2026-02-12T03:58:44.957 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.941+0000 7f578b7fe640 1 -- 10.20.193.91:0/4044015278 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5794162400 con 0x7f5794163310 2026-02-12T03:58:44.957 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.941+0000 7f578b7fe640 10 monclient: _finish_auth 0 2026-02-12T03:58:44.957 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.941+0000 7f578b7fe640 10 monclient: _check_auth_tickets 2026-02-12T03:58:44.957 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.941+0000 7f578b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:44.957 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.941+0000 7f579aaf7640 5 monclient: authenticate success, global_id 4343 2026-02-12T03:58:44.957 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.941+0000 7f579aaf7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:44.957 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.941+0000 7f578b7fe640 1 -- 10.20.193.91:0/4044015278 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f577c002df0 con 0x7f5794163310 2026-02-12T03:58:44.957 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.941+0000 7f578b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:44.957 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.941+0000 7f578b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:44.957 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.941+0000 7f578b7fe640 10 monclient: dump: 2026-02-12T03:58:44.958 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:44.958 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:44.958 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:44.958 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:44.958 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:44.958 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:44.958 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:44.958 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:44.958 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:44.958 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:44.958 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.941+0000 7f579aaf7640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:44.958 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.942+0000 7f578b7fe640 1 -- 10.20.193.91:0/4044015278 <== mon.2 v1:10.20.193.111:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f577c003040 con 0x7f5794163310 2026-02-12T03:58:44.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.942+0000 7f578b7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:44.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.942+0000 7f578b7fe640 1 -- 10.20.193.91:0/4044015278 <== mon.2 v1:10.20.193.111:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f577c003440 con 0x7f5794163310 2026-02-12T03:58:44.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.942+0000 7f578b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:44.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.942+0000 7f578b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:44.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.942+0000 7f578b7fe640 10 monclient: dump: 2026-02-12T03:58:44.959 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:44.959 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:44.959 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:44.959 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:44.959 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:44.959 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:44.959 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:44.959 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:44.960 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:44.960 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:44.960 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.942+0000 7f579aaf7640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:44.960 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.942+0000 7f579aaf7640 4 set_mon_vals no callback set 2026-02-12T03:58:44.960 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.942+0000 7f579aaf7640 10 monclient: shutdown 2026-02-12T03:58:44.960 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.942+0000 7f579aaf7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:44.960 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.942+0000 7f579aaf7640 1 -- 10.20.193.91:0/4044015278 >> v1:10.20.193.111:6789/0 conn(0x7f5794163310 legacy=0x7f57940559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:44.960 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.942+0000 7f579aaf7640 1 -- 10.20.193.91:0/4044015278 shutdown_connections 2026-02-12T03:58:44.960 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.942+0000 7f579aaf7640 1 -- 10.20.193.91:0/4044015278 >> 10.20.193.91:0/4044015278 conn(0x7f57940b6560 msgr2=0x7f57940b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:44.960 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.942+0000 7f579aaf7640 1 -- 10.20.193.91:0/4044015278 shutdown_connections 2026-02-12T03:58:44.960 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.942+0000 7f579aaf7640 1 -- 10.20.193.91:0/4044015278 wait complete. 2026-02-12T03:58:44.960 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.943+0000 7f579aaf7640 10 monclient: build_initial_monmap 2026-02-12T03:58:44.961 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.943+0000 7f579aaf7640 10 monclient: monmap: 2026-02-12T03:58:44.961 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:44.961 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:44.961 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:44.961 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:44.961 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:44.961 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:44.961 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:44.961 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:44.961 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:44.961 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:44.962 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.943+0000 7f579aaf7640 1 librados: starting msgr at 2026-02-12T03:58:44.962 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.943+0000 7f579aaf7640 1 librados: starting objecter 2026-02-12T03:58:44.962 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.943+0000 7f579aaf7640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:44.962 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.943+0000 7f579aaf7640 1 Processor -- start 2026-02-12T03:58:44.962 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.943+0000 7f579aaf7640 1 -- start start 2026-02-12T03:58:44.962 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.943+0000 7f579aaf7640 1 librados: setting wanted keys 2026-02-12T03:58:44.962 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.943+0000 7f579aaf7640 1 librados: calling monclient init 2026-02-12T03:58:44.962 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.943+0000 7f579aaf7640 10 monclient: init 2026-02-12T03:58:44.962 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.944+0000 7f579aaf7640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:44.962 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.944+0000 7f579aaf7640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T03:58:44.962 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.944+0000 7f579aaf7640 10 monclient(hunting): picked mon.noname-b con 0x7f57940560d0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:44.962 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.944+0000 7f579aaf7640 10 monclient(hunting): picked mon.noname-a con 0x7f57941575d0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:44.963 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.944+0000 7f579aaf7640 10 monclient(hunting): picked mon.noname-c con 0x7f5794163310 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:44.963 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.944+0000 7f579aaf7640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f579405d210 con 0x7f57941575d0 2026-02-12T03:58:44.963 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.944+0000 7f579aaf7640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f579405d4f0 con 0x7f57940560d0 2026-02-12T03:58:44.963 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.944+0000 7f579aaf7640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57941fe270 con 0x7f5794163310 2026-02-12T03:58:44.963 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.944+0000 7f579aaf7640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:44.963 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.944+0000 7f579aaf7640 10 monclient(hunting): authenticate will time out at 1127.687164s 2026-02-12T03:58:44.963 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.944+0000 7f578bfff640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f57941575d0 0x7f57941fac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:59120/0 (socket says 10.20.193.91:59120) 2026-02-12T03:58:44.963 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.944+0000 7f578bfff640 1 -- 10.20.193.91:0/11041746 learned_addr learned my addr 10.20.193.91:0/11041746 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:44.963 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.944+0000 7f57897fa640 10 client.?.objecter ms_handle_connect 0x7f57941575d0 2026-02-12T03:58:44.963 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.944+0000 7f57897fa640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:44.963 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.944+0000 7f57897fa640 10 client.?.objecter ms_handle_connect 0x7f57940560d0 2026-02-12T03:58:44.963 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.944+0000 7f57897fa640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:44.963 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.945+0000 7f57897fa640 10 client.?.objecter ms_handle_connect 0x7f5794163310 2026-02-12T03:58:44.964 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.945+0000 7f57897fa640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:44.964 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.945+0000 7f57897fa640 1 -- 10.20.193.91:0/11041746 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1455666205 0 0) 0x7f579405d210 con 0x7f57941575d0 2026-02-12T03:58:44.964 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.945+0000 7f57897fa640 10 monclient(hunting): _negotiate 2026-02-12T03:58:44.964 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.945+0000 7f57897fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:44.964 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.945+0000 7f57897fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:44.964 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.945+0000 7f57897fa640 10 monclient(hunting): my global_id is 4392 2026-02-12T03:58:44.964 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.945+0000 7f57897fa640 1 -- 10.20.193.91:0/11041746 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5764003610 con 0x7f57941575d0 2026-02-12T03:58:44.964 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.946+0000 7f57897fa640 1 -- 10.20.193.91:0/11041746 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1903813045 0 0) 0x7f579405d4f0 con 0x7f57940560d0 2026-02-12T03:58:44.964 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.946+0000 7f57897fa640 10 monclient(hunting): _negotiate 2026-02-12T03:58:44.964 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.946+0000 7f57897fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:44.964 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.946+0000 7f57897fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:44.964 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.946+0000 7f57897fa640 10 monclient(hunting): my global_id is 4384 2026-02-12T03:58:44.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.946+0000 7f57897fa640 1 -- 10.20.193.91:0/11041746 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f579405d210 con 0x7f57940560d0 2026-02-12T03:58:44.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.946+0000 7f57897fa640 1 -- 10.20.193.91:0/11041746 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1113095136 0 0) 0x7f57941fe270 con 0x7f5794163310 2026-02-12T03:58:44.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.946+0000 7f57897fa640 10 monclient(hunting): _negotiate 2026-02-12T03:58:44.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.946+0000 7f57897fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:44.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.946+0000 7f57897fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:44.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.946+0000 7f57897fa640 10 monclient(hunting): my global_id is 4346 2026-02-12T03:58:44.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.946+0000 7f57897fa640 1 -- 10.20.193.91:0/11041746 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f579405d4f0 con 0x7f5794163310 2026-02-12T03:58:44.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.947+0000 7f57897fa640 1 -- 10.20.193.91:0/11041746 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2532459522 0 0) 0x7f5764003610 con 0x7f57941575d0 2026-02-12T03:58:44.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.947+0000 7f57897fa640 1 -- 10.20.193.91:0/11041746 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f57941fe270 con 0x7f57941575d0 2026-02-12T03:58:44.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.947+0000 7f57897fa640 1 -- 10.20.193.91:0/11041746 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f577c003390 con 0x7f57941575d0 2026-02-12T03:58:44.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.947+0000 7f57897fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:44.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.947+0000 7f57897fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:44.966 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.947+0000 7f57897fa640 10 monclient(hunting): dump: 2026-02-12T03:58:44.966 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:44.966 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:44.966 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:44.966 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:44.966 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:44.966 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:44.966 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:44.966 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:44.966 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:44.966 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:44.966 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.947+0000 7f57897fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:44.967 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.948+0000 7f57897fa640 1 -- 10.20.193.91:0/11041746 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 154289967 0 0) 0x7f579405d210 con 0x7f57940560d0 2026-02-12T03:58:44.967 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.948+0000 7f57897fa640 1 -- 10.20.193.91:0/11041746 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5764003610 con 0x7f57940560d0 2026-02-12T03:58:44.967 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.948+0000 7f57897fa640 1 -- 10.20.193.91:0/11041746 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f57840030b0 con 0x7f57940560d0 2026-02-12T03:58:44.967 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.948+0000 7f57897fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:44.967 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.948+0000 7f57897fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:44.967 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.948+0000 7f57897fa640 10 monclient(hunting): dump: 2026-02-12T03:58:44.968 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:44.968 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:44.968 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:44.968 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:44.968 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:44.968 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:44.968 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:44.968 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:44.968 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:44.969 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:44.969 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.949+0000 7f57897fa640 1 -- 10.20.193.91:0/11041746 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1819656196 0 0) 0x7f579405d4f0 con 0x7f5794163310 2026-02-12T03:58:44.969 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.949+0000 7f57897fa640 1 -- 10.20.193.91:0/11041746 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f579405d210 con 0x7f5794163310 2026-02-12T03:58:44.969 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.949+0000 7f57897fa640 1 -- 10.20.193.91:0/11041746 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f5790003410 con 0x7f5794163310 2026-02-12T03:58:44.969 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.949+0000 7f57897fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:44.969 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.949+0000 7f57897fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:44.969 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.949+0000 7f57897fa640 10 monclient(hunting): dump: 2026-02-12T03:58:44.969 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:44.969 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:44.969 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:44.969 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:44.969 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:44.969 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:44.970 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:44.970 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:44.970 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:44.970 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:44.970 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.949+0000 7f57897fa640 1 -- 10.20.193.91:0/11041746 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3227039830 0 0) 0x7f57941fe270 con 0x7f57941575d0 2026-02-12T03:58:44.970 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.949+0000 7f57897fa640 1 -- 10.20.193.91:0/11041746 >> v1:10.20.193.111:6789/0 conn(0x7f5794163310 legacy=0x7f5794134b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:44.970 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.949+0000 7f57897fa640 1 -- 10.20.193.91:0/11041746 >> v1:10.20.193.98:6789/0 conn(0x7f57940560d0 legacy=0x7f5794059a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:44.970 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.949+0000 7f57897fa640 10 monclient: _finish_hunting 0 2026-02-12T03:58:44.970 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.949+0000 7f57897fa640 1 monclient: found mon.a 2026-02-12T03:58:44.970 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.949+0000 7f57897fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:44.970 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.949+0000 7f57897fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:44.970 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.949+0000 7f57897fa640 1 -- 10.20.193.91:0/11041746 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57941fe550 con 0x7f57941575d0 2026-02-12T03:58:44.971 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.949+0000 7f57897fa640 10 monclient: _finish_auth 0 2026-02-12T03:58:44.971 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.949+0000 7f57897fa640 10 monclient: _check_auth_tickets 2026-02-12T03:58:44.971 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.949+0000 7f57897fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:44.971 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.949+0000 7f579aaf7640 5 monclient: authenticate success, global_id 4392 2026-02-12T03:58:44.971 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.949+0000 7f579aaf7640 10 monclient: _renew_subs 2026-02-12T03:58:44.971 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.949+0000 7f579aaf7640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:44.971 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.949+0000 7f579aaf7640 1 -- 10.20.193.91:0/11041746 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5794135410 con 0x7f57941575d0 2026-02-12T03:58:44.971 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.949+0000 7f579aaf7640 10 client.4392.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:44.971 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.949+0000 7f579aaf7640 10 monclient: _renew_subs 2026-02-12T03:58:44.971 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.949+0000 7f579aaf7640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:44.971 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.949+0000 7f579aaf7640 1 -- 10.20.193.91:0/11041746 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f57941fef30 con 0x7f57941575d0 2026-02-12T03:58:44.971 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.949+0000 7f579aaf7640 1 librados: init done 2026-02-12T03:58:44.971 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.949+0000 7f579aaf7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:44.972 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.949+0000 7f579aaf7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:44.972 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.949+0000 7f579aaf7640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:44.972 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:44.949+0000 7f579aaf7640 1 -- 10.20.193.91:0/11041746 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5794135640 con 0x7f57941575d0 2026-02-12T03:58:45.045 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.042+0000 7f57897fa640 1 -- 10.20.193.91:0/11041746 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f577c003020 con 0x7f57941575d0 2026-02-12T03:58:45.045 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.042+0000 7f57897fa640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:45.046 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.042+0000 7f57897fa640 1 -- 10.20.193.91:0/11041746 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f577c004d20 con 0x7f57941575d0 2026-02-12T03:58:45.046 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.042+0000 7f57897fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.046 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.042+0000 7f57897fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:45.046 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.042+0000 7f57897fa640 10 monclient: dump: 2026-02-12T03:58:45.046 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.046 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.047 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.047 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.047 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.047 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.047 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.047 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.048 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.048 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.048 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.042+0000 7f578affd640 4 set_mon_vals no callback set 2026-02-12T03:58:45.048 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.043+0000 7f57897fa640 1 -- 10.20.193.91:0/11041746 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f577c01e200 con 0x7f57941575d0 2026-02-12T03:58:45.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.044+0000 7f579886c640 10 monclient: get_auth_request con 0x7f576407a040 auth_method 0 2026-02-12T03:58:45.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.044+0000 7f57897fa640 10 client.4392.objecter ms_handle_connect 0x7f576407a040 2026-02-12T03:58:45.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.047+0000 7f57897fa640 1 -- 10.20.193.91:0/11041746 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7f577c095a60 con 0x7f57941575d0 2026-02-12T03:58:45.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.047+0000 7f57897fa640 10 client.4392.objecter ms_dispatch2 0x7f5794000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:45.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.047+0000 7f57897fa640 3 client.4392.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:45.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.047+0000 7f57897fa640 3 client.4392.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:45.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.047+0000 7f57897fa640 20 client.4392.objecter dump_active .. 0 homeless 2026-02-12T03:58:45.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.047+0000 7f57897fa640 1 -- 10.20.193.91:0/11041746 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f577c05f3c0 con 0x7f57941575d0 2026-02-12T03:58:45.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.047+0000 7f57897fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:45.052 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.047+0000 7f57897fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:45.159 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.157+0000 7f579aaf7640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-12T03:58:45.159 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.157+0000 7f579aaf7640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T03:58:45.159 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.157+0000 7f579aaf7640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:45.159 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.157+0000 7f579aaf7640 1 -- 10.20.193.91:0/11041746 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f57940b7290 con 0x7f57941575d0 2026-02-12T03:58:45.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.174+0000 7f57897fa640 1 -- 10.20.193.91:0/11041746 <== mon.0 v1:10.20.193.91:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+20912 (unknown 634195324 0 2801080463) 0x7f577c05ecc0 con 0x7f57941575d0 2026-02-12T03:58:45.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.174+0000 7f57897fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T03:58:45.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.174+0000 7f57897fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:45.176 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:58:45.176 INFO:teuthology.orchestra.run.trial091.stdout:{"epoch":28,"fsid":"1e356fcf-3d61-462e-a451-82f8dd01e1f3","created":"2026-02-12T03:57:59.014379+0000","modified":"2026-02-12T03:58:43.923444+0000","last_up_change":"2026-02-12T03:58:32.372907+0000","last_in_change":"2026-02-12T03:58:05.455425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-12T03:58:32.248062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-12T03:58:39.975964+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":28,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":5.9899997711181641,"score_stable":5.9899997711181641,"optimal_score":0.68999999761581421,"raw_score_acting":4.130000114440918,"raw_score_stable":4.130000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"791c97c5-83f6-4024-9f43-ff3b2ee22a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6801","nonce":1203233578}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6802","nonce":1203233578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6804","nonce":1203233578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6803","nonce":1203233578}]},"public_addr":"10.20.193.91:6801/1203233578","cluster_addr":"10.20.193.91:6802/1203233578","heartbeat_back_addr":"10.20.193.91:6804/1203233578","heartbeat_front_addr":"10.20.193.91:6803/1203233578","state":["exists","up"]},{"osd":1,"uuid":"0cf561d6-85aa-428a-bc69-83ce77b1c802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6812","nonce":2011281833}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6813","nonce":2011281833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6815","nonce":2011281833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6814","nonce":2011281833}]},"public_addr":"10.20.193.98:6812/2011281833","cluster_addr":"10.20.193.98:6813/2011281833","heartbeat_back_addr":"10.20.193.98:6815/2011281833","heartbeat_front_addr":"10.20.193.98:6814/2011281833","state":["exists","up"]},{"osd":2,"uuid":"b3dc78b9-cae6-4b1f-931f-7352a43b9e26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6812","nonce":350848222}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6813","nonce":350848222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6815","nonce":350848222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6814","nonce":350848222}]},"public_addr":"10.20.193.111:6812/350848222","cluster_addr":"10.20.193.111:6813/350848222","heartbeat_back_addr":"10.20.193.111:6815/350848222","heartbeat_front_addr":"10.20.193.111:6814/350848222","state":["exists","up"]},{"osd":3,"uuid":"e164e3ae-cf6a-45ff-b126-3ac739c5b1be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6800","nonce":4779434}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6801","nonce":4779434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6803","nonce":4779434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6802","nonce":4779434}]},"public_addr":"10.20.193.154:6800/4779434","cluster_addr":"10.20.193.154:6801/4779434","heartbeat_back_addr":"10.20.193.154:6803/4779434","heartbeat_front_addr":"10.20.193.154:6802/4779434","state":["exists","up"]},{"osd":4,"uuid":"5583cc8c-83d4-42b4-a997-c056f3b145a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6805","nonce":1766507926}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6806","nonce":1766507926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6808","nonce":1766507926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6807","nonce":1766507926}]},"public_addr":"10.20.193.91:6805/1766507926","cluster_addr":"10.20.193.91:6806/1766507926","heartbeat_back_addr":"10.20.193.91:6808/1766507926","heartbeat_front_addr":"10.20.193.91:6807/1766507926","state":["exists","up"]},{"osd":5,"uuid":"d7bb6fa1-b042-4dce-9644-00e817a5bc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6808","nonce":3918277953}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6809","nonce":3918277953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6811","nonce":3918277953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6810","nonce":3918277953}]},"public_addr":"10.20.193.98:6808/3918277953","cluster_addr":"10.20.193.98:6809/3918277953","heartbeat_back_addr":"10.20.193.98:6811/3918277953","heartbeat_front_addr":"10.20.193.98:6810/3918277953","state":["exists","up"]},{"osd":6,"uuid":"93cd9edf-a000-4d22-8da7-52f4bd547765","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6804","nonce":727190484}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6805","nonce":727190484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6807","nonce":727190484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6806","nonce":727190484}]},"public_addr":"10.20.193.111:6804/727190484","cluster_addr":"10.20.193.111:6805/727190484","heartbeat_back_addr":"10.20.193.111:6807/727190484","heartbeat_front_addr":"10.20.193.111:6806/727190484","state":["exists","up"]},{"osd":7,"uuid":"f5e11a47-d746-46ca-85f1-27d3bc586371","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6808","nonce":903276772}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6810","nonce":903276772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6813","nonce":903276772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6811","nonce":903276772}]},"public_addr":"10.20.193.154:6808/903276772","cluster_addr":"10.20.193.154:6810/903276772","heartbeat_back_addr":"10.20.193.154:6813/903276772","heartbeat_front_addr":"10.20.193.154:6811/903276772","state":["exists","up"]},{"osd":8,"uuid":"bb8207ce-22b9-46be-9c89-c77f2690e405","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6809","nonce":443384425}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6810","nonce":443384425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6812","nonce":443384425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6811","nonce":443384425}]},"public_addr":"10.20.193.91:6809/443384425","cluster_addr":"10.20.193.91:6810/443384425","heartbeat_back_addr":"10.20.193.91:6812/443384425","heartbeat_front_addr":"10.20.193.91:6811/443384425","state":["exists","up"]},{"osd":9,"uuid":"e6318a6d-2367-48ce-a3a1-47307de14b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6801","nonce":4165741185}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6804","nonce":4165741185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6807","nonce":4165741185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6806","nonce":4165741185}]},"public_addr":"10.20.193.98:6801/4165741185","cluster_addr":"10.20.193.98:6804/4165741185","heartbeat_back_addr":"10.20.193.98:6807/4165741185","heartbeat_front_addr":"10.20.193.98:6806/4165741185","state":["exists","up"]},{"osd":10,"uuid":"cd6c97a2-bdfe-4b86-afeb-217315976d6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6808","nonce":1268343515}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6809","nonce":1268343515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6811","nonce":1268343515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6810","nonce":1268343515}]},"public_addr":"10.20.193.111:6808/1268343515","cluster_addr":"10.20.193.111:6809/1268343515","heartbeat_back_addr":"10.20.193.111:6811/1268343515","heartbeat_front_addr":"10.20.193.111:6810/1268343515","state":["exists","up"]},{"osd":11,"uuid":"b6c647bb-4e86-4b0e-b79c-b0236a780a66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6804","nonce":2902069275}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6805","nonce":2902069275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6807","nonce":2902069275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6806","nonce":2902069275}]},"public_addr":"10.20.193.154:6804/2902069275","cluster_addr":"10.20.193.154:6805/2902069275","heartbeat_back_addr":"10.20.193.154:6807/2902069275","heartbeat_front_addr":"10.20.193.154:6806/2902069275","state":["exists","up"]},{"osd":12,"uuid":"19bb3570-0c0a-48cc-a0b8-ec3194f30fa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6813","nonce":3587007397}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6814","nonce":3587007397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6816","nonce":3587007397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6815","nonce":3587007397}]},"public_addr":"10.20.193.91:6813/3587007397","cluster_addr":"10.20.193.91:6814/3587007397","heartbeat_back_addr":"10.20.193.91:6816/3587007397","heartbeat_front_addr":"10.20.193.91:6815/3587007397","state":["exists","up"]},{"osd":13,"uuid":"a8215062-521c-47f6-b20a-9e40c1f3f5a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6800","nonce":1665089474}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6802","nonce":1665089474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6805","nonce":1665089474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6803","nonce":1665089474}]},"public_addr":"10.20.193.98:6800/1665089474","cluster_addr":"10.20.193.98:6802/1665089474","heartbeat_back_addr":"10.20.193.98:6805/1665089474","heartbeat_front_addr":"10.20.193.98:6803/1665089474","state":["exists","up"]},{"osd":14,"uuid":"3cd1bb48-53a2-462e-b7e5-4d6d918dd543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6800","nonce":1665676360}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6801","nonce":1665676360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6803","nonce":1665676360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6802","nonce":1665676360}]},"public_addr":"10.20.193.111:6800/1665676360","cluster_addr":"10.20.193.111:6801/1665676360","heartbeat_back_addr":"10.20.193.111:6803/1665676360","heartbeat_front_addr":"10.20.193.111:6802/1665676360","state":["exists","up"]},{"osd":15,"uuid":"9bd39438-f5e5-4a19-afa4-678395d63c24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6809","nonce":2343771552}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6812","nonce":2343771552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6815","nonce":2343771552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6814","nonce":2343771552}]},"public_addr":"10.20.193.154:6809/2343771552","cluster_addr":"10.20.193.154:6812/2343771552","heartbeat_back_addr":"10.20.193.154:6815/2343771552","heartbeat_front_addr":"10.20.193.154:6814/2343771552","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.723024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:30.073947+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.930180+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:30.325123+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.735688+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.923661+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.879912+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:30.480032+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.983654+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.730948+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.899878+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:30.549254+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.968146+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.918456+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.803753+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:30.518611+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T03:58:45.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.177+0000 7f579aaf7640 10 librados: watch_flush enter 2026-02-12T03:58:45.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.177+0000 7f579aaf7640 10 librados: watch_flush exit 2026-02-12T03:58:45.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.177+0000 7f579aaf7640 20 client.4392.objecter shutdown clearing up homeless session... 2026-02-12T03:58:45.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.177+0000 7f579aaf7640 10 client.4392.objecter successfully canceled tick 2026-02-12T03:58:45.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.177+0000 7f579aaf7640 1 -- 10.20.193.91:0/11041746 >> v1:10.20.193.91:6800/2929217192 conn(0x7f576407a040 legacy=0x7f576409a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.177+0000 7f579aaf7640 10 monclient: shutdown 2026-02-12T03:58:45.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.177+0000 7f579aaf7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:45.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.177+0000 7f579aaf7640 1 -- 10.20.193.91:0/11041746 >> v1:10.20.193.91:6789/0 conn(0x7f57941575d0 legacy=0x7f57941fac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.177+0000 7f579aaf7640 1 -- 10.20.193.91:0/11041746 shutdown_connections 2026-02-12T03:58:45.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.177+0000 7f579aaf7640 1 -- 10.20.193.91:0/11041746 >> 10.20.193.91:0/11041746 conn(0x7f57940b6560 msgr2=0x7f57940b1900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:45.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.177+0000 7f579aaf7640 1 -- 10.20.193.91:0/11041746 shutdown_connections 2026-02-12T03:58:45.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.177+0000 7f579aaf7640 1 -- 10.20.193.91:0/11041746 wait complete. 2026-02-12T03:58:45.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.177+0000 7f579aaf7640 1 librados: shutdown 2026-02-12T03:58:45.189 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-12T03:58:45.190 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T03:58:45.259 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.257+0000 7f47e6710640 10 monclient: get_monmap_and_config 2026-02-12T03:58:45.259 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.257+0000 7f47e6710640 10 monclient: build_initial_monmap 2026-02-12T03:58:45.259 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.257+0000 7f47e6710640 10 monclient: monmap: 2026-02-12T03:58:45.259 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:45.259 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.259 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:45.258109+0000 2026-02-12T03:58:45.259 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:45.258109+0000 2026-02-12T03:58:45.260 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:45.260 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.260 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:45.260 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:45.260 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:45.260 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.261 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.257+0000 7f47e6710640 1 Processor -- start 2026-02-12T03:58:45.261 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.258+0000 7f47e6710640 1 -- start start 2026-02-12T03:58:45.261 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.258+0000 7f47e6710640 10 monclient: init 2026-02-12T03:58:45.261 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.258+0000 7f47e6710640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:45.261 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.258+0000 7f47e6710640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T03:58:45.261 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.258+0000 7f47e6710640 10 monclient(hunting): picked mon.noname-c con 0x7f47e01575d0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:45.261 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.258+0000 7f47e6710640 10 monclient(hunting): picked mon.noname-b con 0x7f47e0163310 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:45.261 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.258+0000 7f47e6710640 10 monclient(hunting): picked mon.noname-a con 0x7f47e00560d0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:45.262 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.258+0000 7f47e6710640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47e00b20b0 con 0x7f47e00560d0 2026-02-12T03:58:45.262 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.258+0000 7f47e6710640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47e00b2390 con 0x7f47e0163310 2026-02-12T03:58:45.262 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.258+0000 7f47e6710640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47e00b2670 con 0x7f47e01575d0 2026-02-12T03:58:45.262 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.258+0000 7f47e6710640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:45.262 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.258+0000 7f47e6710640 10 monclient(hunting): authenticate will time out at 1128.001542s 2026-02-12T03:58:45.262 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.258+0000 7f47dffff640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f47e01575d0 0x7f47e0162c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:37576/0 (socket says 10.20.193.91:37576) 2026-02-12T03:58:45.262 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.258+0000 7f47dffff640 1 -- 10.20.193.91:0/4084719413 learned_addr learned my addr 10.20.193.91:0/4084719413 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:45.263 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.260+0000 7f47deffd640 1 -- 10.20.193.91:0/4084719413 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1629164357 0 0) 0x7f47e00b2670 con 0x7f47e01575d0 2026-02-12T03:58:45.263 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.260+0000 7f47deffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.263 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.260+0000 7f47deffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.263 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.260+0000 7f47deffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.263 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.260+0000 7f47deffd640 10 monclient(hunting): my global_id is 4349 2026-02-12T03:58:45.263 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.260+0000 7f47deffd640 1 -- 10.20.193.91:0/4084719413 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47c4003610 con 0x7f47e01575d0 2026-02-12T03:58:45.263 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.260+0000 7f47deffd640 1 -- 10.20.193.91:0/4084719413 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2017247345 0 0) 0x7f47e00b2390 con 0x7f47e0163310 2026-02-12T03:58:45.263 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.260+0000 7f47deffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.264 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.260+0000 7f47deffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.264 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.260+0000 7f47deffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.264 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.260+0000 7f47deffd640 10 monclient(hunting): my global_id is 4387 2026-02-12T03:58:45.264 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.260+0000 7f47deffd640 1 -- 10.20.193.91:0/4084719413 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47e00b2670 con 0x7f47e0163310 2026-02-12T03:58:45.264 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.260+0000 7f47deffd640 1 -- 10.20.193.91:0/4084719413 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1719503267 0 0) 0x7f47e00b20b0 con 0x7f47e00560d0 2026-02-12T03:58:45.264 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.260+0000 7f47deffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.264 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.260+0000 7f47deffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.264 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.260+0000 7f47deffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.264 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.260+0000 7f47deffd640 10 monclient(hunting): my global_id is 4395 2026-02-12T03:58:45.264 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.260+0000 7f47deffd640 1 -- 10.20.193.91:0/4084719413 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47e00b2390 con 0x7f47e00560d0 2026-02-12T03:58:45.268 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.262+0000 7f47deffd640 1 -- 10.20.193.91:0/4084719413 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2409815310 0 0) 0x7f47c4003610 con 0x7f47e01575d0 2026-02-12T03:58:45.268 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.262+0000 7f47deffd640 1 -- 10.20.193.91:0/4084719413 >> v1:10.20.193.98:6789/0 conn(0x7f47e0163310 legacy=0x7f47e00559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.268 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.262+0000 7f47deffd640 1 -- 10.20.193.91:0/4084719413 >> v1:10.20.193.91:6789/0 conn(0x7f47e00560d0 legacy=0x7f47e01c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.268 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.262+0000 7f47deffd640 10 monclient: _finish_hunting 0 2026-02-12T03:58:45.268 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.262+0000 7f47deffd640 1 monclient: found mon.noname-c 2026-02-12T03:58:45.268 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.262+0000 7f47deffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:45.268 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.262+0000 7f47deffd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.111:6789/0 2026-02-12T03:58:45.268 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.262+0000 7f47deffd640 1 -- 10.20.193.91:0/4084719413 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e0162400 con 0x7f47e01575d0 2026-02-12T03:58:45.268 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.262+0000 7f47deffd640 10 monclient: _finish_auth 0 2026-02-12T03:58:45.268 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.262+0000 7f47deffd640 10 monclient: _check_auth_tickets 2026-02-12T03:58:45.269 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.262+0000 7f47deffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:45.269 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.262+0000 7f47deffd640 1 -- 10.20.193.91:0/4084719413 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f47cc002df0 con 0x7f47e01575d0 2026-02-12T03:58:45.269 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.262+0000 7f47deffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.269 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.262+0000 7f47deffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:45.269 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.262+0000 7f47deffd640 10 monclient: dump: 2026-02-12T03:58:45.269 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.269 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.269 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.269 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.269 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.269 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.269 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.269 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.269 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.269 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.270 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.262+0000 7f47e6710640 5 monclient: authenticate success, global_id 4349 2026-02-12T03:58:45.270 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.262+0000 7f47e6710640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:45.270 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.263+0000 7f47deffd640 1 -- 10.20.193.91:0/4084719413 <== mon.2 v1:10.20.193.111:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f47cc002fc0 con 0x7f47e01575d0 2026-02-12T03:58:45.270 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.263+0000 7f47deffd640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:45.270 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.263+0000 7f47deffd640 1 -- 10.20.193.91:0/4084719413 <== mon.2 v1:10.20.193.111:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f47cc003400 con 0x7f47e01575d0 2026-02-12T03:58:45.270 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.263+0000 7f47deffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.270 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.263+0000 7f47deffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:45.270 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.263+0000 7f47deffd640 10 monclient: dump: 2026-02-12T03:58:45.270 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.270 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.270 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.270 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.270 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.270 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.270 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.271 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.271 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.271 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.263+0000 7f47e6710640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:45.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.263+0000 7f47e6710640 4 set_mon_vals no callback set 2026-02-12T03:58:45.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.263+0000 7f47e6710640 10 monclient: shutdown 2026-02-12T03:58:45.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.263+0000 7f47e6710640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:45.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.263+0000 7f47e6710640 1 -- 10.20.193.91:0/4084719413 >> v1:10.20.193.111:6789/0 conn(0x7f47e01575d0 legacy=0x7f47e0162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.263+0000 7f47e6710640 1 -- 10.20.193.91:0/4084719413 shutdown_connections 2026-02-12T03:58:45.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.263+0000 7f47e6710640 1 -- 10.20.193.91:0/4084719413 >> 10.20.193.91:0/4084719413 conn(0x7f47e00b6560 msgr2=0x7f47e00b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:45.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.263+0000 7f47e6710640 1 -- 10.20.193.91:0/4084719413 shutdown_connections 2026-02-12T03:58:45.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.263+0000 7f47e6710640 1 -- 10.20.193.91:0/4084719413 wait complete. 2026-02-12T03:58:45.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.263+0000 7f47e6710640 10 monclient: build_initial_monmap 2026-02-12T03:58:45.271 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.263+0000 7f47e6710640 10 monclient: monmap: 2026-02-12T03:58:45.271 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:45.272 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:45.272 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:45.272 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:45.272 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:45.272 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:45.272 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:45.272 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:45.272 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:45.272 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.272 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.263+0000 7f47e6710640 1 librados: starting msgr at 2026-02-12T03:58:45.272 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.263+0000 7f47e6710640 1 librados: starting objecter 2026-02-12T03:58:45.272 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.263+0000 7f47e6710640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:45.272 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.263+0000 7f47e6710640 1 Processor -- start 2026-02-12T03:58:45.272 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.264+0000 7f47e6710640 1 -- start start 2026-02-12T03:58:45.272 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.264+0000 7f47e6710640 1 librados: setting wanted keys 2026-02-12T03:58:45.273 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.264+0000 7f47e6710640 1 librados: calling monclient init 2026-02-12T03:58:45.273 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.264+0000 7f47e6710640 10 monclient: init 2026-02-12T03:58:45.273 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.264+0000 7f47e6710640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:45.273 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.264+0000 7f47e6710640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T03:58:45.273 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.264+0000 7f47e6710640 10 monclient(hunting): picked mon.noname-b con 0x7f47e00560d0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:45.273 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.264+0000 7f47e6710640 10 monclient(hunting): picked mon.noname-c con 0x7f47e01575d0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:45.273 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.264+0000 7f47e6710640 10 monclient(hunting): picked mon.noname-a con 0x7f47e0163310 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:45.273 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.264+0000 7f47e6710640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47e01ff7d0 con 0x7f47e0163310 2026-02-12T03:58:45.273 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.264+0000 7f47e6710640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47e01fef80 con 0x7f47e00560d0 2026-02-12T03:58:45.273 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.264+0000 7f47e6710640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47e0161080 con 0x7f47e01575d0 2026-02-12T03:58:45.273 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.264+0000 7f47e6710640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:45.273 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.264+0000 7f47e6710640 10 monclient(hunting): authenticate will time out at 1128.007437s 2026-02-12T03:58:45.273 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.264+0000 7f47df7fe640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f47e01575d0 0x7f47e01fe870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:37588/0 (socket says 10.20.193.91:37588) 2026-02-12T03:58:45.273 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.264+0000 7f47df7fe640 1 -- 10.20.193.91:0/99829732 learned_addr learned my addr 10.20.193.91:0/99829732 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:45.273 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.264+0000 7f47dcff9640 10 client.?.objecter ms_handle_connect 0x7f47e01575d0 2026-02-12T03:58:45.274 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.264+0000 7f47dcff9640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.274 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.265+0000 7f47dcff9640 10 client.?.objecter ms_handle_connect 0x7f47e0163310 2026-02-12T03:58:45.274 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.265+0000 7f47dcff9640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.274 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.265+0000 7f47dcff9640 10 client.?.objecter ms_handle_connect 0x7f47e00560d0 2026-02-12T03:58:45.274 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.265+0000 7f47dcff9640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.274 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.265+0000 7f47dcff9640 1 -- 10.20.193.91:0/99829732 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2045544214 0 0) 0x7f47e0161080 con 0x7f47e01575d0 2026-02-12T03:58:45.274 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.265+0000 7f47dcff9640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.274 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.265+0000 7f47dcff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.274 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.265+0000 7f47dcff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.274 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.265+0000 7f47dcff9640 10 monclient(hunting): my global_id is 4352 2026-02-12T03:58:45.274 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.265+0000 7f47dcff9640 1 -- 10.20.193.91:0/99829732 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47b0003610 con 0x7f47e01575d0 2026-02-12T03:58:45.274 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.266+0000 7f47dcff9640 1 -- 10.20.193.91:0/99829732 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 578814058 0 0) 0x7f47e01ff7d0 con 0x7f47e0163310 2026-02-12T03:58:45.274 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.266+0000 7f47dcff9640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.274 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.266+0000 7f47dcff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.274 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.266+0000 7f47dcff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.275 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.266+0000 7f47dcff9640 10 monclient(hunting): my global_id is 4398 2026-02-12T03:58:45.275 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.266+0000 7f47dcff9640 1 -- 10.20.193.91:0/99829732 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47e0161080 con 0x7f47e0163310 2026-02-12T03:58:45.275 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.266+0000 7f47dcff9640 1 -- 10.20.193.91:0/99829732 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3698557241 0 0) 0x7f47e01fef80 con 0x7f47e00560d0 2026-02-12T03:58:45.275 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.266+0000 7f47dcff9640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.275 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.266+0000 7f47dcff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.275 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.266+0000 7f47dcff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.275 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.266+0000 7f47dcff9640 10 monclient(hunting): my global_id is 4390 2026-02-12T03:58:45.275 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.266+0000 7f47dcff9640 1 -- 10.20.193.91:0/99829732 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47e01ff7d0 con 0x7f47e00560d0 2026-02-12T03:58:45.277 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.268+0000 7f47dcff9640 1 -- 10.20.193.91:0/99829732 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2114965820 0 0) 0x7f47b0003610 con 0x7f47e01575d0 2026-02-12T03:58:45.277 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.268+0000 7f47dcff9640 1 -- 10.20.193.91:0/99829732 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f47e01fef80 con 0x7f47e01575d0 2026-02-12T03:58:45.277 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.268+0000 7f47dcff9640 1 -- 10.20.193.91:0/99829732 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f47d00030a0 con 0x7f47e01575d0 2026-02-12T03:58:45.277 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.268+0000 7f47dcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:45.277 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.268+0000 7f47dcff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:45.277 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.268+0000 7f47dcff9640 10 monclient(hunting): dump: 2026-02-12T03:58:45.277 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.277 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.278 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.278 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.278 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.278 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.278 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.278 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.278 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.278 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.278 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.268+0000 7f47dcff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:45.278 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.268+0000 7f47dcff9640 1 -- 10.20.193.91:0/99829732 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 558451816 0 0) 0x7f47e0161080 con 0x7f47e0163310 2026-02-12T03:58:45.278 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.268+0000 7f47dcff9640 1 -- 10.20.193.91:0/99829732 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f47b0003610 con 0x7f47e0163310 2026-02-12T03:58:45.278 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.268+0000 7f47dcff9640 1 -- 10.20.193.91:0/99829732 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f47d4003410 con 0x7f47e0163310 2026-02-12T03:58:45.278 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.268+0000 7f47dcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:45.278 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.268+0000 7f47dcff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:45.278 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.268+0000 7f47dcff9640 10 monclient(hunting): dump: 2026-02-12T03:58:45.279 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.279 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.279 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.279 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.279 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.279 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.279 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.279 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.279 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.279 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.279 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.268+0000 7f47dcff9640 1 -- 10.20.193.91:0/99829732 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2007001751 0 0) 0x7f47e01ff7d0 con 0x7f47e00560d0 2026-02-12T03:58:45.279 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.268+0000 7f47dcff9640 1 -- 10.20.193.91:0/99829732 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f47e0161080 con 0x7f47e00560d0 2026-02-12T03:58:45.279 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.268+0000 7f47dcff9640 1 -- 10.20.193.91:0/99829732 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f47cc003310 con 0x7f47e00560d0 2026-02-12T03:58:45.279 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.268+0000 7f47dcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:45.279 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.268+0000 7f47dcff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:45.279 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.268+0000 7f47dcff9640 10 monclient(hunting): dump: 2026-02-12T03:58:45.280 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.280 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.280 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.280 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.280 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.280 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.280 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.280 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.280 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.280 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.280 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.270+0000 7f47dcff9640 1 -- 10.20.193.91:0/99829732 <== mon.2 v1:10.20.193.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3159466097 0 0) 0x7f47e01fef80 con 0x7f47e01575d0 2026-02-12T03:58:45.280 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.270+0000 7f47dcff9640 1 -- 10.20.193.91:0/99829732 >> v1:10.20.193.98:6789/0 conn(0x7f47e00560d0 legacy=0x7f47e013a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.280 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.270+0000 7f47dcff9640 1 -- 10.20.193.91:0/99829732 >> v1:10.20.193.91:6789/0 conn(0x7f47e0163310 legacy=0x7f47e0160970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.280 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.270+0000 7f47dcff9640 10 monclient: _finish_hunting 0 2026-02-12T03:58:45.280 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.270+0000 7f47dcff9640 1 monclient: found mon.c 2026-02-12T03:58:45.281 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.270+0000 7f47dcff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:45.281 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.270+0000 7f47dcff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:45.281 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.270+0000 7f47dcff9640 1 -- 10.20.193.91:0/99829732 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47e0139df0 con 0x7f47e01575d0 2026-02-12T03:58:45.281 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.270+0000 7f47dcff9640 10 monclient: _finish_auth 0 2026-02-12T03:58:45.281 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.270+0000 7f47dcff9640 10 monclient: _check_auth_tickets 2026-02-12T03:58:45.281 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.270+0000 7f47dcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:45.281 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.270+0000 7f47e6710640 5 monclient: authenticate success, global_id 4352 2026-02-12T03:58:45.281 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.270+0000 7f47e6710640 10 monclient: _renew_subs 2026-02-12T03:58:45.281 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.270+0000 7f47e6710640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:45.281 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.270+0000 7f47e6710640 1 -- 10.20.193.91:0/99829732 --> v1:10.20.193.111:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f47e01ff210 con 0x7f47e01575d0 2026-02-12T03:58:45.281 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.270+0000 7f47e6710640 10 client.4352.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:45.281 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.270+0000 7f47e6710640 10 monclient: _renew_subs 2026-02-12T03:58:45.281 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.270+0000 7f47e6710640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:45.281 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.270+0000 7f47e6710640 1 -- 10.20.193.91:0/99829732 --> v1:10.20.193.111:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f47e0139030 con 0x7f47e01575d0 2026-02-12T03:58:45.281 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.270+0000 7f47e6710640 1 librados: init done 2026-02-12T03:58:45.281 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.270+0000 7f47e6710640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:45.282 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.270+0000 7f47e6710640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:45.282 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.270+0000 7f47e6710640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:45.282 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.270+0000 7f47e6710640 1 -- 10.20.193.91:0/99829732 --> v1:10.20.193.111:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47e00b7290 con 0x7f47e01575d0 2026-02-12T03:58:45.367 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.366+0000 7f47dcff9640 1 -- 10.20.193.91:0/99829732 <== mon.2 v1:10.20.193.111:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f47d0003450 con 0x7f47e01575d0 2026-02-12T03:58:45.368 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.366+0000 7f47dcff9640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:45.368 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.366+0000 7f47dcff9640 1 -- 10.20.193.91:0/99829732 <== mon.2 v1:10.20.193.111:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f47d0003b50 con 0x7f47e01575d0 2026-02-12T03:58:45.368 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.366+0000 7f47dcff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.368 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.366+0000 7f47dcff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:45.368 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.366+0000 7f47dcff9640 10 monclient: dump: 2026-02-12T03:58:45.369 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.369 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.369 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.369 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.369 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.369 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.370 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.370 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.370 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.370 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.370 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.366+0000 7f47de7fc640 4 set_mon_vals no callback set 2026-02-12T03:58:45.372 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.366+0000 7f47dcff9640 1 -- 10.20.193.91:0/99829732 <== mon.2 v1:10.20.193.111:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f47d0003b50 con 0x7f47e01575d0 2026-02-12T03:58:45.372 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.367+0000 7f47dffff640 10 monclient: get_auth_request con 0x7f47b007a040 auth_method 0 2026-02-12T03:58:45.373 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.367+0000 7f47dcff9640 10 client.4352.objecter ms_handle_connect 0x7f47b007a040 2026-02-12T03:58:45.373 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.368+0000 7f47dcff9640 1 -- 10.20.193.91:0/99829732 <== mon.2 v1:10.20.193.111:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7f47d0095ad0 con 0x7f47e01575d0 2026-02-12T03:58:45.373 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.368+0000 7f47dcff9640 10 client.4352.objecter ms_dispatch2 0x7f47e0000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:45.373 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.368+0000 7f47dcff9640 3 client.4352.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:45.373 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.368+0000 7f47dcff9640 3 client.4352.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:45.374 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.368+0000 7f47dcff9640 20 client.4352.objecter dump_active .. 0 homeless 2026-02-12T03:58:45.374 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.369+0000 7f47dcff9640 1 -- 10.20.193.91:0/99829732 <== mon.2 v1:10.20.193.111:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f47d005f430 con 0x7f47e01575d0 2026-02-12T03:58:45.374 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.369+0000 7f47dcff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:45.374 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.369+0000 7f47dcff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:45.477 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.475+0000 7f47e6710640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-12T03:58:45.477 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.475+0000 7f47e6710640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T03:58:45.477 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.475+0000 7f47e6710640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:45.477 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.475+0000 7f47e6710640 1 -- 10.20.193.91:0/99829732 --> v1:10.20.193.111:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f47e00565d0 con 0x7f47e01575d0 2026-02-12T03:58:45.535 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.533+0000 7f47dcff9640 1 -- 10.20.193.91:0/99829732 <== mon.2 v1:10.20.193.111:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+20912 (unknown 634195324 0 2801080463) 0x7f47d005ed30 con 0x7f47e01575d0 2026-02-12T03:58:45.535 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.533+0000 7f47dcff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T03:58:45.535 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.533+0000 7f47dcff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:45.535 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:58:45.535 INFO:teuthology.orchestra.run.trial091.stdout:{"epoch":28,"fsid":"1e356fcf-3d61-462e-a451-82f8dd01e1f3","created":"2026-02-12T03:57:59.014379+0000","modified":"2026-02-12T03:58:43.923444+0000","last_up_change":"2026-02-12T03:58:32.372907+0000","last_in_change":"2026-02-12T03:58:05.455425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-12T03:58:32.248062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-12T03:58:39.975964+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":28,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":5.9899997711181641,"score_stable":5.9899997711181641,"optimal_score":0.68999999761581421,"raw_score_acting":4.130000114440918,"raw_score_stable":4.130000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"791c97c5-83f6-4024-9f43-ff3b2ee22a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6801","nonce":1203233578}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6802","nonce":1203233578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6804","nonce":1203233578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6803","nonce":1203233578}]},"public_addr":"10.20.193.91:6801/1203233578","cluster_addr":"10.20.193.91:6802/1203233578","heartbeat_back_addr":"10.20.193.91:6804/1203233578","heartbeat_front_addr":"10.20.193.91:6803/1203233578","state":["exists","up"]},{"osd":1,"uuid":"0cf561d6-85aa-428a-bc69-83ce77b1c802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6812","nonce":2011281833}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6813","nonce":2011281833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6815","nonce":2011281833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6814","nonce":2011281833}]},"public_addr":"10.20.193.98:6812/2011281833","cluster_addr":"10.20.193.98:6813/2011281833","heartbeat_back_addr":"10.20.193.98:6815/2011281833","heartbeat_front_addr":"10.20.193.98:6814/2011281833","state":["exists","up"]},{"osd":2,"uuid":"b3dc78b9-cae6-4b1f-931f-7352a43b9e26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6812","nonce":350848222}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6813","nonce":350848222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6815","nonce":350848222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6814","nonce":350848222}]},"public_addr":"10.20.193.111:6812/350848222","cluster_addr":"10.20.193.111:6813/350848222","heartbeat_back_addr":"10.20.193.111:6815/350848222","heartbeat_front_addr":"10.20.193.111:6814/350848222","state":["exists","up"]},{"osd":3,"uuid":"e164e3ae-cf6a-45ff-b126-3ac739c5b1be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6800","nonce":4779434}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6801","nonce":4779434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6803","nonce":4779434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6802","nonce":4779434}]},"public_addr":"10.20.193.154:6800/4779434","cluster_addr":"10.20.193.154:6801/4779434","heartbeat_back_addr":"10.20.193.154:6803/4779434","heartbeat_front_addr":"10.20.193.154:6802/4779434","state":["exists","up"]},{"osd":4,"uuid":"5583cc8c-83d4-42b4-a997-c056f3b145a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6805","nonce":1766507926}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6806","nonce":1766507926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6808","nonce":1766507926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6807","nonce":1766507926}]},"public_addr":"10.20.193.91:6805/1766507926","cluster_addr":"10.20.193.91:6806/1766507926","heartbeat_back_addr":"10.20.193.91:6808/1766507926","heartbeat_front_addr":"10.20.193.91:6807/1766507926","state":["exists","up"]},{"osd":5,"uuid":"d7bb6fa1-b042-4dce-9644-00e817a5bc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6808","nonce":3918277953}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6809","nonce":3918277953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6811","nonce":3918277953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6810","nonce":3918277953}]},"public_addr":"10.20.193.98:6808/3918277953","cluster_addr":"10.20.193.98:6809/3918277953","heartbeat_back_addr":"10.20.193.98:6811/3918277953","heartbeat_front_addr":"10.20.193.98:6810/3918277953","state":["exists","up"]},{"osd":6,"uuid":"93cd9edf-a000-4d22-8da7-52f4bd547765","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6804","nonce":727190484}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6805","nonce":727190484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6807","nonce":727190484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6806","nonce":727190484}]},"public_addr":"10.20.193.111:6804/727190484","cluster_addr":"10.20.193.111:6805/727190484","heartbeat_back_addr":"10.20.193.111:6807/727190484","heartbeat_front_addr":"10.20.193.111:6806/727190484","state":["exists","up"]},{"osd":7,"uuid":"f5e11a47-d746-46ca-85f1-27d3bc586371","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6808","nonce":903276772}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6810","nonce":903276772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6813","nonce":903276772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6811","nonce":903276772}]},"public_addr":"10.20.193.154:6808/903276772","cluster_addr":"10.20.193.154:6810/903276772","heartbeat_back_addr":"10.20.193.154:6813/903276772","heartbeat_front_addr":"10.20.193.154:6811/903276772","state":["exists","up"]},{"osd":8,"uuid":"bb8207ce-22b9-46be-9c89-c77f2690e405","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6809","nonce":443384425}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6810","nonce":443384425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6812","nonce":443384425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6811","nonce":443384425}]},"public_addr":"10.20.193.91:6809/443384425","cluster_addr":"10.20.193.91:6810/443384425","heartbeat_back_addr":"10.20.193.91:6812/443384425","heartbeat_front_addr":"10.20.193.91:6811/443384425","state":["exists","up"]},{"osd":9,"uuid":"e6318a6d-2367-48ce-a3a1-47307de14b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6801","nonce":4165741185}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6804","nonce":4165741185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6807","nonce":4165741185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6806","nonce":4165741185}]},"public_addr":"10.20.193.98:6801/4165741185","cluster_addr":"10.20.193.98:6804/4165741185","heartbeat_back_addr":"10.20.193.98:6807/4165741185","heartbeat_front_addr":"10.20.193.98:6806/4165741185","state":["exists","up"]},{"osd":10,"uuid":"cd6c97a2-bdfe-4b86-afeb-217315976d6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6808","nonce":1268343515}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6809","nonce":1268343515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6811","nonce":1268343515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6810","nonce":1268343515}]},"public_addr":"10.20.193.111:6808/1268343515","cluster_addr":"10.20.193.111:6809/1268343515","heartbeat_back_addr":"10.20.193.111:6811/1268343515","heartbeat_front_addr":"10.20.193.111:6810/1268343515","state":["exists","up"]},{"osd":11,"uuid":"b6c647bb-4e86-4b0e-b79c-b0236a780a66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6804","nonce":2902069275}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6805","nonce":2902069275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6807","nonce":2902069275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6806","nonce":2902069275}]},"public_addr":"10.20.193.154:6804/2902069275","cluster_addr":"10.20.193.154:6805/2902069275","heartbeat_back_addr":"10.20.193.154:6807/2902069275","heartbeat_front_addr":"10.20.193.154:6806/2902069275","state":["exists","up"]},{"osd":12,"uuid":"19bb3570-0c0a-48cc-a0b8-ec3194f30fa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6813","nonce":3587007397}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6814","nonce":3587007397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6816","nonce":3587007397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6815","nonce":3587007397}]},"public_addr":"10.20.193.91:6813/3587007397","cluster_addr":"10.20.193.91:6814/3587007397","heartbeat_back_addr":"10.20.193.91:6816/3587007397","heartbeat_front_addr":"10.20.193.91:6815/3587007397","state":["exists","up"]},{"osd":13,"uuid":"a8215062-521c-47f6-b20a-9e40c1f3f5a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6800","nonce":1665089474}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6802","nonce":1665089474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6805","nonce":1665089474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6803","nonce":1665089474}]},"public_addr":"10.20.193.98:6800/1665089474","cluster_addr":"10.20.193.98:6802/1665089474","heartbeat_back_addr":"10.20.193.98:6805/1665089474","heartbeat_front_addr":"10.20.193.98:6803/1665089474","state":["exists","up"]},{"osd":14,"uuid":"3cd1bb48-53a2-462e-b7e5-4d6d918dd543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6800","nonce":1665676360}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6801","nonce":1665676360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6803","nonce":1665676360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6802","nonce":1665676360}]},"public_addr":"10.20.193.111:6800/1665676360","cluster_addr":"10.20.193.111:6801/1665676360","heartbeat_back_addr":"10.20.193.111:6803/1665676360","heartbeat_front_addr":"10.20.193.111:6802/1665676360","state":["exists","up"]},{"osd":15,"uuid":"9bd39438-f5e5-4a19-afa4-678395d63c24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6809","nonce":2343771552}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6812","nonce":2343771552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6815","nonce":2343771552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6814","nonce":2343771552}]},"public_addr":"10.20.193.154:6809/2343771552","cluster_addr":"10.20.193.154:6812/2343771552","heartbeat_back_addr":"10.20.193.154:6815/2343771552","heartbeat_front_addr":"10.20.193.154:6814/2343771552","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.723024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:30.073947+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.930180+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:30.325123+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.735688+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.923661+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.879912+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:30.480032+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.983654+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.730948+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.899878+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:30.549254+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.968146+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.918456+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.803753+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:30.518611+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T03:58:45.536 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.534+0000 7f47e6710640 10 librados: watch_flush enter 2026-02-12T03:58:45.536 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.534+0000 7f47e6710640 10 librados: watch_flush exit 2026-02-12T03:58:45.536 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.534+0000 7f47e6710640 20 client.4352.objecter shutdown clearing up homeless session... 2026-02-12T03:58:45.536 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.534+0000 7f47e6710640 10 client.4352.objecter successfully canceled tick 2026-02-12T03:58:45.536 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.534+0000 7f47e6710640 1 -- 10.20.193.91:0/99829732 >> v1:10.20.193.91:6800/2929217192 conn(0x7f47b007a040 legacy=0x7f47b009a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.537 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.534+0000 7f47e6710640 10 monclient: shutdown 2026-02-12T03:58:45.537 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.534+0000 7f47e6710640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:45.537 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.534+0000 7f47e6710640 1 -- 10.20.193.91:0/99829732 >> v1:10.20.193.111:6789/0 conn(0x7f47e01575d0 legacy=0x7f47e01fe870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.537 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.534+0000 7f47e6710640 1 -- 10.20.193.91:0/99829732 shutdown_connections 2026-02-12T03:58:45.537 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.534+0000 7f47e6710640 1 -- 10.20.193.91:0/99829732 >> 10.20.193.91:0/99829732 conn(0x7f47e00b6560 msgr2=0x7f47e00b1880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:45.537 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.534+0000 7f47e6710640 1 -- 10.20.193.91:0/99829732 shutdown_connections 2026-02-12T03:58:45.537 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.534+0000 7f47e6710640 1 -- 10.20.193.91:0/99829732 wait complete. 2026-02-12T03:58:45.537 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.535+0000 7f47e6710640 1 librados: shutdown 2026-02-12T03:58:45.546 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-12T03:58:45.547 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-12T03:58:45.547 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-12T03:58:45.547 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-12T03:58:45.547 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2026-02-12T03:58:45.547 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2026-02-12T03:58:45.548 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2026-02-12T03:58:45.548 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2026-02-12T03:58:45.548 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2026-02-12T03:58:45.548 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2026-02-12T03:58:45.548 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 flush_pg_stats 2026-02-12T03:58:45.549 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 flush_pg_stats 2026-02-12T03:58:45.549 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 flush_pg_stats 2026-02-12T03:58:45.549 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 flush_pg_stats 2026-02-12T03:58:45.549 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 flush_pg_stats 2026-02-12T03:58:45.549 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 flush_pg_stats 2026-02-12T03:58:45.632 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.630+0000 7fab3dc6f640 10 monclient: get_monmap_and_config 2026-02-12T03:58:45.633 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.630+0000 7fab3dc6f640 10 monclient: build_initial_monmap 2026-02-12T03:58:45.633 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.630+0000 7fab3dc6f640 10 monclient: monmap: 2026-02-12T03:58:45.633 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:45.633 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.633 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:45.631510+0000 2026-02-12T03:58:45.633 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:45.631510+0000 2026-02-12T03:58:45.633 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:45.633 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.633 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:45.633 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:45.634 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:45.634 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.635 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.631+0000 7fab3dc6f640 1 Processor -- start 2026-02-12T03:58:45.635 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.631+0000 7fab3dc6f640 1 -- start start 2026-02-12T03:58:45.635 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.631+0000 7fab3dc6f640 10 monclient: init 2026-02-12T03:58:45.635 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.632+0000 7fab3dc6f640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:45.635 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.632+0000 7fab3dc6f640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T03:58:45.635 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.632+0000 7fab3dc6f640 10 monclient(hunting): picked mon.noname-b con 0x7fab380b57a0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:45.635 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.632+0000 7fab3dc6f640 10 monclient(hunting): picked mon.noname-a con 0x7fab380b7180 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:45.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.632+0000 7fab3dc6f640 10 monclient(hunting): picked mon.noname-c con 0x7fab380b5b70 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:45.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.632+0000 7fab3dc6f640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab38163f30 con 0x7fab380b7180 2026-02-12T03:58:45.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.632+0000 7fab3dc6f640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab380b63c0 con 0x7fab380b57a0 2026-02-12T03:58:45.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.632+0000 7fab3dc6f640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab380b66a0 con 0x7fab380b5b70 2026-02-12T03:58:45.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.632+0000 7fab3dc6f640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:45.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.632+0000 7fab3dc6f640 10 monclient(hunting): authenticate will time out at 1128.375577s 2026-02-12T03:58:45.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.632+0000 7fab377fe640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7fab380b57a0 0x7fab380b3990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:48316/0 (socket says 10.20.193.91:48316) 2026-02-12T03:58:45.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.632+0000 7fab37fff640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7fab380b5b70 0x7fab381633b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:37600/0 (socket says 10.20.193.91:37600) 2026-02-12T03:58:45.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.632+0000 7fab377fe640 1 -- 10.20.193.91:0/514838465 learned_addr learned my addr 10.20.193.91:0/514838465 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:45.637 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.633+0000 7f7dd3802640 10 monclient: get_monmap_and_config 2026-02-12T03:58:45.637 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.633+0000 7f7dd3802640 10 monclient: build_initial_monmap 2026-02-12T03:58:45.637 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.633+0000 7f7dd3802640 10 monclient: monmap: 2026-02-12T03:58:45.637 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:45.637 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.637 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:45.633956+0000 2026-02-12T03:58:45.637 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:45.633956+0000 2026-02-12T03:58:45.637 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:45.638 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.638 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:45.638 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:45.638 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:45.638 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.638 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.633+0000 7f7dd3802640 1 Processor -- start 2026-02-12T03:58:45.638 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.634+0000 7fab367fc640 1 -- 10.20.193.91:0/514838465 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2968537939 0 0) 0x7fab380b63c0 con 0x7fab380b57a0 2026-02-12T03:58:45.638 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.634+0000 7fab367fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.638 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.634+0000 7fab367fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.634+0000 7fab367fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.634+0000 7fab367fc640 10 monclient(hunting): my global_id is 4393 2026-02-12T03:58:45.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.634+0000 7f7dd3802640 1 -- start start 2026-02-12T03:58:45.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.634+0000 7f7dd3802640 10 monclient: init 2026-02-12T03:58:45.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.634+0000 7fab367fc640 1 -- 10.20.193.91:0/514838465 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab1c003610 con 0x7fab380b57a0 2026-02-12T03:58:45.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.634+0000 7fab367fc640 1 -- 10.20.193.91:0/514838465 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3557205299 0 0) 0x7fab380b66a0 con 0x7fab380b5b70 2026-02-12T03:58:45.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.634+0000 7fab367fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.634+0000 7fab367fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.634+0000 7fab367fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.634+0000 7fab367fc640 10 monclient(hunting): my global_id is 4355 2026-02-12T03:58:45.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.634+0000 7fab367fc640 1 -- 10.20.193.91:0/514838465 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab380b63c0 con 0x7fab380b5b70 2026-02-12T03:58:45.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.634+0000 7f47ff5cc640 10 monclient: get_monmap_and_config 2026-02-12T03:58:45.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.634+0000 7f47ff5cc640 10 monclient: build_initial_monmap 2026-02-12T03:58:45.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.634+0000 7f47ff5cc640 10 monclient: monmap: 2026-02-12T03:58:45.641 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:45.641 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.641 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:45.635229+0000 2026-02-12T03:58:45.641 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:45.635229+0000 2026-02-12T03:58:45.641 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:45.641 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.641 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:45.641 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:45.641 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:45.642 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.643 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.634+0000 7f7dd3802640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:45.643 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.634+0000 7f7dd3802640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T03:58:45.643 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.634+0000 7f7dd3802640 10 monclient(hunting): picked mon.noname-b con 0x7f7dcc0b57a0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:45.643 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.634+0000 7f7dd3802640 10 monclient(hunting): picked mon.noname-c con 0x7f7dcc0b7180 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:45.643 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.635+0000 7f7dd3802640 10 monclient(hunting): picked mon.noname-a con 0x7f7dcc0b5b70 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:45.643 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.635+0000 7f7dd3802640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dcc163f30 con 0x7f7dcc0b5b70 2026-02-12T03:58:45.643 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.635+0000 7f7dd3802640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dcc0b63c0 con 0x7f7dcc0b57a0 2026-02-12T03:58:45.643 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.635+0000 7f7dd3802640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dcc0b66a0 con 0x7f7dcc0b7180 2026-02-12T03:58:45.643 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.635+0000 7f7dd3802640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:45.643 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.635+0000 7f7dd3802640 10 monclient(hunting): authenticate will time out at 1128.378238s 2026-02-12T03:58:45.644 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.635+0000 7f47ff5cc640 1 Processor -- start 2026-02-12T03:58:45.644 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.635+0000 7f47ff5cc640 1 -- start start 2026-02-12T03:58:45.644 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.635+0000 7f47ff5cc640 10 monclient: init 2026-02-12T03:58:45.644 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.635+0000 7fd0d8a96640 10 monclient: get_monmap_and_config 2026-02-12T03:58:45.645 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.635+0000 7fd0d8a96640 10 monclient: build_initial_monmap 2026-02-12T03:58:45.645 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.635+0000 7fd0d8a96640 10 monclient: monmap: 2026-02-12T03:58:45.645 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:45.645 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.645 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:45.636028+0000 2026-02-12T03:58:45.645 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:45.636028+0000 2026-02-12T03:58:45.645 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:45.645 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.645 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:45.645 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:45.645 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:45.645 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.646 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.635+0000 7fab367fc640 1 -- 10.20.193.91:0/514838465 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1132688946 0 0) 0x7fab38163f30 con 0x7fab380b7180 2026-02-12T03:58:45.646 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.635+0000 7fab367fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.646 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.635+0000 7fab367fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.646 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.635+0000 7fab367fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.646 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.635+0000 7fab367fc640 10 monclient(hunting): my global_id is 4401 2026-02-12T03:58:45.646 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.635+0000 7fab367fc640 1 -- 10.20.193.91:0/514838465 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab380b66a0 con 0x7fab380b7180 2026-02-12T03:58:45.647 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.635+0000 7f7dd1d78640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f7dcc0b5b70 0x7f7dcc1633b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:59148/0 (socket says 10.20.193.91:59148) 2026-02-12T03:58:45.647 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.635+0000 7f7dd1d78640 1 -- 10.20.193.91:0/40174497 learned_addr learned my addr 10.20.193.91:0/40174497 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:45.647 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.635+0000 7fab367fc640 1 -- 10.20.193.91:0/514838465 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1307160534 0 0) 0x7fab1c003610 con 0x7fab380b57a0 2026-02-12T03:58:45.647 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.635+0000 7fab367fc640 1 -- 10.20.193.91:0/514838465 >> v1:10.20.193.111:6789/0 conn(0x7fab380b5b70 legacy=0x7fab381633b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.647 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.635+0000 7fab367fc640 1 -- 10.20.193.91:0/514838465 >> v1:10.20.193.91:6789/0 conn(0x7fab380b7180 legacy=0x7fab380565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.647 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.635+0000 7fab367fc640 10 monclient: _finish_hunting 0 2026-02-12T03:58:45.647 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.635+0000 7fab367fc640 1 monclient: found mon.noname-b 2026-02-12T03:58:45.648 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.635+0000 7f47ff5cc640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:45.648 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.635+0000 7f47ff5cc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T03:58:45.648 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.635+0000 7f47ff5cc640 10 monclient(hunting): picked mon.noname-b con 0x7f47f80b57a0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:45.648 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.635+0000 7fd0d8a96640 1 Processor -- start 2026-02-12T03:58:45.649 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.636+0000 7f47ff5cc640 10 monclient(hunting): picked mon.noname-c con 0x7f47f80b7180 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:45.649 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.636+0000 7fd0d8a96640 1 -- start start 2026-02-12T03:58:45.649 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.636+0000 7fd0d8a96640 10 monclient: init 2026-02-12T03:58:45.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.636+0000 7fab367fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:45.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.636+0000 7fab367fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T03:58:45.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.636+0000 7fab367fc640 1 -- 10.20.193.91:0/514838465 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab380b6980 con 0x7fab380b57a0 2026-02-12T03:58:45.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.636+0000 7fab367fc640 10 monclient: _finish_auth 0 2026-02-12T03:58:45.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.636+0000 7fab367fc640 10 monclient: _check_auth_tickets 2026-02-12T03:58:45.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.636+0000 7fab367fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:45.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.636+0000 7fab367fc640 1 -- 10.20.193.91:0/514838465 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fab24002df0 con 0x7fab380b57a0 2026-02-12T03:58:45.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.636+0000 7fab367fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.651 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.636+0000 7f47ff5cc640 10 monclient(hunting): picked mon.noname-a con 0x7f47f80b5b70 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:45.651 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.636+0000 7fab367fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:45.651 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.636+0000 7fab367fc640 10 monclient: dump: 2026-02-12T03:58:45.651 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.651 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.651 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.651 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.652 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.652 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.652 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.652 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.652 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.652 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.652 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.636+0000 7fab3dc6f640 5 monclient: authenticate success, global_id 4393 2026-02-12T03:58:45.652 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.636+0000 7fab3dc6f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:45.653 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.636+0000 7f47ff5cc640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47f8163f30 con 0x7f47f80b5b70 2026-02-12T03:58:45.653 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.637+0000 7ff2342c4640 10 monclient: get_monmap_and_config 2026-02-12T03:58:45.654 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.637+0000 7ff2342c4640 10 monclient: build_initial_monmap 2026-02-12T03:58:45.654 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.637+0000 7ff2342c4640 10 monclient: monmap: 2026-02-12T03:58:45.654 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:45.654 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.654 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:45.637671+0000 2026-02-12T03:58:45.654 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:45.637671+0000 2026-02-12T03:58:45.654 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:45.654 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.654 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:45.654 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:45.655 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:45.655 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.655 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.637+0000 7ff2342c4640 1 Processor -- start 2026-02-12T03:58:45.655 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.637+0000 7ff2342c4640 1 -- start start 2026-02-12T03:58:45.655 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.637+0000 7ff2342c4640 10 monclient: init 2026-02-12T03:58:45.655 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.636+0000 7f47ff5cc640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47f80b63c0 con 0x7f47f80b57a0 2026-02-12T03:58:45.655 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.636+0000 7f47ff5cc640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47f80b66a0 con 0x7f47f80b7180 2026-02-12T03:58:45.656 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.636+0000 7f47ff5cc640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:45.656 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.636+0000 7f47ff5cc640 10 monclient(hunting): authenticate will time out at 1128.379227s 2026-02-12T03:58:45.656 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.637+0000 7f47fd341640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f47f80b57a0 0x7f47f80b3990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:48330/0 (socket says 10.20.193.91:48330) 2026-02-12T03:58:45.656 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.637+0000 7f47fd341640 1 -- 10.20.193.91:0/3702304355 learned_addr learned my addr 10.20.193.91:0/3702304355 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:45.656 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.636+0000 7fd0d8a96640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:45.656 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.636+0000 7fd0d8a96640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T03:58:45.656 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.636+0000 7fd0d8a96640 10 monclient(hunting): picked mon.noname-a con 0x7fd0d415d2f0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:45.657 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.636+0000 7fd0d8a96640 10 monclient(hunting): picked mon.noname-c con 0x7fd0d40b8080 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:45.657 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.636+0000 7fd0d8a96640 10 monclient(hunting): picked mon.noname-b con 0x7fd0d415d6c0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:45.657 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.636+0000 7fd0d8a96640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0d40577f0 con 0x7fd0d415d2f0 2026-02-12T03:58:45.657 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.636+0000 7fd0d8a96640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0d40b57b0 con 0x7fd0d415d6c0 2026-02-12T03:58:45.657 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.636+0000 7fd0d8a96640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0d40b5a90 con 0x7fd0d40b8080 2026-02-12T03:58:45.657 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.636+0000 7fd0d8a96640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:45.657 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.636+0000 7fd0d8a96640 10 monclient(hunting): authenticate will time out at 1128.379622s 2026-02-12T03:58:45.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.637+0000 7fab367fc640 1 -- 10.20.193.91:0/514838465 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fab24002fc0 con 0x7fab380b57a0 2026-02-12T03:58:45.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.637+0000 7fab367fc640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:45.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.637+0000 7fab367fc640 1 -- 10.20.193.91:0/514838465 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fab24003400 con 0x7fab380b57a0 2026-02-12T03:58:45.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.637+0000 7fab367fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.637+0000 7fab367fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:45.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.637+0000 7fab367fc640 10 monclient: dump: 2026-02-12T03:58:45.658 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.658 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.659 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.659 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.659 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.659 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.659 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.659 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.659 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.659 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.659 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.638+0000 7fab3dc6f640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:45.659 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.638+0000 7fab3dc6f640 4 set_mon_vals no callback set 2026-02-12T03:58:45.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.638+0000 7ff2342c4640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:45.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.638+0000 7ff2342c4640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T03:58:45.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.638+0000 7ff2342c4640 10 monclient(hunting): picked mon.noname-a con 0x7ff22c159b70 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:45.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.638+0000 7f725b251640 10 monclient: get_monmap_and_config 2026-02-12T03:58:45.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.638+0000 7f725b251640 10 monclient: build_initial_monmap 2026-02-12T03:58:45.661 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.638+0000 7f725b251640 10 monclient: monmap: 2026-02-12T03:58:45.661 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:45.661 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.661 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:45.638849+0000 2026-02-12T03:58:45.661 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:45.638849+0000 2026-02-12T03:58:45.661 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:45.661 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.661 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:45.661 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:45.661 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:45.661 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.638+0000 7ff2342c4640 10 monclient(hunting): picked mon.noname-b con 0x7ff22c166f70 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:45.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.638+0000 7ff2342c4640 10 monclient(hunting): picked mon.noname-c con 0x7ff22c164760 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:45.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.638+0000 7ff2342c4640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff22c0b8a20 con 0x7ff22c159b70 2026-02-12T03:58:45.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.638+0000 7ff2342c4640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff22c0b8cc0 con 0x7ff22c166f70 2026-02-12T03:58:45.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.638+0000 7ff2342c4640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff22c0b8fa0 con 0x7ff22c164760 2026-02-12T03:58:45.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.638+0000 7ff2342c4640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:45.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.638+0000 7ff2342c4640 10 monclient(hunting): authenticate will time out at 1128.381442s 2026-02-12T03:58:45.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.638+0000 7fab3dc6f640 10 monclient: shutdown 2026-02-12T03:58:45.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.638+0000 7fab3dc6f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:45.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.638+0000 7fab3dc6f640 1 -- 10.20.193.91:0/514838465 >> v1:10.20.193.98:6789/0 conn(0x7fab380b57a0 legacy=0x7fab380b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.638+0000 7fab3dc6f640 1 -- 10.20.193.91:0/514838465 shutdown_connections 2026-02-12T03:58:45.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.638+0000 7fab3dc6f640 1 -- 10.20.193.91:0/514838465 >> 10.20.193.91:0/514838465 conn(0x7fab380559c0 msgr2=0x7fab38055dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:45.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.638+0000 7fab3dc6f640 1 -- 10.20.193.91:0/514838465 shutdown_connections 2026-02-12T03:58:45.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.638+0000 7fab3dc6f640 1 -- 10.20.193.91:0/514838465 wait complete. 2026-02-12T03:58:45.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.638+0000 7f7dbbfff640 1 -- 10.20.193.91:0/40174497 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1543516897 0 0) 0x7f7dcc0b66a0 con 0x7f7dcc0b7180 2026-02-12T03:58:45.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.638+0000 7f7dbbfff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.638+0000 7f7dbbfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.638+0000 7f7dbbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.638+0000 7f7dbbfff640 10 monclient(hunting): my global_id is 4358 2026-02-12T03:58:45.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.638+0000 7f7dbbfff640 1 -- 10.20.193.91:0/40174497 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7db4003610 con 0x7f7dcc0b7180 2026-02-12T03:58:45.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.638+0000 7f725b251640 1 Processor -- start 2026-02-12T03:58:45.666 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.638+0000 7f7dbbfff640 1 -- 10.20.193.91:0/40174497 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 371592016 0 0) 0x7f7dcc0b63c0 con 0x7f7dcc0b57a0 2026-02-12T03:58:45.666 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.638+0000 7f7dbbfff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.666 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.638+0000 7f7dbbfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.666 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.638+0000 7f7dbbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.666 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.638+0000 7f7dbbfff640 10 monclient(hunting): my global_id is 4396 2026-02-12T03:58:45.666 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.638+0000 7f7dbbfff640 1 -- 10.20.193.91:0/40174497 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7dcc0b66a0 con 0x7f7dcc0b57a0 2026-02-12T03:58:45.666 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.638+0000 7f725b251640 1 -- start start 2026-02-12T03:58:45.667 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.638+0000 7f725b251640 10 monclient: init 2026-02-12T03:58:45.667 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.639+0000 7fab3dc6f640 10 monclient: build_initial_monmap 2026-02-12T03:58:45.667 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.639+0000 7fab3dc6f640 10 monclient: monmap: 2026-02-12T03:58:45.667 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:45.667 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:45.667 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:45.667 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:45.667 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:45.667 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:45.668 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:45.668 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:45.668 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:45.668 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.639+0000 7fd0d2d76640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7fd0d415d6c0 0x7fd0d40570e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:48334/0 (socket says 10.20.193.91:48334) 2026-02-12T03:58:45.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.639+0000 7fd0d2d76640 1 -- 10.20.193.91:0/1944730696 learned_addr learned my addr 10.20.193.91:0/1944730696 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:45.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.639+0000 7f79423be640 10 monclient: get_monmap_and_config 2026-02-12T03:58:45.669 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.639+0000 7f79423be640 10 monclient: build_initial_monmap 2026-02-12T03:58:45.669 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.639+0000 7f79423be640 10 monclient: monmap: 2026-02-12T03:58:45.669 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:45.669 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.669 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:45.639776+0000 2026-02-12T03:58:45.669 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:45.639776+0000 2026-02-12T03:58:45.669 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:45.669 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.669 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:45.669 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:45.669 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:45.669 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.639+0000 7fab3dc6f640 1 librados: starting msgr at 2026-02-12T03:58:45.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.639+0000 7fab3dc6f640 1 librados: starting objecter 2026-02-12T03:58:45.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.639+0000 7f725b251640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:45.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.639+0000 7fab3dc6f640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:45.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.639+0000 7fab3dc6f640 1 Processor -- start 2026-02-12T03:58:45.671 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.639+0000 7f79423be640 1 Processor -- start 2026-02-12T03:58:45.671 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.639+0000 7fab3dc6f640 1 -- start start 2026-02-12T03:58:45.671 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.639+0000 7fab3dc6f640 1 librados: setting wanted keys 2026-02-12T03:58:45.671 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.639+0000 7fab3dc6f640 1 librados: calling monclient init 2026-02-12T03:58:45.671 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.639+0000 7fab3dc6f640 10 monclient: init 2026-02-12T03:58:45.671 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.640+0000 7fab3dc6f640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:45.671 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.640+0000 7fab3dc6f640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T03:58:45.671 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.640+0000 7fab3dc6f640 10 monclient(hunting): picked mon.noname-b con 0x7fab380b57a0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:45.671 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.640+0000 7fab3dc6f640 10 monclient(hunting): picked mon.noname-c con 0x7fab380b5b70 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:45.671 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.640+0000 7fab3dc6f640 10 monclient(hunting): picked mon.noname-a con 0x7fab380b7180 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:45.672 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.639+0000 7ff232039640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7ff22c159b70 0x7ff22c166860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:59166/0 (socket says 10.20.193.91:59166) 2026-02-12T03:58:45.672 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.640+0000 7ff232039640 1 -- 10.20.193.91:0/510531861 learned_addr learned my addr 10.20.193.91:0/510531861 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:45.672 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.640+0000 7f47e7fff640 1 -- 10.20.193.91:0/3702304355 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3375921522 0 0) 0x7f47f80b63c0 con 0x7f47f80b57a0 2026-02-12T03:58:45.672 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.640+0000 7f47e7fff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.672 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.640+0000 7f47e7fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.672 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.640+0000 7f47e7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.672 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.640+0000 7f47e7fff640 10 monclient(hunting): my global_id is 4399 2026-02-12T03:58:45.672 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.640+0000 7f47e7fff640 1 -- 10.20.193.91:0/3702304355 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47e0003610 con 0x7f47f80b57a0 2026-02-12T03:58:45.673 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.639+0000 7f725b251640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T03:58:45.673 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.639+0000 7f725b251640 10 monclient(hunting): picked mon.noname-a con 0x7f72540b57a0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:45.673 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.639+0000 7f725b251640 10 monclient(hunting): picked mon.noname-b con 0x7f72540b7180 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:45.673 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.639+0000 7f725b251640 10 monclient(hunting): picked mon.noname-c con 0x7f72540b5b70 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:45.673 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.639+0000 7f725b251640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7254163f30 con 0x7f72540b57a0 2026-02-12T03:58:45.673 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.639+0000 7f725b251640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72540b63c0 con 0x7f72540b7180 2026-02-12T03:58:45.673 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.639+0000 7f725b251640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72540b66a0 con 0x7f72540b5b70 2026-02-12T03:58:45.673 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.639+0000 7f725b251640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:45.673 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.639+0000 7f725b251640 10 monclient(hunting): authenticate will time out at 1128.382934s 2026-02-12T03:58:45.673 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.639+0000 7f79423be640 1 -- start start 2026-02-12T03:58:45.673 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.639+0000 7f79423be640 10 monclient: init 2026-02-12T03:58:45.674 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.640+0000 7f79423be640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:45.674 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.640+0000 7f79423be640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T03:58:45.674 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.640+0000 7f79423be640 10 monclient(hunting): picked mon.noname-b con 0x7f793c15d2f0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:45.674 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.640+0000 7f79423be640 10 monclient(hunting): picked mon.noname-a con 0x7f793c0b8080 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:45.674 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.640+0000 7f79423be640 10 monclient(hunting): picked mon.noname-c con 0x7f793c15d6c0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:45.674 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.640+0000 7f79423be640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f793c0577f0 con 0x7f793c0b8080 2026-02-12T03:58:45.674 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.640+0000 7f79423be640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f793c0b57b0 con 0x7f793c15d2f0 2026-02-12T03:58:45.674 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.640+0000 7f79423be640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f793c0b5a90 con 0x7f793c15d6c0 2026-02-12T03:58:45.674 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.640+0000 7f79423be640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:45.674 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.640+0000 7f79423be640 10 monclient(hunting): authenticate will time out at 1128.383513s 2026-02-12T03:58:45.675 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.640+0000 7fab3dc6f640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab38134080 con 0x7fab380b7180 2026-02-12T03:58:45.675 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.640+0000 7fab3dc6f640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab381543a0 con 0x7fab380b57a0 2026-02-12T03:58:45.675 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.640+0000 7fab3dc6f640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab38154680 con 0x7fab380b5b70 2026-02-12T03:58:45.675 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.640+0000 7fab3dc6f640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:45.675 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.640+0000 7fab3dc6f640 10 monclient(hunting): authenticate will time out at 1128.383731s 2026-02-12T03:58:45.676 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.641+0000 7f7dbbfff640 1 -- 10.20.193.91:0/40174497 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2756041203 0 0) 0x7f7db4003610 con 0x7f7dcc0b7180 2026-02-12T03:58:45.676 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.641+0000 7f7dbbfff640 1 -- 10.20.193.91:0/40174497 >> v1:10.20.193.98:6789/0 conn(0x7f7dcc0b57a0 legacy=0x7f7dcc0b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.676 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.641+0000 7f7dbbfff640 1 -- 10.20.193.91:0/40174497 >> v1:10.20.193.91:6789/0 conn(0x7f7dcc0b5b70 legacy=0x7f7dcc1633b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.676 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.641+0000 7f7dbbfff640 10 monclient: _finish_hunting 0 2026-02-12T03:58:45.676 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.641+0000 7f7dbbfff640 1 monclient: found mon.noname-c 2026-02-12T03:58:45.676 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.641+0000 7f7dbbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:45.676 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.641+0000 7f7dbbfff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.111:6789/0 2026-02-12T03:58:45.677 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.641+0000 7f7dbbfff640 1 -- 10.20.193.91:0/40174497 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dcc0b6980 con 0x7f7dcc0b7180 2026-02-12T03:58:45.677 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.641+0000 7f7dbbfff640 10 monclient: _finish_auth 0 2026-02-12T03:58:45.677 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.641+0000 7f7dbbfff640 10 monclient: _check_auth_tickets 2026-02-12T03:58:45.677 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.641+0000 7f7dbbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:45.677 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.641+0000 7f7dbbfff640 1 -- 10.20.193.91:0/40174497 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f7dc0002df0 con 0x7f7dcc0b7180 2026-02-12T03:58:45.677 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.641+0000 7f7dbbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.677 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.641+0000 7f7dbbfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:45.677 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.641+0000 7f7dbbfff640 10 monclient: dump: 2026-02-12T03:58:45.677 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.678 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.678 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.678 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.678 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.678 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.678 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.678 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.678 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.678 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.641+0000 7f7dd3802640 5 monclient: authenticate success, global_id 4358 2026-02-12T03:58:45.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.641+0000 7f7dd3802640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:45.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.642+0000 7f3e6cda9640 10 monclient: get_monmap_and_config 2026-02-12T03:58:45.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.642+0000 7f3e6cda9640 10 monclient: build_initial_monmap 2026-02-12T03:58:45.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.642+0000 7f3e6cda9640 10 monclient: monmap: 2026-02-12T03:58:45.679 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:45.680 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.680 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:45.643101+0000 2026-02-12T03:58:45.680 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:45.643101+0000 2026-02-12T03:58:45.680 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:45.680 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.680 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:45.680 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:45.680 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:45.680 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.681 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.642+0000 7f72597c7640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f72540b5b70 0x7f72541633b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:37646/0 (socket says 10.20.193.91:37646) 2026-02-12T03:58:45.681 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.642+0000 7f72597c7640 1 -- 10.20.193.91:0/3248146501 learned_addr learned my addr 10.20.193.91:0/3248146501 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:45.681 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.643+0000 7f3e6cda9640 1 Processor -- start 2026-02-12T03:58:45.682 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.643+0000 7f3e6cda9640 1 -- start start 2026-02-12T03:58:45.682 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.643+0000 7f3e6cda9640 10 monclient: init 2026-02-12T03:58:45.682 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.643+0000 7f50afed4640 10 monclient: get_monmap_and_config 2026-02-12T03:58:45.682 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.643+0000 7f50afed4640 10 monclient: build_initial_monmap 2026-02-12T03:58:45.682 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.643+0000 7f50afed4640 10 monclient: monmap: 2026-02-12T03:58:45.682 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:45.682 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.683 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:45.643623+0000 2026-02-12T03:58:45.683 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:45.643623+0000 2026-02-12T03:58:45.683 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:45.683 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.683 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:45.683 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:45.683 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:45.683 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.684 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.643+0000 7fd0d1573640 1 -- 10.20.193.91:0/1944730696 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 659052032 0 0) 0x7fd0d40b57b0 con 0x7fd0d415d6c0 2026-02-12T03:58:45.684 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.643+0000 7fd0d1573640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.684 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.643+0000 7fd0d1573640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.684 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.643+0000 7fd0d1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.684 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.643+0000 7fd0d1573640 10 monclient(hunting): my global_id is 4402 2026-02-12T03:58:45.684 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.643+0000 7fd0d1573640 1 -- 10.20.193.91:0/1944730696 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0c0003610 con 0x7fd0d415d6c0 2026-02-12T03:58:45.685 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.643+0000 7f50afed4640 1 Processor -- start 2026-02-12T03:58:45.685 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.643+0000 7fab377fe640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7fab380b57a0 0x7fab38133970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:48368/0 (socket says 10.20.193.91:48368) 2026-02-12T03:58:45.685 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.643+0000 7fab377fe640 1 -- 10.20.193.91:0/1484103208 learned_addr learned my addr 10.20.193.91:0/1484103208 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:45.685 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.643+0000 7f3e6cda9640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:45.685 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.643+0000 7f3e6cda9640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T03:58:45.686 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.643+0000 7f50afed4640 1 -- start start 2026-02-12T03:58:45.686 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.643+0000 7f50afed4640 10 monclient: init 2026-02-12T03:58:45.686 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.643+0000 7f3e6cda9640 10 monclient(hunting): picked mon.noname-a con 0x7f3e680afe70 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:45.687 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.643+0000 7f3e6cda9640 10 monclient(hunting): picked mon.noname-b con 0x7f3e6815f310 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:45.687 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.643+0000 7f3e6cda9640 10 monclient(hunting): picked mon.noname-c con 0x7f3e681639c0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:45.687 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.643+0000 7f3e6cda9640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e68162bb0 con 0x7f3e680afe70 2026-02-12T03:58:45.687 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.643+0000 7f3e6cda9640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e68162e90 con 0x7f3e6815f310 2026-02-12T03:58:45.687 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.643+0000 7f3e6cda9640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e6815de40 con 0x7f3e681639c0 2026-02-12T03:58:45.687 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.643+0000 7f3e6cda9640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:45.687 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.643+0000 7f3e6cda9640 10 monclient(hunting): authenticate will time out at 1128.386645s 2026-02-12T03:58:45.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.643+0000 7f47e7fff640 1 -- 10.20.193.91:0/3702304355 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2732420053 0 0) 0x7f47f80b66a0 con 0x7f47f80b7180 2026-02-12T03:58:45.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.643+0000 7f47e7fff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.643+0000 7f47e7fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.643+0000 7f47e7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.643+0000 7f47e7fff640 10 monclient(hunting): my global_id is 4361 2026-02-12T03:58:45.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.643+0000 7f47e7fff640 1 -- 10.20.193.91:0/3702304355 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47f80b63c0 con 0x7f47f80b7180 2026-02-12T03:58:45.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.644+0000 7fbda1a50640 10 monclient: get_monmap_and_config 2026-02-12T03:58:45.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.644+0000 7fbda1a50640 10 monclient: build_initial_monmap 2026-02-12T03:58:45.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.644+0000 7fbda1a50640 10 monclient: monmap: 2026-02-12T03:58:45.689 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:45.689 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.689 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:45.644639+0000 2026-02-12T03:58:45.689 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:45.644639+0000 2026-02-12T03:58:45.689 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:45.689 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.689 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:45.689 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:45.689 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:45.689 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.690 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.644+0000 7fd0d1573640 1 -- 10.20.193.91:0/1944730696 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2997315667 0 0) 0x7fd0d40b5a90 con 0x7fd0d40b8080 2026-02-12T03:58:45.690 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.644+0000 7fd0d1573640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.690 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.644+0000 7fd0d1573640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.690 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.644+0000 7fd0d1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.690 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.644+0000 7fd0d1573640 10 monclient(hunting): my global_id is 4364 2026-02-12T03:58:45.690 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.644+0000 7fd0d1573640 1 -- 10.20.193.91:0/1944730696 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0d40b57b0 con 0x7fd0d40b8080 2026-02-12T03:58:45.691 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.644+0000 7f50afed4640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:45.691 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.644+0000 7f50afed4640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T03:58:45.691 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.644+0000 7f50afed4640 10 monclient(hunting): picked mon.noname-c con 0x7f50a80b57a0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:45.691 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.644+0000 7f50afed4640 10 monclient(hunting): picked mon.noname-a con 0x7f50a80b7180 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:45.691 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.644+0000 7f50afed4640 10 monclient(hunting): picked mon.noname-b con 0x7f50a80b5b70 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:45.691 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.644+0000 7f50afed4640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50a8163f30 con 0x7f50a80b7180 2026-02-12T03:58:45.692 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.644+0000 7f50afed4640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50a80b63c0 con 0x7f50a80b5b70 2026-02-12T03:58:45.692 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.644+0000 7f50afed4640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50a80b66a0 con 0x7f50a80b57a0 2026-02-12T03:58:45.692 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.644+0000 7f50afed4640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:45.692 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.644+0000 7f50afed4640 10 monclient(hunting): authenticate will time out at 1128.387408s 2026-02-12T03:58:45.692 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.644+0000 7fbda1a50640 1 Processor -- start 2026-02-12T03:58:45.692 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.644+0000 7f1b69b1c640 10 monclient: get_monmap_and_config 2026-02-12T03:58:45.693 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.644+0000 7f1b69b1c640 10 monclient: build_initial_monmap 2026-02-12T03:58:45.693 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.644+0000 7f1b69b1c640 10 monclient: monmap: 2026-02-12T03:58:45.693 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:45.693 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.693 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:45.645195+0000 2026-02-12T03:58:45.693 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:45.645195+0000 2026-02-12T03:58:45.693 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:45.693 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.693 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:45.693 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:45.693 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:45.693 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.694 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.644+0000 7fbda1a50640 1 -- start start 2026-02-12T03:58:45.694 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.644+0000 7fbda1a50640 10 monclient: init 2026-02-12T03:58:45.694 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.644+0000 7fab13fff640 10 client.?.objecter ms_handle_connect 0x7fab380b57a0 2026-02-12T03:58:45.694 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.644+0000 7fab13fff640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.694 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.645+0000 7f1b69b1c640 1 Processor -- start 2026-02-12T03:58:45.695 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.645+0000 7fbda1a50640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:45.695 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.645+0000 7fbda1a50640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T03:58:45.695 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.645+0000 7f47e7fff640 1 -- 10.20.193.91:0/3702304355 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2350060968 0 0) 0x7f47f8163f30 con 0x7f47f80b5b70 2026-02-12T03:58:45.695 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.645+0000 7f47e7fff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.696 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.645+0000 7fbda1a50640 10 monclient(hunting): picked mon.noname-b con 0x7fbd9c0b57a0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:45.696 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.645+0000 7f47e7fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.696 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.645+0000 7fbda1a50640 10 monclient(hunting): picked mon.noname-a con 0x7fbd9c0b7180 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:45.696 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.645+0000 7f47e7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.696 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.645+0000 7f47e7fff640 10 monclient(hunting): my global_id is 4407 2026-02-12T03:58:45.697 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.645+0000 7fbda1a50640 10 monclient(hunting): picked mon.noname-c con 0x7fbd9c0b5b70 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:45.697 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.645+0000 7f47e7fff640 1 -- 10.20.193.91:0/3702304355 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47f80b66a0 con 0x7f47f80b5b70 2026-02-12T03:58:45.697 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.645+0000 7fbda1a50640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd9c163f30 con 0x7fbd9c0b7180 2026-02-12T03:58:45.697 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.645+0000 7f1b69b1c640 1 -- start start 2026-02-12T03:58:45.698 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.645+0000 7f1b69b1c640 10 monclient: init 2026-02-12T03:58:45.698 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.645+0000 7f1b69b1c640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:45.698 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.645+0000 7f1b69b1c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T03:58:45.698 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.645+0000 7f1b69b1c640 10 monclient(hunting): picked mon.noname-a con 0x7f1b64161c10 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:45.698 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.645+0000 7f1b69b1c640 10 monclient(hunting): picked mon.noname-b con 0x7f1b640b5e90 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:45.698 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.645+0000 7f1b69b1c640 10 monclient(hunting): picked mon.noname-c con 0x7f1b6405a7c0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:45.698 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.645+0000 7f1b69b1c640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b64052720 con 0x7f1b64161c10 2026-02-12T03:58:45.698 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.645+0000 7f1b69b1c640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b64058b70 con 0x7f1b640b5e90 2026-02-12T03:58:45.698 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.645+0000 7f1b69b1c640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b640577f0 con 0x7f1b6405a7c0 2026-02-12T03:58:45.698 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.645+0000 7f1b69b1c640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:45.698 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.645+0000 7f1b69b1c640 10 monclient(hunting): authenticate will time out at 1128.388982s 2026-02-12T03:58:45.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.646+0000 7fbda1a50640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd9c0b63c0 con 0x7fbd9c0b57a0 2026-02-12T03:58:45.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.646+0000 7fbda1a50640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd9c0b66a0 con 0x7fbd9c0b5b70 2026-02-12T03:58:45.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.646+0000 7fbda1a50640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:45.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.646+0000 7fbda1a50640 10 monclient(hunting): authenticate will time out at 1128.389088s 2026-02-12T03:58:45.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.646+0000 7fab13fff640 10 client.?.objecter ms_handle_connect 0x7fab380b5b70 2026-02-12T03:58:45.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.646+0000 7fab13fff640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.646+0000 7fab13fff640 10 client.?.objecter ms_handle_connect 0x7fab380b7180 2026-02-12T03:58:45.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.646+0000 7fab13fff640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.646+0000 7f7940934640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f793c15d6c0 0x7f793c0570e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:37674/0 (socket says 10.20.193.91:37674) 2026-02-12T03:58:45.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.646+0000 7f7940934640 1 -- 10.20.193.91:0/3548655832 learned_addr learned my addr 10.20.193.91:0/3548655832 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:45.700 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.646+0000 7f07e9528640 10 monclient: get_monmap_and_config 2026-02-12T03:58:45.700 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.646+0000 7f07e9528640 10 monclient: build_initial_monmap 2026-02-12T03:58:45.700 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.646+0000 7f07e9528640 10 monclient: monmap: 2026-02-12T03:58:45.700 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:45.700 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.700 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:45.646979+0000 2026-02-12T03:58:45.700 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:45.646979+0000 2026-02-12T03:58:45.700 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:45.700 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.700 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:45.700 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:45.701 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:45.701 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.701 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.646+0000 7f7dbbfff640 1 -- 10.20.193.91:0/40174497 <== mon.2 v1:10.20.193.111:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7dc0003000 con 0x7f7dcc0b7180 2026-02-12T03:58:45.701 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.646+0000 7f7dbbfff640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:45.701 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.646+0000 7f7dbbfff640 1 -- 10.20.193.91:0/40174497 <== mon.2 v1:10.20.193.111:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f7dc0003440 con 0x7f7dcc0b7180 2026-02-12T03:58:45.701 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.646+0000 7f7dbbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.701 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.646+0000 7f7dbbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:45.701 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.646+0000 7f7dbbfff640 10 monclient: dump: 2026-02-12T03:58:45.701 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.701 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.701 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.701 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.701 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.702 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.702 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.702 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.702 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.702 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.702 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.646+0000 7f7dd3802640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:45.702 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.646+0000 7f7dd3802640 4 set_mon_vals no callback set 2026-02-12T03:58:45.702 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.646+0000 7f07e9528640 1 Processor -- start 2026-02-12T03:58:45.702 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.646+0000 7f07e9528640 1 -- start start 2026-02-12T03:58:45.702 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.646+0000 7f07e9528640 10 monclient: init 2026-02-12T03:58:45.703 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.647+0000 7f7dd3802640 10 monclient: shutdown 2026-02-12T03:58:45.703 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.647+0000 7f7dd3802640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:45.703 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.647+0000 7f7dd3802640 1 -- 10.20.193.91:0/40174497 >> v1:10.20.193.111:6789/0 conn(0x7f7dcc0b7180 legacy=0x7f7dcc0565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.703 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.647+0000 7f7dd3802640 1 -- 10.20.193.91:0/40174497 shutdown_connections 2026-02-12T03:58:45.703 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.647+0000 7f7dd3802640 1 -- 10.20.193.91:0/40174497 >> 10.20.193.91:0/40174497 conn(0x7f7dcc0559c0 msgr2=0x7f7dcc055dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:45.703 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.647+0000 7f7dd3802640 1 -- 10.20.193.91:0/40174497 shutdown_connections 2026-02-12T03:58:45.703 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.647+0000 7f7dd3802640 1 -- 10.20.193.91:0/40174497 wait complete. 2026-02-12T03:58:45.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.647+0000 7f724b7fe640 1 -- 10.20.193.91:0/3248146501 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1076464718 0 0) 0x7f72540b66a0 con 0x7f72540b5b70 2026-02-12T03:58:45.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.647+0000 7f724b7fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.647+0000 7f724b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.647+0000 7f724b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.647+0000 7f724b7fe640 10 monclient(hunting): my global_id is 4370 2026-02-12T03:58:45.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.647+0000 7f724b7fe640 1 -- 10.20.193.91:0/3248146501 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7240003610 con 0x7f72540b5b70 2026-02-12T03:58:45.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.647+0000 7f07e9528640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:45.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.647+0000 7fb2c2d13640 10 monclient: get_monmap_and_config 2026-02-12T03:58:45.705 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.647+0000 7fb2c2d13640 10 monclient: build_initial_monmap 2026-02-12T03:58:45.705 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.647+0000 7fb2c2d13640 10 monclient: monmap: 2026-02-12T03:58:45.705 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:45.705 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.705 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:45.648374+0000 2026-02-12T03:58:45.705 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:45.648374+0000 2026-02-12T03:58:45.705 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:45.705 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.705 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:45.705 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:45.705 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:45.705 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.706 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.647+0000 7f07e9528640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T03:58:45.706 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.647+0000 7f07e9528640 10 monclient(hunting): picked mon.noname-a con 0x7f07e40b57a0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:45.706 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.647+0000 7f07e9528640 10 monclient(hunting): picked mon.noname-b con 0x7f07e40b7180 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:45.706 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.647+0000 7f07e9528640 10 monclient(hunting): picked mon.noname-c con 0x7f07e40b5b70 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:45.706 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.647+0000 7f07e9528640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07e4163f30 con 0x7f07e40b57a0 2026-02-12T03:58:45.706 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.647+0000 7f07e9528640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07e40b63c0 con 0x7f07e40b7180 2026-02-12T03:58:45.706 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.647+0000 7f3e66575640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f3e680afe70 0x7f3e6815ec00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:59200/0 (socket says 10.20.193.91:59200) 2026-02-12T03:58:45.706 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.647+0000 7f3e66575640 1 -- 10.20.193.91:0/3388427599 learned_addr learned my addr 10.20.193.91:0/3388427599 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:45.706 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.647+0000 7f07e9528640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07e40b66a0 con 0x7f07e40b5b70 2026-02-12T03:58:45.707 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7f07e9528640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:45.707 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7f07e9528640 10 monclient(hunting): authenticate will time out at 1128.391019s 2026-02-12T03:58:45.707 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7f7dd3802640 10 monclient: build_initial_monmap 2026-02-12T03:58:45.707 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7f7dd3802640 10 monclient: monmap: 2026-02-12T03:58:45.707 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:45.707 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:45.707 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:45.707 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:45.707 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:45.707 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:45.707 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:45.707 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:45.707 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:45.708 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.708 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7fb2c2d13640 1 Processor -- start 2026-02-12T03:58:45.708 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7f7dd3802640 1 librados: starting msgr at 2026-02-12T03:58:45.708 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7f7dd3802640 1 librados: starting objecter 2026-02-12T03:58:45.708 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7fb2c2d13640 1 -- start start 2026-02-12T03:58:45.708 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7fb2c2d13640 10 monclient: init 2026-02-12T03:58:45.708 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7f7dd3802640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:45.708 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7f7dd3802640 1 Processor -- start 2026-02-12T03:58:45.709 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7ff231037640 1 -- 10.20.193.91:0/510531861 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2511456094 0 0) 0x7ff22c0b8fa0 con 0x7ff22c164760 2026-02-12T03:58:45.709 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7ff231037640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.709 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7ff231037640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.709 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7ff231037640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.709 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7ff231037640 10 monclient(hunting): my global_id is 4367 2026-02-12T03:58:45.709 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7ff231037640 1 -- 10.20.193.91:0/510531861 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff214003610 con 0x7ff22c164760 2026-02-12T03:58:45.709 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7f7dd3802640 1 -- start start 2026-02-12T03:58:45.709 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7f7dd3802640 1 librados: setting wanted keys 2026-02-12T03:58:45.709 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7f7dd3802640 1 librados: calling monclient init 2026-02-12T03:58:45.710 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7f7dd3802640 10 monclient: init 2026-02-12T03:58:45.710 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7f7dd3802640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:45.710 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7f7dd3802640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T03:58:45.710 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7f7dd3802640 10 monclient(hunting): picked mon.noname-b con 0x7f7dcc0b57a0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:45.710 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7f7dd3802640 10 monclient(hunting): picked mon.noname-a con 0x7f7dcc0b5b70 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:45.710 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7f7dd3802640 10 monclient(hunting): picked mon.noname-c con 0x7f7dcc0b7180 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:45.710 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7f7dd3802640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dcc1377b0 con 0x7f7dcc0b5b70 2026-02-12T03:58:45.710 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7f7dd3802640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dcc137a90 con 0x7f7dcc0b57a0 2026-02-12T03:58:45.710 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7f7dd3802640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dcc137d70 con 0x7f7dcc0b7180 2026-02-12T03:58:45.710 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7f7dd3802640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:45.710 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7f7dd3802640 10 monclient(hunting): authenticate will time out at 1128.391824s 2026-02-12T03:58:45.711 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7fb2c2d13640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:45.711 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7fb2c2d13640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T03:58:45.711 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7fb2c2d13640 10 monclient(hunting): picked mon.noname-c con 0x7fb2bc0b57a0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:45.711 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7fb2c2d13640 10 monclient(hunting): picked mon.noname-b con 0x7fb2bc0b7180 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:45.711 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7fb2c2d13640 10 monclient(hunting): picked mon.noname-a con 0x7fb2bc0b5b70 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:45.711 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7fb2c2d13640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2bc163f30 con 0x7fb2bc0b5b70 2026-02-12T03:58:45.711 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7fb2c2d13640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2bc0b63c0 con 0x7fb2bc0b7180 2026-02-12T03:58:45.711 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.648+0000 7fb2c2d13640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2bc0b66a0 con 0x7fb2bc0b57a0 2026-02-12T03:58:45.711 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7fb2c2d13640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:45.711 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7fb2c2d13640 10 monclient(hunting): authenticate will time out at 1128.392026s 2026-02-12T03:58:45.712 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7f47e7fff640 1 -- 10.20.193.91:0/3702304355 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2165183380 0 0) 0x7f47e0003610 con 0x7f47f80b57a0 2026-02-12T03:58:45.712 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7f47e7fff640 1 -- 10.20.193.91:0/3702304355 >> v1:10.20.193.111:6789/0 conn(0x7f47f80b7180 legacy=0x7f47f80565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.712 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7f47e7fff640 1 -- 10.20.193.91:0/3702304355 >> v1:10.20.193.91:6789/0 conn(0x7f47f80b5b70 legacy=0x7f47f81633b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.712 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7f47e7fff640 10 monclient: _finish_hunting 0 2026-02-12T03:58:45.712 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7f47e7fff640 1 monclient: found mon.noname-b 2026-02-12T03:58:45.712 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7f47e7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:45.712 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7f47e7fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T03:58:45.712 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7f47e7fff640 1 -- 10.20.193.91:0/3702304355 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f80b6980 con 0x7f47f80b57a0 2026-02-12T03:58:45.712 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7f47e7fff640 10 monclient: _finish_auth 0 2026-02-12T03:58:45.712 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7f47e7fff640 10 monclient: _check_auth_tickets 2026-02-12T03:58:45.712 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7f47e7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:45.712 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7f47e7fff640 1 -- 10.20.193.91:0/3702304355 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f47e8002d20 con 0x7f47f80b57a0 2026-02-12T03:58:45.712 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7f47e7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.713 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7f47e7fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:45.713 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7f47e7fff640 10 monclient: dump: 2026-02-12T03:58:45.713 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.713 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.713 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.713 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.713 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.713 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.713 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.713 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.713 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.713 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.714 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7fab13fff640 1 -- 10.20.193.91:0/1484103208 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3703278770 0 0) 0x7fab381543a0 con 0x7fab380b57a0 2026-02-12T03:58:45.714 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7fab13fff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.714 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7fab13fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.714 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7fab13fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.714 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7fab13fff640 10 monclient(hunting): my global_id is 4408 2026-02-12T03:58:45.714 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7fab13fff640 1 -- 10.20.193.91:0/1484103208 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab08003610 con 0x7fab380b57a0 2026-02-12T03:58:45.714 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7f71f8bcc640 10 monclient: get_monmap_and_config 2026-02-12T03:58:45.714 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7f71f8bcc640 10 monclient: build_initial_monmap 2026-02-12T03:58:45.714 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7f71f8bcc640 10 monclient: monmap: 2026-02-12T03:58:45.714 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:45.714 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.715 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:45.650192+0000 2026-02-12T03:58:45.715 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:45.650192+0000 2026-02-12T03:58:45.715 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:45.715 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.715 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:45.715 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:45.715 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:45.715 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.715 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7f47ff5cc640 5 monclient: authenticate success, global_id 4399 2026-02-12T03:58:45.715 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7f47ff5cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:45.715 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7fd0d1573640 1 -- 10.20.193.91:0/1944730696 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 182206485 0 0) 0x7fd0c0003610 con 0x7fd0d415d6c0 2026-02-12T03:58:45.716 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7fd0d1573640 1 -- 10.20.193.91:0/1944730696 >> v1:10.20.193.111:6789/0 conn(0x7fd0d40b8080 legacy=0x7fd0d40569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.716 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7fd0d1573640 1 -- 10.20.193.91:0/1944730696 >> v1:10.20.193.91:6789/0 conn(0x7fd0d415d2f0 legacy=0x7fd0d40b89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.716 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7fd0d1573640 10 monclient: _finish_hunting 0 2026-02-12T03:58:45.716 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7fd0d1573640 1 monclient: found mon.noname-b 2026-02-12T03:58:45.716 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7fd0d1573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:45.716 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7fd0d1573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T03:58:45.716 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7fd0d1573640 1 -- 10.20.193.91:0/1944730696 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0d40b5d70 con 0x7fd0d415d6c0 2026-02-12T03:58:45.716 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7fd0d1573640 10 monclient: _finish_auth 0 2026-02-12T03:58:45.716 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7fd0d1573640 10 monclient: _check_auth_tickets 2026-02-12T03:58:45.716 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7fd0d1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:45.716 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7fd0d1573640 1 -- 10.20.193.91:0/1944730696 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd0c4003170 con 0x7fd0d415d6c0 2026-02-12T03:58:45.716 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.649+0000 7fd0d1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.716 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.650+0000 7fd0d1573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:45.716 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.650+0000 7fd0d1573640 10 monclient: dump: 2026-02-12T03:58:45.716 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.716 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.716 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.716 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.717 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.717 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.717 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.717 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.717 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.717 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.717 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.650+0000 7fd0d8a96640 5 monclient: authenticate success, global_id 4402 2026-02-12T03:58:45.717 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.650+0000 7fd0d8a96640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:45.717 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.650+0000 7f71f8bcc640 1 Processor -- start 2026-02-12T03:58:45.717 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.650+0000 7f71f8bcc640 1 -- start start 2026-02-12T03:58:45.717 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.650+0000 7f71f8bcc640 10 monclient: init 2026-02-12T03:58:45.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.650+0000 7f793affd640 1 -- 10.20.193.91:0/3548655832 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 758886789 0 0) 0x7f793c0b5a90 con 0x7f793c15d6c0 2026-02-12T03:58:45.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.650+0000 7f793affd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.650+0000 7f793affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.650+0000 7f793affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.650+0000 7f793affd640 10 monclient(hunting): my global_id is 4376 2026-02-12T03:58:45.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.650+0000 7f793affd640 1 -- 10.20.193.91:0/3548655832 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7920003610 con 0x7f793c15d6c0 2026-02-12T03:58:45.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.650+0000 7f50ad448640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f50a80b7180 0x7f50a80565b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:59208/0 (socket says 10.20.193.91:59208) 2026-02-12T03:58:45.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.650+0000 7f50ad448640 1 -- 10.20.193.91:0/3201408856 learned_addr learned my addr 10.20.193.91:0/3201408856 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:45.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.650+0000 7f71f8bcc640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:45.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.650+0000 7f71f8bcc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T03:58:45.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.650+0000 7fbd9b7fe640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7fbd9c0b5b70 0x7fbd9c1633b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:37696/0 (socket says 10.20.193.91:37696) 2026-02-12T03:58:45.719 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.650+0000 7fbd9b7fe640 1 -- 10.20.193.91:0/1877426241 learned_addr learned my addr 10.20.193.91:0/1877426241 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:45.719 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.650+0000 7f71f8bcc640 10 monclient(hunting): picked mon.noname-b con 0x7f71f4159b70 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:45.719 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.650+0000 7f71f8bcc640 10 monclient(hunting): picked mon.noname-a con 0x7f71f4166f70 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:45.719 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.650+0000 7ff73134a640 10 monclient: get_monmap_and_config 2026-02-12T03:58:45.719 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.650+0000 7ff73134a640 10 monclient: build_initial_monmap 2026-02-12T03:58:45.719 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.650+0000 7ff73134a640 10 monclient: monmap: 2026-02-12T03:58:45.719 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:45.719 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.719 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:45.651356+0000 2026-02-12T03:58:45.719 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:45.651356+0000 2026-02-12T03:58:45.719 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:45.719 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.719 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:45.719 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:45.720 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:45.720 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.720 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.650+0000 7f71f8bcc640 10 monclient(hunting): picked mon.noname-c con 0x7f71f4164760 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:45.720 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.650+0000 7f71f8bcc640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71f40b8a20 con 0x7f71f4166f70 2026-02-12T03:58:45.720 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.650+0000 7f71f8bcc640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71f40b8cc0 con 0x7f71f4159b70 2026-02-12T03:58:45.720 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.650+0000 7f71f8bcc640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71f40b8fa0 con 0x7f71f4164760 2026-02-12T03:58:45.720 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.650+0000 7f71f8bcc640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:45.720 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.650+0000 7f71f8bcc640 10 monclient(hunting): authenticate will time out at 1128.393967s 2026-02-12T03:58:45.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.651+0000 7ff73134a640 1 Processor -- start 2026-02-12T03:58:45.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.651+0000 7ff73134a640 1 -- start start 2026-02-12T03:58:45.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.651+0000 7ff73134a640 10 monclient: init 2026-02-12T03:58:45.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.651+0000 7ff73134a640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:45.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.651+0000 7ff73134a640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T03:58:45.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.651+0000 7ff73134a640 10 monclient(hunting): picked mon.noname-c con 0x7ff72c0aba80 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:45.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.651+0000 7ff73134a640 10 monclient(hunting): picked mon.noname-b con 0x7ff72c0abe50 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:45.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.652+0000 7ff73134a640 10 monclient(hunting): picked mon.noname-a con 0x7ff72c0b3f60 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:45.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.652+0000 7ff73134a640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff72c1618b0 con 0x7ff72c0b3f60 2026-02-12T03:58:45.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.652+0000 7ff73134a640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff72c0b31a0 con 0x7ff72c0abe50 2026-02-12T03:58:45.721 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.652+0000 7ff73134a640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff72c0b3480 con 0x7ff72c0aba80 2026-02-12T03:58:45.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.652+0000 7ff73134a640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:45.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.652+0000 7ff73134a640 10 monclient(hunting): authenticate will time out at 1128.395167s 2026-02-12T03:58:45.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.652+0000 7ff231037640 1 -- 10.20.193.91:0/510531861 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2920312322 0 0) 0x7ff22c0b8cc0 con 0x7ff22c166f70 2026-02-12T03:58:45.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.652+0000 7ff231037640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.652+0000 7ff231037640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.652+0000 7ff231037640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.652+0000 7ff231037640 10 monclient(hunting): my global_id is 4405 2026-02-12T03:58:45.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.652+0000 7ff231037640 1 -- 10.20.193.91:0/510531861 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff22c0b8fa0 con 0x7ff22c166f70 2026-02-12T03:58:45.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.654+0000 7f1b63fff640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f1b6405a7c0 0x7f1b6416b5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:37700/0 (socket says 10.20.193.91:37700) 2026-02-12T03:58:45.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.654+0000 7f1b63fff640 1 -- 10.20.193.91:0/2629347674 learned_addr learned my addr 10.20.193.91:0/2629347674 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:45.723 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.654+0000 7fab13fff640 1 -- 10.20.193.91:0/1484103208 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4092292412 0 0) 0x7fab38154680 con 0x7fab380b5b70 2026-02-12T03:58:45.723 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.654+0000 7fab13fff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.723 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.654+0000 7fab13fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.723 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.654+0000 7fab13fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.723 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.654+0000 7fab13fff640 10 monclient(hunting): my global_id is 4373 2026-02-12T03:58:45.723 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.654+0000 7fab13fff640 1 -- 10.20.193.91:0/1484103208 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab381543a0 con 0x7fab380b5b70 2026-02-12T03:58:45.723 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.654+0000 7fab13fff640 1 -- 10.20.193.91:0/1484103208 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1550152857 0 0) 0x7fab38134080 con 0x7fab380b7180 2026-02-12T03:58:45.723 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.654+0000 7fab13fff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.723 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.654+0000 7fab13fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.723 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.654+0000 7fab13fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.723 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.654+0000 7fab13fff640 10 monclient(hunting): my global_id is 4416 2026-02-12T03:58:45.723 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.654+0000 7fab13fff640 1 -- 10.20.193.91:0/1484103208 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab38154680 con 0x7fab380b7180 2026-02-12T03:58:45.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.654+0000 7ff2425a8640 10 monclient: get_monmap_and_config 2026-02-12T03:58:45.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.654+0000 7ff2425a8640 10 monclient: build_initial_monmap 2026-02-12T03:58:45.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.654+0000 7ff2425a8640 10 monclient: monmap: 2026-02-12T03:58:45.724 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:45.724 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.724 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:45.655509+0000 2026-02-12T03:58:45.724 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:45.655509+0000 2026-02-12T03:58:45.724 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:45.724 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.724 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:45.724 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:45.724 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:45.724 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.725 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.655+0000 7ff231037640 1 -- 10.20.193.91:0/510531861 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1271992733 0 0) 0x7ff214003610 con 0x7ff22c164760 2026-02-12T03:58:45.725 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.655+0000 7ff231037640 1 -- 10.20.193.91:0/510531861 >> v1:10.20.193.98:6789/0 conn(0x7ff22c166f70 legacy=0x7ff22c0563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.725 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.655+0000 7ff231037640 1 -- 10.20.193.91:0/510531861 >> v1:10.20.193.91:6789/0 conn(0x7ff22c159b70 legacy=0x7ff22c166860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.725 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.655+0000 7ff231037640 10 monclient: _finish_hunting 0 2026-02-12T03:58:45.725 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.655+0000 7ff231037640 1 monclient: found mon.noname-c 2026-02-12T03:58:45.725 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.655+0000 7ff231037640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:45.725 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.655+0000 7ff231037640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.111:6789/0 2026-02-12T03:58:45.725 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.655+0000 7ff231037640 1 -- 10.20.193.91:0/510531861 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff22c0b9280 con 0x7ff22c164760 2026-02-12T03:58:45.725 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.655+0000 7ff231037640 10 monclient: _finish_auth 0 2026-02-12T03:58:45.725 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.655+0000 7ff231037640 10 monclient: _check_auth_tickets 2026-02-12T03:58:45.725 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.655+0000 7ff231037640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:45.725 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.655+0000 7ff231037640 1 -- 10.20.193.91:0/510531861 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7ff228003170 con 0x7ff22c164760 2026-02-12T03:58:45.725 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.655+0000 7ff231037640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.725 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.655+0000 7ff231037640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:45.725 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.655+0000 7ff231037640 10 monclient: dump: 2026-02-12T03:58:45.725 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.725 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.725 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.726 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.726 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.726 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.726 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.726 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.726 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.726 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.726 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.655+0000 7ff2342c4640 5 monclient: authenticate success, global_id 4367 2026-02-12T03:58:45.726 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.655+0000 7ff2342c4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:45.726 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.655+0000 7ff2425a8640 1 Processor -- start 2026-02-12T03:58:45.726 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.655+0000 7f50acc47640 1 -- 10.20.193.91:0/3201408856 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2965353959 0 0) 0x7f50a8163f30 con 0x7f50a80b7180 2026-02-12T03:58:45.726 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.655+0000 7f50acc47640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.726 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.655+0000 7f50acc47640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.726 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.655+0000 7f50acc47640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.727 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.655+0000 7f50acc47640 10 monclient(hunting): my global_id is 4425 2026-02-12T03:58:45.727 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.655+0000 7f50acc47640 1 -- 10.20.193.91:0/3201408856 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5090003610 con 0x7f50a80b7180 2026-02-12T03:58:45.727 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.655+0000 7ff2425a8640 1 -- start start 2026-02-12T03:58:45.727 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.655+0000 7ff2425a8640 10 monclient: init 2026-02-12T03:58:45.727 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.655+0000 7f724b7fe640 1 -- 10.20.193.91:0/3248146501 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1491182948 0 0) 0x7f72540b63c0 con 0x7f72540b7180 2026-02-12T03:58:45.727 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.655+0000 7f724b7fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.727 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.655+0000 7f724b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.727 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.655+0000 7f724b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.727 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.655+0000 7f724b7fe640 10 monclient(hunting): my global_id is 4411 2026-02-12T03:58:45.727 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.655+0000 7f724b7fe640 1 -- 10.20.193.91:0/3248146501 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72540b66a0 con 0x7f72540b7180 2026-02-12T03:58:45.728 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.656+0000 7ff2425a8640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:45.728 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.656+0000 7ff2425a8640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T03:58:45.728 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.656+0000 7ff2425a8640 10 monclient(hunting): picked mon.noname-a con 0x7ff23c161ad0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:45.728 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.656+0000 7ff2425a8640 10 monclient(hunting): picked mon.noname-b con 0x7ff23c167e90 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:45.728 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.656+0000 7ff2425a8640 10 monclient(hunting): picked mon.noname-c con 0x7ff23c0564d0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:45.728 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.656+0000 7ff2425a8640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff23c161ea0 con 0x7ff23c161ad0 2026-02-12T03:58:45.728 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.656+0000 7ff2425a8640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff23c0b6290 con 0x7ff23c167e90 2026-02-12T03:58:45.728 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.656+0000 7ff2425a8640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff23c056b30 con 0x7ff23c0564d0 2026-02-12T03:58:45.728 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.656+0000 7ff2425a8640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:45.728 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.656+0000 7ff2425a8640 10 monclient(hunting): authenticate will time out at 1128.399309s 2026-02-12T03:58:45.728 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.656+0000 7f724b7fe640 1 -- 10.20.193.91:0/3248146501 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2414965699 0 0) 0x7f7254163f30 con 0x7f72540b57a0 2026-02-12T03:58:45.729 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.656+0000 7f724b7fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.729 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.656+0000 7f724b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.729 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.656+0000 7f724b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.729 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.656+0000 7f724b7fe640 10 monclient(hunting): my global_id is 4422 2026-02-12T03:58:45.729 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.656+0000 7f724b7fe640 1 -- 10.20.193.91:0/3248146501 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72540b63c0 con 0x7f72540b57a0 2026-02-12T03:58:45.729 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.658+0000 7f793affd640 1 -- 10.20.193.91:0/3548655832 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 696767567 0 0) 0x7f793c0b57b0 con 0x7f793c15d2f0 2026-02-12T03:58:45.729 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.659+0000 7f793affd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.729 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.659+0000 7f793affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.729 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.659+0000 7f793affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.729 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.659+0000 7f793affd640 10 monclient(hunting): my global_id is 4414 2026-02-12T03:58:45.729 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.659+0000 7f793affd640 1 -- 10.20.193.91:0/3548655832 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f793c0b5a90 con 0x7f793c15d2f0 2026-02-12T03:58:45.729 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.659+0000 7fab13fff640 1 -- 10.20.193.91:0/1484103208 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2480409674 0 0) 0x7fab08003610 con 0x7fab380b57a0 2026-02-12T03:58:45.729 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.659+0000 7fab13fff640 1 -- 10.20.193.91:0/1484103208 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fab38134080 con 0x7fab380b57a0 2026-02-12T03:58:45.729 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.659+0000 7fab13fff640 1 -- 10.20.193.91:0/1484103208 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fab24003310 con 0x7fab380b57a0 2026-02-12T03:58:45.729 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.659+0000 7fab13fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:45.730 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.659+0000 7fab13fff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:45.730 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.659+0000 7fab13fff640 10 monclient(hunting): dump: 2026-02-12T03:58:45.730 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.730 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.730 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.730 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.730 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.730 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.730 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.730 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.730 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.730 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.730 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.659+0000 7fab13fff640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:45.730 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.659+0000 7f793affd640 1 -- 10.20.193.91:0/3548655832 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2764142639 0 0) 0x7f793c0577f0 con 0x7f793c0b8080 2026-02-12T03:58:45.730 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.659+0000 7f793affd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.730 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.659+0000 7f793affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.730 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.659+0000 7f793affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.731 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.659+0000 7f793affd640 10 monclient(hunting): my global_id is 4428 2026-02-12T03:58:45.731 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.659+0000 7f793affd640 1 -- 10.20.193.91:0/3548655832 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f793c0b57b0 con 0x7f793c0b8080 2026-02-12T03:58:45.731 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.659+0000 7f07e27fc640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f07e40b7180 0x7f07e40565b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:48412/0 (socket says 10.20.193.91:48412) 2026-02-12T03:58:45.731 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.659+0000 7f07e27fc640 1 -- 10.20.193.91:0/1007060249 learned_addr learned my addr 10.20.193.91:0/1007060249 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:45.731 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.659+0000 7f7dd1577640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f7dcc0b57a0 0x7f7dcc136fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:48424/0 (socket says 10.20.193.91:48424) 2026-02-12T03:58:45.731 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.659+0000 7f7dd1577640 1 -- 10.20.193.91:0/4137855695 learned_addr learned my addr 10.20.193.91:0/4137855695 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:45.731 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.660+0000 7f7db9ffb640 10 client.?.objecter ms_handle_connect 0x7f7dcc0b57a0 2026-02-12T03:58:45.731 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.660+0000 7f7db9ffb640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.731 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.660+0000 7fbd99ffb640 1 -- 10.20.193.91:0/1877426241 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1374214141 0 0) 0x7fbd9c0b66a0 con 0x7fbd9c0b5b70 2026-02-12T03:58:45.732 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.660+0000 7fbd99ffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.732 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.660+0000 7fbd99ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.732 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.660+0000 7fbd99ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.732 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.660+0000 7fbd99ffb640 10 monclient(hunting): my global_id is 4382 2026-02-12T03:58:45.732 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.660+0000 7fbd99ffb640 1 -- 10.20.193.91:0/1877426241 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd88003610 con 0x7fbd9c0b5b70 2026-02-12T03:58:45.732 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.661+0000 7fb2b3fff640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7fb2bc0b7180 0x7fb2bc0565b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:48440/0 (socket says 10.20.193.91:48440) 2026-02-12T03:58:45.732 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.661+0000 7fb2b3fff640 1 -- 10.20.193.91:0/1706977470 learned_addr learned my addr 10.20.193.91:0/1706977470 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:45.732 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.661+0000 7f71f2575640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f71f4159b70 0x7f71f4166860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:48452/0 (socket says 10.20.193.91:48452) 2026-02-12T03:58:45.732 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.661+0000 7f71f2575640 1 -- 10.20.193.91:0/1943632750 learned_addr learned my addr 10.20.193.91:0/1943632750 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:45.732 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.661+0000 7ff72b7fe640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7ff72c0abe50 0x7ff72c160dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:48454/0 (socket says 10.20.193.91:48454) 2026-02-12T03:58:45.732 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.661+0000 7f3e65573640 1 -- 10.20.193.91:0/3388427599 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3424498417 0 0) 0x7f3e6815de40 con 0x7f3e681639c0 2026-02-12T03:58:45.733 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.661+0000 7f3e65573640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.733 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.661+0000 7f3e65573640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.733 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.661+0000 7f3e65573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.733 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.661+0000 7f3e65573640 10 monclient(hunting): my global_id is 4379 2026-02-12T03:58:45.733 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.661+0000 7f3e65573640 1 -- 10.20.193.91:0/3388427599 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e54003610 con 0x7f3e681639c0 2026-02-12T03:58:45.733 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.661+0000 7ff72b7fe640 1 -- 10.20.193.91:0/1969427963 learned_addr learned my addr 10.20.193.91:0/1969427963 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:45.733 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7f793affd640 1 -- 10.20.193.91:0/3548655832 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2098429835 0 0) 0x7f7920003610 con 0x7f793c15d6c0 2026-02-12T03:58:45.733 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7f793affd640 1 -- 10.20.193.91:0/3548655832 >> v1:10.20.193.98:6789/0 conn(0x7f793c15d2f0 legacy=0x7f793c0b89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.733 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7f793affd640 1 -- 10.20.193.91:0/3548655832 >> v1:10.20.193.91:6789/0 conn(0x7f793c0b8080 legacy=0x7f793c0569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.733 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7f793affd640 10 monclient: _finish_hunting 0 2026-02-12T03:58:45.734 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7f793affd640 1 monclient: found mon.noname-c 2026-02-12T03:58:45.734 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7f793affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:45.734 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7f793affd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.111:6789/0 2026-02-12T03:58:45.734 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7f793affd640 1 -- 10.20.193.91:0/3548655832 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f793c0b5d70 con 0x7f793c15d6c0 2026-02-12T03:58:45.734 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7f793affd640 10 monclient: _finish_auth 0 2026-02-12T03:58:45.734 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7f793affd640 10 monclient: _check_auth_tickets 2026-02-12T03:58:45.734 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7f793affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:45.734 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7f793affd640 1 -- 10.20.193.91:0/3548655832 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f7930003170 con 0x7f793c15d6c0 2026-02-12T03:58:45.734 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7f793affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.734 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7f793affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:45.734 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7f793affd640 10 monclient: dump: 2026-02-12T03:58:45.734 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.734 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.734 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.734 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.734 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.734 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.734 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.734 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.734 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.734 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.735 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7f79423be640 5 monclient: authenticate success, global_id 4376 2026-02-12T03:58:45.735 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7f79423be640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:45.735 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7fab13fff640 1 -- 10.20.193.91:0/1484103208 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1734178703 0 0) 0x7fab38154680 con 0x7fab380b7180 2026-02-12T03:58:45.735 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7fab13fff640 1 -- 10.20.193.91:0/1484103208 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fab08003610 con 0x7fab380b7180 2026-02-12T03:58:45.735 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7fab13fff640 1 -- 10.20.193.91:0/1484103208 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fab2c0033b0 con 0x7fab380b7180 2026-02-12T03:58:45.735 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7fab13fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:45.735 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7fab13fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:45.735 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7fab13fff640 10 monclient(hunting): dump: 2026-02-12T03:58:45.735 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.735 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.735 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.735 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.735 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.735 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.736 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.736 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.736 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.736 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.736 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7ff231037640 1 -- 10.20.193.91:0/510531861 <== mon.2 v1:10.20.193.111:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff228003380 con 0x7ff22c164760 2026-02-12T03:58:45.736 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7ff231037640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:45.736 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7ff231037640 1 -- 10.20.193.91:0/510531861 <== mon.2 v1:10.20.193.111:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7ff2280037c0 con 0x7ff22c164760 2026-02-12T03:58:45.736 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7ff2342c4640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:45.736 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7ff2342c4640 4 set_mon_vals no callback set 2026-02-12T03:58:45.736 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7ff231037640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.736 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7ff231037640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:45.736 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7ff231037640 10 monclient: dump: 2026-02-12T03:58:45.736 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.736 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.736 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.736 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.736 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.737 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.737 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.737 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.737 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.737 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7f1b627fc640 1 -- 10.20.193.91:0/2629347674 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3275184463 0 0) 0x7f1b640577f0 con 0x7f1b6405a7c0 2026-02-12T03:58:45.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7f1b627fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7f1b627fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7f1b627fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7f1b627fc640 10 monclient(hunting): my global_id is 4385 2026-02-12T03:58:45.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7f1b627fc640 1 -- 10.20.193.91:0/2629347674 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b48003610 con 0x7f1b6405a7c0 2026-02-12T03:58:45.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7f1b627fc640 1 -- 10.20.193.91:0/2629347674 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1791865088 0 0) 0x7f1b64052720 con 0x7f1b64161c10 2026-02-12T03:58:45.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7f1b627fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7f1b627fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7f1b627fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.738 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7f1b627fc640 10 monclient(hunting): my global_id is 4431 2026-02-12T03:58:45.738 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7f1b627fc640 1 -- 10.20.193.91:0/2629347674 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b640577f0 con 0x7f1b64161c10 2026-02-12T03:58:45.738 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7ff2342c4640 10 monclient: shutdown 2026-02-12T03:58:45.738 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7ff2342c4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:45.738 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.662+0000 7ff2342c4640 1 -- 10.20.193.91:0/510531861 >> v1:10.20.193.111:6789/0 conn(0x7ff22c164760 legacy=0x7ff22c056ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.738 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.663+0000 7ff2342c4640 1 -- 10.20.193.91:0/510531861 shutdown_connections 2026-02-12T03:58:45.738 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.663+0000 7ff2342c4640 1 -- 10.20.193.91:0/510531861 >> 10.20.193.91:0/510531861 conn(0x7ff22c0bab20 msgr2=0x7ff22c0baf20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:45.738 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.663+0000 7ff2342c4640 1 -- 10.20.193.91:0/510531861 shutdown_connections 2026-02-12T03:58:45.739 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.663+0000 7ff2342c4640 1 -- 10.20.193.91:0/510531861 wait complete. 2026-02-12T03:58:45.739 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.663+0000 7ff2342c4640 10 monclient: build_initial_monmap 2026-02-12T03:58:45.739 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.663+0000 7ff2342c4640 10 monclient: monmap: 2026-02-12T03:58:45.739 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:45.739 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:45.739 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:45.739 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:45.739 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:45.739 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:45.739 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:45.739 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:45.739 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:45.739 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.739 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.664+0000 7ff2342c4640 1 librados: starting msgr at 2026-02-12T03:58:45.739 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.664+0000 7ff2342c4640 1 librados: starting objecter 2026-02-12T03:58:45.739 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.664+0000 7ff2342c4640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:45.739 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.664+0000 7ff2342c4640 1 Processor -- start 2026-02-12T03:58:45.739 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.664+0000 7ff2342c4640 1 -- start start 2026-02-12T03:58:45.739 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.664+0000 7ff2342c4640 1 librados: setting wanted keys 2026-02-12T03:58:45.739 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.664+0000 7ff2342c4640 1 librados: calling monclient init 2026-02-12T03:58:45.739 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.664+0000 7ff2342c4640 10 monclient: init 2026-02-12T03:58:45.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.664+0000 7f3e65573640 1 -- 10.20.193.91:0/3388427599 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 898984092 0 0) 0x7f3e68162bb0 con 0x7f3e680afe70 2026-02-12T03:58:45.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.664+0000 7f3e65573640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.664+0000 7f3e65573640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.664+0000 7f3e65573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.664+0000 7f3e65573640 10 monclient(hunting): my global_id is 4419 2026-02-12T03:58:45.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.664+0000 7f3e65573640 1 -- 10.20.193.91:0/3388427599 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e6815de40 con 0x7f3e680afe70 2026-02-12T03:58:45.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.664+0000 7ff2342c4640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:45.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.664+0000 7ff2342c4640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T03:58:45.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.664+0000 7ff2342c4640 10 monclient(hunting): picked mon.noname-a con 0x7ff22c159b70 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:45.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.664+0000 7ff2342c4640 10 monclient(hunting): picked mon.noname-b con 0x7ff22c164760 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:45.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.664+0000 7ff2342c4640 10 monclient(hunting): picked mon.noname-c con 0x7ff22c166f70 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:45.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.664+0000 7ff2342c4640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff22c130d30 con 0x7ff22c159b70 2026-02-12T03:58:45.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.664+0000 7ff2342c4640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff22c11f9c0 con 0x7ff22c164760 2026-02-12T03:58:45.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.664+0000 7ff2342c4640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff22c11fca0 con 0x7ff22c166f70 2026-02-12T03:58:45.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.664+0000 7ff2342c4640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:45.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.664+0000 7ff2342c4640 10 monclient(hunting): authenticate will time out at 1128.407677s 2026-02-12T03:58:45.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.667+0000 7f50acc47640 1 -- 10.20.193.91:0/3201408856 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4041043148 0 0) 0x7f5090003610 con 0x7f50a80b7180 2026-02-12T03:58:45.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.667+0000 7f50acc47640 1 -- 10.20.193.91:0/3201408856 >> v1:10.20.193.111:6789/0 conn(0x7f50a80b57a0 legacy=0x7f50a80b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.667+0000 7f50acc47640 1 -- 10.20.193.91:0/3201408856 >> v1:10.20.193.98:6789/0 conn(0x7f50a80b5b70 legacy=0x7f50a81633b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.667+0000 7f50acc47640 10 monclient: _finish_hunting 0 2026-02-12T03:58:45.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.667+0000 7f50acc47640 1 monclient: found mon.noname-a 2026-02-12T03:58:45.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.667+0000 7f50acc47640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:45.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.667+0000 7f50acc47640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.91:6789/0 2026-02-12T03:58:45.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.667+0000 7f50acc47640 1 -- 10.20.193.91:0/3201408856 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50a80b6980 con 0x7f50a80b7180 2026-02-12T03:58:45.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.667+0000 7f50acc47640 10 monclient: _finish_auth 0 2026-02-12T03:58:45.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.667+0000 7f50acc47640 10 monclient: _check_auth_tickets 2026-02-12T03:58:45.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.667+0000 7f50acc47640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:45.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.667+0000 7f50acc47640 1 -- 10.20.193.91:0/3201408856 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f509c002df0 con 0x7f50a80b7180 2026-02-12T03:58:45.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.667+0000 7f50acc47640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.667+0000 7f50acc47640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:45.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.667+0000 7f50acc47640 10 monclient: dump: 2026-02-12T03:58:45.742 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.742 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.742 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.742 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.742 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.742 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.742 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.742 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.742 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.742 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.667+0000 7f50afed4640 5 monclient: authenticate success, global_id 4425 2026-02-12T03:58:45.743 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.667+0000 7f50afed4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:45.743 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.667+0000 7fd0d1573640 1 -- 10.20.193.91:0/1944730696 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd0c4003380 con 0x7fd0d415d6c0 2026-02-12T03:58:45.743 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.667+0000 7fd0d1573640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:45.743 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.667+0000 7fd0d1573640 1 -- 10.20.193.91:0/1944730696 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd0c40037c0 con 0x7fd0d415d6c0 2026-02-12T03:58:45.743 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.667+0000 7fd0d1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.743 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.667+0000 7fd0d1573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:45.743 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.667+0000 7fd0d1573640 10 monclient: dump: 2026-02-12T03:58:45.743 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.743 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.743 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.743 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.743 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.744 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.744 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.744 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.744 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.744 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.744 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.667+0000 7fd0d8a96640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:45.744 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.667+0000 7fd0d8a96640 4 set_mon_vals no callback set 2026-02-12T03:58:45.744 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.668+0000 7fd0d8a96640 10 monclient: shutdown 2026-02-12T03:58:45.744 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.668+0000 7fd0d8a96640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:45.744 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.668+0000 7fd0d8a96640 1 -- 10.20.193.91:0/1944730696 >> v1:10.20.193.98:6789/0 conn(0x7fd0d415d6c0 legacy=0x7fd0d40570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.744 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.668+0000 7fd0d8a96640 1 -- 10.20.193.91:0/1944730696 shutdown_connections 2026-02-12T03:58:45.744 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.668+0000 7fd0d8a96640 1 -- 10.20.193.91:0/1944730696 >> 10.20.193.91:0/1944730696 conn(0x7fd0d40b7570 msgr2=0x7fd0d40b7970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:45.744 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.668+0000 7fd0d8a96640 1 -- 10.20.193.91:0/1944730696 shutdown_connections 2026-02-12T03:58:45.744 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.668+0000 7fd0d8a96640 1 -- 10.20.193.91:0/1944730696 wait complete. 2026-02-12T03:58:45.744 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.669+0000 7f7db9ffb640 10 client.?.objecter ms_handle_connect 0x7f7dcc0b5b70 2026-02-12T03:58:45.744 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.669+0000 7f7db9ffb640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.745 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.669+0000 7fd0d8a96640 10 monclient: build_initial_monmap 2026-02-12T03:58:45.745 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.669+0000 7fd0d8a96640 10 monclient: monmap: 2026-02-12T03:58:45.745 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:45.746 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:45.746 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:45.746 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:45.746 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:45.746 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:45.746 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:45.746 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:45.746 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:45.746 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.746 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.669+0000 7fd0d8a96640 1 librados: starting msgr at 2026-02-12T03:58:45.746 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.669+0000 7fd0d8a96640 1 librados: starting objecter 2026-02-12T03:58:45.746 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.669+0000 7fd0d8a96640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:45.746 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.669+0000 7fd0d8a96640 1 Processor -- start 2026-02-12T03:58:45.746 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.669+0000 7fd0d8a96640 1 -- start start 2026-02-12T03:58:45.746 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.669+0000 7fd0d8a96640 1 librados: setting wanted keys 2026-02-12T03:58:45.746 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.669+0000 7fd0d8a96640 1 librados: calling monclient init 2026-02-12T03:58:45.746 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.669+0000 7fd0d8a96640 10 monclient: init 2026-02-12T03:58:45.746 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.670+0000 7fd0d8a96640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:45.746 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.670+0000 7fd0d8a96640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T03:58:45.746 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.670+0000 7fd0d8a96640 10 monclient(hunting): picked mon.noname-c con 0x7fd0d40b8080 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:45.746 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.670+0000 7fd0d8a96640 10 monclient(hunting): picked mon.noname-a con 0x7fd0d415d2f0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:45.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.670+0000 7fd0d8a96640 10 monclient(hunting): picked mon.noname-b con 0x7fd0d415d6c0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:45.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.670+0000 7fd0d8a96640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0d4165510 con 0x7fd0d415d2f0 2026-02-12T03:58:45.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.670+0000 7fd0d8a96640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0d415b490 con 0x7fd0d415d6c0 2026-02-12T03:58:45.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.670+0000 7fd0d8a96640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0d413b800 con 0x7fd0d40b8080 2026-02-12T03:58:45.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.670+0000 7fd0d8a96640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:45.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.670+0000 7f724b7fe640 1 -- 10.20.193.91:0/3248146501 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 993048432 0 0) 0x7f7240003610 con 0x7f72540b5b70 2026-02-12T03:58:45.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.670+0000 7f724b7fe640 1 -- 10.20.193.91:0/3248146501 >> v1:10.20.193.98:6789/0 conn(0x7f72540b7180 legacy=0x7f72540565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.670+0000 7fd0d8a96640 10 monclient(hunting): authenticate will time out at 1128.413621s 2026-02-12T03:58:45.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.670+0000 7f724b7fe640 1 -- 10.20.193.91:0/3248146501 >> v1:10.20.193.91:6789/0 conn(0x7f72540b57a0 legacy=0x7f72540b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.670+0000 7f724b7fe640 10 monclient: _finish_hunting 0 2026-02-12T03:58:45.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.670+0000 7f724b7fe640 1 monclient: found mon.noname-c 2026-02-12T03:58:45.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.670+0000 7f724b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:45.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.670+0000 7f724b7fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.111:6789/0 2026-02-12T03:58:45.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.670+0000 7f724b7fe640 1 -- 10.20.193.91:0/3248146501 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72540b6980 con 0x7f72540b5b70 2026-02-12T03:58:45.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.670+0000 7f724b7fe640 10 monclient: _finish_auth 0 2026-02-12T03:58:45.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.670+0000 7f724b7fe640 10 monclient: _check_auth_tickets 2026-02-12T03:58:45.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.670+0000 7f724b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:45.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.670+0000 7f724b7fe640 1 -- 10.20.193.91:0/3248146501 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f7250003170 con 0x7f72540b5b70 2026-02-12T03:58:45.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.670+0000 7f724b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.749 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.670+0000 7f724b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:45.749 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.670+0000 7f724b7fe640 10 monclient: dump: 2026-02-12T03:58:45.749 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.749 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.749 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.749 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.749 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.749 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.749 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.749 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.749 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.749 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.749 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.670+0000 7f725b251640 5 monclient: authenticate success, global_id 4370 2026-02-12T03:58:45.749 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.670+0000 7f725b251640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:45.750 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.671+0000 7fbd99ffb640 1 -- 10.20.193.91:0/1877426241 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1071002616 0 0) 0x7fbd88003610 con 0x7fbd9c0b5b70 2026-02-12T03:58:45.750 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.671+0000 7fbd99ffb640 1 -- 10.20.193.91:0/1877426241 >> v1:10.20.193.98:6789/0 conn(0x7fbd9c0b57a0 legacy=0x7fbd9c0b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.750 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.671+0000 7fbd99ffb640 1 -- 10.20.193.91:0/1877426241 >> v1:10.20.193.91:6789/0 conn(0x7fbd9c0b7180 legacy=0x7fbd9c0565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.750 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.671+0000 7fbd99ffb640 10 monclient: _finish_hunting 0 2026-02-12T03:58:45.750 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.671+0000 7fbd99ffb640 1 monclient: found mon.noname-c 2026-02-12T03:58:45.750 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.671+0000 7fbd99ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:45.750 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.671+0000 7fbd99ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.111:6789/0 2026-02-12T03:58:45.750 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.671+0000 7fbd99ffb640 1 -- 10.20.193.91:0/1877426241 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd9c0b6980 con 0x7fbd9c0b5b70 2026-02-12T03:58:45.750 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.671+0000 7fbd99ffb640 10 monclient: _finish_auth 0 2026-02-12T03:58:45.750 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.671+0000 7fbd99ffb640 10 monclient: _check_auth_tickets 2026-02-12T03:58:45.750 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.671+0000 7fbd99ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:45.750 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.671+0000 7fbd99ffb640 1 -- 10.20.193.91:0/1877426241 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fbd8c003170 con 0x7fbd9c0b5b70 2026-02-12T03:58:45.750 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.671+0000 7fbda1a50640 5 monclient: authenticate success, global_id 4382 2026-02-12T03:58:45.750 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.671+0000 7fbda1a50640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:45.750 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.671+0000 7fbd99ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.751 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.671+0000 7fbd99ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:45.751 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.671+0000 7fbd99ffb640 10 monclient: dump: 2026-02-12T03:58:45.751 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.751 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.751 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.751 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.751 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.751 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.751 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.751 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.751 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.751 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.751 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.671+0000 7fbda1a50640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:45.751 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.671+0000 7f07e1ffb640 1 -- 10.20.193.91:0/1007060249 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2061503179 0 0) 0x7f07e40b63c0 con 0x7f07e40b7180 2026-02-12T03:58:45.751 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.671+0000 7f07e1ffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.751 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.671+0000 7f07e1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.751 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.671+0000 7f07e1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.751 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.671+0000 7f07e1ffb640 10 monclient(hunting): my global_id is 4429 2026-02-12T03:58:45.752 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.671+0000 7f07e1ffb640 1 -- 10.20.193.91:0/1007060249 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07d0003610 con 0x7f07e40b7180 2026-02-12T03:58:45.752 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.671+0000 7f793affd640 1 -- 10.20.193.91:0/3548655832 <== mon.2 v1:10.20.193.111:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7930003340 con 0x7f793c15d6c0 2026-02-12T03:58:45.752 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.671+0000 7f793affd640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:45.752 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.671+0000 7f793affd640 1 -- 10.20.193.91:0/3548655832 <== mon.2 v1:10.20.193.111:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f7930003780 con 0x7f793c15d6c0 2026-02-12T03:58:45.752 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.671+0000 7f793affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.752 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.671+0000 7f793affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:45.752 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.671+0000 7f793affd640 10 monclient: dump: 2026-02-12T03:58:45.752 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.752 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.752 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.752 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.752 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.752 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.752 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.752 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.752 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.752 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.752 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.671+0000 7f79423be640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:45.753 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.671+0000 7f79423be640 4 set_mon_vals no callback set 2026-02-12T03:58:45.753 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.671+0000 7f3e65573640 1 -- 10.20.193.91:0/3388427599 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2243734307 0 0) 0x7f3e68162e90 con 0x7f3e6815f310 2026-02-12T03:58:45.753 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.671+0000 7f3e65573640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.753 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.671+0000 7f3e65573640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.753 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.671+0000 7f3e65573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.753 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.671+0000 7f3e65573640 10 monclient(hunting): my global_id is 4420 2026-02-12T03:58:45.753 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.671+0000 7f3e65573640 1 -- 10.20.193.91:0/3388427599 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e68162bb0 con 0x7f3e6815f310 2026-02-12T03:58:45.753 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7f47e7fff640 1 -- 10.20.193.91:0/3702304355 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f47e8002f30 con 0x7f47f80b57a0 2026-02-12T03:58:45.753 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7f47e7fff640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:45.753 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7f47e7fff640 1 -- 10.20.193.91:0/3702304355 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f47e8003330 con 0x7f47f80b57a0 2026-02-12T03:58:45.753 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7f47e7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.753 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7f47e7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:45.754 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7f47e7fff640 10 monclient: dump: 2026-02-12T03:58:45.754 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.754 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.754 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.754 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.754 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.754 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.754 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.754 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.754 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.754 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.754 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7f47ff5cc640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:45.754 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7f47ff5cc640 4 set_mon_vals no callback set 2026-02-12T03:58:45.754 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7f71f1573640 1 -- 10.20.193.91:0/1943632750 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2930647357 0 0) 0x7f71f40b8cc0 con 0x7f71f4159b70 2026-02-12T03:58:45.754 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7f71f1573640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.754 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7f71f1573640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.754 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7f71f1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.755 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7f71f1573640 10 monclient(hunting): my global_id is 4438 2026-02-12T03:58:45.755 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7f71f1573640 1 -- 10.20.193.91:0/1943632750 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71e0003610 con 0x7f71f4159b70 2026-02-12T03:58:45.755 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7f1b627fc640 1 -- 10.20.193.91:0/2629347674 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3342122474 0 0) 0x7f1b64058b70 con 0x7f1b640b5e90 2026-02-12T03:58:45.755 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7f1b627fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.755 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7f1b627fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.755 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7f1b627fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.755 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7f1b627fc640 10 monclient(hunting): my global_id is 4426 2026-02-12T03:58:45.755 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7f1b627fc640 1 -- 10.20.193.91:0/2629347674 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b64052720 con 0x7f1b640b5e90 2026-02-12T03:58:45.755 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7f79423be640 10 monclient: shutdown 2026-02-12T03:58:45.755 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7f79423be640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:45.755 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7f79423be640 1 -- 10.20.193.91:0/3548655832 >> v1:10.20.193.111:6789/0 conn(0x7f793c15d6c0 legacy=0x7f793c0570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.755 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7f79423be640 1 -- 10.20.193.91:0/3548655832 shutdown_connections 2026-02-12T03:58:45.756 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7fb2b37fe640 1 -- 10.20.193.91:0/1706977470 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2891264124 0 0) 0x7fb2bc0b63c0 con 0x7fb2bc0b7180 2026-02-12T03:58:45.756 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7fb2b37fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.756 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7fb2b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.756 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7fb2b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.756 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7fb2b37fe640 10 monclient(hunting): my global_id is 4435 2026-02-12T03:58:45.756 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7fb2b37fe640 1 -- 10.20.193.91:0/1706977470 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2a8003610 con 0x7fb2bc0b7180 2026-02-12T03:58:45.756 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7f79423be640 1 -- 10.20.193.91:0/3548655832 >> 10.20.193.91:0/3548655832 conn(0x7f793c0b7570 msgr2=0x7f793c0b7970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:45.756 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7f79423be640 1 -- 10.20.193.91:0/3548655832 shutdown_connections 2026-02-12T03:58:45.756 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7f79423be640 1 -- 10.20.193.91:0/3548655832 wait complete. 2026-02-12T03:58:45.756 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7f47ff5cc640 10 monclient: shutdown 2026-02-12T03:58:45.756 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7f47ff5cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:45.756 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7f47ff5cc640 1 -- 10.20.193.91:0/3702304355 >> v1:10.20.193.98:6789/0 conn(0x7f47f80b57a0 legacy=0x7f47f80b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7fb2b37fe640 1 -- 10.20.193.91:0/1706977470 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 816720866 0 0) 0x7fb2bc163f30 con 0x7fb2bc0b5b70 2026-02-12T03:58:45.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7fb2b37fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7fb2b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7fb2b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7fb2b37fe640 10 monclient(hunting): my global_id is 4437 2026-02-12T03:58:45.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7fb2b37fe640 1 -- 10.20.193.91:0/1706977470 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2bc0b63c0 con 0x7fb2bc0b5b70 2026-02-12T03:58:45.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7ff231838640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7ff22c164760 0x7ff22c135920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:48464/0 (socket says 10.20.193.91:48464) 2026-02-12T03:58:45.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7ff231838640 1 -- 10.20.193.91:0/861051702 learned_addr learned my addr 10.20.193.91:0/861051702 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:45.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7f47ff5cc640 1 -- 10.20.193.91:0/3702304355 shutdown_connections 2026-02-12T03:58:45.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7ff23b7fe640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7ff23c167e90 0x7ff23c1ac060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:48460/0 (socket says 10.20.193.91:48460) 2026-02-12T03:58:45.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7ff23b7fe640 1 -- 10.20.193.91:0/1216685769 learned_addr learned my addr 10.20.193.91:0/1216685769 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:45.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7f47ff5cc640 1 -- 10.20.193.91:0/3702304355 >> 10.20.193.91:0/3702304355 conn(0x7f47f80559c0 msgr2=0x7f47f8055dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:45.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7f47ff5cc640 1 -- 10.20.193.91:0/3702304355 shutdown_connections 2026-02-12T03:58:45.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7f47ff5cc640 1 -- 10.20.193.91:0/3702304355 wait complete. 2026-02-12T03:58:45.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7fab13fff640 1 -- 10.20.193.91:0/1484103208 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2740164280 0 0) 0x7fab08003610 con 0x7fab380b7180 2026-02-12T03:58:45.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7fab13fff640 1 -- 10.20.193.91:0/1484103208 >> v1:10.20.193.111:6789/0 conn(0x7fab380b5b70 legacy=0x7fab38155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7fab13fff640 1 -- 10.20.193.91:0/1484103208 >> v1:10.20.193.98:6789/0 conn(0x7fab380b57a0 legacy=0x7fab38133970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7fab13fff640 10 monclient: _finish_hunting 0 2026-02-12T03:58:45.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7fab13fff640 1 monclient: found mon.a 2026-02-12T03:58:45.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7fab13fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:45.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7fab13fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:45.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7fab13fff640 1 -- 10.20.193.91:0/1484103208 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab38154960 con 0x7fab380b7180 2026-02-12T03:58:45.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7fab13fff640 10 monclient: _finish_auth 0 2026-02-12T03:58:45.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7fab13fff640 10 monclient: _check_auth_tickets 2026-02-12T03:58:45.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7fab13fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:45.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7fab3dc6f640 5 monclient: authenticate success, global_id 4416 2026-02-12T03:58:45.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7fab3dc6f640 10 monclient: _renew_subs 2026-02-12T03:58:45.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7fab3dc6f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:45.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7fab3dc6f640 1 -- 10.20.193.91:0/1484103208 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fab38154c40 con 0x7fab380b7180 2026-02-12T03:58:45.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7fab3dc6f640 10 client.4416.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:45.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7fab3dc6f640 10 monclient: _renew_subs 2026-02-12T03:58:45.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7fab3dc6f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:45.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7fab3dc6f640 1 -- 10.20.193.91:0/1484103208 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fab38153f60 con 0x7fab380b7180 2026-02-12T03:58:45.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.672+0000 7fab3dc6f640 1 librados: init done 2026-02-12T03:58:45.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f79423be640 10 monclient: build_initial_monmap 2026-02-12T03:58:45.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f79423be640 10 monclient: monmap: 2026-02-12T03:58:45.759 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:45.759 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:45.759 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:45.759 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:45.759 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:45.759 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:45.759 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:45.759 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:45.760 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:45.760 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.760 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f47ff5cc640 10 monclient: build_initial_monmap 2026-02-12T03:58:45.760 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f47ff5cc640 10 monclient: monmap: 2026-02-12T03:58:45.760 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:45.760 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:45.760 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:45.760 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:45.760 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:45.760 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:45.760 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:45.760 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:45.760 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:45.760 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.761 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f79423be640 1 librados: starting msgr at 2026-02-12T03:58:45.761 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f79423be640 1 librados: starting objecter 2026-02-12T03:58:45.761 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f79423be640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:45.761 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f1b627fc640 1 -- 10.20.193.91:0/2629347674 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3808409890 0 0) 0x7f1b640577f0 con 0x7f1b64161c10 2026-02-12T03:58:45.761 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7ff212ffd640 10 client.?.objecter ms_handle_connect 0x7ff22c164760 2026-02-12T03:58:45.761 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f1b627fc640 1 -- 10.20.193.91:0/2629347674 >> v1:10.20.193.111:6789/0 conn(0x7f1b6405a7c0 legacy=0x7f1b6416b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.761 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f1b627fc640 1 -- 10.20.193.91:0/2629347674 >> v1:10.20.193.98:6789/0 conn(0x7f1b640b5e90 legacy=0x7f1b6416aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.761 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f1b627fc640 10 monclient: _finish_hunting 0 2026-02-12T03:58:45.761 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7ff212ffd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.762 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f1b627fc640 1 monclient: found mon.noname-a 2026-02-12T03:58:45.762 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f1b627fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:45.762 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f1b627fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.91:6789/0 2026-02-12T03:58:45.762 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f1b627fc640 1 -- 10.20.193.91:0/2629347674 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b64057ad0 con 0x7f1b64161c10 2026-02-12T03:58:45.762 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f1b627fc640 10 monclient: _finish_auth 0 2026-02-12T03:58:45.762 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f1b627fc640 10 monclient: _check_auth_tickets 2026-02-12T03:58:45.762 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f1b627fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:45.762 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f1b627fc640 1 -- 10.20.193.91:0/2629347674 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f1b50002df0 con 0x7f1b64161c10 2026-02-12T03:58:45.762 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f1b627fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.762 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f1b627fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:45.762 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f1b627fc640 10 monclient: dump: 2026-02-12T03:58:45.762 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.762 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.762 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.762 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.763 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.763 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.763 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.763 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.763 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.763 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.763 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f1b69b1c640 5 monclient: authenticate success, global_id 4431 2026-02-12T03:58:45.763 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f1b69b1c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:45.763 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f79423be640 1 Processor -- start 2026-02-12T03:58:45.763 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f79423be640 1 -- start start 2026-02-12T03:58:45.763 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f79423be640 1 librados: setting wanted keys 2026-02-12T03:58:45.763 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f79423be640 1 librados: calling monclient init 2026-02-12T03:58:45.763 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f79423be640 10 monclient: init 2026-02-12T03:58:45.763 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7fab3dc6f640 10 client.4416.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:45.763 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7fab3dc6f640 15 client.4416.objecter _session_command_op_assign -1 1 2026-02-12T03:58:45.763 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7fab3dc6f640 20 client.4416.objecter _get_session osd=-1 returning homeless 2026-02-12T03:58:45.764 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7fab3dc6f640 10 client.4416.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:45.764 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7fab3dc6f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:45.764 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7fab3dc6f640 1 -- 10.20.193.91:0/1484103208 --> v1:10.20.193.91:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fab380b20d0 con 0x7fab380b7180 2026-02-12T03:58:45.764 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f47ff5cc640 1 librados: starting msgr at 2026-02-12T03:58:45.764 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f47ff5cc640 1 librados: starting objecter 2026-02-12T03:58:45.764 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f47ff5cc640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:45.764 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f47ff5cc640 1 Processor -- start 2026-02-12T03:58:45.764 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f7db9ffb640 1 -- 10.20.193.91:0/4137855695 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2914325834 0 0) 0x7f7dcc137a90 con 0x7f7dcc0b57a0 2026-02-12T03:58:45.764 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f7db9ffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.764 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f7db9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.764 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f7db9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.765 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f7db9ffb640 10 monclient(hunting): my global_id is 4432 2026-02-12T03:58:45.765 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f7db9ffb640 1 -- 10.20.193.91:0/4137855695 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d9c003610 con 0x7f7dcc0b57a0 2026-02-12T03:58:45.765 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f47ff5cc640 1 -- start start 2026-02-12T03:58:45.765 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f47ff5cc640 1 librados: setting wanted keys 2026-02-12T03:58:45.765 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f47ff5cc640 1 librados: calling monclient init 2026-02-12T03:58:45.765 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f47ff5cc640 10 monclient: init 2026-02-12T03:58:45.765 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f79423be640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:45.765 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f79423be640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T03:58:45.765 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f79423be640 10 monclient(hunting): picked mon.noname-c con 0x7f793c0b8080 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:45.765 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f79423be640 10 monclient(hunting): picked mon.noname-a con 0x7f793c15d2f0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:45.766 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f79423be640 10 monclient(hunting): picked mon.noname-b con 0x7f793c15d6c0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:45.766 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f79423be640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f793c0b43b0 con 0x7f793c15d2f0 2026-02-12T03:58:45.766 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f79423be640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f793c13bd30 con 0x7f793c15d6c0 2026-02-12T03:58:45.766 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f79423be640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f793c13c010 con 0x7f793c0b8080 2026-02-12T03:58:45.766 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f79423be640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:45.766 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7f79423be640 10 monclient(hunting): authenticate will time out at 1128.416739s 2026-02-12T03:58:45.766 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7ff72affd640 1 -- 10.20.193.91:0/1969427963 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4181726303 0 0) 0x7ff72c0b31a0 con 0x7ff72c0abe50 2026-02-12T03:58:45.766 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7ff72affd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.766 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7ff72affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.766 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7ff72affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.766 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7ff72affd640 10 monclient(hunting): my global_id is 4441 2026-02-12T03:58:45.766 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.673+0000 7ff72affd640 1 -- 10.20.193.91:0/1969427963 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff710003610 con 0x7ff72c0abe50 2026-02-12T03:58:45.767 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.674+0000 7f47ff5cc640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:45.767 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.674+0000 7f47ff5cc640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T03:58:45.767 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.674+0000 7f47ff5cc640 10 monclient(hunting): picked mon.noname-b con 0x7f47f80b57a0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:45.767 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.674+0000 7f47ff5cc640 10 monclient(hunting): picked mon.noname-c con 0x7f47f80b5b70 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:45.767 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.674+0000 7f47ff5cc640 10 monclient(hunting): picked mon.noname-a con 0x7f47f80b7180 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:45.767 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.674+0000 7f47ff5cc640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47f811b7d0 con 0x7f47f80b7180 2026-02-12T03:58:45.767 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.674+0000 7f47ff5cc640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47f811bab0 con 0x7f47f80b57a0 2026-02-12T03:58:45.767 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.674+0000 7f47ff5cc640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47f811bd90 con 0x7f47f80b5b70 2026-02-12T03:58:45.767 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.674+0000 7f47ff5cc640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:45.767 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.674+0000 7f47ff5cc640 10 monclient(hunting): authenticate will time out at 1128.417206s 2026-02-12T03:58:45.767 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.674+0000 7f7db9ffb640 10 client.?.objecter ms_handle_connect 0x7f7dcc0b7180 2026-02-12T03:58:45.767 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.674+0000 7f7db9ffb640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.768 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.674+0000 7f50acc47640 1 -- 10.20.193.91:0/3201408856 <== mon.0 v1:10.20.193.91:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f509c003000 con 0x7f50a80b7180 2026-02-12T03:58:45.768 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.674+0000 7f50acc47640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:45.768 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.674+0000 7f50acc47640 1 -- 10.20.193.91:0/3201408856 <== mon.0 v1:10.20.193.91:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f509c003400 con 0x7f50a80b7180 2026-02-12T03:58:45.768 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.674+0000 7f50acc47640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.768 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.674+0000 7f50acc47640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:45.768 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.674+0000 7f50acc47640 10 monclient: dump: 2026-02-12T03:58:45.768 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.768 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.768 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.769 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.769 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.769 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.769 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.769 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.769 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.769 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.675+0000 7f50afed4640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:45.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.675+0000 7f50afed4640 4 set_mon_vals no callback set 2026-02-12T03:58:45.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.675+0000 7f50afed4640 10 monclient: shutdown 2026-02-12T03:58:45.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.675+0000 7f50afed4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:45.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.675+0000 7f50afed4640 1 -- 10.20.193.91:0/3201408856 >> v1:10.20.193.91:6789/0 conn(0x7f50a80b7180 legacy=0x7f50a80565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.675+0000 7f50afed4640 1 -- 10.20.193.91:0/3201408856 shutdown_connections 2026-02-12T03:58:45.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.675+0000 7f50afed4640 1 -- 10.20.193.91:0/3201408856 >> 10.20.193.91:0/3201408856 conn(0x7f50a80559c0 msgr2=0x7f50a8055dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:45.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.675+0000 7f50afed4640 1 -- 10.20.193.91:0/3201408856 shutdown_connections 2026-02-12T03:58:45.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.675+0000 7f50afed4640 1 -- 10.20.193.91:0/3201408856 wait complete. 2026-02-12T03:58:45.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f50afed4640 10 monclient: build_initial_monmap 2026-02-12T03:58:45.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f50afed4640 10 monclient: monmap: 2026-02-12T03:58:45.769 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:45.769 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:45.769 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:45.770 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:45.770 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:45.770 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:45.770 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:45.770 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:45.770 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:45.770 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f793b7fe640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f793c15d2f0 0x7f793c0b3ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:59292/0 (socket says 10.20.193.91:59292) 2026-02-12T03:58:45.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f793b7fe640 1 -- 10.20.193.91:0/4216721313 learned_addr learned my addr 10.20.193.91:0/4216721313 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:45.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f3e65573640 1 -- 10.20.193.91:0/3388427599 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3131002682 0 0) 0x7f3e54003610 con 0x7f3e681639c0 2026-02-12T03:58:45.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f3e65573640 1 -- 10.20.193.91:0/3388427599 >> v1:10.20.193.98:6789/0 conn(0x7f3e6815f310 legacy=0x7f3e681632b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f3e65573640 1 -- 10.20.193.91:0/3388427599 >> v1:10.20.193.91:6789/0 conn(0x7f3e680afe70 legacy=0x7f3e6815ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f3e65573640 10 monclient: _finish_hunting 0 2026-02-12T03:58:45.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f3e65573640 1 monclient: found mon.noname-c 2026-02-12T03:58:45.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f3e65573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:45.771 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f3e65573640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.111:6789/0 2026-02-12T03:58:45.771 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f3e65573640 1 -- 10.20.193.91:0/3388427599 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e6815e120 con 0x7f3e681639c0 2026-02-12T03:58:45.771 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f3e65573640 10 monclient: _finish_auth 0 2026-02-12T03:58:45.771 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f3e65573640 10 monclient: _check_auth_tickets 2026-02-12T03:58:45.771 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f3e65573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:45.771 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f3e65573640 1 -- 10.20.193.91:0/3388427599 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f3e58003170 con 0x7f3e681639c0 2026-02-12T03:58:45.771 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f3e65573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.771 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f3e65573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:45.771 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f3e65573640 10 monclient: dump: 2026-02-12T03:58:45.771 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.771 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.771 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.771 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.771 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.771 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.771 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.771 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.771 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.771 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.772 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f50afed4640 1 librados: starting msgr at 2026-02-12T03:58:45.772 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f50afed4640 1 librados: starting objecter 2026-02-12T03:58:45.772 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f3e6cda9640 5 monclient: authenticate success, global_id 4379 2026-02-12T03:58:45.772 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f3e6cda9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:45.772 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f50afed4640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:45.773 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f50afed4640 1 Processor -- start 2026-02-12T03:58:45.773 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f50afed4640 1 -- start start 2026-02-12T03:58:45.773 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f50afed4640 1 librados: setting wanted keys 2026-02-12T03:58:45.773 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f50afed4640 1 librados: calling monclient init 2026-02-12T03:58:45.773 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f50afed4640 10 monclient: init 2026-02-12T03:58:45.773 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f50afed4640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:45.773 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f50afed4640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T03:58:45.773 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f50afed4640 10 monclient(hunting): picked mon.noname-a con 0x7f50a80b57a0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:45.773 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f50afed4640 10 monclient(hunting): picked mon.noname-b con 0x7f50a80b5b70 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:45.773 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f50afed4640 10 monclient(hunting): picked mon.noname-c con 0x7f50a80b7180 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:45.773 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f50afed4640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50a8131a90 con 0x7f50a80b57a0 2026-02-12T03:58:45.773 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f50afed4640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50a8131d70 con 0x7f50a80b5b70 2026-02-12T03:58:45.773 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f50afed4640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50a8161350 con 0x7f50a80b7180 2026-02-12T03:58:45.773 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f50afed4640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:45.773 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.676+0000 7f50afed4640 10 monclient(hunting): authenticate will time out at 1128.419979s 2026-02-12T03:58:45.773 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.677+0000 7ff72affd640 1 -- 10.20.193.91:0/1969427963 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 73728366 0 0) 0x7ff72c0b3480 con 0x7ff72c0aba80 2026-02-12T03:58:45.774 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.677+0000 7ff72affd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.774 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.677+0000 7ff72affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.774 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.677+0000 7ff72affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.774 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.677+0000 7ff72affd640 10 monclient(hunting): my global_id is 4391 2026-02-12T03:58:45.774 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.677+0000 7ff72affd640 1 -- 10.20.193.91:0/1969427963 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff72c0b31a0 con 0x7ff72c0aba80 2026-02-12T03:58:45.774 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.677+0000 7fbd99ffb640 1 -- 10.20.193.91:0/1877426241 <== mon.2 v1:10.20.193.111:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbd8c003380 con 0x7fbd9c0b5b70 2026-02-12T03:58:45.774 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.677+0000 7fbd99ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:45.774 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.677+0000 7fbd99ffb640 1 -- 10.20.193.91:0/1877426241 <== mon.2 v1:10.20.193.111:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fbd8c003780 con 0x7fbd9c0b5b70 2026-02-12T03:58:45.774 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.677+0000 7fbd99ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.774 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.677+0000 7fbd99ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:45.774 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.677+0000 7fbd99ffb640 10 monclient: dump: 2026-02-12T03:58:45.775 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.775 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.775 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.775 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.775 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.775 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.775 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.775 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.775 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.775 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.775 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.677+0000 7fbda1a50640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:45.775 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.677+0000 7fbda1a50640 4 set_mon_vals no callback set 2026-02-12T03:58:45.775 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.678+0000 7fbda1a50640 10 monclient: shutdown 2026-02-12T03:58:45.775 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.678+0000 7fbda1a50640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:45.775 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.678+0000 7fbda1a50640 1 -- 10.20.193.91:0/1877426241 >> v1:10.20.193.111:6789/0 conn(0x7fbd9c0b5b70 legacy=0x7fbd9c1633b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.775 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.678+0000 7fbda1a50640 1 -- 10.20.193.91:0/1877426241 shutdown_connections 2026-02-12T03:58:45.775 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.678+0000 7fbda1a50640 1 -- 10.20.193.91:0/1877426241 >> 10.20.193.91:0/1877426241 conn(0x7fbd9c0559c0 msgr2=0x7fbd9c055dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:45.775 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.678+0000 7fbda1a50640 1 -- 10.20.193.91:0/1877426241 shutdown_connections 2026-02-12T03:58:45.775 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.678+0000 7fbda1a50640 1 -- 10.20.193.91:0/1877426241 wait complete. 2026-02-12T03:58:45.775 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.678+0000 7f7938ff9640 10 client.?.objecter ms_handle_connect 0x7f793c15d2f0 2026-02-12T03:58:45.775 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.678+0000 7f7938ff9640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.775 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.678+0000 7fbda1a50640 10 monclient: build_initial_monmap 2026-02-12T03:58:45.775 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.678+0000 7fbda1a50640 10 monclient: monmap: 2026-02-12T03:58:45.775 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:45.775 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:45.775 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:45.775 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:45.775 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:45.775 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:45.775 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:45.775 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:45.775 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:45.775 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.776 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.678+0000 7f7db9ffb640 1 -- 10.20.193.91:0/4137855695 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2682608102 0 0) 0x7f7dcc1377b0 con 0x7f7dcc0b5b70 2026-02-12T03:58:45.776 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.678+0000 7f7db9ffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.776 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.678+0000 7f7db9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.776 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.678+0000 7f7db9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.776 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.678+0000 7f7db9ffb640 10 monclient(hunting): my global_id is 4443 2026-02-12T03:58:45.776 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.678+0000 7f7db9ffb640 1 -- 10.20.193.91:0/4137855695 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7dcc137a90 con 0x7f7dcc0b5b70 2026-02-12T03:58:45.776 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.678+0000 7fbda1a50640 1 librados: starting msgr at 2026-02-12T03:58:45.776 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.679+0000 7fbda1a50640 1 librados: starting objecter 2026-02-12T03:58:45.776 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.679+0000 7fbda1a50640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:45.776 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.679+0000 7fbda1a50640 1 Processor -- start 2026-02-12T03:58:45.776 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.679+0000 7fbda1a50640 1 -- start start 2026-02-12T03:58:45.776 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.679+0000 7fbda1a50640 1 librados: setting wanted keys 2026-02-12T03:58:45.776 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.679+0000 7fbda1a50640 1 librados: calling monclient init 2026-02-12T03:58:45.776 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.679+0000 7fbda1a50640 10 monclient: init 2026-02-12T03:58:45.776 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.679+0000 7fbda1a50640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:45.776 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.679+0000 7fbda1a50640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T03:58:45.776 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.679+0000 7fbda1a50640 10 monclient(hunting): picked mon.noname-c con 0x7fbd9c0b57a0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:45.776 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.679+0000 7fbda1a50640 10 monclient(hunting): picked mon.noname-a con 0x7fbd9c0b5b70 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:45.776 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.679+0000 7ff23affd640 1 -- 10.20.193.91:0/1216685769 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3936231437 0 0) 0x7ff23c0b6290 con 0x7ff23c167e90 2026-02-12T03:58:45.776 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.679+0000 7fbda1a50640 10 monclient(hunting): picked mon.noname-b con 0x7fbd9c0b7180 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:45.776 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.679+0000 7fbda1a50640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd9c0b4a70 con 0x7fbd9c0b5b70 2026-02-12T03:58:45.776 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.679+0000 7fbda1a50640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd9c12a150 con 0x7fbd9c0b7180 2026-02-12T03:58:45.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.679+0000 7ff23affd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.679+0000 7ff23affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.679+0000 7ff23affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.679+0000 7ff23affd640 10 monclient(hunting): my global_id is 4444 2026-02-12T03:58:45.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.679+0000 7ff23affd640 1 -- 10.20.193.91:0/1216685769 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff220003610 con 0x7ff23c167e90 2026-02-12T03:58:45.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.679+0000 7fbda1a50640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd9c12a430 con 0x7fbd9c0b57a0 2026-02-12T03:58:45.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.679+0000 7fbda1a50640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:45.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.679+0000 7fbda1a50640 10 monclient(hunting): authenticate will time out at 1128.422588s 2026-02-12T03:58:45.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.679+0000 7fd0d1d74640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7fd0d415d2f0 0x7fd0d4156630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:59282/0 (socket says 10.20.193.91:59282) 2026-02-12T03:58:45.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.679+0000 7fd0d1d74640 1 -- 10.20.193.91:0/2911181674 learned_addr learned my addr 10.20.193.91:0/2911181674 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:45.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.680+0000 7fd0baffd640 10 client.?.objecter ms_handle_connect 0x7fd0d415d2f0 2026-02-12T03:58:45.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.680+0000 7fd0baffd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.680+0000 7fb2b37fe640 1 -- 10.20.193.91:0/1706977470 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2225880149 0 0) 0x7fb2bc0b66a0 con 0x7fb2bc0b57a0 2026-02-12T03:58:45.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.680+0000 7fb2b37fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.680+0000 7fb2b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.680+0000 7fb2b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.680+0000 7fb2b37fe640 10 monclient(hunting): my global_id is 4397 2026-02-12T03:58:45.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.680+0000 7fb2b37fe640 1 -- 10.20.193.91:0/1706977470 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2bc163f30 con 0x7fb2bc0b57a0 2026-02-12T03:58:45.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.681+0000 7f07e1ffb640 1 -- 10.20.193.91:0/1007060249 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 682889055 0 0) 0x7f07e4163f30 con 0x7f07e40b57a0 2026-02-12T03:58:45.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.681+0000 7f07e1ffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.681+0000 7f07e1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.681+0000 7f07e1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.681+0000 7f07e1ffb640 10 monclient(hunting): my global_id is 4434 2026-02-12T03:58:45.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.681+0000 7f07e1ffb640 1 -- 10.20.193.91:0/1007060249 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07e40b63c0 con 0x7f07e40b57a0 2026-02-12T03:58:45.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.681+0000 7fd0baffd640 10 client.?.objecter ms_handle_connect 0x7fd0d415d6c0 2026-02-12T03:58:45.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.681+0000 7fd0baffd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.682+0000 7ff23affd640 1 -- 10.20.193.91:0/1216685769 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2645680016 0 0) 0x7ff23c056b30 con 0x7ff23c0564d0 2026-02-12T03:58:45.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.682+0000 7fb2b37fe640 1 -- 10.20.193.91:0/1706977470 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2900425071 0 0) 0x7fb2bc0b63c0 con 0x7fb2bc0b5b70 2026-02-12T03:58:45.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.682+0000 7fb2b37fe640 1 -- 10.20.193.91:0/1706977470 >> v1:10.20.193.111:6789/0 conn(0x7fb2bc0b57a0 legacy=0x7fb2bc0b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.682+0000 7fb2b37fe640 1 -- 10.20.193.91:0/1706977470 >> v1:10.20.193.98:6789/0 conn(0x7fb2bc0b7180 legacy=0x7fb2bc0565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.682+0000 7fb2b37fe640 10 monclient: _finish_hunting 0 2026-02-12T03:58:45.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.682+0000 7fb2b37fe640 1 monclient: found mon.noname-a 2026-02-12T03:58:45.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.682+0000 7fb2b37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:45.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.682+0000 7fb2b37fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.91:6789/0 2026-02-12T03:58:45.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.682+0000 7fb2b37fe640 1 -- 10.20.193.91:0/1706977470 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2bc0b6980 con 0x7fb2bc0b5b70 2026-02-12T03:58:45.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.682+0000 7fb2b37fe640 10 monclient: _finish_auth 0 2026-02-12T03:58:45.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.682+0000 7fb2b37fe640 10 monclient: _check_auth_tickets 2026-02-12T03:58:45.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.682+0000 7fb2b37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:45.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.682+0000 7fb2c2d13640 5 monclient: authenticate success, global_id 4437 2026-02-12T03:58:45.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.682+0000 7fb2c2d13640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:45.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.682+0000 7ff23affd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.682+0000 7ff23affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.682+0000 7ff23affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.682+0000 7ff23affd640 10 monclient(hunting): my global_id is 4400 2026-02-12T03:58:45.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.682+0000 7ff23affd640 1 -- 10.20.193.91:0/1216685769 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff23c0b6290 con 0x7ff23c0564d0 2026-02-12T03:58:45.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.682+0000 7ff212ffd640 10 client.?.objecter ms_handle_connect 0x7ff22c166f70 2026-02-12T03:58:45.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.682+0000 7ff212ffd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.683+0000 7f724b7fe640 1 -- 10.20.193.91:0/3248146501 <== mon.2 v1:10.20.193.111:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f72500033c0 con 0x7f72540b5b70 2026-02-12T03:58:45.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.683+0000 7f724b7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:45.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.683+0000 7f724b7fe640 1 -- 10.20.193.91:0/3248146501 <== mon.2 v1:10.20.193.111:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f7250003800 con 0x7f72540b5b70 2026-02-12T03:58:45.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.683+0000 7f724b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.683+0000 7f724b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:45.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.683+0000 7f724b7fe640 10 monclient: dump: 2026-02-12T03:58:45.779 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.779 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.779 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.779 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.779 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.779 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.779 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.779 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.779 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.779 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.683+0000 7f725b251640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:45.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.683+0000 7f725b251640 4 set_mon_vals no callback set 2026-02-12T03:58:45.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.684+0000 7f725b251640 10 monclient: shutdown 2026-02-12T03:58:45.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.684+0000 7f725b251640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:45.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.684+0000 7f725b251640 1 -- 10.20.193.91:0/3248146501 >> v1:10.20.193.111:6789/0 conn(0x7f72540b5b70 legacy=0x7f72541633b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.684+0000 7f725b251640 1 -- 10.20.193.91:0/3248146501 shutdown_connections 2026-02-12T03:58:45.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.684+0000 7f725b251640 1 -- 10.20.193.91:0/3248146501 >> 10.20.193.91:0/3248146501 conn(0x7f72540559c0 msgr2=0x7f7254055dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:45.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.684+0000 7f725b251640 1 -- 10.20.193.91:0/3248146501 shutdown_connections 2026-02-12T03:58:45.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.684+0000 7f725b251640 1 -- 10.20.193.91:0/3248146501 wait complete. 2026-02-12T03:58:45.780 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.684+0000 7f07e1ffb640 1 -- 10.20.193.91:0/1007060249 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2934682083 0 0) 0x7f07e40b66a0 con 0x7f07e40b5b70 2026-02-12T03:58:45.780 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.684+0000 7f07e1ffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.780 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.684+0000 7f07e1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.780 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.684+0000 7f07e1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.780 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.684+0000 7f07e1ffb640 10 monclient(hunting): my global_id is 4394 2026-02-12T03:58:45.780 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.684+0000 7f07e1ffb640 1 -- 10.20.193.91:0/1007060249 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07e4163f30 con 0x7f07e40b5b70 2026-02-12T03:58:45.780 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.684+0000 7f725b251640 10 monclient: build_initial_monmap 2026-02-12T03:58:45.780 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.684+0000 7f725b251640 10 monclient: monmap: 2026-02-12T03:58:45.780 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:45.780 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:45.780 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:45.780 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:45.780 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:45.780 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:45.780 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:45.780 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:45.780 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:45.780 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.780 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.684+0000 7f7db9ffb640 1 -- 10.20.193.91:0/4137855695 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2618403028 0 0) 0x7f7dcc137d70 con 0x7f7dcc0b7180 2026-02-12T03:58:45.780 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.684+0000 7f7db9ffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.780 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.684+0000 7f7db9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.780 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.684+0000 7f7db9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.780 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.684+0000 7f7db9ffb640 10 monclient(hunting): my global_id is 4403 2026-02-12T03:58:45.780 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.684+0000 7f7db9ffb640 1 -- 10.20.193.91:0/4137855695 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7dcc1377b0 con 0x7f7dcc0b7180 2026-02-12T03:58:45.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.684+0000 7f725b251640 1 librados: starting msgr at 2026-02-12T03:58:45.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.684+0000 7f725b251640 1 librados: starting objecter 2026-02-12T03:58:45.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.684+0000 7f725b251640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:45.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.684+0000 7f725b251640 1 Processor -- start 2026-02-12T03:58:45.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.684+0000 7f725b251640 1 -- start start 2026-02-12T03:58:45.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.684+0000 7f725b251640 1 librados: setting wanted keys 2026-02-12T03:58:45.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.684+0000 7f725b251640 1 librados: calling monclient init 2026-02-12T03:58:45.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.684+0000 7f725b251640 10 monclient: init 2026-02-12T03:58:45.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.685+0000 7f725b251640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:45.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.685+0000 7f725b251640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T03:58:45.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.685+0000 7f725b251640 10 monclient(hunting): picked mon.noname-b con 0x7f72540b57a0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:45.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.685+0000 7f725b251640 10 monclient(hunting): picked mon.noname-c con 0x7f72540b5b70 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:45.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.685+0000 7f725b251640 10 monclient(hunting): picked mon.noname-a con 0x7f72540b7180 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:45.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.685+0000 7f725b251640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7254122c60 con 0x7f72540b7180 2026-02-12T03:58:45.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.685+0000 7f725b251640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7254162d90 con 0x7f72540b57a0 2026-02-12T03:58:45.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.685+0000 7f725b251640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7254057b90 con 0x7f72540b5b70 2026-02-12T03:58:45.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.685+0000 7f725b251640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:45.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.685+0000 7f725b251640 10 monclient(hunting): authenticate will time out at 1128.428399s 2026-02-12T03:58:45.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.686+0000 7f71f1573640 1 -- 10.20.193.91:0/1943632750 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2798777290 0 0) 0x7f71f40b8fa0 con 0x7f71f4164760 2026-02-12T03:58:45.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.686+0000 7f71f1573640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.686+0000 7f71f1573640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.686+0000 7f71f1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.686+0000 7f71f1573640 10 monclient(hunting): my global_id is 4406 2026-02-12T03:58:45.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.686+0000 7f71f1573640 1 -- 10.20.193.91:0/1943632750 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71f40b8cc0 con 0x7f71f4164760 2026-02-12T03:58:45.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.686+0000 7f47fcb40640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f47f80b5b70 0x7f47f81301c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:37796/0 (socket says 10.20.193.91:37796) 2026-02-12T03:58:45.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.686+0000 7f47fcb40640 1 -- 10.20.193.91:0/4153586687 learned_addr learned my addr 10.20.193.91:0/4153586687 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:45.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.686+0000 7f3e65573640 1 -- 10.20.193.91:0/3388427599 <== mon.2 v1:10.20.193.111:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3e58003340 con 0x7f3e681639c0 2026-02-12T03:58:45.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.686+0000 7f3e65573640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:45.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.686+0000 7f3e65573640 1 -- 10.20.193.91:0/3388427599 <== mon.2 v1:10.20.193.111:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f3e58003780 con 0x7f3e681639c0 2026-02-12T03:58:45.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.686+0000 7f3e65573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.686+0000 7f3e65573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:45.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.686+0000 7f3e65573640 10 monclient: dump: 2026-02-12T03:58:45.782 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.782 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.782 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.782 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.782 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.782 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.782 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.782 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.782 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.782 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.687+0000 7f3e6cda9640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:45.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.687+0000 7f3e6cda9640 4 set_mon_vals no callback set 2026-02-12T03:58:45.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.687+0000 7f3e6cda9640 10 monclient: shutdown 2026-02-12T03:58:45.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.687+0000 7f3e6cda9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:45.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.687+0000 7f3e6cda9640 1 -- 10.20.193.91:0/3388427599 >> v1:10.20.193.111:6789/0 conn(0x7f3e681639c0 legacy=0x7f3e68161b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.687+0000 7f3e6cda9640 1 -- 10.20.193.91:0/3388427599 shutdown_connections 2026-02-12T03:58:45.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.687+0000 7f3e6cda9640 1 -- 10.20.193.91:0/3388427599 >> 10.20.193.91:0/3388427599 conn(0x7f3e680b6560 msgr2=0x7f3e680b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:45.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.687+0000 7f3e6cda9640 1 -- 10.20.193.91:0/3388427599 shutdown_connections 2026-02-12T03:58:45.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.687+0000 7f3e6cda9640 1 -- 10.20.193.91:0/3388427599 wait complete. 2026-02-12T03:58:45.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.687+0000 7f3e6cda9640 10 monclient: build_initial_monmap 2026-02-12T03:58:45.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.687+0000 7f3e6cda9640 10 monclient: monmap: 2026-02-12T03:58:45.782 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:45.782 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:45.782 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:45.782 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:45.782 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:45.782 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:45.782 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:45.782 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:45.782 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:45.782 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.783 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.688+0000 7fd0baffd640 10 client.?.objecter ms_handle_connect 0x7fd0d40b8080 2026-02-12T03:58:45.783 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.688+0000 7fd0baffd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.783 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.688+0000 7f3e6cda9640 1 librados: starting msgr at 2026-02-12T03:58:45.783 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.688+0000 7f3e6cda9640 1 librados: starting objecter 2026-02-12T03:58:45.783 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.688+0000 7f3e6cda9640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:45.783 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.688+0000 7f3e6cda9640 1 Processor -- start 2026-02-12T03:58:45.783 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.688+0000 7f47e5ffb640 10 client.?.objecter ms_handle_connect 0x7f47f80b5b70 2026-02-12T03:58:45.783 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.688+0000 7f47e5ffb640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.783 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.688+0000 7f3e6cda9640 1 -- start start 2026-02-12T03:58:45.783 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.688+0000 7f3e6cda9640 1 librados: setting wanted keys 2026-02-12T03:58:45.783 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.688+0000 7f3e6cda9640 1 librados: calling monclient init 2026-02-12T03:58:45.783 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.688+0000 7f3e6cda9640 10 monclient: init 2026-02-12T03:58:45.783 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.688+0000 7f7938ff9640 10 client.?.objecter ms_handle_connect 0x7f793c15d6c0 2026-02-12T03:58:45.783 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.688+0000 7f7938ff9640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.783 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.688+0000 7f3e6cda9640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:45.783 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.688+0000 7f3e6cda9640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T03:58:45.783 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.688+0000 7f3e6cda9640 10 monclient(hunting): picked mon.noname-a con 0x7f3e680afe70 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:45.784 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.688+0000 7f3e6cda9640 10 monclient(hunting): picked mon.noname-c con 0x7f3e6815f310 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:45.784 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.688+0000 7f7938ff9640 10 client.?.objecter ms_handle_connect 0x7f793c0b8080 2026-02-12T03:58:45.784 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.688+0000 7f7938ff9640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.784 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.689+0000 7f3e6cda9640 10 monclient(hunting): picked mon.noname-b con 0x7f3e681639c0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:45.784 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.689+0000 7f3e6cda9640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e681f8370 con 0x7f3e680afe70 2026-02-12T03:58:45.784 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.689+0000 7f3e6cda9640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e681fad40 con 0x7f3e681639c0 2026-02-12T03:58:45.784 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.689+0000 7f3e6cda9640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e681fb020 con 0x7f3e6815f310 2026-02-12T03:58:45.784 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.689+0000 7f3e6cda9640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:45.784 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.689+0000 7f3e6cda9640 10 monclient(hunting): authenticate will time out at 1128.432115s 2026-02-12T03:58:45.784 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.689+0000 7f47e5ffb640 10 client.?.objecter ms_handle_connect 0x7f47f80b57a0 2026-02-12T03:58:45.784 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.689+0000 7f47e5ffb640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.784 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.689+0000 7fb2b37fe640 1 -- 10.20.193.91:0/1706977470 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fb2b8003170 con 0x7fb2bc0b5b70 2026-02-12T03:58:45.784 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.689+0000 7fb2b37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.784 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.689+0000 7fb2b37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:45.784 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.689+0000 7fb2b37fe640 10 monclient: dump: 2026-02-12T03:58:45.784 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.784 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.784 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.784 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.784 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.784 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.784 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.785 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.785 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.785 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.785 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.689+0000 7fb2c2d13640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:45.785 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.690+0000 7ff72affd640 1 -- 10.20.193.91:0/1969427963 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 155788516 0 0) 0x7ff72c0b31a0 con 0x7ff72c0aba80 2026-02-12T03:58:45.785 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.690+0000 7ff72affd640 1 -- 10.20.193.91:0/1969427963 >> v1:10.20.193.98:6789/0 conn(0x7ff72c0abe50 legacy=0x7ff72c160dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.785 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.690+0000 7ff72affd640 1 -- 10.20.193.91:0/1969427963 >> v1:10.20.193.91:6789/0 conn(0x7ff72c0b3f60 legacy=0x7ff72c058da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.785 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.690+0000 7ff72affd640 10 monclient: _finish_hunting 0 2026-02-12T03:58:45.785 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.690+0000 7ff72affd640 1 monclient: found mon.noname-c 2026-02-12T03:58:45.785 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.690+0000 7ff72affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:45.785 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.690+0000 7ff72affd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.111:6789/0 2026-02-12T03:58:45.785 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.690+0000 7ff72affd640 1 -- 10.20.193.91:0/1969427963 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff72c0b3760 con 0x7ff72c0aba80 2026-02-12T03:58:45.785 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.690+0000 7ff72affd640 10 monclient: _finish_auth 0 2026-02-12T03:58:45.785 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.690+0000 7ff72affd640 10 monclient: _check_auth_tickets 2026-02-12T03:58:45.785 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.690+0000 7ff72affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:45.785 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.690+0000 7ff72affd640 1 -- 10.20.193.91:0/1969427963 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7ff718002df0 con 0x7ff72c0aba80 2026-02-12T03:58:45.785 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.690+0000 7ff72affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.785 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.690+0000 7ff72affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:45.785 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.690+0000 7ff72affd640 10 monclient: dump: 2026-02-12T03:58:45.785 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.785 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.785 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.785 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.785 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.785 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.785 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.785 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.785 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.785 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.785 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.690+0000 7ff73134a640 5 monclient: authenticate success, global_id 4391 2026-02-12T03:58:45.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.690+0000 7ff73134a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:45.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.690+0000 7fbd9affd640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7fbd9c0b57a0 0x7fbd9c129810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:37802/0 (socket says 10.20.193.91:37802) 2026-02-12T03:58:45.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.690+0000 7fbd9affd640 1 -- 10.20.193.91:0/286286997 learned_addr learned my addr 10.20.193.91:0/286286997 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:45.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.690+0000 7f50ae44a640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f50a80b7180 0x7f50a81334d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:37800/0 (socket says 10.20.193.91:37800) 2026-02-12T03:58:45.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.690+0000 7f50ae44a640 1 -- 10.20.193.91:0/1727122728 learned_addr learned my addr 10.20.193.91:0/1727122728 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:45.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.691+0000 7ff212ffd640 1 -- 10.20.193.91:0/861051702 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3169089189 0 0) 0x7ff22c11f9c0 con 0x7ff22c164760 2026-02-12T03:58:45.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.691+0000 7ff212ffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.691+0000 7ff212ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.691+0000 7ff212ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.691+0000 7ff212ffd640 10 monclient(hunting): my global_id is 4447 2026-02-12T03:58:45.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.691+0000 7ff212ffd640 1 -- 10.20.193.91:0/861051702 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1fc003610 con 0x7ff22c164760 2026-02-12T03:58:45.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.691+0000 7f7938ff9640 1 -- 10.20.193.91:0/4216721313 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2437757674 0 0) 0x7f793c0b43b0 con 0x7f793c15d2f0 2026-02-12T03:58:45.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.691+0000 7f7938ff9640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.691+0000 7f7938ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.691+0000 7f7938ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.691+0000 7f7938ff9640 10 monclient(hunting): my global_id is 4458 2026-02-12T03:58:45.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.691+0000 7f7938ff9640 1 -- 10.20.193.91:0/4216721313 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f790c003610 con 0x7f793c15d2f0 2026-02-12T03:58:45.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.691+0000 7f50967fc640 10 client.?.objecter ms_handle_connect 0x7f50a80b7180 2026-02-12T03:58:45.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.691+0000 7f50967fc640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.691+0000 7fbd73fff640 10 client.?.objecter ms_handle_connect 0x7fbd9c0b57a0 2026-02-12T03:58:45.787 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.691+0000 7fbd73fff640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.787 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.692+0000 7f7db9ffb640 1 -- 10.20.193.91:0/4137855695 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 799845058 0 0) 0x7f7d9c003610 con 0x7f7dcc0b57a0 2026-02-12T03:58:45.787 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.692+0000 7f7db9ffb640 1 -- 10.20.193.91:0/4137855695 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7dcc137d70 con 0x7f7dcc0b57a0 2026-02-12T03:58:45.787 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.692+0000 7f7db9ffb640 1 -- 10.20.193.91:0/4137855695 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f7dbc003120 con 0x7f7dcc0b57a0 2026-02-12T03:58:45.787 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.692+0000 7f7db9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:45.787 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.692+0000 7f7db9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:45.787 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.692+0000 7f7db9ffb640 10 monclient(hunting): dump: 2026-02-12T03:58:45.787 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.787 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.787 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.787 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.787 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.787 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.787 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.787 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.787 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.787 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.787 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.692+0000 7f7db9ffb640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:45.787 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.692+0000 7fd0baffd640 1 -- 10.20.193.91:0/2911181674 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3349576795 0 0) 0x7fd0d4165510 con 0x7fd0d415d2f0 2026-02-12T03:58:45.787 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.692+0000 7fd0baffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.787 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.692+0000 7fd0baffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.787 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.692+0000 7fd0baffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.787 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.692+0000 7fd0baffd640 10 monclient(hunting): my global_id is 4455 2026-02-12T03:58:45.787 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.692+0000 7fd0baffd640 1 -- 10.20.193.91:0/2911181674 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0a0003610 con 0x7fd0d415d2f0 2026-02-12T03:58:45.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.692+0000 7f07e1ffb640 1 -- 10.20.193.91:0/1007060249 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1504028633 0 0) 0x7f07d0003610 con 0x7f07e40b7180 2026-02-12T03:58:45.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.692+0000 7f07e1ffb640 1 -- 10.20.193.91:0/1007060249 >> v1:10.20.193.111:6789/0 conn(0x7f07e40b5b70 legacy=0x7f07e41633b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.692+0000 7f07e1ffb640 1 -- 10.20.193.91:0/1007060249 >> v1:10.20.193.91:6789/0 conn(0x7f07e40b57a0 legacy=0x7f07e40b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.692+0000 7f07e1ffb640 10 monclient: _finish_hunting 0 2026-02-12T03:58:45.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.692+0000 7f07e1ffb640 1 monclient: found mon.noname-b 2026-02-12T03:58:45.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.692+0000 7f07e1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:45.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.692+0000 7f07e1ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T03:58:45.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.692+0000 7f07e1ffb640 1 -- 10.20.193.91:0/1007060249 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07e40b6980 con 0x7f07e40b7180 2026-02-12T03:58:45.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.692+0000 7f07e1ffb640 10 monclient: _finish_auth 0 2026-02-12T03:58:45.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.692+0000 7f07e1ffb640 10 monclient: _check_auth_tickets 2026-02-12T03:58:45.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.692+0000 7f07e1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:45.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.692+0000 7f07e1ffb640 1 -- 10.20.193.91:0/1007060249 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f07cc002df0 con 0x7f07e40b7180 2026-02-12T03:58:45.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.692+0000 7f07e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.692+0000 7f07e1ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:45.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.692+0000 7f07e1ffb640 10 monclient: dump: 2026-02-12T03:58:45.788 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.788 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.788 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.788 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.788 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.788 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.788 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.788 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.788 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.788 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.692+0000 7f07e9528640 5 monclient: authenticate success, global_id 4429 2026-02-12T03:58:45.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.692+0000 7f07e9528640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:45.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.692+0000 7ff23affd640 1 -- 10.20.193.91:0/1216685769 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3944807201 0 0) 0x7ff228002910 con 0x7ff23c161ad0 2026-02-12T03:58:45.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.692+0000 7ff23affd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.692+0000 7ff23affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.692+0000 7ff23affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.692+0000 7ff23affd640 10 monclient(hunting): my global_id is 4452 2026-02-12T03:58:45.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.692+0000 7ff23affd640 1 -- 10.20.193.91:0/1216685769 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff23c056b30 con 0x7ff23c161ad0 2026-02-12T03:58:45.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.693+0000 7f50967fc640 10 client.?.objecter ms_handle_connect 0x7f50a80b57a0 2026-02-12T03:58:45.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.693+0000 7f50967fc640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.693+0000 7ff212ffd640 1 -- 10.20.193.91:0/861051702 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2959992925 0 0) 0x7ff22c11fca0 con 0x7ff22c166f70 2026-02-12T03:58:45.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.693+0000 7ff212ffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.693+0000 7ff212ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.693+0000 7ff212ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.693+0000 7ff212ffd640 10 monclient(hunting): my global_id is 4409 2026-02-12T03:58:45.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.693+0000 7ff212ffd640 1 -- 10.20.193.91:0/861051702 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff22c11f9c0 con 0x7ff22c166f70 2026-02-12T03:58:45.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.697+0000 7f71f1573640 1 -- 10.20.193.91:0/1943632750 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3266032432 0 0) 0x7f71e0003610 con 0x7f71f4159b70 2026-02-12T03:58:45.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.697+0000 7f71f1573640 1 -- 10.20.193.91:0/1943632750 >> v1:10.20.193.111:6789/0 conn(0x7f71f4164760 legacy=0x7f71f4056ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.697+0000 7f71f1573640 1 -- 10.20.193.91:0/1943632750 >> v1:10.20.193.91:6789/0 conn(0x7f71f4166f70 legacy=0x7f71f40563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.697+0000 7f71f1573640 10 monclient: _finish_hunting 0 2026-02-12T03:58:45.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.697+0000 7f71f1573640 1 monclient: found mon.noname-b 2026-02-12T03:58:45.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.697+0000 7f71f1573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:45.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.697+0000 7f71f1573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T03:58:45.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.697+0000 7f71f1573640 1 -- 10.20.193.91:0/1943632750 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f40b9280 con 0x7f71f4159b70 2026-02-12T03:58:45.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.697+0000 7f71f1573640 10 monclient: _finish_auth 0 2026-02-12T03:58:45.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.697+0000 7f71f1573640 10 monclient: _check_auth_tickets 2026-02-12T03:58:45.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.697+0000 7f71f1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:45.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.697+0000 7f71f1573640 1 -- 10.20.193.91:0/1943632750 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f71e8002df0 con 0x7f71f4159b70 2026-02-12T03:58:45.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.697+0000 7f71f1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.697+0000 7f71f1573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:45.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.697+0000 7f71f1573640 10 monclient: dump: 2026-02-12T03:58:45.789 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.789 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.789 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.789 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.789 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.790 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.790 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.790 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.790 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.790 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.697+0000 7f71f8bcc640 5 monclient: authenticate success, global_id 4438 2026-02-12T03:58:45.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.697+0000 7f71f8bcc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:45.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.697+0000 7fbd73fff640 10 client.?.objecter ms_handle_connect 0x7fbd9c0b5b70 2026-02-12T03:58:45.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.697+0000 7fbd73fff640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.697+0000 7fd0baffd640 1 -- 10.20.193.91:0/2911181674 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 892981017 0 0) 0x7fd0d415b490 con 0x7fd0d415d6c0 2026-02-12T03:58:45.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.697+0000 7fd0baffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.697+0000 7fd0baffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.697+0000 7fd0baffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.697+0000 7fd0baffd640 10 monclient(hunting): my global_id is 4450 2026-02-12T03:58:45.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.697+0000 7fd0baffd640 1 -- 10.20.193.91:0/2911181674 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0d4165510 con 0x7fd0d415d6c0 2026-02-12T03:58:45.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.697+0000 7f50967fc640 10 client.?.objecter ms_handle_connect 0x7f50a80b5b70 2026-02-12T03:58:45.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.697+0000 7f50967fc640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.697+0000 7f7938ff9640 1 -- 10.20.193.91:0/4216721313 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1278909206 0 0) 0x7f793c13bd30 con 0x7f793c15d6c0 2026-02-12T03:58:45.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.697+0000 7f7938ff9640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.697+0000 7f7938ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.697+0000 7f7938ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.697+0000 7f7938ff9640 10 monclient(hunting): my global_id is 4453 2026-02-12T03:58:45.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.697+0000 7f7938ff9640 1 -- 10.20.193.91:0/4216721313 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f793c0b43b0 con 0x7f793c15d6c0 2026-02-12T03:58:45.791 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.699+0000 7f3e66575640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f3e680afe70 0x7f3e681fa470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:59330/0 (socket says 10.20.193.91:59330) 2026-02-12T03:58:45.791 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.699+0000 7f3e66575640 1 -- 10.20.193.91:0/1309264919 learned_addr learned my addr 10.20.193.91:0/1309264919 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:45.791 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.700+0000 7ff212ffd640 10 client.?.objecter ms_handle_connect 0x7ff22c159b70 2026-02-12T03:58:45.791 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.700+0000 7ff212ffd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.791 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.700+0000 7fd0baffd640 1 -- 10.20.193.91:0/2911181674 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 194882943 0 0) 0x7fd0d413b800 con 0x7fd0d40b8080 2026-02-12T03:58:45.791 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.700+0000 7fd0baffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.791 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.700+0000 7fd0baffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.791 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.700+0000 7fd0baffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.791 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.700+0000 7fd0baffd640 10 monclient(hunting): my global_id is 4412 2026-02-12T03:58:45.791 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.700+0000 7fd0baffd640 1 -- 10.20.193.91:0/2911181674 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0d415b490 con 0x7fd0d40b8080 2026-02-12T03:58:45.791 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7ff23affd640 1 -- 10.20.193.91:0/1216685769 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3112978440 0 0) 0x7ff23c0b6290 con 0x7ff23c0564d0 2026-02-12T03:58:45.791 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7ff23affd640 1 -- 10.20.193.91:0/1216685769 >> v1:10.20.193.98:6789/0 conn(0x7ff23c167e90 legacy=0x7ff23c1ac060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.791 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7ff23affd640 1 -- 10.20.193.91:0/1216685769 >> v1:10.20.193.91:6789/0 conn(0x7ff23c161ad0 legacy=0x7ff23c167780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.791 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7ff23affd640 10 monclient: _finish_hunting 0 2026-02-12T03:58:45.791 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7ff23affd640 1 monclient: found mon.noname-c 2026-02-12T03:58:45.791 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7ff23affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:45.791 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7ff23affd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.111:6789/0 2026-02-12T03:58:45.791 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7ff23affd640 1 -- 10.20.193.91:0/1216685769 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff23c0b6530 con 0x7ff23c0564d0 2026-02-12T03:58:45.791 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7ff23affd640 10 monclient: _finish_auth 0 2026-02-12T03:58:45.791 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7ff23affd640 10 monclient: _check_auth_tickets 2026-02-12T03:58:45.791 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7ff23affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:45.791 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7ff23affd640 1 -- 10.20.193.91:0/1216685769 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7ff230003170 con 0x7ff23c0564d0 2026-02-12T03:58:45.791 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7ff23affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.791 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7f50967fc640 1 -- 10.20.193.91:0/1727122728 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3561098032 0 0) 0x7f50a8161350 con 0x7f50a80b7180 2026-02-12T03:58:45.792 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7ff23affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:45.792 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7ff23affd640 10 monclient: dump: 2026-02-12T03:58:45.792 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.792 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.792 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.792 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.792 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.792 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.792 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.792 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.792 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.792 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.792 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7f50967fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.792 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7f50967fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.792 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7f50967fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.792 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7f50967fc640 10 monclient(hunting): my global_id is 4421 2026-02-12T03:58:45.792 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7f50967fc640 1 -- 10.20.193.91:0/1727122728 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5078003610 con 0x7f50a80b7180 2026-02-12T03:58:45.792 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7ff2425a8640 5 monclient: authenticate success, global_id 4400 2026-02-12T03:58:45.792 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7ff2425a8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:45.792 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7fbd73fff640 10 client.?.objecter ms_handle_connect 0x7fbd9c0b7180 2026-02-12T03:58:45.792 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7fbd73fff640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.792 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7f47e5ffb640 1 -- 10.20.193.91:0/4153586687 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3902662801 0 0) 0x7f47f811bab0 con 0x7f47f80b57a0 2026-02-12T03:58:45.792 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7f47e5ffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.792 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7f47e5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7f47e5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7f47e5ffb640 10 monclient(hunting): my global_id is 4456 2026-02-12T03:58:45.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7f47e5ffb640 1 -- 10.20.193.91:0/4153586687 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47c8003610 con 0x7f47f80b57a0 2026-02-12T03:58:45.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7f47e5ffb640 1 -- 10.20.193.91:0/4153586687 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3211987930 0 0) 0x7f47f811bd90 con 0x7f47f80b5b70 2026-02-12T03:58:45.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7f47e5ffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7f47e5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7f47e5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7f47e5ffb640 10 monclient(hunting): my global_id is 4415 2026-02-12T03:58:45.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7f47e5ffb640 1 -- 10.20.193.91:0/4153586687 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47f811bab0 con 0x7f47f80b5b70 2026-02-12T03:58:45.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7ff72affd640 1 -- 10.20.193.91:0/1969427963 <== mon.2 v1:10.20.193.111:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff718003000 con 0x7ff72c0aba80 2026-02-12T03:58:45.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7ff72affd640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:45.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7ff72affd640 1 -- 10.20.193.91:0/1969427963 <== mon.2 v1:10.20.193.111:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7ff718003440 con 0x7ff72c0aba80 2026-02-12T03:58:45.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7f724bfff640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f72540b5b70 0x7f7254057480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:37814/0 (socket says 10.20.193.91:37814) 2026-02-12T03:58:45.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7ff72affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7ff72affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:45.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7ff72affd640 10 monclient: dump: 2026-02-12T03:58:45.793 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.793 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.793 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.793 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.793 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.793 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.793 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.793 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.793 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.793 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7f724bfff640 1 -- 10.20.193.91:0/1817416077 learned_addr learned my addr 10.20.193.91:0/1817416077 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:45.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7ff73134a640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:45.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.701+0000 7ff73134a640 4 set_mon_vals no callback set 2026-02-12T03:58:45.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.702+0000 7f7938ff9640 1 -- 10.20.193.91:0/4216721313 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3842999134 0 0) 0x7f793c13c010 con 0x7f793c0b8080 2026-02-12T03:58:45.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.702+0000 7f7938ff9640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.702+0000 7f7938ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.702+0000 7f7938ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.702+0000 7f7938ff9640 10 monclient(hunting): my global_id is 4418 2026-02-12T03:58:45.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.702+0000 7f7938ff9640 1 -- 10.20.193.91:0/4216721313 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f793c13bd30 con 0x7f793c0b8080 2026-02-12T03:58:45.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.702+0000 7fbd73fff640 1 -- 10.20.193.91:0/286286997 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2778201266 0 0) 0x7fbd9c12a430 con 0x7fbd9c0b57a0 2026-02-12T03:58:45.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.702+0000 7fbd73fff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.702+0000 7fbd73fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.702+0000 7fbd73fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.702+0000 7fbd73fff640 10 monclient(hunting): my global_id is 4424 2026-02-12T03:58:45.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.702+0000 7fbd73fff640 1 -- 10.20.193.91:0/286286997 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd6c003610 con 0x7fbd9c0b57a0 2026-02-12T03:58:45.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.702+0000 7ff212ffd640 1 -- 10.20.193.91:0/861051702 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 808491485 0 0) 0x7ff22c11f9c0 con 0x7ff22c166f70 2026-02-12T03:58:45.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.702+0000 7ff212ffd640 1 -- 10.20.193.91:0/861051702 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff22c11fca0 con 0x7ff22c166f70 2026-02-12T03:58:45.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.702+0000 7ff212ffd640 1 -- 10.20.193.91:0/861051702 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7ff2280036d0 con 0x7ff22c166f70 2026-02-12T03:58:45.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.702+0000 7ff212ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:45.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.702+0000 7ff212ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:45.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.702+0000 7ff212ffd640 10 monclient(hunting): dump: 2026-02-12T03:58:45.794 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.794 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.794 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.794 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.794 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.794 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.794 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.794 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.794 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.795 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.702+0000 7ff212ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:45.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.702+0000 7f72497fa640 10 client.?.objecter ms_handle_connect 0x7f72540b5b70 2026-02-12T03:58:45.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.702+0000 7f72497fa640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.702+0000 7ff73134a640 10 monclient: shutdown 2026-02-12T03:58:45.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.702+0000 7ff73134a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:45.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.702+0000 7ff73134a640 1 -- 10.20.193.91:0/1969427963 >> v1:10.20.193.111:6789/0 conn(0x7ff72c0aba80 legacy=0x7ff72c05b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.702+0000 7ff73134a640 1 -- 10.20.193.91:0/1969427963 shutdown_connections 2026-02-12T03:58:45.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.702+0000 7ff73134a640 1 -- 10.20.193.91:0/1969427963 >> 10.20.193.91:0/1969427963 conn(0x7ff72c0b8780 msgr2=0x7ff72c0b8b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:45.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.702+0000 7ff73134a640 1 -- 10.20.193.91:0/1969427963 shutdown_connections 2026-02-12T03:58:45.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.702+0000 7ff73134a640 1 -- 10.20.193.91:0/1969427963 wait complete. 2026-02-12T03:58:45.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.703+0000 7ff73134a640 10 monclient: build_initial_monmap 2026-02-12T03:58:45.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.703+0000 7ff73134a640 10 monclient: monmap: 2026-02-12T03:58:45.796 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:45.796 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:45.796 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:45.796 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:45.796 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:45.796 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:45.796 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:45.796 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:45.796 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:45.796 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.703+0000 7ff73134a640 1 librados: starting msgr at 2026-02-12T03:58:45.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.703+0000 7ff73134a640 1 librados: starting objecter 2026-02-12T03:58:45.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.703+0000 7ff73134a640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:45.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.703+0000 7ff73134a640 1 Processor -- start 2026-02-12T03:58:45.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.703+0000 7ff73134a640 1 -- start start 2026-02-12T03:58:45.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.703+0000 7ff73134a640 1 librados: setting wanted keys 2026-02-12T03:58:45.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.703+0000 7ff73134a640 1 librados: calling monclient init 2026-02-12T03:58:45.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.703+0000 7ff73134a640 10 monclient: init 2026-02-12T03:58:45.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.703+0000 7ff73134a640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:45.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.703+0000 7ff73134a640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T03:58:45.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.703+0000 7ff73134a640 10 monclient(hunting): picked mon.noname-a con 0x7ff72c0aba80 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:45.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.703+0000 7ff73134a640 10 monclient(hunting): picked mon.noname-b con 0x7ff72c0abe50 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:45.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.703+0000 7ff73134a640 10 monclient(hunting): picked mon.noname-c con 0x7ff72c0b3f60 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:45.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.703+0000 7ff73134a640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff72c11ba80 con 0x7ff72c0aba80 2026-02-12T03:58:45.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.703+0000 7ff73134a640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff72c13aa00 con 0x7ff72c0abe50 2026-02-12T03:58:45.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.703+0000 7ff73134a640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff72c13ace0 con 0x7ff72c0b3f60 2026-02-12T03:58:45.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.703+0000 7ff73134a640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:45.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.703+0000 7ff73134a640 10 monclient(hunting): authenticate will time out at 1128.446847s 2026-02-12T03:58:45.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.703+0000 7ff212ffd640 1 -- 10.20.193.91:0/861051702 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 969317529 0 0) 0x7ff1fc003610 con 0x7ff22c164760 2026-02-12T03:58:45.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.703+0000 7ff212ffd640 1 -- 10.20.193.91:0/861051702 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff22c11f9c0 con 0x7ff22c164760 2026-02-12T03:58:45.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.703+0000 7ff212ffd640 1 -- 10.20.193.91:0/861051702 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7ff220003170 con 0x7ff22c164760 2026-02-12T03:58:45.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.703+0000 7ff212ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:45.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.703+0000 7ff212ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:45.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.703+0000 7ff212ffd640 10 monclient(hunting): dump: 2026-02-12T03:58:45.796 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.796 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.796 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.797 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.797 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.797 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.797 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.797 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.797 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.797 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.797 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.703+0000 7f3e4effd640 10 client.?.objecter ms_handle_connect 0x7f3e681639c0 2026-02-12T03:58:45.797 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.703+0000 7f3e4effd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.797 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.705+0000 7fab13fff640 1 -- 10.20.193.91:0/1484103208 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fab380b20d0 con 0x7fab380b7180 2026-02-12T03:58:45.797 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.705+0000 7fab13fff640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:45.797 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.705+0000 7fab13fff640 1 -- 10.20.193.91:0/1484103208 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fab2c004c50 con 0x7fab380b7180 2026-02-12T03:58:45.797 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.705+0000 7fab13fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.797 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.705+0000 7fab13fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:45.797 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.705+0000 7fab13fff640 10 monclient: dump: 2026-02-12T03:58:45.797 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.797 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.797 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.797 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.797 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.797 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.797 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.797 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.797 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.797 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.797 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.705+0000 7fab35ffb640 4 set_mon_vals no callback set 2026-02-12T03:58:45.797 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.705+0000 7f3e4effd640 10 client.?.objecter ms_handle_connect 0x7f3e6815f310 2026-02-12T03:58:45.797 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.705+0000 7f3e4effd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.798 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.706+0000 7fab13fff640 1 -- 10.20.193.91:0/1484103208 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7fab2c01e130 con 0x7fab380b7180 2026-02-12T03:58:45.798 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.706+0000 7fab377fe640 10 monclient: get_auth_request con 0x7fab08079fc0 auth_method 0 2026-02-12T03:58:45.798 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.706+0000 7fab13fff640 10 client.4416.objecter ms_handle_connect 0x7fab08079fc0 2026-02-12T03:58:45.798 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.706+0000 7f72497fa640 10 client.?.objecter ms_handle_connect 0x7f72540b57a0 2026-02-12T03:58:45.798 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.706+0000 7f72497fa640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.798 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.708+0000 7fab13fff640 1 -- 10.20.193.91:0/1484103208 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7fab2c095c30 con 0x7fab380b7180 2026-02-12T03:58:45.798 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.708+0000 7fab13fff640 10 client.4416.objecter ms_dispatch2 0x7fab38000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:45.798 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.708+0000 7fab13fff640 3 client.4416.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:45.798 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.708+0000 7fab13fff640 3 client.4416.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:45.798 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.708+0000 7fab13fff640 10 client.4416.objecter checking command 1 2026-02-12T03:58:45.798 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.708+0000 7fab13fff640 20 client.4416.objecter _get_session s=0x7fab080a2e20 osd=1 3 2026-02-12T03:58:45.798 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.708+0000 7fab13fff640 20 client.4416.objecter put_session s=0x7fab080a2e20 osd=1 3 2026-02-12T03:58:45.798 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.708+0000 7fab13fff640 15 client.4416.objecter _session_command_op_remove -1 1 2026-02-12T03:58:45.798 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.708+0000 7fab13fff640 20 client.4416.objecter _get_session s=0x7fab080a2e20 osd=1 3 2026-02-12T03:58:45.798 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.708+0000 7fab13fff640 20 client.4416.objecter get_session s=0x7fab080a2e20 osd=1 3 2026-02-12T03:58:45.798 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.708+0000 7fab13fff640 15 client.4416.objecter _session_command_op_assign 1 1 2026-02-12T03:58:45.798 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.708+0000 7fab13fff640 20 client.4416.objecter put_session s=0x7fab080a2e20 osd=1 4 2026-02-12T03:58:45.798 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.708+0000 7fab13fff640 10 client.4416.objecter _send_command 1 2026-02-12T03:58:45.798 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.708+0000 7fab13fff640 1 -- 10.20.193.91:0/1484103208 --> v1:10.20.193.98:6812/2011281833 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fab080c5170 con 0x7fab080a34d0 2026-02-12T03:58:45.798 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.708+0000 7fab13fff640 20 client.4416.objecter dump_active .. 0 homeless 2026-02-12T03:58:45.798 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.708+0000 7fab13fff640 1 -- 10.20.193.91:0/1484103208 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7fab2c05ec60 con 0x7fab380b7180 2026-02-12T03:58:45.798 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.708+0000 7fab13fff640 10 monclient: handle_get_version_reply finishing 1 version 28 2026-02-12T03:58:45.798 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.709+0000 7f3e4effd640 10 client.?.objecter ms_handle_connect 0x7f3e680afe70 2026-02-12T03:58:45.798 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.709+0000 7f3e4effd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.799 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.709+0000 7fab36ffd640 10 monclient: get_auth_request con 0x7fab080a34d0 auth_method 0 2026-02-12T03:58:45.799 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.709+0000 7f7db9ffb640 1 -- 10.20.193.91:0/4137855695 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 748987106 0 0) 0x7f7dcc1377b0 con 0x7f7dcc0b7180 2026-02-12T03:58:45.799 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.709+0000 7f7db9ffb640 1 -- 10.20.193.91:0/4137855695 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7d9c003610 con 0x7f7dcc0b7180 2026-02-12T03:58:45.799 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.709+0000 7f7db9ffb640 1 -- 10.20.193.91:0/4137855695 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f7dc8003310 con 0x7f7dcc0b7180 2026-02-12T03:58:45.799 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.709+0000 7f7db9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:45.799 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.709+0000 7f7db9ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:45.799 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.709+0000 7f7db9ffb640 10 monclient(hunting): dump: 2026-02-12T03:58:45.799 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.799 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.799 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.799 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.799 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.799 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.799 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.799 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.799 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.799 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.799 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.709+0000 7f1b627fc640 1 -- 10.20.193.91:0/2629347674 <== mon.0 v1:10.20.193.91:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1b50003030 con 0x7f1b64161c10 2026-02-12T03:58:45.799 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.709+0000 7f1b627fc640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:45.799 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.709+0000 7f1b627fc640 1 -- 10.20.193.91:0/2629347674 <== mon.0 v1:10.20.193.91:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f1b50003470 con 0x7f1b64161c10 2026-02-12T03:58:45.799 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.709+0000 7f1b627fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.799 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.709+0000 7f1b627fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:45.799 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.709+0000 7f1b627fc640 10 monclient: dump: 2026-02-12T03:58:45.799 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.799 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.799 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.799 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.799 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.800 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.800 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.800 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.800 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.800 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.800 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.709+0000 7f1b69b1c640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:45.800 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.709+0000 7f1b69b1c640 4 set_mon_vals no callback set 2026-02-12T03:58:45.800 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f1b69b1c640 10 monclient: shutdown 2026-02-12T03:58:45.800 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f1b69b1c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:45.800 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f1b69b1c640 1 -- 10.20.193.91:0/2629347674 >> v1:10.20.193.91:6789/0 conn(0x7f1b64161c10 legacy=0x7f1b640b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.800 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f7db9ffb640 1 -- 10.20.193.91:0/4137855695 <== mon.1 v1:10.20.193.98:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 162369354 0 0) 0x7f7dcc137d70 con 0x7f7dcc0b57a0 2026-02-12T03:58:45.800 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f7db9ffb640 1 -- 10.20.193.91:0/4137855695 >> v1:10.20.193.111:6789/0 conn(0x7f7dcc0b7180 legacy=0x7f7dcc136230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.800 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f1b69b1c640 1 -- 10.20.193.91:0/2629347674 shutdown_connections 2026-02-12T03:58:45.800 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f1b69b1c640 1 -- 10.20.193.91:0/2629347674 >> 10.20.193.91:0/2629347674 conn(0x7f1b640b5380 msgr2=0x7f1b640b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:45.800 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f7db9ffb640 1 -- 10.20.193.91:0/4137855695 >> v1:10.20.193.91:6789/0 conn(0x7f7dcc0b5b70 legacy=0x7f7dcc133f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.800 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f7db9ffb640 10 monclient: _finish_hunting 0 2026-02-12T03:58:45.800 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f7db9ffb640 1 monclient: found mon.b 2026-02-12T03:58:45.800 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f1b69b1c640 1 -- 10.20.193.91:0/2629347674 shutdown_connections 2026-02-12T03:58:45.800 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f7db9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:45.800 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f7db9ffb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:45.800 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f7db9ffb640 1 -- 10.20.193.91:0/4137855695 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dcc138050 con 0x7f7dcc0b57a0 2026-02-12T03:58:45.800 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f07e1ffb640 1 -- 10.20.193.91:0/1007060249 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f07cc003040 con 0x7f07e40b7180 2026-02-12T03:58:45.801 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f07e1ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:45.801 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f1b69b1c640 1 -- 10.20.193.91:0/2629347674 wait complete. 2026-02-12T03:58:45.801 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f07e1ffb640 1 -- 10.20.193.91:0/1007060249 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f07cc003480 con 0x7f07e40b7180 2026-02-12T03:58:45.801 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f07e9528640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:45.801 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f07e9528640 4 set_mon_vals no callback set 2026-02-12T03:58:45.801 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f07e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.801 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f07e1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:45.801 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f7db9ffb640 10 monclient: _finish_auth 0 2026-02-12T03:58:45.801 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f7db9ffb640 10 monclient: _check_auth_tickets 2026-02-12T03:58:45.801 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f7db9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:45.801 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f7dd3802640 5 monclient: authenticate success, global_id 4432 2026-02-12T03:58:45.801 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f7dd3802640 10 monclient: _renew_subs 2026-02-12T03:58:45.801 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f7dd3802640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:45.801 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f7dd3802640 1 -- 10.20.193.91:0/4137855695 --> v1:10.20.193.98:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7dcc136940 con 0x7f7dcc0b57a0 2026-02-12T03:58:45.801 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f07e1ffb640 10 monclient: dump: 2026-02-12T03:58:45.801 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.801 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.801 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.801 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.801 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.801 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.801 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.801 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.801 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.801 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f7dd3802640 10 client.4432.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:45.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f7dd3802640 10 monclient: _renew_subs 2026-02-12T03:58:45.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f7dd3802640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:45.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f7dd3802640 1 -- 10.20.193.91:0/4137855695 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7dcc11f760 con 0x7f7dcc0b57a0 2026-02-12T03:58:45.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f7dd3802640 1 librados: init done 2026-02-12T03:58:45.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7fab13fff640 10 client.4416.objecter ms_handle_connect 0x7fab080a34d0 2026-02-12T03:58:45.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f72497fa640 10 client.?.objecter ms_handle_connect 0x7f72540b7180 2026-02-12T03:58:45.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f72497fa640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f07e9528640 10 monclient: shutdown 2026-02-12T03:58:45.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f07e9528640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:45.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f07e9528640 1 -- 10.20.193.91:0/1007060249 >> v1:10.20.193.98:6789/0 conn(0x7f07e40b7180 legacy=0x7f07e40565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f1b69b1c640 10 monclient: build_initial_monmap 2026-02-12T03:58:45.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f1b69b1c640 10 monclient: monmap: 2026-02-12T03:58:45.802 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:45.802 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:45.802 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:45.802 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:45.802 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:45.802 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:45.802 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:45.802 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:45.802 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:45.802 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f07e9528640 1 -- 10.20.193.91:0/1007060249 shutdown_connections 2026-02-12T03:58:45.803 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f07e9528640 1 -- 10.20.193.91:0/1007060249 >> 10.20.193.91:0/1007060249 conn(0x7f07e40559c0 msgr2=0x7f07e4055dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:45.803 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f7dd3802640 10 client.4432.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:45.803 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f7dd3802640 15 client.4432.objecter _session_command_op_assign -1 1 2026-02-12T03:58:45.803 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f7dd3802640 20 client.4432.objecter _get_session osd=-1 returning homeless 2026-02-12T03:58:45.803 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f07e9528640 1 -- 10.20.193.91:0/1007060249 shutdown_connections 2026-02-12T03:58:45.803 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f7dd3802640 10 client.4432.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:45.803 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f7dd3802640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:45.803 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f7dd3802640 1 -- 10.20.193.91:0/4137855695 --> v1:10.20.193.98:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f7dcc138220 con 0x7f7dcc0b57a0 2026-02-12T03:58:45.803 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.710+0000 7f07e9528640 1 -- 10.20.193.91:0/1007060249 wait complete. 2026-02-12T03:58:45.803 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f1b69b1c640 1 librados: starting msgr at 2026-02-12T03:58:45.803 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f1b69b1c640 1 librados: starting objecter 2026-02-12T03:58:45.803 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f1b69b1c640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:45.803 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f1b69b1c640 1 Processor -- start 2026-02-12T03:58:45.803 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f71f1573640 1 -- 10.20.193.91:0/1943632750 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f71e8003000 con 0x7f71f4159b70 2026-02-12T03:58:45.803 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f71f1573640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:45.803 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f71f1573640 1 -- 10.20.193.91:0/1943632750 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f71e8003440 con 0x7f71f4159b70 2026-02-12T03:58:45.803 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f71f1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.803 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f71f1573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:45.803 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f71f1573640 10 monclient: dump: 2026-02-12T03:58:45.803 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.804 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.804 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.804 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.804 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.804 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.804 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.804 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.804 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.804 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.804 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f71f8bcc640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:45.804 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f71f8bcc640 4 set_mon_vals no callback set 2026-02-12T03:58:45.804 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f1b69b1c640 1 -- start start 2026-02-12T03:58:45.804 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f1b69b1c640 1 librados: setting wanted keys 2026-02-12T03:58:45.804 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f1b69b1c640 1 librados: calling monclient init 2026-02-12T03:58:45.804 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f1b69b1c640 10 monclient: init 2026-02-12T03:58:45.804 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f07e9528640 10 monclient: build_initial_monmap 2026-02-12T03:58:45.804 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f07e9528640 10 monclient: monmap: 2026-02-12T03:58:45.804 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:45.804 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:45.804 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:45.804 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:45.804 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:45.804 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:45.804 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:45.804 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:45.804 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:45.804 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.804 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f1b69b1c640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:45.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f1b69b1c640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T03:58:45.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f1b69b1c640 10 monclient(hunting): picked mon.noname-b con 0x7f1b6405a7c0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:45.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f1b69b1c640 10 monclient(hunting): picked mon.noname-c con 0x7f1b640b5e90 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:45.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f1b69b1c640 10 monclient(hunting): picked mon.noname-a con 0x7f1b64161c10 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:45.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f1b69b1c640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b64164fb0 con 0x7f1b64161c10 2026-02-12T03:58:45.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f1b69b1c640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b640b1bc0 con 0x7f1b6405a7c0 2026-02-12T03:58:45.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f1b69b1c640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b640b1ea0 con 0x7f1b640b5e90 2026-02-12T03:58:45.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f1b69b1c640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:45.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f1b69b1c640 10 monclient(hunting): authenticate will time out at 1128.454583s 2026-02-12T03:58:45.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f07e9528640 1 librados: starting msgr at 2026-02-12T03:58:45.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f07e9528640 1 librados: starting objecter 2026-02-12T03:58:45.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f07e9528640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:45.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f07e9528640 1 Processor -- start 2026-02-12T03:58:45.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f71f8bcc640 10 monclient: shutdown 2026-02-12T03:58:45.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f71f8bcc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:45.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f71f8bcc640 1 -- 10.20.193.91:0/1943632750 >> v1:10.20.193.98:6789/0 conn(0x7f71f4159b70 legacy=0x7f71f4166860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7fd0baffd640 1 -- 10.20.193.91:0/2911181674 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2768842433 0 0) 0x7fd0d4165510 con 0x7fd0d415d6c0 2026-02-12T03:58:45.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7fd0baffd640 1 -- 10.20.193.91:0/2911181674 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd0d413b800 con 0x7fd0d415d6c0 2026-02-12T03:58:45.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7fd0baffd640 1 -- 10.20.193.91:0/2911181674 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd0c40036d0 con 0x7fd0d415d6c0 2026-02-12T03:58:45.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7fd0baffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:45.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7fd0baffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:45.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7fd0baffd640 10 monclient(hunting): dump: 2026-02-12T03:58:45.805 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.805 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.805 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.805 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.805 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.805 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.805 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.806 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.806 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.806 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7fd0baffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:45.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f71f8bcc640 1 -- 10.20.193.91:0/1943632750 shutdown_connections 2026-02-12T03:58:45.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f71f8bcc640 1 -- 10.20.193.91:0/1943632750 >> 10.20.193.91:0/1943632750 conn(0x7f71f40bab20 msgr2=0x7f71f40baf20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:45.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f71f8bcc640 1 -- 10.20.193.91:0/1943632750 shutdown_connections 2026-02-12T03:58:45.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f07e9528640 1 -- start start 2026-02-12T03:58:45.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f07e9528640 1 librados: setting wanted keys 2026-02-12T03:58:45.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f07e9528640 1 librados: calling monclient init 2026-02-12T03:58:45.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f71f8bcc640 1 -- 10.20.193.91:0/1943632750 wait complete. 2026-02-12T03:58:45.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.711+0000 7f07e9528640 10 monclient: init 2026-02-12T03:58:45.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f07e9528640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:45.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f07e9528640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T03:58:45.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f7938ff9640 1 -- 10.20.193.91:0/4216721313 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1256510795 0 0) 0x7f793c0b43b0 con 0x7f793c15d6c0 2026-02-12T03:58:45.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f7938ff9640 1 -- 10.20.193.91:0/4216721313 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f793c13c010 con 0x7f793c15d6c0 2026-02-12T03:58:45.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f07e9528640 10 monclient(hunting): picked mon.noname-a con 0x7f07e40b57a0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:45.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f07e9528640 10 monclient(hunting): picked mon.noname-b con 0x7f07e40b5b70 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:45.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f07e9528640 10 monclient(hunting): picked mon.noname-c con 0x7f07e40b7180 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:45.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f07e9528640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07e4153060 con 0x7f07e40b57a0 2026-02-12T03:58:45.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f07e9528640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07e4152200 con 0x7f07e40b5b70 2026-02-12T03:58:45.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f07e9528640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07e41524e0 con 0x7f07e40b7180 2026-02-12T03:58:45.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f07e9528640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:45.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f07e9528640 10 monclient(hunting): authenticate will time out at 1128.455148s 2026-02-12T03:58:45.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f7938ff9640 1 -- 10.20.193.91:0/4216721313 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f79300034f0 con 0x7f793c15d6c0 2026-02-12T03:58:45.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f7938ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:45.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f7938ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:45.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f7938ff9640 10 monclient(hunting): dump: 2026-02-12T03:58:45.807 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.807 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.807 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.807 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.807 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.807 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.807 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.807 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.807 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.807 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f7938ff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:45.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f71f8bcc640 10 monclient: build_initial_monmap 2026-02-12T03:58:45.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f71f8bcc640 10 monclient: monmap: 2026-02-12T03:58:45.807 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:45.807 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:45.807 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:45.807 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:45.807 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:45.807 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:45.807 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:45.807 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:45.807 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:45.807 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f47e5ffb640 10 client.?.objecter ms_handle_connect 0x7f47f80b7180 2026-02-12T03:58:45.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f47e5ffb640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f50967fc640 1 -- 10.20.193.91:0/1727122728 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2759624775 0 0) 0x7f50a8131d70 con 0x7f50a80b5b70 2026-02-12T03:58:45.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f50967fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f50967fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f50967fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f50967fc640 10 monclient(hunting): my global_id is 4459 2026-02-12T03:58:45.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f50967fc640 1 -- 10.20.193.91:0/1727122728 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50a8161350 con 0x7f50a80b5b70 2026-02-12T03:58:45.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f71f8bcc640 1 librados: starting msgr at 2026-02-12T03:58:45.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f71f8bcc640 1 librados: starting objecter 2026-02-12T03:58:45.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f71f8bcc640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:45.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f71f8bcc640 1 Processor -- start 2026-02-12T03:58:45.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f71f8bcc640 1 -- start start 2026-02-12T03:58:45.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f71f8bcc640 1 librados: setting wanted keys 2026-02-12T03:58:45.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f71f8bcc640 1 librados: calling monclient init 2026-02-12T03:58:45.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f71f8bcc640 10 monclient: init 2026-02-12T03:58:45.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7fd0baffd640 1 -- 10.20.193.91:0/2911181674 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 652214066 0 0) 0x7fd0d415b490 con 0x7fd0d40b8080 2026-02-12T03:58:45.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7fd0baffd640 1 -- 10.20.193.91:0/2911181674 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd0d4165510 con 0x7fd0d40b8080 2026-02-12T03:58:45.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7fd0baffd640 1 -- 10.20.193.91:0/2911181674 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd0c8003010 con 0x7fd0d40b8080 2026-02-12T03:58:45.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7fd0baffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:45.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7fd0baffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:45.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7fd0baffd640 10 monclient(hunting): dump: 2026-02-12T03:58:45.808 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.809 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.809 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.809 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.809 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.809 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.809 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.809 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.809 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.809 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f71f8bcc640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:45.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f71f8bcc640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T03:58:45.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f71f8bcc640 10 monclient(hunting): picked mon.noname-c con 0x7f71f4159b70 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:45.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f71f8bcc640 10 monclient(hunting): picked mon.noname-a con 0x7f71f4164760 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:45.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f71f8bcc640 10 monclient(hunting): picked mon.noname-b con 0x7f71f4166f70 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:45.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f71f8bcc640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71f415e890 con 0x7f71f4164760 2026-02-12T03:58:45.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f71f8bcc640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71f415eb70 con 0x7f71f4166f70 2026-02-12T03:58:45.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f71f8bcc640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71f415ee50 con 0x7f71f4159b70 2026-02-12T03:58:45.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f71f8bcc640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:45.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.712+0000 7f71f8bcc640 10 monclient(hunting): authenticate will time out at 1128.455980s 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.713+0000 7fb2b37fe640 1 -- 10.20.193.91:0/1706977470 <== mon.0 v1:10.20.193.91:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb2b80033c0 con 0x7fb2bc0b5b70 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.713+0000 7fb2b37fe640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.713+0000 7fb2b37fe640 1 -- 10.20.193.91:0/1706977470 <== mon.0 v1:10.20.193.91:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fb2b80037c0 con 0x7fb2bc0b5b70 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.713+0000 7fb2b37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.713+0000 7fb2b37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.713+0000 7fb2b37fe640 10 monclient: dump: 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.713+0000 7fb2c2d13640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.713+0000 7fb2c2d13640 4 set_mon_vals no callback set 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.713+0000 7fb2c2d13640 10 monclient: shutdown 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.713+0000 7fb2c2d13640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.713+0000 7fb2c2d13640 1 -- 10.20.193.91:0/1706977470 >> v1:10.20.193.91:6789/0 conn(0x7fb2bc0b5b70 legacy=0x7fb2bc1633b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.713+0000 7fb2c2d13640 1 -- 10.20.193.91:0/1706977470 shutdown_connections 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.713+0000 7fb2c2d13640 1 -- 10.20.193.91:0/1706977470 >> 10.20.193.91:0/1706977470 conn(0x7fb2bc0559c0 msgr2=0x7fb2bc055dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.713+0000 7fb2c2d13640 1 -- 10.20.193.91:0/1706977470 shutdown_connections 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.713+0000 7fb2c2d13640 1 -- 10.20.193.91:0/1706977470 wait complete. 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.714+0000 7fb2c2d13640 10 monclient: build_initial_monmap 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.714+0000 7fb2c2d13640 10 monclient: monmap: 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.714+0000 7fb2c2d13640 1 librados: starting msgr at 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.714+0000 7fb2c2d13640 1 librados: starting objecter 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.714+0000 7fb2c2d13640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:45.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.714+0000 7ff23affd640 1 -- 10.20.193.91:0/1216685769 <== mon.2 v1:10.20.193.111:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff230003340 con 0x7ff23c0564d0 2026-02-12T03:58:45.811 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.714+0000 7ff23affd640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:45.811 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.714+0000 7ff23affd640 1 -- 10.20.193.91:0/1216685769 <== mon.2 v1:10.20.193.111:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7ff230003780 con 0x7ff23c0564d0 2026-02-12T03:58:45.811 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.714+0000 7ff23affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.811 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.714+0000 7fb2c2d13640 1 Processor -- start 2026-02-12T03:58:45.811 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.714+0000 7ff23affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:45.811 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.714+0000 7ff23affd640 10 monclient: dump: 2026-02-12T03:58:45.811 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.811 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.811 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.811 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.811 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.811 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.811 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.811 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.811 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.811 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.811 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.714+0000 7ff2425a8640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:45.811 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.714+0000 7ff2425a8640 4 set_mon_vals no callback set 2026-02-12T03:58:45.811 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.714+0000 7fb2c2d13640 1 -- start start 2026-02-12T03:58:45.811 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.714+0000 7fb2c2d13640 1 librados: setting wanted keys 2026-02-12T03:58:45.811 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.714+0000 7fb2c2d13640 1 librados: calling monclient init 2026-02-12T03:58:45.811 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.714+0000 7fb2c2d13640 10 monclient: init 2026-02-12T03:58:45.811 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.714+0000 7f50967fc640 1 -- 10.20.193.91:0/1727122728 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1979982118 0 0) 0x7f5078003610 con 0x7f50a80b7180 2026-02-12T03:58:45.811 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.714+0000 7f50967fc640 1 -- 10.20.193.91:0/1727122728 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f50a8131d70 con 0x7f50a80b7180 2026-02-12T03:58:45.811 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.714+0000 7f50967fc640 1 -- 10.20.193.91:0/1727122728 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f50a4003490 con 0x7f50a80b7180 2026-02-12T03:58:45.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.714+0000 7f50967fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:45.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.714+0000 7f50967fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:45.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.714+0000 7f50967fc640 10 monclient(hunting): dump: 2026-02-12T03:58:45.812 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.812 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.812 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.812 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.812 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.812 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.812 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.812 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.812 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.812 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.714+0000 7f50967fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:45.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.715+0000 7ff2425a8640 10 monclient: shutdown 2026-02-12T03:58:45.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.715+0000 7ff2425a8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:45.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.715+0000 7fb2c2d13640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:45.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.715+0000 7fb2c2d13640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T03:58:45.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.715+0000 7fb2c2d13640 10 monclient(hunting): picked mon.noname-b con 0x7fb2bc0b57a0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:45.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.715+0000 7fb2c2d13640 10 monclient(hunting): picked mon.noname-c con 0x7fb2bc0b5b70 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:45.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.715+0000 7ff2425a8640 1 -- 10.20.193.91:0/1216685769 >> v1:10.20.193.111:6789/0 conn(0x7ff23c0564d0 legacy=0x7ff23c1cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.715+0000 7ff2425a8640 1 -- 10.20.193.91:0/1216685769 shutdown_connections 2026-02-12T03:58:45.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.715+0000 7ff2425a8640 1 -- 10.20.193.91:0/1216685769 >> 10.20.193.91:0/1216685769 conn(0x7ff23c0559c0 msgr2=0x7ff23c055dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:45.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.715+0000 7ff2425a8640 1 -- 10.20.193.91:0/1216685769 shutdown_connections 2026-02-12T03:58:45.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.715+0000 7ff2425a8640 1 -- 10.20.193.91:0/1216685769 wait complete. 2026-02-12T03:58:45.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.715+0000 7fb2c2d13640 10 monclient(hunting): picked mon.noname-a con 0x7fb2bc0b7180 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:45.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.715+0000 7fb2c2d13640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2bc15deb0 con 0x7fb2bc0b7180 2026-02-12T03:58:45.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.715+0000 7fb2c2d13640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2bc15e190 con 0x7fb2bc0b57a0 2026-02-12T03:58:45.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.715+0000 7fb2c2d13640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2bc15e470 con 0x7fb2bc0b5b70 2026-02-12T03:58:45.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.715+0000 7fb2c2d13640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:45.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.715+0000 7fb2c2d13640 10 monclient(hunting): authenticate will time out at 1128.458327s 2026-02-12T03:58:45.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.715+0000 7ff2425a8640 10 monclient: build_initial_monmap 2026-02-12T03:58:45.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.715+0000 7ff2425a8640 10 monclient: monmap: 2026-02-12T03:58:45.813 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:45.813 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:45.813 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:45.813 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:45.813 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:45.813 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:45.813 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:45.813 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:45.813 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:45.813 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.715+0000 7ff2425a8640 1 librados: starting msgr at 2026-02-12T03:58:45.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.715+0000 7ff2425a8640 1 librados: starting objecter 2026-02-12T03:58:45.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.715+0000 7ff2425a8640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:45.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.715+0000 7ff2425a8640 1 Processor -- start 2026-02-12T03:58:45.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.715+0000 7ff2425a8640 1 -- start start 2026-02-12T03:58:45.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.715+0000 7ff2425a8640 1 librados: setting wanted keys 2026-02-12T03:58:45.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.715+0000 7ff2425a8640 1 librados: calling monclient init 2026-02-12T03:58:45.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.715+0000 7ff2425a8640 10 monclient: init 2026-02-12T03:58:45.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.716+0000 7ff2425a8640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:45.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.716+0000 7ff2425a8640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T03:58:45.814 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.716+0000 7ff212ffd640 1 -- 10.20.193.91:0/861051702 <== mon.2 v1:10.20.193.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 70682217 0 0) 0x7ff22c11fca0 con 0x7ff22c166f70 2026-02-12T03:58:45.814 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.716+0000 7ff212ffd640 1 -- 10.20.193.91:0/861051702 >> v1:10.20.193.98:6789/0 conn(0x7ff22c164760 legacy=0x7ff22c135920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.814 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.716+0000 7ff212ffd640 1 -- 10.20.193.91:0/861051702 >> v1:10.20.193.91:6789/0 conn(0x7ff22c159b70 legacy=0x7ff22c11b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.814 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.716+0000 7ff2425a8640 10 monclient(hunting): picked mon.noname-a con 0x7ff23c0564d0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:45.814 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.716+0000 7ff212ffd640 10 monclient: _finish_hunting 0 2026-02-12T03:58:45.814 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.716+0000 7ff212ffd640 1 monclient: found mon.c 2026-02-12T03:58:45.814 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.716+0000 7ff2425a8640 10 monclient(hunting): picked mon.noname-b con 0x7ff23c161ad0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:45.814 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.716+0000 7ff212ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:45.814 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.716+0000 7ff212ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:45.814 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.716+0000 7ff212ffd640 1 -- 10.20.193.91:0/861051702 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff22c11ff80 con 0x7ff22c166f70 2026-02-12T03:58:45.814 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.716+0000 7ff212ffd640 10 monclient: _finish_auth 0 2026-02-12T03:58:45.814 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.716+0000 7ff212ffd640 10 monclient: _check_auth_tickets 2026-02-12T03:58:45.814 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.716+0000 7ff2425a8640 10 monclient(hunting): picked mon.noname-c con 0x7ff23c167e90 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:45.814 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.716+0000 7ff212ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:45.814 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.716+0000 7ff2342c4640 5 monclient: authenticate success, global_id 4409 2026-02-12T03:58:45.814 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.716+0000 7ff2342c4640 10 monclient: _renew_subs 2026-02-12T03:58:45.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.716+0000 7ff2425a8640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff23c166220 con 0x7ff23c0564d0 2026-02-12T03:58:45.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.716+0000 7ff2342c4640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:45.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.716+0000 7ff2342c4640 1 -- 10.20.193.91:0/861051702 --> v1:10.20.193.111:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff22c120260 con 0x7ff22c166f70 2026-02-12T03:58:45.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.716+0000 7ff2425a8640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff23c166500 con 0x7ff23c161ad0 2026-02-12T03:58:45.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.716+0000 7ff2425a8640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff23c1667e0 con 0x7ff23c167e90 2026-02-12T03:58:45.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.716+0000 7ff2425a8640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:45.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.716+0000 7ff2425a8640 10 monclient(hunting): authenticate will time out at 1128.459482s 2026-02-12T03:58:45.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.716+0000 7ff2342c4640 10 client.4409.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:45.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.716+0000 7ff2342c4640 10 monclient: _renew_subs 2026-02-12T03:58:45.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.716+0000 7ff2342c4640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:45.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.716+0000 7ff2342c4640 1 -- 10.20.193.91:0/861051702 --> v1:10.20.193.111:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff22c120820 con 0x7ff22c166f70 2026-02-12T03:58:45.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.716+0000 7ff2342c4640 1 librados: init done 2026-02-12T03:58:45.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.717+0000 7ff2342c4640 10 client.4409.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:45.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.717+0000 7ff2342c4640 15 client.4409.objecter _session_command_op_assign -1 1 2026-02-12T03:58:45.816 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.717+0000 7ff2342c4640 20 client.4409.objecter _get_session osd=-1 returning homeless 2026-02-12T03:58:45.816 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.717+0000 7ff2342c4640 10 client.4409.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:45.816 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.717+0000 7ff2342c4640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:45.816 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.717+0000 7ff2342c4640 1 -- 10.20.193.91:0/861051702 --> v1:10.20.193.111:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7ff22c0564e0 con 0x7ff22c166f70 2026-02-12T03:58:45.816 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.717+0000 7f7938ff9640 1 -- 10.20.193.91:0/4216721313 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2096460321 0 0) 0x7f793c13bd30 con 0x7f793c0b8080 2026-02-12T03:58:45.816 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.717+0000 7f7938ff9640 1 -- 10.20.193.91:0/4216721313 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f793c0b43b0 con 0x7f793c0b8080 2026-02-12T03:58:45.816 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.717+0000 7f7938ff9640 1 -- 10.20.193.91:0/4216721313 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f79280030b0 con 0x7f793c0b8080 2026-02-12T03:58:45.816 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.717+0000 7f7938ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:45.816 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.717+0000 7f7938ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:45.816 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.717+0000 7f7938ff9640 10 monclient(hunting): dump: 2026-02-12T03:58:45.816 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.816 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.816 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.816 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.816 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.816 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.816 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.816 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.817 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.817 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.817 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.717+0000 7f7938ff9640 1 -- 10.20.193.91:0/4216721313 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 541812581 0 0) 0x7f790c003610 con 0x7f793c15d2f0 2026-02-12T03:58:45.817 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.717+0000 7f7938ff9640 1 -- 10.20.193.91:0/4216721313 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f793c13bd30 con 0x7f793c15d2f0 2026-02-12T03:58:45.817 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.717+0000 7f7938ff9640 1 -- 10.20.193.91:0/4216721313 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f792c003170 con 0x7f793c15d2f0 2026-02-12T03:58:45.817 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.717+0000 7f7938ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:45.817 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.717+0000 7f7938ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:45.817 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.717+0000 7f7938ff9640 10 monclient(hunting): dump: 2026-02-12T03:58:45.817 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.817 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.817 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.817 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.817 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.817 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.817 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.817 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.817 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.817 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.817 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.717+0000 7fbd73fff640 1 -- 10.20.193.91:0/286286997 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3349579527 0 0) 0x7fbd9c12a150 con 0x7fbd9c0b7180 2026-02-12T03:58:45.817 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.717+0000 7fbd73fff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.817 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.717+0000 7fbd73fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.817 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.717+0000 7fbd73fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.817 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.717+0000 7fbd73fff640 10 monclient(hunting): my global_id is 4462 2026-02-12T03:58:45.817 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.717+0000 7fbd73fff640 1 -- 10.20.193.91:0/286286997 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd9c12a430 con 0x7fbd9c0b7180 2026-02-12T03:58:45.817 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.717+0000 7f72497fa640 1 -- 10.20.193.91:0/1817416077 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3546549418 0 0) 0x7f7254162d90 con 0x7f72540b57a0 2026-02-12T03:58:45.817 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.718+0000 7f72497fa640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.817 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.718+0000 7f72497fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.817 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.718+0000 7f72497fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.817 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.718+0000 7f72497fa640 10 monclient(hunting): my global_id is 4468 2026-02-12T03:58:45.817 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.718+0000 7f72497fa640 1 -- 10.20.193.91:0/1817416077 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7224003610 con 0x7f72540b57a0 2026-02-12T03:58:45.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.718+0000 7f50967fc640 1 -- 10.20.193.91:0/1727122728 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3650903025 0 0) 0x7f50a8131a90 con 0x7f50a80b57a0 2026-02-12T03:58:45.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.718+0000 7f50967fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.718+0000 7f50967fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.718+0000 7f50967fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.718+0000 7f50967fc640 10 monclient(hunting): my global_id is 4461 2026-02-12T03:58:45.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.718+0000 7f50967fc640 1 -- 10.20.193.91:0/1727122728 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5078003610 con 0x7f50a80b57a0 2026-02-12T03:58:45.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.718+0000 7f72497fa640 1 -- 10.20.193.91:0/1817416077 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3371846413 0 0) 0x7f7254122c60 con 0x7f72540b7180 2026-02-12T03:58:45.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.718+0000 7f72497fa640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.718+0000 7f72497fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.718+0000 7f72497fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.718+0000 7f72497fa640 10 monclient(hunting): my global_id is 4473 2026-02-12T03:58:45.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.718+0000 7f72497fa640 1 -- 10.20.193.91:0/1817416077 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7254162d90 con 0x7f72540b7180 2026-02-12T03:58:45.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.718+0000 7fbd73fff640 1 -- 10.20.193.91:0/286286997 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 628907776 0 0) 0x7fbd9c0b4a70 con 0x7fbd9c0b5b70 2026-02-12T03:58:45.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.718+0000 7fbd73fff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.718+0000 7fbd73fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.718+0000 7fbd73fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.718+0000 7fbd73fff640 10 monclient(hunting): my global_id is 4464 2026-02-12T03:58:45.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.718+0000 7fbd73fff640 1 -- 10.20.193.91:0/286286997 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd9c12a150 con 0x7fbd9c0b5b70 2026-02-12T03:58:45.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.718+0000 7f3e4effd640 1 -- 10.20.193.91:0/1309264919 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2688319615 0 0) 0x7f3e681f8370 con 0x7f3e680afe70 2026-02-12T03:58:45.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.718+0000 7f3e4effd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.718+0000 7f3e4effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.718+0000 7f3e4effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.819 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.719+0000 7f3e4effd640 10 monclient(hunting): my global_id is 4470 2026-02-12T03:58:45.819 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.719+0000 7f3e4effd640 1 -- 10.20.193.91:0/1309264919 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e34003610 con 0x7f3e680afe70 2026-02-12T03:58:45.819 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.719+0000 7ff72bfff640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7ff72c0aba80 0x7ff72c13b7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:59338/0 (socket says 10.20.193.91:59338) 2026-02-12T03:58:45.819 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.719+0000 7ff72bfff640 1 -- 10.20.193.91:0/2171776711 learned_addr learned my addr 10.20.193.91:0/2171776711 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:45.819 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.720+0000 7fbd73fff640 1 -- 10.20.193.91:0/286286997 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1941932303 0 0) 0x7fbd6c003610 con 0x7fbd9c0b57a0 2026-02-12T03:58:45.819 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.720+0000 7fbd73fff640 1 -- 10.20.193.91:0/286286997 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbd9c0b4a70 con 0x7fbd9c0b57a0 2026-02-12T03:58:45.819 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.720+0000 7fbd73fff640 1 -- 10.20.193.91:0/286286997 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fbd90003100 con 0x7fbd9c0b57a0 2026-02-12T03:58:45.819 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.720+0000 7fbd73fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:45.819 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.720+0000 7fbd73fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:45.819 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.720+0000 7fbd73fff640 10 monclient(hunting): dump: 2026-02-12T03:58:45.819 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.819 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.819 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.819 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.819 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.819 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.819 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.819 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.819 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.819 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.819 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.720+0000 7fbd73fff640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:45.819 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.721+0000 7fd0baffd640 1 -- 10.20.193.91:0/2911181674 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2013705560 0 0) 0x7fd0a0003610 con 0x7fd0d415d2f0 2026-02-12T03:58:45.819 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.721+0000 7fd0baffd640 1 -- 10.20.193.91:0/2911181674 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd0d415b490 con 0x7fd0d415d2f0 2026-02-12T03:58:45.819 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.721+0000 7fd0baffd640 1 -- 10.20.193.91:0/2911181674 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd0bc003170 con 0x7fd0d415d2f0 2026-02-12T03:58:45.819 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.721+0000 7fd0baffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:45.820 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.721+0000 7fd0baffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:45.820 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.721+0000 7fd0baffd640 10 monclient(hunting): dump: 2026-02-12T03:58:45.820 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.820 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.820 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.820 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.820 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.820 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.820 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.820 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.820 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.820 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.820 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.721+0000 7ff728ff9640 10 client.?.objecter ms_handle_connect 0x7ff72c0aba80 2026-02-12T03:58:45.820 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.721+0000 7ff728ff9640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.820 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.722+0000 7f72497fa640 1 -- 10.20.193.91:0/1817416077 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3970438053 0 0) 0x7f7254057b90 con 0x7f72540b5b70 2026-02-12T03:58:45.820 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.722+0000 7f72497fa640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.820 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.722+0000 7f72497fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.820 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.722+0000 7f72497fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.820 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.722+0000 7f72497fa640 10 monclient(hunting): my global_id is 4427 2026-02-12T03:58:45.820 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.722+0000 7f72497fa640 1 -- 10.20.193.91:0/1817416077 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7254122c60 con 0x7f72540b5b70 2026-02-12T03:58:45.820 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.722+0000 7f3e4effd640 1 -- 10.20.193.91:0/1309264919 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2348010516 0 0) 0x7f3e681fb020 con 0x7f3e6815f310 2026-02-12T03:58:45.820 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.722+0000 7f3e4effd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.820 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.722+0000 7f3e4effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.820 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.722+0000 7f3e4effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.820 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.722+0000 7f3e4effd640 10 monclient(hunting): my global_id is 4430 2026-02-12T03:58:45.820 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.722+0000 7f3e4effd640 1 -- 10.20.193.91:0/1309264919 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e681f8370 con 0x7f3e6815f310 2026-02-12T03:58:45.821 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.723+0000 7ff728ff9640 10 client.?.objecter ms_handle_connect 0x7ff72c0b3f60 2026-02-12T03:58:45.821 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.723+0000 7ff728ff9640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.821 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.723+0000 7f47e5ffb640 1 -- 10.20.193.91:0/4153586687 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2368861306 0 0) 0x7f47f811bab0 con 0x7f47f80b5b70 2026-02-12T03:58:45.821 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.723+0000 7f47e5ffb640 1 -- 10.20.193.91:0/4153586687 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f47f811bd90 con 0x7f47f80b5b70 2026-02-12T03:58:45.821 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.723+0000 7f47e5ffb640 1 -- 10.20.193.91:0/4153586687 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f47ec0030f0 con 0x7f47f80b5b70 2026-02-12T03:58:45.821 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.723+0000 7f47e5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:45.821 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.723+0000 7f47e5ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:45.821 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.723+0000 7f47e5ffb640 10 monclient(hunting): dump: 2026-02-12T03:58:45.821 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.821 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.821 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.821 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.821 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.821 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.821 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.821 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.821 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.821 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.821 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.723+0000 7f47e5ffb640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:45.821 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.724+0000 7f1b63fff640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f1b64161c10 0x7f1b64162490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:59348/0 (socket says 10.20.193.91:59348) 2026-02-12T03:58:45.821 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.724+0000 7f1b63fff640 1 -- 10.20.193.91:0/3744615041 learned_addr learned my addr 10.20.193.91:0/3744615041 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:45.821 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.725+0000 7fb2b3fff640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7fb2bc0b5b70 0x7fb2bc1629c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:37866/0 (socket says 10.20.193.91:37866) 2026-02-12T03:58:45.821 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.725+0000 7fb2b3fff640 1 -- 10.20.193.91:0/3624527245 learned_addr learned my addr 10.20.193.91:0/3624527245 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:45.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.725+0000 7f3e4effd640 1 -- 10.20.193.91:0/1309264919 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1697790506 0 0) 0x7f3e681fad40 con 0x7f3e681639c0 2026-02-12T03:58:45.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.725+0000 7f3e4effd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.725+0000 7f3e4effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.725+0000 7f3e4effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.725+0000 7f3e4effd640 10 monclient(hunting): my global_id is 4465 2026-02-12T03:58:45.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.725+0000 7f3e4effd640 1 -- 10.20.193.91:0/1309264919 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e681fb020 con 0x7f3e681639c0 2026-02-12T03:58:45.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.727+0000 7f7938ff9640 1 -- 10.20.193.91:0/4216721313 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3989020138 0 0) 0x7f793c13bd30 con 0x7f793c15d2f0 2026-02-12T03:58:45.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.727+0000 7f7938ff9640 1 -- 10.20.193.91:0/4216721313 >> v1:10.20.193.111:6789/0 conn(0x7f793c0b8080 legacy=0x7f793c11ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.727+0000 7f7938ff9640 1 -- 10.20.193.91:0/4216721313 >> v1:10.20.193.98:6789/0 conn(0x7f793c15d6c0 legacy=0x7f793c11f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.727+0000 7f7938ff9640 10 monclient: _finish_hunting 0 2026-02-12T03:58:45.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.727+0000 7f7938ff9640 1 monclient: found mon.a 2026-02-12T03:58:45.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.727+0000 7f7938ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:45.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.727+0000 7f7938ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:45.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.727+0000 7f7938ff9640 1 -- 10.20.193.91:0/4216721313 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f793c13c2f0 con 0x7f793c15d2f0 2026-02-12T03:58:45.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.727+0000 7f7938ff9640 10 monclient: _finish_auth 0 2026-02-12T03:58:45.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.727+0000 7f7938ff9640 10 monclient: _check_auth_tickets 2026-02-12T03:58:45.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.727+0000 7f7938ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:45.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.727+0000 7f79423be640 5 monclient: authenticate success, global_id 4458 2026-02-12T03:58:45.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.727+0000 7f79423be640 10 monclient: _renew_subs 2026-02-12T03:58:45.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.727+0000 7f79423be640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:45.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.727+0000 7f79423be640 1 -- 10.20.193.91:0/4216721313 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f793c13c5d0 con 0x7f793c15d2f0 2026-02-12T03:58:45.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.727+0000 7f79423be640 10 client.4458.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:45.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.727+0000 7f79423be640 10 monclient: _renew_subs 2026-02-12T03:58:45.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.727+0000 7f79423be640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:45.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.727+0000 7f79423be640 1 -- 10.20.193.91:0/4216721313 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f793c11e8b0 con 0x7f793c15d2f0 2026-02-12T03:58:45.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.727+0000 7f79423be640 1 librados: init done 2026-02-12T03:58:45.823 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.727+0000 7f1b3ffff640 10 client.?.objecter ms_handle_connect 0x7f1b64161c10 2026-02-12T03:58:45.823 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.727+0000 7f1b3ffff640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.823 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.727+0000 7f71f1d74640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f71f4164760 0x7f71f4145e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:59358/0 (socket says 10.20.193.91:59358) 2026-02-12T03:58:45.823 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.727+0000 7f71f1d74640 1 -- 10.20.193.91:0/3729138105 learned_addr learned my addr 10.20.193.91:0/3729138105 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:45.823 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.728+0000 7f79423be640 10 client.4458.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:45.823 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.728+0000 7f79423be640 15 client.4458.objecter _session_command_op_assign -1 1 2026-02-12T03:58:45.823 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.728+0000 7f79423be640 20 client.4458.objecter _get_session osd=-1 returning homeless 2026-02-12T03:58:45.823 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.728+0000 7f79423be640 10 client.4458.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:45.823 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.728+0000 7f79423be640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:45.823 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.728+0000 7f79423be640 1 -- 10.20.193.91:0/4216721313 --> v1:10.20.193.91:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f793c0ba7f0 con 0x7f793c15d2f0 2026-02-12T03:58:45.823 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.729+0000 7fb2b17fa640 10 client.?.objecter ms_handle_connect 0x7fb2bc0b5b70 2026-02-12T03:58:45.823 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.729+0000 7fb2b17fa640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.823 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.730+0000 7f1b3ffff640 10 client.?.objecter ms_handle_connect 0x7f1b640b5e90 2026-02-12T03:58:45.823 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.730+0000 7f1b3ffff640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.823 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.730+0000 7f71d6ffd640 10 client.?.objecter ms_handle_connect 0x7f71f4164760 2026-02-12T03:58:45.823 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.730+0000 7f71d6ffd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.823 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.730+0000 7f07e27fc640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f07e40b5b70 0x7f07e415cde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:48534/0 (socket says 10.20.193.91:48534) 2026-02-12T03:58:45.823 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.730+0000 7f07e27fc640 1 -- 10.20.193.91:0/198827363 learned_addr learned my addr 10.20.193.91:0/198827363 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:45.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.731+0000 7ff240b1e640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7ff23c167e90 0x7ff23c169a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:37878/0 (socket says 10.20.193.91:37878) 2026-02-12T03:58:45.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.731+0000 7f07c37fe640 10 client.?.objecter ms_handle_connect 0x7f07e40b7180 2026-02-12T03:58:45.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.731+0000 7f07c37fe640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.731+0000 7ff240b1e640 1 -- 10.20.193.91:0/4164622660 learned_addr learned my addr 10.20.193.91:0/4164622660 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:45.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.732+0000 7ff728ff9640 10 client.?.objecter ms_handle_connect 0x7ff72c0abe50 2026-02-12T03:58:45.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.732+0000 7ff728ff9640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.732+0000 7fab13fff640 1 -- 10.20.193.91:0/1484103208 <== osd.1 v1:10.20.193.98:6812/2011281833 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fab080c5170 con 0x7fab080a34d0 2026-02-12T03:58:45.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.732+0000 7fab13fff640 10 client.4416.objecter ms_dispatch2 0x7fab38000b90 command_reply(tid 1: 0 ) 2026-02-12T03:58:45.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.732+0000 7fab13fff640 10 client.4416.objecter _finish_command 1 = system:0 2026-02-12T03:58:45.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.732+0000 7fab13fff640 20 client.4416.objecter put_session s=0x7fab080a2e20 osd=1 4 2026-02-12T03:58:45.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.732+0000 7fab13fff640 15 client.4416.objecter _session_command_op_remove 1 1 2026-02-12T03:58:45.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.732+0000 7f71d6ffd640 10 client.?.objecter ms_handle_connect 0x7f71f4159b70 2026-02-12T03:58:45.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.732+0000 7f71d6ffd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.733+0000 7ff238ff9640 10 client.?.objecter ms_handle_connect 0x7ff23c167e90 2026-02-12T03:58:45.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.733+0000 7ff238ff9640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.734+0000 7f07c37fe640 10 client.?.objecter ms_handle_connect 0x7f07e40b5b70 2026-02-12T03:58:45.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.734+0000 7f07c37fe640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.734+0000 7f72497fa640 1 -- 10.20.193.91:0/1817416077 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3135466747 0 0) 0x7f7254162d90 con 0x7f72540b7180 2026-02-12T03:58:45.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.734+0000 7f72497fa640 1 -- 10.20.193.91:0/1817416077 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7254057b90 con 0x7f72540b7180 2026-02-12T03:58:45.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.734+0000 7f72497fa640 1 -- 10.20.193.91:0/1817416077 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f7250003570 con 0x7f72540b7180 2026-02-12T03:58:45.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.734+0000 7f72497fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:45.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.734+0000 7f72497fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:45.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.734+0000 7f72497fa640 10 monclient(hunting): dump: 2026-02-12T03:58:45.825 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.825 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.825 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.825 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.825 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.825 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.825 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.825 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.825 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.825 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.734+0000 7f72497fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:45.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.734+0000 7fd0baffd640 1 -- 10.20.193.91:0/2911181674 <== mon.2 v1:10.20.193.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3916797554 0 0) 0x7fd0d4165510 con 0x7fd0d40b8080 2026-02-12T03:58:45.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.734+0000 7fd0baffd640 1 -- 10.20.193.91:0/2911181674 >> v1:10.20.193.98:6789/0 conn(0x7fd0d415d6c0 legacy=0x7fd0d413a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.734+0000 7fd0baffd640 1 -- 10.20.193.91:0/2911181674 >> v1:10.20.193.91:6789/0 conn(0x7fd0d415d2f0 legacy=0x7fd0d4156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.734+0000 7fd0baffd640 10 monclient: _finish_hunting 0 2026-02-12T03:58:45.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.734+0000 7fd0baffd640 1 monclient: found mon.c 2026-02-12T03:58:45.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.734+0000 7fd0baffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:45.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.734+0000 7fd0baffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:45.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.734+0000 7fd0baffd640 1 -- 10.20.193.91:0/2911181674 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0d41657d0 con 0x7fd0d40b8080 2026-02-12T03:58:45.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.734+0000 7fd0baffd640 10 monclient: _finish_auth 0 2026-02-12T03:58:45.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.734+0000 7fd0baffd640 10 monclient: _check_auth_tickets 2026-02-12T03:58:45.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.734+0000 7fd0baffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:45.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.734+0000 7fd0d8a96640 5 monclient: authenticate success, global_id 4412 2026-02-12T03:58:45.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.734+0000 7fd0d8a96640 10 monclient: _renew_subs 2026-02-12T03:58:45.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.734+0000 7fd0d8a96640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:45.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.734+0000 7fd0d8a96640 1 -- 10.20.193.91:0/2911181674 --> v1:10.20.193.111:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd0d4165ab0 con 0x7fd0d40b8080 2026-02-12T03:58:45.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.734+0000 7fd0d8a96640 10 client.4412.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:45.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.734+0000 7fd0d8a96640 10 monclient: _renew_subs 2026-02-12T03:58:45.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.734+0000 7fd0d8a96640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:45.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.734+0000 7fd0d8a96640 1 -- 10.20.193.91:0/2911181674 --> v1:10.20.193.111:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd0d4166070 con 0x7fd0d40b8080 2026-02-12T03:58:45.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.734+0000 7fd0d8a96640 1 librados: init done 2026-02-12T03:58:45.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.735+0000 7fd0d8a96640 10 client.4412.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:45.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.735+0000 7fd0d8a96640 15 client.4412.objecter _session_command_op_assign -1 1 2026-02-12T03:58:45.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.735+0000 7fd0d8a96640 20 client.4412.objecter _get_session osd=-1 returning homeless 2026-02-12T03:58:45.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.735+0000 7fd0d8a96640 10 client.4412.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:45.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.735+0000 7fd0d8a96640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:45.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.735+0000 7fd0d8a96640 1 -- 10.20.193.91:0/2911181674 --> v1:10.20.193.111:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fd0d40ba7f0 con 0x7fd0d40b8080 2026-02-12T03:58:45.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.735+0000 7f47e5ffb640 1 -- 10.20.193.91:0/4153586687 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 115522577 0 0) 0x7f47c8003610 con 0x7f47f80b57a0 2026-02-12T03:58:45.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.735+0000 7f47e5ffb640 1 -- 10.20.193.91:0/4153586687 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f47f811bab0 con 0x7f47f80b57a0 2026-02-12T03:58:45.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.735+0000 7f47e5ffb640 1 -- 10.20.193.91:0/4153586687 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f47e8002c30 con 0x7f47f80b57a0 2026-02-12T03:58:45.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.735+0000 7f47e5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:45.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.735+0000 7f47e5ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:45.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.735+0000 7f47e5ffb640 10 monclient(hunting): dump: 2026-02-12T03:58:45.826 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.826 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.826 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.826 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.826 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.826 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.827 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.827 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.827 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.827 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.827 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.736+0000 7f1b3ffff640 10 client.?.objecter ms_handle_connect 0x7f1b6405a7c0 2026-02-12T03:58:45.827 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.736+0000 7f1b3ffff640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.827 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.737+0000 7fb2b17fa640 10 client.?.objecter ms_handle_connect 0x7fb2bc0b57a0 2026-02-12T03:58:45.827 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.737+0000 7fb2b17fa640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.827 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.737+0000 7f71d6ffd640 10 client.?.objecter ms_handle_connect 0x7f71f4166f70 2026-02-12T03:58:45.827 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.737+0000 7f71d6ffd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.827 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.738+0000 7ff238ff9640 10 client.?.objecter ms_handle_connect 0x7ff23c161ad0 2026-02-12T03:58:45.827 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.738+0000 7ff238ff9640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.827 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.740+0000 7f71d6ffd640 1 -- 10.20.193.91:0/3729138105 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2547894146 0 0) 0x7f71f415e890 con 0x7f71f4164760 2026-02-12T03:58:45.827 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.740+0000 7f71d6ffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.827 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.740+0000 7f71d6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.827 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.740+0000 7f71d6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.827 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.740+0000 7f71d6ffd640 10 monclient(hunting): my global_id is 4485 2026-02-12T03:58:45.827 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.740+0000 7f71d6ffd640 1 -- 10.20.193.91:0/3729138105 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71c0003610 con 0x7f71f4164760 2026-02-12T03:58:45.827 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.740+0000 7fab3dc6f640 10 client.4416.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-12T03:58:45.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.740+0000 7fab3dc6f640 15 client.4416.objecter _session_command_op_assign -1 2 2026-02-12T03:58:45.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.740+0000 7fab3dc6f640 20 client.4416.objecter _get_session s=0x7fab080a2e20 osd=1 3 2026-02-12T03:58:45.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.740+0000 7fab3dc6f640 20 client.4416.objecter put_session s=0x7fab080a2e20 osd=1 3 2026-02-12T03:58:45.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.740+0000 7fab3dc6f640 20 client.4416.objecter _get_session s=0x7fab080a2e20 osd=1 3 2026-02-12T03:58:45.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.740+0000 7fab3dc6f640 15 client.4416.objecter _session_command_op_remove -1 2 2026-02-12T03:58:45.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.740+0000 7fab3dc6f640 20 client.4416.objecter get_session s=0x7fab080a2e20 osd=1 3 2026-02-12T03:58:45.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.740+0000 7fab3dc6f640 15 client.4416.objecter _session_command_op_assign 1 2 2026-02-12T03:58:45.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.740+0000 7fab3dc6f640 20 client.4416.objecter put_session s=0x7fab080a2e20 osd=1 4 2026-02-12T03:58:45.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.740+0000 7fab3dc6f640 10 client.4416.objecter _send_command 2 2026-02-12T03:58:45.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.740+0000 7fab3dc6f640 1 -- 10.20.193.91:0/1484103208 --> v1:10.20.193.98:6812/2011281833 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fab380b60e0 con 0x7fab080a34d0 2026-02-12T03:58:45.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.742+0000 7ff728ff9640 1 -- 10.20.193.91:0/2171776711 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3334157964 0 0) 0x7ff72c13ace0 con 0x7ff72c0b3f60 2026-02-12T03:58:45.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.742+0000 7ff728ff9640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.742+0000 7ff728ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.742+0000 7ff728ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.742+0000 7ff728ff9640 10 monclient(hunting): my global_id is 4433 2026-02-12T03:58:45.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.742+0000 7ff728ff9640 1 -- 10.20.193.91:0/2171776711 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6fc003610 con 0x7ff72c0b3f60 2026-02-12T03:58:45.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.742+0000 7f50967fc640 1 -- 10.20.193.91:0/1727122728 <== mon.2 v1:10.20.193.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 606678227 0 0) 0x7f50a8131d70 con 0x7f50a80b7180 2026-02-12T03:58:45.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.742+0000 7f50967fc640 1 -- 10.20.193.91:0/1727122728 >> v1:10.20.193.98:6789/0 conn(0x7f50a80b5b70 legacy=0x7f50a81631d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.742+0000 7f50967fc640 1 -- 10.20.193.91:0/1727122728 >> v1:10.20.193.91:6789/0 conn(0x7f50a80b57a0 legacy=0x7f50a8161e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.742+0000 7f50967fc640 10 monclient: _finish_hunting 0 2026-02-12T03:58:45.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.742+0000 7f50967fc640 1 monclient: found mon.c 2026-02-12T03:58:45.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.742+0000 7f50967fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:45.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.742+0000 7f50967fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:45.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.742+0000 7f50967fc640 1 -- 10.20.193.91:0/1727122728 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50a8161630 con 0x7f50a80b7180 2026-02-12T03:58:45.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.742+0000 7f50967fc640 10 monclient: _finish_auth 0 2026-02-12T03:58:45.829 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.742+0000 7f50967fc640 10 monclient: _check_auth_tickets 2026-02-12T03:58:45.829 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.742+0000 7f50967fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:45.829 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.742+0000 7f50afed4640 5 monclient: authenticate success, global_id 4421 2026-02-12T03:58:45.829 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.742+0000 7f50afed4640 10 monclient: _renew_subs 2026-02-12T03:58:45.829 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.742+0000 7f50afed4640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:45.829 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.742+0000 7f50afed4640 1 -- 10.20.193.91:0/1727122728 --> v1:10.20.193.111:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f50a8161910 con 0x7f50a80b7180 2026-02-12T03:58:45.829 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.742+0000 7f50afed4640 10 client.4421.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:45.829 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.742+0000 7f50afed4640 10 monclient: _renew_subs 2026-02-12T03:58:45.829 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.742+0000 7f50afed4640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:45.829 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.742+0000 7f50afed4640 1 -- 10.20.193.91:0/1727122728 --> v1:10.20.193.111:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f50a8162720 con 0x7f50a80b7180 2026-02-12T03:58:45.829 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.742+0000 7f50afed4640 1 librados: init done 2026-02-12T03:58:45.829 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.742+0000 7fab13fff640 1 -- 10.20.193.91:0/1484103208 <== osd.1 v1:10.20.193.98:6812/2011281833 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2115957317) 0x7fab380b60e0 con 0x7fab080a34d0 2026-02-12T03:58:45.829 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.742+0000 7fab13fff640 10 client.4416.objecter ms_dispatch2 0x7fab38000b90 command_reply(tid 2: 0 ) 2026-02-12T03:58:45.829 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.742+0000 7fab13fff640 10 client.4416.objecter _finish_command 2 = system:0 2026-02-12T03:58:45.829 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.742+0000 7fab13fff640 20 client.4416.objecter put_session s=0x7fab080a2e20 osd=1 4 2026-02-12T03:58:45.829 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.742+0000 7fab13fff640 15 client.4416.objecter _session_command_op_remove 1 2 2026-02-12T03:58:45.829 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.743+0000 7fab3dc6f640 10 librados: watch_flush enter 2026-02-12T03:58:45.829 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.743+0000 7fab3dc6f640 10 librados: watch_flush exit 2026-02-12T03:58:45.829 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.743+0000 7fab3dc6f640 10 client.4416.objecter close_session for osd.1 2026-02-12T03:58:45.829 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.743+0000 7fab3dc6f640 1 -- 10.20.193.91:0/1484103208 >> v1:10.20.193.98:6812/2011281833 conn(0x7fab080a34d0 legacy=0x7fab080c3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.829 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.743+0000 7fab3dc6f640 20 client.4416.objecter put_session s=0x7fab080a2e20 osd=1 1 2026-02-12T03:58:45.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.743+0000 7fab3dc6f640 20 client.4416.objecter shutdown clearing up homeless session... 2026-02-12T03:58:45.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.743+0000 7fab3dc6f640 10 client.4416.objecter successfully canceled tick 2026-02-12T03:58:45.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.743+0000 7fab3dc6f640 1 -- 10.20.193.91:0/1484103208 >> v1:10.20.193.91:6800/2929217192 conn(0x7fab08079fc0 legacy=0x7fab0809a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.743+0000 7fab3dc6f640 10 monclient: shutdown 2026-02-12T03:58:45.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.743+0000 7fab3dc6f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:45.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.743+0000 7fab3dc6f640 1 -- 10.20.193.91:0/1484103208 >> v1:10.20.193.91:6789/0 conn(0x7fab380b7180 legacy=0x7fab38131530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.743+0000 7fab37fff640 1 -- 10.20.193.91:0/1484103208 reap_dead start 2026-02-12T03:58:45.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.743+0000 7fab3dc6f640 1 -- 10.20.193.91:0/1484103208 shutdown_connections 2026-02-12T03:58:45.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.743+0000 7fab3dc6f640 1 -- 10.20.193.91:0/1484103208 >> 10.20.193.91:0/1484103208 conn(0x7fab380559c0 msgr2=0x7fab380b9650 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:45.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.743+0000 7fab3dc6f640 1 -- 10.20.193.91:0/1484103208 shutdown_connections 2026-02-12T03:58:45.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.743+0000 7fab3dc6f640 1 -- 10.20.193.91:0/1484103208 wait complete. 2026-02-12T03:58:45.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.743+0000 7fab3dc6f640 1 librados: shutdown 2026-02-12T03:58:45.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.743+0000 7f50afed4640 10 client.4421.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:45.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.743+0000 7f50afed4640 15 client.4421.objecter _session_command_op_assign -1 1 2026-02-12T03:58:45.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.743+0000 7f50afed4640 20 client.4421.objecter _get_session osd=-1 returning homeless 2026-02-12T03:58:45.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.743+0000 7f50afed4640 10 client.4421.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:45.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.743+0000 7f50afed4640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:45.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.743+0000 7f50afed4640 1 -- 10.20.193.91:0/1727122728 --> v1:10.20.193.111:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f50a80b60e0 con 0x7f50a80b7180 2026-02-12T03:58:45.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.743+0000 7f07c37fe640 10 client.?.objecter ms_handle_connect 0x7f07e40b57a0 2026-02-12T03:58:45.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.743+0000 7f07c37fe640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.744+0000 7f07c37fe640 1 -- 10.20.193.91:0/198827363 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2081720005 0 0) 0x7f07e41524e0 con 0x7f07e40b7180 2026-02-12T03:58:45.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.744+0000 7f07c37fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.744+0000 7f07c37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.744+0000 7f07c37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.744+0000 7f07c37fe640 10 monclient(hunting): my global_id is 4442 2026-02-12T03:58:45.830 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.744+0000 7f07c37fe640 1 -- 10.20.193.91:0/198827363 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07b0003610 con 0x7f07e40b7180 2026-02-12T03:58:45.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.744+0000 7f7db9ffb640 1 -- 10.20.193.91:0/4137855695 <== mon.1 v1:10.20.193.98:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7dbc0032c0 con 0x7f7dcc0b57a0 2026-02-12T03:58:45.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.744+0000 7f7db9ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:45.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.744+0000 7f7db9ffb640 1 -- 10.20.193.91:0/4137855695 <== mon.1 v1:10.20.193.98:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f7dbc003b50 con 0x7f7dcc0b57a0 2026-02-12T03:58:45.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.744+0000 7f7db9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.744+0000 7f7db9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:45.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.744+0000 7f7db9ffb640 10 monclient: dump: 2026-02-12T03:58:45.831 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.831 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.831 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.831 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.831 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.831 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.831 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.831 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.831 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.831 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.744+0000 7f7dbb7fe640 4 set_mon_vals no callback set 2026-02-12T03:58:45.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.745+0000 7f7db9ffb640 1 -- 10.20.193.91:0/4137855695 <== mon.1 v1:10.20.193.98:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f7dbc003d60 con 0x7f7dcc0b57a0 2026-02-12T03:58:45.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.745+0000 7f7dd0d76640 10 monclient: get_auth_request con 0x7f7d9c079f50 auth_method 0 2026-02-12T03:58:45.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.745+0000 7f7db9ffb640 10 client.4432.objecter ms_handle_connect 0x7f7d9c079f50 2026-02-12T03:58:45.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.747+0000 7f7db9ffb640 1 -- 10.20.193.91:0/4137855695 <== mon.1 v1:10.20.193.98:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7f7dbc095ce0 con 0x7f7dcc0b57a0 2026-02-12T03:58:45.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.747+0000 7f7db9ffb640 10 client.4432.objecter ms_dispatch2 0x7f7dcc000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:45.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.747+0000 7f7db9ffb640 3 client.4432.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:45.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.747+0000 7f7db9ffb640 3 client.4432.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:45.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.747+0000 7f7db9ffb640 10 client.4432.objecter checking command 1 2026-02-12T03:58:45.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.747+0000 7f7db9ffb640 20 client.4432.objecter _get_session s=0x7f7d9c0a2dd0 osd=2 3 2026-02-12T03:58:45.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.747+0000 7f7db9ffb640 20 client.4432.objecter put_session s=0x7f7d9c0a2dd0 osd=2 3 2026-02-12T03:58:45.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.747+0000 7f7db9ffb640 15 client.4432.objecter _session_command_op_remove -1 1 2026-02-12T03:58:45.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.747+0000 7f7db9ffb640 20 client.4432.objecter _get_session s=0x7f7d9c0a2dd0 osd=2 3 2026-02-12T03:58:45.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.747+0000 7f7db9ffb640 20 client.4432.objecter get_session s=0x7f7d9c0a2dd0 osd=2 3 2026-02-12T03:58:45.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.747+0000 7f7db9ffb640 15 client.4432.objecter _session_command_op_assign 2 1 2026-02-12T03:58:45.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.747+0000 7f7db9ffb640 20 client.4432.objecter put_session s=0x7f7d9c0a2dd0 osd=2 4 2026-02-12T03:58:45.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.747+0000 7f7db9ffb640 10 client.4432.objecter _send_command 1 2026-02-12T03:58:45.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.747+0000 7f7db9ffb640 1 -- 10.20.193.91:0/4137855695 --> v1:10.20.193.111:6812/350848222 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7d9c0c5080 con 0x7f7d9c0a3480 2026-02-12T03:58:45.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.747+0000 7f7db9ffb640 20 client.4432.objecter dump_active .. 0 homeless 2026-02-12T03:58:45.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.747+0000 7f7db9ffb640 1 -- 10.20.193.91:0/4137855695 <== mon.1 v1:10.20.193.98:6789/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7f7dbc05b2b0 con 0x7f7dcc0b57a0 2026-02-12T03:58:45.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.747+0000 7f7db9ffb640 10 monclient: handle_get_version_reply finishing 1 version 28 2026-02-12T03:58:45.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.747+0000 7f7dd1d78640 10 monclient: get_auth_request con 0x7f7d9c0a3480 auth_method 0 2026-02-12T03:58:45.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7f7938ff9640 1 -- 10.20.193.91:0/4216721313 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f793c0ba7f0 con 0x7f793c15d2f0 2026-02-12T03:58:45.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7f7938ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:45.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7f7938ff9640 1 -- 10.20.193.91:0/4216721313 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f792c0039b0 con 0x7f793c15d2f0 2026-02-12T03:58:45.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7f7938ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7f7938ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:45.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7f793a7fc640 4 set_mon_vals no callback set 2026-02-12T03:58:45.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7f7938ff9640 10 monclient: dump: 2026-02-12T03:58:45.832 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.832 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.832 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.832 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.832 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.832 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.832 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.832 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.832 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.832 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7ff238ff9640 10 client.?.objecter ms_handle_connect 0x7ff23c0564d0 2026-02-12T03:58:45.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7ff238ff9640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7ff212ffd640 1 -- 10.20.193.91:0/861051702 <== mon.2 v1:10.20.193.111:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff22c0564e0 con 0x7ff22c166f70 2026-02-12T03:58:45.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7ff212ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:45.833 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7ff212ffd640 1 -- 10.20.193.91:0/861051702 <== mon.2 v1:10.20.193.111:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7ff228003dd0 con 0x7ff22c166f70 2026-02-12T03:58:45.833 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7ff212ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.833 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7ff212ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:45.833 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7ff230836640 4 set_mon_vals no callback set 2026-02-12T03:58:45.833 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7ff212ffd640 10 monclient: dump: 2026-02-12T03:58:45.833 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.833 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.833 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.833 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.833 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.833 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.833 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.833 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.833 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.833 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.833 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7fbd73fff640 1 -- 10.20.193.91:0/286286997 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2222645093 0 0) 0x7fbd9c12a430 con 0x7fbd9c0b7180 2026-02-12T03:58:45.833 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7fbd73fff640 1 -- 10.20.193.91:0/286286997 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbd6c003610 con 0x7fbd9c0b7180 2026-02-12T03:58:45.833 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7fbd73fff640 1 -- 10.20.193.91:0/286286997 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fbd8c003080 con 0x7fbd9c0b7180 2026-02-12T03:58:45.833 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7fbd73fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:45.833 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7fbd73fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:45.833 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7fbd73fff640 10 monclient(hunting): dump: 2026-02-12T03:58:45.833 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.833 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.833 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.833 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.833 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.833 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.833 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.834 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.834 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.834 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.834 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7fbd73fff640 1 -- 10.20.193.91:0/286286997 <== mon.2 v1:10.20.193.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2387738885 0 0) 0x7fbd9c0b4a70 con 0x7fbd9c0b57a0 2026-02-12T03:58:45.834 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7fbd73fff640 1 -- 10.20.193.91:0/286286997 >> v1:10.20.193.98:6789/0 conn(0x7fbd9c0b7180 legacy=0x7fbd9c1423c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.834 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7fbd73fff640 1 -- 10.20.193.91:0/286286997 >> v1:10.20.193.91:6789/0 conn(0x7fbd9c0b5b70 legacy=0x7fbd9c0b4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.834 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7fbd73fff640 10 monclient: _finish_hunting 0 2026-02-12T03:58:45.834 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7fbd73fff640 1 monclient: found mon.c 2026-02-12T03:58:45.834 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7fbd73fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:45.834 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7fbd73fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:45.834 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7fbd73fff640 1 -- 10.20.193.91:0/286286997 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd9c12a710 con 0x7fbd9c0b57a0 2026-02-12T03:58:45.834 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7fbd73fff640 10 monclient: _finish_auth 0 2026-02-12T03:58:45.834 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7fbd73fff640 10 monclient: _check_auth_tickets 2026-02-12T03:58:45.834 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7fbd73fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:45.834 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7fbda1a50640 5 monclient: authenticate success, global_id 4424 2026-02-12T03:58:45.834 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7fbda1a50640 10 monclient: _renew_subs 2026-02-12T03:58:45.834 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7fbda1a50640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:45.834 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7fbda1a50640 1 -- 10.20.193.91:0/286286997 --> v1:10.20.193.111:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbd9c12a9f0 con 0x7fbd9c0b57a0 2026-02-12T03:58:45.834 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7fbda1a50640 10 client.4424.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:45.834 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7fbda1a50640 10 monclient: _renew_subs 2026-02-12T03:58:45.834 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7fbda1a50640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:45.834 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7fbda1a50640 1 -- 10.20.193.91:0/286286997 --> v1:10.20.193.111:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fbd9c142cb0 con 0x7fbd9c0b57a0 2026-02-12T03:58:45.834 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7fbda1a50640 1 librados: init done 2026-02-12T03:58:45.834 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7f7938ff9640 1 -- 10.20.193.91:0/4216721313 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f792c003bc0 con 0x7f793c15d2f0 2026-02-12T03:58:45.834 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7f7db9ffb640 10 client.4432.objecter ms_handle_connect 0x7f7d9c0a3480 2026-02-12T03:58:45.834 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7fbda1a50640 10 client.4424.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:45.834 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7fbda1a50640 15 client.4424.objecter _session_command_op_assign -1 1 2026-02-12T03:58:45.834 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7fbda1a50640 20 client.4424.objecter _get_session osd=-1 returning homeless 2026-02-12T03:58:45.834 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7fbda1a50640 10 client.4424.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:45.834 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7fbda1a50640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:45.834 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7fbda1a50640 1 -- 10.20.193.91:0/286286997 --> v1:10.20.193.111:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fbd9c141ce0 con 0x7fbd9c0b57a0 2026-02-12T03:58:45.834 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.748+0000 7ff212ffd640 1 -- 10.20.193.91:0/861051702 <== mon.2 v1:10.20.193.111:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7ff22801d2b0 con 0x7ff22c166f70 2026-02-12T03:58:45.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.749+0000 7f793bfff640 10 monclient: get_auth_request con 0x7f790c07a160 auth_method 0 2026-02-12T03:58:45.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.749+0000 7f7938ff9640 10 client.4458.objecter ms_handle_connect 0x7f790c07a160 2026-02-12T03:58:45.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.749+0000 7ff232039640 10 monclient: get_auth_request con 0x7ff1fc07a040 auth_method 0 2026-02-12T03:58:45.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.749+0000 7ff212ffd640 10 client.4409.objecter ms_handle_connect 0x7ff1fc07a040 2026-02-12T03:58:45.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.750+0000 7f7938ff9640 1 -- 10.20.193.91:0/4216721313 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7f792c0039b0 con 0x7f793c15d2f0 2026-02-12T03:58:45.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.750+0000 7f7938ff9640 10 client.4458.objecter ms_dispatch2 0x7f793c000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:45.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.750+0000 7f7938ff9640 3 client.4458.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:45.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.750+0000 7f7938ff9640 3 client.4458.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:45.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.751+0000 7f7938ff9640 10 client.4458.objecter checking command 1 2026-02-12T03:58:45.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.751+0000 7f7938ff9640 20 client.4458.objecter _get_session s=0x7f790c0a2fe0 osd=12 3 2026-02-12T03:58:45.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.751+0000 7f7938ff9640 20 client.4458.objecter put_session s=0x7f790c0a2fe0 osd=12 3 2026-02-12T03:58:45.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.751+0000 7f7938ff9640 15 client.4458.objecter _session_command_op_remove -1 1 2026-02-12T03:58:45.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.751+0000 7f7938ff9640 20 client.4458.objecter _get_session s=0x7f790c0a2fe0 osd=12 3 2026-02-12T03:58:45.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.751+0000 7f7938ff9640 20 client.4458.objecter get_session s=0x7f790c0a2fe0 osd=12 3 2026-02-12T03:58:45.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.751+0000 7f7938ff9640 15 client.4458.objecter _session_command_op_assign 12 1 2026-02-12T03:58:45.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.751+0000 7f7938ff9640 20 client.4458.objecter put_session s=0x7f790c0a2fe0 osd=12 4 2026-02-12T03:58:45.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.751+0000 7f7938ff9640 10 client.4458.objecter _send_command 1 2026-02-12T03:58:45.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.751+0000 7f7938ff9640 1 -- 10.20.193.91:0/4216721313 --> v1:10.20.193.91:6813/3587007397 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f790c0c5290 con 0x7f790c0a3690 2026-02-12T03:58:45.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.751+0000 7f7938ff9640 20 client.4458.objecter dump_active .. 0 homeless 2026-02-12T03:58:45.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.751+0000 7f7938ff9640 1 -- 10.20.193.91:0/4216721313 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7f792c05aee0 con 0x7f793c15d2f0 2026-02-12T03:58:45.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.751+0000 7f7938ff9640 10 monclient: handle_get_version_reply finishing 1 version 28 2026-02-12T03:58:45.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.751+0000 7f7940934640 10 monclient: get_auth_request con 0x7f790c0a3690 auth_method 0 2026-02-12T03:58:45.836 INFO:teuthology.orchestra.run.trial091.stdout:94489280516 2026-02-12T03:58:45.836 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-12T03:58:45.836 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.752+0000 7f47e5ffb640 1 -- 10.20.193.91:0/4153586687 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 35216979 0 0) 0x7f47f811b7d0 con 0x7f47f80b7180 2026-02-12T03:58:45.836 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.752+0000 7f47e5ffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.836 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.752+0000 7f47e5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.836 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.752+0000 7f47e5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.836 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.752+0000 7f47e5ffb640 10 monclient(hunting): my global_id is 4476 2026-02-12T03:58:45.836 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.752+0000 7f47e5ffb640 1 -- 10.20.193.91:0/4153586687 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47c8003610 con 0x7f47f80b7180 2026-02-12T03:58:45.836 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.752+0000 7f07c37fe640 1 -- 10.20.193.91:0/198827363 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3498111249 0 0) 0x7f07e4152200 con 0x7f07e40b5b70 2026-02-12T03:58:45.836 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.752+0000 7f07c37fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.836 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.752+0000 7f07c37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.836 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.752+0000 7f07c37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.836 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.752+0000 7f07c37fe640 10 monclient(hunting): my global_id is 4474 2026-02-12T03:58:45.836 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.752+0000 7f07c37fe640 1 -- 10.20.193.91:0/198827363 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07e41524e0 con 0x7f07e40b5b70 2026-02-12T03:58:45.837 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.752+0000 7f7938ff9640 10 client.4458.objecter ms_handle_connect 0x7f790c0a3690 2026-02-12T03:58:45.837 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7f72497fa640 1 -- 10.20.193.91:0/1817416077 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1713462390 0 0) 0x7f7224003610 con 0x7f72540b57a0 2026-02-12T03:58:45.837 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7f72497fa640 1 -- 10.20.193.91:0/1817416077 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7254162d90 con 0x7f72540b57a0 2026-02-12T03:58:45.837 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7f72497fa640 1 -- 10.20.193.91:0/1817416077 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f7244003060 con 0x7f72540b57a0 2026-02-12T03:58:45.837 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7f72497fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:45.837 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7f72497fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:45.837 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7f72497fa640 10 monclient(hunting): dump: 2026-02-12T03:58:45.837 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.837 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.837 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.837 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.837 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.837 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.837 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.837 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.837 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.837 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.837 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7ff728ff9640 1 -- 10.20.193.91:0/2171776711 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2547720950 0 0) 0x7ff72c13aa00 con 0x7ff72c0abe50 2026-02-12T03:58:45.837 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7ff728ff9640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.837 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7ff728ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.837 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7ff728ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.837 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7ff728ff9640 10 monclient(hunting): my global_id is 4471 2026-02-12T03:58:45.837 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7ff728ff9640 1 -- 10.20.193.91:0/2171776711 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff72c13ace0 con 0x7ff72c0abe50 2026-02-12T03:58:45.838 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7fb2b17fa640 1 -- 10.20.193.91:0/3624527245 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2093625099 0 0) 0x7fb2bc15e190 con 0x7fb2bc0b57a0 2026-02-12T03:58:45.838 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7fb2b17fa640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.838 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7fb2b17fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.838 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7fb2b17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.838 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7fb2b17fa640 10 monclient(hunting): my global_id is 4480 2026-02-12T03:58:45.838 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7ff212ffd640 1 -- 10.20.193.91:0/861051702 <== mon.2 v1:10.20.193.111:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7ff228094b30 con 0x7ff22c166f70 2026-02-12T03:58:45.838 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7ff212ffd640 10 client.4409.objecter ms_dispatch2 0x7ff22c000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:45.838 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7ff212ffd640 3 client.4409.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:45.838 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7ff212ffd640 3 client.4409.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:45.838 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7fb2b17fa640 1 -- 10.20.193.91:0/3624527245 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb28c003610 con 0x7fb2bc0b57a0 2026-02-12T03:58:45.838 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7ff212ffd640 10 client.4409.objecter checking command 1 2026-02-12T03:58:45.838 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7ff212ffd640 20 client.4409.objecter _get_session s=0x7ff1fc0a2ec0 osd=6 3 2026-02-12T03:58:45.838 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7ff212ffd640 20 client.4409.objecter put_session s=0x7ff1fc0a2ec0 osd=6 3 2026-02-12T03:58:45.838 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7ff212ffd640 15 client.4409.objecter _session_command_op_remove -1 1 2026-02-12T03:58:45.838 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7ff212ffd640 20 client.4409.objecter _get_session s=0x7ff1fc0a2ec0 osd=6 3 2026-02-12T03:58:45.838 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7ff212ffd640 20 client.4409.objecter get_session s=0x7ff1fc0a2ec0 osd=6 3 2026-02-12T03:58:45.838 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7ff212ffd640 15 client.4409.objecter _session_command_op_assign 6 1 2026-02-12T03:58:45.838 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7ff212ffd640 20 client.4409.objecter put_session s=0x7ff1fc0a2ec0 osd=6 4 2026-02-12T03:58:45.838 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7ff212ffd640 10 client.4409.objecter _send_command 1 2026-02-12T03:58:45.838 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7ff212ffd640 1 -- 10.20.193.91:0/861051702 --> v1:10.20.193.111:6804/727190484 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff228003380 con 0x7ff1fc0a3570 2026-02-12T03:58:45.838 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7ff212ffd640 20 client.4409.objecter dump_active .. 0 homeless 2026-02-12T03:58:45.838 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7ff212ffd640 1 -- 10.20.193.91:0/861051702 <== mon.2 v1:10.20.193.111:6789/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7ff22805a100 con 0x7ff22c166f70 2026-02-12T03:58:45.838 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7ff212ffd640 10 monclient: handle_get_version_reply finishing 1 version 28 2026-02-12T03:58:45.839 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7fb2b17fa640 1 -- 10.20.193.91:0/3624527245 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1644562429 0 0) 0x7fb2bc15e470 con 0x7fb2bc0b5b70 2026-02-12T03:58:45.839 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7fb2b17fa640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.839 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7fb2b17fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.839 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7fb2b17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.839 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7fb2b17fa640 10 monclient(hunting): my global_id is 4439 2026-02-12T03:58:45.839 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7fb2b17fa640 1 -- 10.20.193.91:0/3624527245 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2bc15e190 con 0x7fb2bc0b5b70 2026-02-12T03:58:45.839 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7f71d6ffd640 1 -- 10.20.193.91:0/3729138105 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3005559189 0 0) 0x7f71f415eb70 con 0x7f71f4166f70 2026-02-12T03:58:45.839 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7f71d6ffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.839 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7f71d6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.839 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7f71d6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.839 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7f71d6ffd640 10 monclient(hunting): my global_id is 4483 2026-02-12T03:58:45.839 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.753+0000 7f71d6ffd640 1 -- 10.20.193.91:0/3729138105 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71f415e890 con 0x7f71f4166f70 2026-02-12T03:58:45.839 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.754+0000 7f1b3ffff640 1 -- 10.20.193.91:0/3744615041 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1311977309 0 0) 0x7f1b640b1ea0 con 0x7f1b640b5e90 2026-02-12T03:58:45.839 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.754+0000 7f1b3ffff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.839 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.754+0000 7f1b3ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.839 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.754+0000 7f1b3ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.839 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.754+0000 7f1b3ffff640 10 monclient(hunting): my global_id is 4436 2026-02-12T03:58:45.839 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.754+0000 7f1b3ffff640 1 -- 10.20.193.91:0/3744615041 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b34003610 con 0x7f1b640b5e90 2026-02-12T03:58:45.839 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.754+0000 7ff231838640 10 monclient: get_auth_request con 0x7ff1fc0a3570 auth_method 0 2026-02-12T03:58:45.839 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.754+0000 7f3e4effd640 1 -- 10.20.193.91:0/1309264919 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 106632298 0 0) 0x7f3e681fb020 con 0x7f3e681639c0 2026-02-12T03:58:45.839 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.754+0000 7f3e4effd640 1 -- 10.20.193.91:0/1309264919 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3e681fad40 con 0x7f3e681639c0 2026-02-12T03:58:45.840 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.754+0000 7f3e4effd640 1 -- 10.20.193.91:0/1309264919 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f3e580034f0 con 0x7f3e681639c0 2026-02-12T03:58:45.840 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.754+0000 7f3e4effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:45.840 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.754+0000 7f3e4effd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:45.840 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.754+0000 7f3e4effd640 10 monclient(hunting): dump: 2026-02-12T03:58:45.840 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.840 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.840 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.840 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.840 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.840 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.840 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.840 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.840 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.840 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.840 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.754+0000 7f3e4effd640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:45.840 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.754+0000 7f47e5ffb640 1 -- 10.20.193.91:0/4153586687 <== mon.1 v1:10.20.193.98:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1540605924 0 0) 0x7f47f811bab0 con 0x7f47f80b57a0 2026-02-12T03:58:45.840 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.754+0000 7f47e5ffb640 1 -- 10.20.193.91:0/4153586687 >> v1:10.20.193.111:6789/0 conn(0x7f47f80b5b70 legacy=0x7f47f81301c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.840 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.754+0000 7f47e5ffb640 1 -- 10.20.193.91:0/4153586687 >> v1:10.20.193.91:6789/0 conn(0x7f47f80b7180 legacy=0x7f47f8136c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.840 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.754+0000 7f47e5ffb640 10 monclient: _finish_hunting 0 2026-02-12T03:58:45.840 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.754+0000 7f47e5ffb640 1 monclient: found mon.b 2026-02-12T03:58:45.840 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.754+0000 7f47e5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:45.840 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.754+0000 7f47e5ffb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:45.840 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.754+0000 7f47e5ffb640 1 -- 10.20.193.91:0/4153586687 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f811c070 con 0x7f47f80b57a0 2026-02-12T03:58:45.840 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.754+0000 7f47e5ffb640 10 monclient: _finish_auth 0 2026-02-12T03:58:45.840 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.754+0000 7f47e5ffb640 10 monclient: _check_auth_tickets 2026-02-12T03:58:45.840 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.754+0000 7f47e5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:45.840 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.754+0000 7f47ff5cc640 5 monclient: authenticate success, global_id 4456 2026-02-12T03:58:45.840 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.754+0000 7f47ff5cc640 10 monclient: _renew_subs 2026-02-12T03:58:45.840 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.754+0000 7f47ff5cc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:45.841 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.754+0000 7f47ff5cc640 1 -- 10.20.193.91:0/4153586687 --> v1:10.20.193.98:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f47f812fca0 con 0x7f47f80b57a0 2026-02-12T03:58:45.841 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.754+0000 7f47ff5cc640 10 client.4456.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:45.841 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.754+0000 7f47ff5cc640 10 monclient: _renew_subs 2026-02-12T03:58:45.841 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.754+0000 7f47ff5cc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:45.841 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.754+0000 7f47ff5cc640 1 -- 10.20.193.91:0/4153586687 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f47f81308d0 con 0x7f47f80b57a0 2026-02-12T03:58:45.841 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.754+0000 7f47ff5cc640 1 librados: init done 2026-02-12T03:58:45.841 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.755+0000 7f47ff5cc640 10 client.4456.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:45.841 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.755+0000 7f47ff5cc640 15 client.4456.objecter _session_command_op_assign -1 1 2026-02-12T03:58:45.841 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.755+0000 7f47ff5cc640 20 client.4456.objecter _get_session osd=-1 returning homeless 2026-02-12T03:58:45.841 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.755+0000 7f47ff5cc640 10 client.4456.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:45.841 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.755+0000 7f47ff5cc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:45.841 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.755+0000 7f47ff5cc640 1 -- 10.20.193.91:0/4153586687 --> v1:10.20.193.98:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f47f80b60e0 con 0x7f47f80b57a0 2026-02-12T03:58:45.841 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.755+0000 7ff212ffd640 10 client.4409.objecter ms_handle_connect 0x7ff1fc0a3570 2026-02-12T03:58:45.841 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.756+0000 7f72497fa640 1 -- 10.20.193.91:0/1817416077 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 82264444 0 0) 0x7f7254057b90 con 0x7f72540b7180 2026-02-12T03:58:45.841 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.756+0000 7f72497fa640 1 -- 10.20.193.91:0/1817416077 >> v1:10.20.193.111:6789/0 conn(0x7f72540b5b70 legacy=0x7f7254057480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.841 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.756+0000 7f72497fa640 1 -- 10.20.193.91:0/1817416077 >> v1:10.20.193.98:6789/0 conn(0x7f72540b57a0 legacy=0x7f7254162680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.841 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.756+0000 7f72497fa640 10 monclient: _finish_hunting 0 2026-02-12T03:58:45.841 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.756+0000 7f72497fa640 1 monclient: found mon.a 2026-02-12T03:58:45.841 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.756+0000 7f72497fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:45.841 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.756+0000 7f72497fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:45.841 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.756+0000 7f72497fa640 1 -- 10.20.193.91:0/1817416077 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7254161300 con 0x7f72540b7180 2026-02-12T03:58:45.841 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.756+0000 7f72497fa640 10 monclient: _finish_auth 0 2026-02-12T03:58:45.841 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.756+0000 7f72497fa640 10 monclient: _check_auth_tickets 2026-02-12T03:58:45.841 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.756+0000 7f72497fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:45.841 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.756+0000 7f725b251640 5 monclient: authenticate success, global_id 4473 2026-02-12T03:58:45.841 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.756+0000 7f725b251640 10 monclient: _renew_subs 2026-02-12T03:58:45.841 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.756+0000 7f725b251640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:45.841 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.756+0000 7f725b251640 1 -- 10.20.193.91:0/1817416077 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f72541615e0 con 0x7f72540b7180 2026-02-12T03:58:45.841 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.756+0000 7f725b251640 10 client.4473.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:45.842 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.756+0000 7f725b251640 10 monclient: _renew_subs 2026-02-12T03:58:45.842 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.756+0000 7f725b251640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:45.842 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.756+0000 7f725b251640 1 -- 10.20.193.91:0/1817416077 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7254161ba0 con 0x7f72540b7180 2026-02-12T03:58:45.842 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.756+0000 7f725b251640 1 librados: init done 2026-02-12T03:58:45.842 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.757+0000 7f3e4effd640 1 -- 10.20.193.91:0/1309264919 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1851670727 0 0) 0x7f3e34003610 con 0x7f3e680afe70 2026-02-12T03:58:45.842 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.757+0000 7f3e4effd640 1 -- 10.20.193.91:0/1309264919 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3e681fb020 con 0x7f3e680afe70 2026-02-12T03:58:45.842 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.757+0000 7f3e4effd640 1 -- 10.20.193.91:0/1309264919 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f3e5c0030d0 con 0x7f3e680afe70 2026-02-12T03:58:45.842 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.757+0000 7f3e4effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:45.842 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.757+0000 7f3e4effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:45.842 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.757+0000 7f3e4effd640 10 monclient(hunting): dump: 2026-02-12T03:58:45.842 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.842 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.842 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.842 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.842 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.842 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.842 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.842 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.842 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.842 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.842 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.757+0000 7f725b251640 10 client.4473.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:45.842 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.757+0000 7f725b251640 15 client.4473.objecter _session_command_op_assign -1 1 2026-02-12T03:58:45.842 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.757+0000 7f725b251640 20 client.4473.objecter _get_session osd=-1 returning homeless 2026-02-12T03:58:45.842 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.757+0000 7f725b251640 10 client.4473.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:45.842 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.757+0000 7f725b251640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:45.842 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.757+0000 7f725b251640 1 -- 10.20.193.91:0/1817416077 --> v1:10.20.193.91:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f72540b60e0 con 0x7f72540b7180 2026-02-12T03:58:45.842 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.757+0000 7f71d6ffd640 1 -- 10.20.193.91:0/3729138105 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 139463081 0 0) 0x7f71c0003610 con 0x7f71f4164760 2026-02-12T03:58:45.842 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.757+0000 7f71d6ffd640 1 -- 10.20.193.91:0/3729138105 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f71f415eb70 con 0x7f71f4164760 2026-02-12T03:58:45.842 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.757+0000 7f71d6ffd640 1 -- 10.20.193.91:0/3729138105 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f71dc003100 con 0x7f71f4164760 2026-02-12T03:58:45.842 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.757+0000 7f71d6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:45.843 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.757+0000 7f71d6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:45.843 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.757+0000 7f71d6ffd640 10 monclient(hunting): dump: 2026-02-12T03:58:45.843 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.843 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.843 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.843 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.843 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.843 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.843 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.843 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.843 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.843 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.843 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.757+0000 7f71d6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:45.843 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.757+0000 7f1b3ffff640 1 -- 10.20.193.91:0/3744615041 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2308386689 0 0) 0x7f1b640b1bc0 con 0x7f1b6405a7c0 2026-02-12T03:58:45.843 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.757+0000 7f1b3ffff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.843 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.757+0000 7f1b3ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.843 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.757+0000 7f1b3ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.843 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.757+0000 7f1b3ffff640 10 monclient(hunting): my global_id is 4477 2026-02-12T03:58:45.843 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.757+0000 7f1b3ffff640 1 -- 10.20.193.91:0/3744615041 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b640b1ea0 con 0x7f1b6405a7c0 2026-02-12T03:58:45.843 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.757+0000 7ff238ff9640 1 -- 10.20.193.91:0/4164622660 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2013011042 0 0) 0x7ff23c1667e0 con 0x7ff23c167e90 2026-02-12T03:58:45.843 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.757+0000 7ff238ff9640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.843 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.757+0000 7ff238ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.843 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.757+0000 7ff238ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.843 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.757+0000 7ff238ff9640 10 monclient(hunting): my global_id is 4448 2026-02-12T03:58:45.843 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.757+0000 7ff238ff9640 1 -- 10.20.193.91:0/4164622660 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff20c003610 con 0x7ff23c167e90 2026-02-12T03:58:45.843 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.758+0000 7f71d6ffd640 1 -- 10.20.193.91:0/3729138105 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2381470695 0 0) 0x7f71f415ee50 con 0x7f71f4159b70 2026-02-12T03:58:45.844 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.758+0000 7f71d6ffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.844 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.758+0000 7f71d6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.844 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.758+0000 7f71d6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.844 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.758+0000 7f71d6ffd640 10 monclient(hunting): my global_id is 4445 2026-02-12T03:58:45.844 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.758+0000 7f71d6ffd640 1 -- 10.20.193.91:0/3729138105 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71c0003610 con 0x7f71f4159b70 2026-02-12T03:58:45.844 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.761+0000 7ff728ff9640 1 -- 10.20.193.91:0/2171776711 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2218925899 0 0) 0x7ff72c11ba80 con 0x7ff72c0aba80 2026-02-12T03:58:45.844 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.761+0000 7ff728ff9640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.844 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.761+0000 7ff728ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.844 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.761+0000 7ff728ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.844 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.761+0000 7ff728ff9640 10 monclient(hunting): my global_id is 4479 2026-02-12T03:58:45.844 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.761+0000 7ff728ff9640 1 -- 10.20.193.91:0/2171776711 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff72c13aa00 con 0x7ff72c0aba80 2026-02-12T03:58:45.844 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.762+0000 7fb2b17fa640 10 client.?.objecter ms_handle_connect 0x7fb2bc0b7180 2026-02-12T03:58:45.844 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.762+0000 7fb2b17fa640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:45.844 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.764+0000 7fd0baffd640 1 -- 10.20.193.91:0/2911181674 <== mon.2 v1:10.20.193.111:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd0d40ba7f0 con 0x7fd0d40b8080 2026-02-12T03:58:45.844 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.764+0000 7fd0baffd640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:45.844 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.764+0000 7fd0baffd640 1 -- 10.20.193.91:0/2911181674 <== mon.2 v1:10.20.193.111:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd0c8003680 con 0x7fd0d40b8080 2026-02-12T03:58:45.844 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.764+0000 7fd0baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.844 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.764+0000 7fd0baffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:45.844 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.764+0000 7fd0d0d72640 4 set_mon_vals no callback set 2026-02-12T03:58:45.844 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.764+0000 7fd0baffd640 10 monclient: dump: 2026-02-12T03:58:45.844 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.844 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.844 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.845 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.845 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.845 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.845 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.845 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.845 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.845 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.845 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.765+0000 7fd0baffd640 1 -- 10.20.193.91:0/2911181674 <== mon.2 v1:10.20.193.111:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7fd0c8003850 con 0x7fd0d40b8080 2026-02-12T03:58:45.845 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.765+0000 7fd0d1d74640 10 monclient: get_auth_request con 0x7fd0a007a160 auth_method 0 2026-02-12T03:58:45.845 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.765+0000 7fd0baffd640 10 client.4412.objecter ms_handle_connect 0x7fd0a007a160 2026-02-12T03:58:45.845 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.765+0000 7f07c37fe640 1 -- 10.20.193.91:0/198827363 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2156399696 0 0) 0x7f07e41524e0 con 0x7f07e40b5b70 2026-02-12T03:58:45.845 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.765+0000 7f07c37fe640 1 -- 10.20.193.91:0/198827363 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f07e4152200 con 0x7f07e40b5b70 2026-02-12T03:58:45.845 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.765+0000 7f07c37fe640 1 -- 10.20.193.91:0/198827363 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f07cc003390 con 0x7f07e40b5b70 2026-02-12T03:58:45.845 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.765+0000 7f07c37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:45.845 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.765+0000 7f07c37fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:45.845 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.765+0000 7f07c37fe640 10 monclient(hunting): dump: 2026-02-12T03:58:45.845 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.845 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.845 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.845 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.845 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.845 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.845 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.845 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.845 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.845 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.845 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.765+0000 7f07c37fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:45.845 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.765+0000 7ff238ff9640 1 -- 10.20.193.91:0/4164622660 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2243421263 0 0) 0x7ff23c166500 con 0x7ff23c161ad0 2026-02-12T03:58:45.845 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.765+0000 7ff238ff9640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.846 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.765+0000 7ff238ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.846 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.765+0000 7ff238ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.846 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.765+0000 7ff238ff9640 10 monclient(hunting): my global_id is 4486 2026-02-12T03:58:45.846 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.765+0000 7ff238ff9640 1 -- 10.20.193.91:0/4164622660 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff23c1667e0 con 0x7ff23c161ad0 2026-02-12T03:58:45.846 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.766+0000 7fb2b17fa640 1 -- 10.20.193.91:0/3624527245 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3803074802 0 0) 0x7fb28c003610 con 0x7fb2bc0b57a0 2026-02-12T03:58:45.846 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.766+0000 7fb2b17fa640 1 -- 10.20.193.91:0/3624527245 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb2bc15e470 con 0x7fb2bc0b57a0 2026-02-12T03:58:45.846 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.766+0000 7fb2b17fa640 1 -- 10.20.193.91:0/3624527245 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fb2ac003060 con 0x7fb2bc0b57a0 2026-02-12T03:58:45.846 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.766+0000 7fb2b17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:45.846 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.766+0000 7fb2b17fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:45.846 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.766+0000 7fb2b17fa640 10 monclient(hunting): dump: 2026-02-12T03:58:45.846 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.846 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.846 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.846 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.846 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.846 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.846 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.846 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.846 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.846 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.846 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.766+0000 7fb2b17fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:45.846 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.767+0000 7fd0baffd640 1 -- 10.20.193.91:0/2911181674 <== mon.2 v1:10.20.193.111:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7fd0c80945d0 con 0x7fd0d40b8080 2026-02-12T03:58:45.846 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.767+0000 7fd0baffd640 10 client.4412.objecter ms_dispatch2 0x7fd0d4000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:45.847 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.767+0000 7fd0baffd640 3 client.4412.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:45.847 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.767+0000 7fd0baffd640 3 client.4412.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:45.847 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.767+0000 7fd0baffd640 10 client.4412.objecter checking command 1 2026-02-12T03:58:45.847 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.767+0000 7fd0baffd640 20 client.4412.objecter _get_session s=0x7fd0a00a3040 osd=8 3 2026-02-12T03:58:45.847 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.767+0000 7fd0baffd640 20 client.4412.objecter put_session s=0x7fd0a00a3040 osd=8 3 2026-02-12T03:58:45.847 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.767+0000 7fd0baffd640 15 client.4412.objecter _session_command_op_remove -1 1 2026-02-12T03:58:45.847 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.767+0000 7fd0baffd640 20 client.4412.objecter _get_session s=0x7fd0a00a3040 osd=8 3 2026-02-12T03:58:45.847 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.767+0000 7fd0baffd640 20 client.4412.objecter get_session s=0x7fd0a00a3040 osd=8 3 2026-02-12T03:58:45.847 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.767+0000 7fd0baffd640 15 client.4412.objecter _session_command_op_assign 8 1 2026-02-12T03:58:45.847 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.767+0000 7fd0baffd640 20 client.4412.objecter put_session s=0x7fd0a00a3040 osd=8 4 2026-02-12T03:58:45.847 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.767+0000 7fd0baffd640 10 client.4412.objecter _send_command 1 2026-02-12T03:58:45.847 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.767+0000 7fd0baffd640 1 -- 10.20.193.91:0/2911181674 --> v1:10.20.193.91:6809/443384425 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd0a00c5390 con 0x7fd0a00a36f0 2026-02-12T03:58:45.847 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.767+0000 7fd0baffd640 20 client.4412.objecter dump_active .. 0 homeless 2026-02-12T03:58:45.847 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.767+0000 7fd0baffd640 1 -- 10.20.193.91:0/2911181674 <== mon.2 v1:10.20.193.111:6789/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7fd0c8059ba0 con 0x7fd0d40b8080 2026-02-12T03:58:45.847 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.767+0000 7fd0baffd640 10 monclient: handle_get_version_reply finishing 1 version 28 2026-02-12T03:58:45.847 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.767+0000 7ff728ff9640 1 -- 10.20.193.91:0/2171776711 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2480302658 0 0) 0x7ff6fc003610 con 0x7ff72c0b3f60 2026-02-12T03:58:45.847 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.767+0000 7ff728ff9640 1 -- 10.20.193.91:0/2171776711 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff72c11ba80 con 0x7ff72c0b3f60 2026-02-12T03:58:45.847 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.767+0000 7ff728ff9640 1 -- 10.20.193.91:0/2171776711 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7ff7200032f0 con 0x7ff72c0b3f60 2026-02-12T03:58:45.847 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.767+0000 7ff728ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:45.847 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.767+0000 7ff728ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:45.847 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.767+0000 7ff728ff9640 10 monclient(hunting): dump: 2026-02-12T03:58:45.847 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.847 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.847 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.847 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.847 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.847 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.847 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.847 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.847 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.847 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.847 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.767+0000 7ff728ff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:45.848 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.767+0000 7fd0d2d76640 10 monclient: get_auth_request con 0x7fd0a00a36f0 auth_method 0 2026-02-12T03:58:45.848 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.768+0000 7fd0baffd640 10 client.4412.objecter ms_handle_connect 0x7fd0a00a36f0 2026-02-12T03:58:45.848 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.769+0000 7f7db9ffb640 1 -- 10.20.193.91:0/4137855695 <== osd.2 v1:10.20.193.111:6812/350848222 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f7d9c0c5080 con 0x7f7d9c0a3480 2026-02-12T03:58:45.848 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.769+0000 7f7db9ffb640 10 client.4432.objecter ms_dispatch2 0x7f7dcc000b90 command_reply(tid 1: 0 ) 2026-02-12T03:58:45.848 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.769+0000 7f7db9ffb640 10 client.4432.objecter _finish_command 1 = system:0 2026-02-12T03:58:45.848 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.769+0000 7f7db9ffb640 20 client.4432.objecter put_session s=0x7f7d9c0a2dd0 osd=2 4 2026-02-12T03:58:45.848 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.769+0000 7f7db9ffb640 15 client.4432.objecter _session_command_op_remove 2 1 2026-02-12T03:58:45.848 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.771+0000 7f07c37fe640 1 -- 10.20.193.91:0/198827363 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 987898170 0 0) 0x7f07b0003610 con 0x7f07e40b7180 2026-02-12T03:58:45.848 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.771+0000 7f07c37fe640 1 -- 10.20.193.91:0/198827363 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f07e41524e0 con 0x7f07e40b7180 2026-02-12T03:58:45.848 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.771+0000 7f07c37fe640 1 -- 10.20.193.91:0/198827363 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f07d4003410 con 0x7f07e40b7180 2026-02-12T03:58:45.848 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.771+0000 7f07c37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:45.848 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.771+0000 7f07c37fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:45.848 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.771+0000 7f07c37fe640 10 monclient(hunting): dump: 2026-02-12T03:58:45.848 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.848 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.848 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.848 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.848 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.848 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.848 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.848 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.848 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.848 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.848 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.771+0000 7f3e4effd640 1 -- 10.20.193.91:0/1309264919 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 785961985 0 0) 0x7f3e681f8370 con 0x7f3e6815f310 2026-02-12T03:58:45.848 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.771+0000 7f3e4effd640 1 -- 10.20.193.91:0/1309264919 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3e34003610 con 0x7f3e6815f310 2026-02-12T03:58:45.848 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.771+0000 7f3e4effd640 1 -- 10.20.193.91:0/1309264919 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f3e50003060 con 0x7f3e6815f310 2026-02-12T03:58:45.849 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.771+0000 7f3e4effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:45.849 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.772+0000 7f3e4effd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:45.849 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.772+0000 7f3e4effd640 10 monclient(hunting): dump: 2026-02-12T03:58:45.849 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.849 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.849 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.849 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.849 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.849 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.849 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.849 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.849 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.849 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.849 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.772+0000 7f7938ff9640 1 -- 10.20.193.91:0/4216721313 <== osd.12 v1:10.20.193.91:6813/3587007397 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f790c0c5290 con 0x7f790c0a3690 2026-02-12T03:58:45.849 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.772+0000 7f7938ff9640 10 client.4458.objecter ms_dispatch2 0x7f793c000b90 command_reply(tid 1: 0 ) 2026-02-12T03:58:45.849 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.772+0000 7f7938ff9640 10 client.4458.objecter _finish_command 1 = system:0 2026-02-12T03:58:45.849 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.772+0000 7f7938ff9640 20 client.4458.objecter put_session s=0x7f790c0a2fe0 osd=12 4 2026-02-12T03:58:45.849 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.772+0000 7f7938ff9640 15 client.4458.objecter _session_command_op_remove 12 1 2026-02-12T03:58:45.849 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.773+0000 7ff728ff9640 1 -- 10.20.193.91:0/2171776711 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 865575570 0 0) 0x7ff72c13ace0 con 0x7ff72c0abe50 2026-02-12T03:58:45.849 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.773+0000 7ff728ff9640 1 -- 10.20.193.91:0/2171776711 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff6fc003610 con 0x7ff72c0abe50 2026-02-12T03:58:45.849 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.773+0000 7ff728ff9640 1 -- 10.20.193.91:0/2171776711 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7ff71c0030b0 con 0x7ff72c0abe50 2026-02-12T03:58:45.849 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.773+0000 7ff728ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:45.849 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.773+0000 7ff728ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:45.849 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.773+0000 7ff728ff9640 10 monclient(hunting): dump: 2026-02-12T03:58:45.849 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.849 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.849 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.849 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.849 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.849 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.849 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.849 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.849 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.850 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.850 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.773+0000 7f72497fa640 1 -- 10.20.193.91:0/1817416077 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f72540b60e0 con 0x7f72540b7180 2026-02-12T03:58:45.850 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.773+0000 7f72497fa640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:45.850 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.773+0000 7f72497fa640 1 -- 10.20.193.91:0/1817416077 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f7250002d40 con 0x7f72540b7180 2026-02-12T03:58:45.850 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.773+0000 7f72497fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.850 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.773+0000 7f72497fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:45.850 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.773+0000 7f72497fa640 10 monclient: dump: 2026-02-12T03:58:45.850 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.850 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.850 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.850 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.850 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.850 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.850 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.850 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.850 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.850 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.850 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.773+0000 7f724affd640 4 set_mon_vals no callback set 2026-02-12T03:58:45.850 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.773+0000 7ff238ff9640 1 -- 10.20.193.91:0/4164622660 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1668609228 0 0) 0x7ff23c166220 con 0x7ff23c0564d0 2026-02-12T03:58:45.850 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.773+0000 7ff238ff9640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.850 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.773+0000 7ff238ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.850 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.773+0000 7ff238ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.850 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.773+0000 7ff238ff9640 10 monclient(hunting): my global_id is 4491 2026-02-12T03:58:45.850 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.773+0000 7ff238ff9640 1 -- 10.20.193.91:0/4164622660 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff23c166500 con 0x7ff23c0564d0 2026-02-12T03:58:45.850 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.774+0000 7f72497fa640 1 -- 10.20.193.91:0/1817416077 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f725001e3a0 con 0x7f72540b7180 2026-02-12T03:58:45.851 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.775+0000 7f7258fc6640 10 monclient: get_auth_request con 0x7f7224079fd0 auth_method 0 2026-02-12T03:58:45.851 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.775+0000 7f72497fa640 10 client.4473.objecter ms_handle_connect 0x7f7224079fd0 2026-02-12T03:58:45.851 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.776+0000 7ff212ffd640 1 -- 10.20.193.91:0/861051702 <== osd.6 v1:10.20.193.111:6804/727190484 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7ff228003380 con 0x7ff1fc0a3570 2026-02-12T03:58:45.851 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.776+0000 7ff212ffd640 10 client.4409.objecter ms_dispatch2 0x7ff22c000b90 command_reply(tid 1: 0 ) 2026-02-12T03:58:45.851 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.776+0000 7ff212ffd640 10 client.4409.objecter _finish_command 1 = system:0 2026-02-12T03:58:45.851 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.776+0000 7ff212ffd640 20 client.4409.objecter put_session s=0x7ff1fc0a2ec0 osd=6 4 2026-02-12T03:58:45.851 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.776+0000 7ff212ffd640 15 client.4409.objecter _session_command_op_remove 6 1 2026-02-12T03:58:45.851 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.777+0000 7f71d6ffd640 1 -- 10.20.193.91:0/3729138105 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3816773446 0 0) 0x7f71f415e890 con 0x7f71f4166f70 2026-02-12T03:58:45.851 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.777+0000 7f71d6ffd640 1 -- 10.20.193.91:0/3729138105 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f71f415ee50 con 0x7f71f4166f70 2026-02-12T03:58:45.851 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.777+0000 7f71d6ffd640 1 -- 10.20.193.91:0/3729138105 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f71e4003430 con 0x7f71f4166f70 2026-02-12T03:58:45.851 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.777+0000 7f71d6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:45.851 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.777+0000 7f71d6ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:45.851 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.777+0000 7f71d6ffd640 10 monclient(hunting): dump: 2026-02-12T03:58:45.851 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.851 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.851 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.851 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.851 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.851 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.851 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.851 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.851 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.851 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.852 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f07c37fe640 1 -- 10.20.193.91:0/198827363 <== mon.1 v1:10.20.193.98:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3652592529 0 0) 0x7f07e4152200 con 0x7f07e40b5b70 2026-02-12T03:58:45.852 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f07c37fe640 1 -- 10.20.193.91:0/198827363 >> v1:10.20.193.111:6789/0 conn(0x7f07e40b7180 legacy=0x7f07e411ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.852 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f07c37fe640 1 -- 10.20.193.91:0/198827363 >> v1:10.20.193.91:6789/0 conn(0x7f07e40b57a0 legacy=0x7f07e411d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.852 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f07c37fe640 10 monclient: _finish_hunting 0 2026-02-12T03:58:45.852 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f07c37fe640 1 monclient: found mon.b 2026-02-12T03:58:45.852 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f07c37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:45.852 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f07c37fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:45.852 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f07c37fe640 1 -- 10.20.193.91:0/198827363 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07e41527c0 con 0x7f07e40b5b70 2026-02-12T03:58:45.852 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f07c37fe640 10 monclient: _finish_auth 0 2026-02-12T03:58:45.852 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f07c37fe640 10 monclient: _check_auth_tickets 2026-02-12T03:58:45.852 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f07c37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:45.852 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f07e9528640 5 monclient: authenticate success, global_id 4474 2026-02-12T03:58:45.852 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f07e9528640 10 monclient: _renew_subs 2026-02-12T03:58:45.852 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f07e9528640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:45.852 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f07e9528640 1 -- 10.20.193.91:0/198827363 --> v1:10.20.193.98:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f07e4152aa0 con 0x7f07e40b5b70 2026-02-12T03:58:45.852 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f72497fa640 1 -- 10.20.193.91:0/1817416077 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7f7250095d10 con 0x7f72540b7180 2026-02-12T03:58:45.852 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f72497fa640 10 client.4473.objecter ms_dispatch2 0x7f7254000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:45.852 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f72497fa640 3 client.4473.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:45.852 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f72497fa640 3 client.4473.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:45.852 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f07e9528640 10 client.4474.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:45.852 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f07e9528640 10 monclient: _renew_subs 2026-02-12T03:58:45.852 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f07e9528640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:45.852 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f07e9528640 1 -- 10.20.193.91:0/198827363 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f07e411cca0 con 0x7f07e40b5b70 2026-02-12T03:58:45.852 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f72497fa640 10 client.4473.objecter checking command 1 2026-02-12T03:58:45.852 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f07e9528640 1 librados: init done 2026-02-12T03:58:45.853 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f3e4effd640 1 -- 10.20.193.91:0/1309264919 <== mon.1 v1:10.20.193.98:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2660349029 0 0) 0x7f3e681fad40 con 0x7f3e681639c0 2026-02-12T03:58:45.853 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f3e4effd640 1 -- 10.20.193.91:0/1309264919 >> v1:10.20.193.111:6789/0 conn(0x7f3e6815f310 legacy=0x7f3e68138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.853 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f72497fa640 20 client.4473.objecter _get_session s=0x7f72240a2e50 osd=9 3 2026-02-12T03:58:45.853 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f72497fa640 20 client.4473.objecter put_session s=0x7f72240a2e50 osd=9 3 2026-02-12T03:58:45.853 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f72497fa640 15 client.4473.objecter _session_command_op_remove -1 1 2026-02-12T03:58:45.853 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f72497fa640 20 client.4473.objecter _get_session s=0x7f72240a2e50 osd=9 3 2026-02-12T03:58:45.853 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f72497fa640 20 client.4473.objecter get_session s=0x7f72240a2e50 osd=9 3 2026-02-12T03:58:45.853 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f72497fa640 15 client.4473.objecter _session_command_op_assign 9 1 2026-02-12T03:58:45.853 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f72497fa640 20 client.4473.objecter put_session s=0x7f72240a2e50 osd=9 4 2026-02-12T03:58:45.853 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f72497fa640 10 client.4473.objecter _send_command 1 2026-02-12T03:58:45.853 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f3e4effd640 1 -- 10.20.193.91:0/1309264919 >> v1:10.20.193.91:6789/0 conn(0x7f3e680afe70 legacy=0x7f3e681fa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.853 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f72497fa640 1 -- 10.20.193.91:0/1817416077 --> v1:10.20.193.98:6801/4165741185 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f72240c5100 con 0x7f72240a3500 2026-02-12T03:58:45.853 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f72497fa640 20 client.4473.objecter dump_active .. 0 homeless 2026-02-12T03:58:45.853 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f72497fa640 1 -- 10.20.193.91:0/1817416077 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7f725005b2e0 con 0x7f72540b7180 2026-02-12T03:58:45.853 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f72497fa640 10 monclient: handle_get_version_reply finishing 1 version 28 2026-02-12T03:58:45.853 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7fb2b17fa640 1 -- 10.20.193.91:0/3624527245 <== mon.1 v1:10.20.193.98:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4251902406 0 0) 0x7fb2bc15e470 con 0x7fb2bc0b57a0 2026-02-12T03:58:45.853 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7fb2b17fa640 1 -- 10.20.193.91:0/3624527245 >> v1:10.20.193.111:6789/0 conn(0x7fb2bc0b5b70 legacy=0x7fb2bc1629c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.853 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f71d6ffd640 1 -- 10.20.193.91:0/3729138105 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 413647423 0 0) 0x7f71f415eb70 con 0x7f71f4164760 2026-02-12T03:58:45.854 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7fb2b17fa640 1 -- 10.20.193.91:0/3624527245 >> v1:10.20.193.91:6789/0 conn(0x7fb2bc0b7180 legacy=0x7fb2bc160970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.854 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7fb2b17fa640 10 monclient: _finish_hunting 0 2026-02-12T03:58:45.854 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7fb2b17fa640 1 monclient: found mon.b 2026-02-12T03:58:45.854 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7fb2b17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:45.854 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f3e4effd640 10 monclient: _finish_hunting 0 2026-02-12T03:58:45.854 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f3e4effd640 1 monclient: found mon.b 2026-02-12T03:58:45.854 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f3e4effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:45.854 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f3e4effd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:45.854 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f3e4effd640 1 -- 10.20.193.91:0/1309264919 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e681fb300 con 0x7f3e681639c0 2026-02-12T03:58:45.854 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f71d6ffd640 1 -- 10.20.193.91:0/3729138105 >> v1:10.20.193.111:6789/0 conn(0x7f71f4159b70 legacy=0x7f71f4134ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.854 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7fb2b17fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:45.854 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7fb2b17fa640 1 -- 10.20.193.91:0/3624527245 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2bc15e750 con 0x7fb2bc0b57a0 2026-02-12T03:58:45.854 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7fb2b17fa640 10 monclient: _finish_auth 0 2026-02-12T03:58:45.854 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7fb2b17fa640 10 monclient: _check_auth_tickets 2026-02-12T03:58:45.854 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7fb2b17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:45.854 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f3e4effd640 10 monclient: _finish_auth 0 2026-02-12T03:58:45.854 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7fb2c2d13640 5 monclient: authenticate success, global_id 4480 2026-02-12T03:58:45.854 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7fb2c2d13640 10 monclient: _renew_subs 2026-02-12T03:58:45.854 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f3e4effd640 10 monclient: _check_auth_tickets 2026-02-12T03:58:45.854 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f3e4effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:45.854 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7fb2c2d13640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:45.855 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7fb2c2d13640 1 -- 10.20.193.91:0/3624527245 --> v1:10.20.193.98:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb2bc15ea30 con 0x7fb2bc0b57a0 2026-02-12T03:58:45.855 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f3e6cda9640 5 monclient: authenticate success, global_id 4465 2026-02-12T03:58:45.855 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f3e6cda9640 10 monclient: _renew_subs 2026-02-12T03:58:45.855 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f3e6cda9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:45.855 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f71d6ffd640 1 -- 10.20.193.91:0/3729138105 >> v1:10.20.193.98:6789/0 conn(0x7f71f4166f70 legacy=0x7f71f415db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.855 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f71d6ffd640 10 monclient: _finish_hunting 0 2026-02-12T03:58:45.855 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f71d6ffd640 1 monclient: found mon.a 2026-02-12T03:58:45.855 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f71d6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:45.855 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f3e6cda9640 1 -- 10.20.193.91:0/1309264919 --> v1:10.20.193.98:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3e68137820 con 0x7f3e681639c0 2026-02-12T03:58:45.855 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f71d6ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:45.855 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f71d6ffd640 1 -- 10.20.193.91:0/3729138105 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f415f130 con 0x7f71f4164760 2026-02-12T03:58:45.855 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f71d6ffd640 10 monclient: _finish_auth 0 2026-02-12T03:58:45.855 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f71d6ffd640 10 monclient: _check_auth_tickets 2026-02-12T03:58:45.855 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f71d6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:45.855 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f71f8bcc640 5 monclient: authenticate success, global_id 4485 2026-02-12T03:58:45.855 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f71f8bcc640 10 monclient: _renew_subs 2026-02-12T03:58:45.855 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f71f8bcc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:45.855 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f71f8bcc640 1 -- 10.20.193.91:0/3729138105 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f71f415f410 con 0x7f71f4164760 2026-02-12T03:58:45.855 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f3e6cda9640 10 client.4465.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:45.855 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7fb2c2d13640 10 client.4480.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:45.855 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7fb2c2d13640 10 monclient: _renew_subs 2026-02-12T03:58:45.856 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f3e6cda9640 10 monclient: _renew_subs 2026-02-12T03:58:45.856 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f3e6cda9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:45.856 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f3e6cda9640 1 -- 10.20.193.91:0/1309264919 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3e68137de0 con 0x7f3e681639c0 2026-02-12T03:58:45.856 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f3e6cda9640 1 librados: init done 2026-02-12T03:58:45.856 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7fb2c2d13640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:45.856 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f1b3ffff640 1 -- 10.20.193.91:0/3744615041 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 62073058 0 0) 0x7f1b64164fb0 con 0x7f1b64161c10 2026-02-12T03:58:45.856 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f1b3ffff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:45.856 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f1b3ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:45.856 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7fb2c2d13640 1 -- 10.20.193.91:0/3624527245 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb2bc15f410 con 0x7fb2bc0b57a0 2026-02-12T03:58:45.856 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7fb2c2d13640 1 librados: init done 2026-02-12T03:58:45.856 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f1b3ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:45.856 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f1b3ffff640 10 monclient(hunting): my global_id is 4482 2026-02-12T03:58:45.856 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f1b3ffff640 1 -- 10.20.193.91:0/3744615041 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b640b1bc0 con 0x7f1b64161c10 2026-02-12T03:58:45.856 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f71f8bcc640 10 client.4485.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:45.856 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f71f8bcc640 10 monclient: _renew_subs 2026-02-12T03:58:45.856 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f71f8bcc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:45.856 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f71f8bcc640 1 -- 10.20.193.91:0/3729138105 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f71f41353a0 con 0x7f71f4164760 2026-02-12T03:58:45.856 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f71f8bcc640 1 librados: init done 2026-02-12T03:58:45.856 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f7dd3802640 10 client.4432.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-12T03:58:45.857 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f7dd3802640 15 client.4432.objecter _session_command_op_assign -1 2 2026-02-12T03:58:45.857 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f7dd3802640 20 client.4432.objecter _get_session s=0x7f7d9c0a2dd0 osd=2 3 2026-02-12T03:58:45.857 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f7dd3802640 20 client.4432.objecter put_session s=0x7f7d9c0a2dd0 osd=2 3 2026-02-12T03:58:45.857 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f7dd3802640 20 client.4432.objecter _get_session s=0x7f7d9c0a2dd0 osd=2 3 2026-02-12T03:58:45.857 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f7dd3802640 15 client.4432.objecter _session_command_op_remove -1 2 2026-02-12T03:58:45.857 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f7dd3802640 20 client.4432.objecter get_session s=0x7f7d9c0a2dd0 osd=2 3 2026-02-12T03:58:45.857 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f7dd3802640 15 client.4432.objecter _session_command_op_assign 2 2 2026-02-12T03:58:45.857 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f7dd3802640 20 client.4432.objecter put_session s=0x7f7d9c0a2dd0 osd=2 4 2026-02-12T03:58:45.857 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f7dd3802640 10 client.4432.objecter _send_command 2 2026-02-12T03:58:45.857 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.778+0000 7f7dd3802640 1 -- 10.20.193.91:0/4137855695 --> v1:10.20.193.111:6812/350848222 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7dcc135b00 con 0x7f7d9c0a3480 2026-02-12T03:58:45.857 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.779+0000 7f07e9528640 10 client.4474.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:45.857 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.779+0000 7f07e9528640 15 client.4474.objecter _session_command_op_assign -1 1 2026-02-12T03:58:45.857 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.779+0000 7f07e9528640 20 client.4474.objecter _get_session osd=-1 returning homeless 2026-02-12T03:58:45.857 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.779+0000 7f07e9528640 10 client.4474.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:45.857 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.779+0000 7f07e9528640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:45.857 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.779+0000 7f07e9528640 1 -- 10.20.193.91:0/198827363 --> v1:10.20.193.98:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f07e40b60e0 con 0x7f07e40b5b70 2026-02-12T03:58:45.857 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.779+0000 7f3e6cda9640 10 client.4465.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:45.857 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.779+0000 7f3e6cda9640 15 client.4465.objecter _session_command_op_assign -1 1 2026-02-12T03:58:45.857 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.779+0000 7f3e6cda9640 20 client.4465.objecter _get_session osd=-1 returning homeless 2026-02-12T03:58:45.857 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.779+0000 7f3e6cda9640 10 client.4465.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:45.857 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.779+0000 7f3e6cda9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:45.857 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.779+0000 7f3e6cda9640 1 -- 10.20.193.91:0/1309264919 --> v1:10.20.193.98:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f3e681fa1f0 con 0x7f3e681639c0 2026-02-12T03:58:45.857 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.779+0000 7fb2c2d13640 10 client.4480.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:45.857 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.779+0000 7fb2c2d13640 15 client.4480.objecter _session_command_op_assign -1 1 2026-02-12T03:58:45.857 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.779+0000 7fb2c2d13640 20 client.4480.objecter _get_session osd=-1 returning homeless 2026-02-12T03:58:45.857 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.779+0000 7fb2c2d13640 10 client.4480.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:45.857 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.779+0000 7fb2c2d13640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:45.857 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.779+0000 7fb2c2d13640 1 -- 10.20.193.91:0/3624527245 --> v1:10.20.193.98:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fb2bc15a630 con 0x7fb2bc0b57a0 2026-02-12T03:58:45.858 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.779+0000 7f71f8bcc640 10 client.4485.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:45.858 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.779+0000 7f71f8bcc640 15 client.4485.objecter _session_command_op_assign -1 1 2026-02-12T03:58:45.858 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.779+0000 7f71f8bcc640 20 client.4485.objecter _get_session osd=-1 returning homeless 2026-02-12T03:58:45.858 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.779+0000 7f71f8bcc640 10 client.4485.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:45.858 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.779+0000 7f71f8bcc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:45.858 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.779+0000 7f71f8bcc640 1 -- 10.20.193.91:0/3729138105 --> v1:10.20.193.91:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f71f415f650 con 0x7f71f4164760 2026-02-12T03:58:45.858 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.780+0000 7f724bfff640 10 monclient: get_auth_request con 0x7f72240a3500 auth_method 0 2026-02-12T03:58:45.858 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.781+0000 7f7db9ffb640 1 -- 10.20.193.91:0/4137855695 <== osd.2 v1:10.20.193.111:6812/350848222 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1506399442) 0x7f7dcc135b00 con 0x7f7d9c0a3480 2026-02-12T03:58:45.858 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.781+0000 7f7db9ffb640 10 client.4432.objecter ms_dispatch2 0x7f7dcc000b90 command_reply(tid 2: 0 ) 2026-02-12T03:58:45.858 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.781+0000 7f7db9ffb640 10 client.4432.objecter _finish_command 2 = system:0 2026-02-12T03:58:45.858 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.781+0000 7f7db9ffb640 20 client.4432.objecter put_session s=0x7f7d9c0a2dd0 osd=2 4 2026-02-12T03:58:45.858 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.781+0000 7f7db9ffb640 15 client.4432.objecter _session_command_op_remove 2 2 2026-02-12T03:58:45.858 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.781+0000 7f79423be640 10 client.4458.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-12T03:58:45.858 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.781+0000 7f79423be640 15 client.4458.objecter _session_command_op_assign -1 2 2026-02-12T03:58:45.858 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.781+0000 7f79423be640 20 client.4458.objecter _get_session s=0x7f790c0a2fe0 osd=12 3 2026-02-12T03:58:45.858 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.781+0000 7f79423be640 20 client.4458.objecter put_session s=0x7f790c0a2fe0 osd=12 3 2026-02-12T03:58:45.858 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.781+0000 7f79423be640 20 client.4458.objecter _get_session s=0x7f790c0a2fe0 osd=12 3 2026-02-12T03:58:45.858 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.781+0000 7f79423be640 15 client.4458.objecter _session_command_op_remove -1 2 2026-02-12T03:58:45.858 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.781+0000 7f79423be640 20 client.4458.objecter get_session s=0x7f790c0a2fe0 osd=12 3 2026-02-12T03:58:45.858 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.781+0000 7f79423be640 15 client.4458.objecter _session_command_op_assign 12 2 2026-02-12T03:58:45.858 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.781+0000 7f79423be640 20 client.4458.objecter put_session s=0x7f790c0a2fe0 osd=12 4 2026-02-12T03:58:45.858 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.781+0000 7f79423be640 10 client.4458.objecter _send_command 2 2026-02-12T03:58:45.858 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.781+0000 7f79423be640 1 -- 10.20.193.91:0/4216721313 --> v1:10.20.193.91:6813/3587007397 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f793c0b2070 con 0x7f790c0a3690 2026-02-12T03:58:45.859 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.781+0000 7f7dd3802640 10 librados: watch_flush enter 2026-02-12T03:58:45.859 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.781+0000 7f7dd3802640 10 librados: watch_flush exit 2026-02-12T03:58:45.859 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.781+0000 7f7dd3802640 10 client.4432.objecter close_session for osd.2 2026-02-12T03:58:45.859 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.781+0000 7f7dd3802640 1 -- 10.20.193.91:0/4137855695 >> v1:10.20.193.111:6812/350848222 conn(0x7f7d9c0a3480 legacy=0x7f7d9c0c38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.859 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.781+0000 7f7dd3802640 20 client.4432.objecter put_session s=0x7f7d9c0a2dd0 osd=2 1 2026-02-12T03:58:45.859 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.781+0000 7f7dd3802640 20 client.4432.objecter shutdown clearing up homeless session... 2026-02-12T03:58:45.859 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.781+0000 7f7dd3802640 10 client.4432.objecter successfully canceled tick 2026-02-12T03:58:45.859 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.781+0000 7f7dd3802640 1 -- 10.20.193.91:0/4137855695 >> v1:10.20.193.91:6800/2929217192 conn(0x7f7d9c079f50 legacy=0x7f7d9c09a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.859 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.781+0000 7f7dd3802640 10 monclient: shutdown 2026-02-12T03:58:45.859 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.781+0000 7f7dd3802640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:45.859 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.781+0000 7f7dd3802640 1 -- 10.20.193.91:0/4137855695 >> v1:10.20.193.98:6789/0 conn(0x7f7dcc0b57a0 legacy=0x7f7dcc136fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.859 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.781+0000 7f7dd1d78640 1 -- 10.20.193.91:0/4137855695 reap_dead start 2026-02-12T03:58:45.859 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.781+0000 7f72497fa640 10 client.4473.objecter ms_handle_connect 0x7f72240a3500 2026-02-12T03:58:45.859 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.782+0000 7f7dd3802640 1 -- 10.20.193.91:0/4137855695 shutdown_connections 2026-02-12T03:58:45.859 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.782+0000 7f7dd3802640 1 -- 10.20.193.91:0/4137855695 >> 10.20.193.91:0/4137855695 conn(0x7f7dcc0559c0 msgr2=0x7f7dcc0b8990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:45.859 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.782+0000 7f7dd3802640 1 -- 10.20.193.91:0/4137855695 shutdown_connections 2026-02-12T03:58:45.859 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.782+0000 7f7dd3802640 1 -- 10.20.193.91:0/4137855695 wait complete. 2026-02-12T03:58:45.859 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.783+0000 7f7dd3802640 1 librados: shutdown 2026-02-12T03:58:45.859 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.784+0000 7f7938ff9640 1 -- 10.20.193.91:0/4216721313 <== osd.12 v1:10.20.193.91:6813/3587007397 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1506399442) 0x7f793c0b2070 con 0x7f790c0a3690 2026-02-12T03:58:45.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.784+0000 7f7938ff9640 10 client.4458.objecter ms_dispatch2 0x7f793c000b90 command_reply(tid 2: 0 ) 2026-02-12T03:58:45.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.784+0000 7f7938ff9640 10 client.4458.objecter _finish_command 2 = system:0 2026-02-12T03:58:45.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.784+0000 7f7938ff9640 20 client.4458.objecter put_session s=0x7f790c0a2fe0 osd=12 4 2026-02-12T03:58:45.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.784+0000 7f7938ff9640 15 client.4458.objecter _session_command_op_remove 12 2 2026-02-12T03:58:45.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.784+0000 7f79423be640 10 librados: watch_flush enter 2026-02-12T03:58:45.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.784+0000 7f79423be640 10 librados: watch_flush exit 2026-02-12T03:58:45.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.784+0000 7f79423be640 10 client.4458.objecter close_session for osd.12 2026-02-12T03:58:45.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.784+0000 7f79423be640 1 -- 10.20.193.91:0/4216721313 >> v1:10.20.193.91:6813/3587007397 conn(0x7f790c0a3690 legacy=0x7f790c0c3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.784+0000 7f79423be640 20 client.4458.objecter put_session s=0x7f790c0a2fe0 osd=12 1 2026-02-12T03:58:45.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.784+0000 7f79423be640 20 client.4458.objecter shutdown clearing up homeless session... 2026-02-12T03:58:45.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.784+0000 7f79423be640 10 client.4458.objecter successfully canceled tick 2026-02-12T03:58:45.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.784+0000 7f79423be640 1 -- 10.20.193.91:0/4216721313 >> v1:10.20.193.91:6800/2929217192 conn(0x7f790c07a160 legacy=0x7f790c09a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.784+0000 7f79423be640 10 monclient: shutdown 2026-02-12T03:58:45.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.784+0000 7f79423be640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:45.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.784+0000 7f79423be640 1 -- 10.20.193.91:0/4216721313 >> v1:10.20.193.91:6789/0 conn(0x7f793c15d2f0 legacy=0x7f793c0b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.784+0000 7f7940934640 1 -- 10.20.193.91:0/4216721313 reap_dead start 2026-02-12T03:58:45.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.784+0000 7f79423be640 1 -- 10.20.193.91:0/4216721313 shutdown_connections 2026-02-12T03:58:45.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.784+0000 7f79423be640 1 -- 10.20.193.91:0/4216721313 >> 10.20.193.91:0/4216721313 conn(0x7f793c0b7570 msgr2=0x7f793c0562d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:45.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.784+0000 7f79423be640 1 -- 10.20.193.91:0/4216721313 shutdown_connections 2026-02-12T03:58:45.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.784+0000 7f79423be640 1 -- 10.20.193.91:0/4216721313 wait complete. 2026-02-12T03:58:45.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.784+0000 7f79423be640 1 librados: shutdown 2026-02-12T03:58:45.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.785+0000 7fbd73fff640 1 -- 10.20.193.91:0/286286997 <== mon.2 v1:10.20.193.111:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbd900034b0 con 0x7fbd9c0b57a0 2026-02-12T03:58:45.860 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.785+0000 7fbd73fff640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:45.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.785+0000 7fbd73fff640 1 -- 10.20.193.91:0/286286997 <== mon.2 v1:10.20.193.111:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fbd90003b50 con 0x7fbd9c0b57a0 2026-02-12T03:58:45.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.785+0000 7fbd73fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.785+0000 7fbd73fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:45.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.785+0000 7fbd73fff640 10 monclient: dump: 2026-02-12T03:58:45.861 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.861 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.861 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.861 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.861 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.861 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.861 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.861 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.861 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.861 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.785+0000 7ff2342c4640 10 client.4409.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-12T03:58:45.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.785+0000 7ff2342c4640 15 client.4409.objecter _session_command_op_assign -1 2 2026-02-12T03:58:45.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.785+0000 7ff2342c4640 20 client.4409.objecter _get_session s=0x7ff1fc0a2ec0 osd=6 3 2026-02-12T03:58:45.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.785+0000 7ff2342c4640 20 client.4409.objecter put_session s=0x7ff1fc0a2ec0 osd=6 3 2026-02-12T03:58:45.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.785+0000 7ff2342c4640 20 client.4409.objecter _get_session s=0x7ff1fc0a2ec0 osd=6 3 2026-02-12T03:58:45.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.785+0000 7ff2342c4640 15 client.4409.objecter _session_command_op_remove -1 2 2026-02-12T03:58:45.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.785+0000 7ff2342c4640 20 client.4409.objecter get_session s=0x7ff1fc0a2ec0 osd=6 3 2026-02-12T03:58:45.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.785+0000 7ff2342c4640 15 client.4409.objecter _session_command_op_assign 6 2 2026-02-12T03:58:45.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.785+0000 7ff2342c4640 20 client.4409.objecter put_session s=0x7ff1fc0a2ec0 osd=6 4 2026-02-12T03:58:45.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.785+0000 7ff2342c4640 10 client.4409.objecter _send_command 2 2026-02-12T03:58:45.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.785+0000 7ff2342c4640 1 -- 10.20.193.91:0/861051702 --> v1:10.20.193.111:6804/727190484 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff22c1659f0 con 0x7ff1fc0a3570 2026-02-12T03:58:45.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.785+0000 7f47e5ffb640 1 -- 10.20.193.91:0/4153586687 <== mon.1 v1:10.20.193.98:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f47f80b60e0 con 0x7f47f80b57a0 2026-02-12T03:58:45.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.785+0000 7fbd997fa640 4 set_mon_vals no callback set 2026-02-12T03:58:45.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.785+0000 7f1b3ffff640 1 -- 10.20.193.91:0/3744615041 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1464790470 0 0) 0x7f1b640b1ea0 con 0x7f1b6405a7c0 2026-02-12T03:58:45.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.785+0000 7f1b3ffff640 1 -- 10.20.193.91:0/3744615041 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1b64164fb0 con 0x7f1b6405a7c0 2026-02-12T03:58:45.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.785+0000 7f1b3ffff640 1 -- 10.20.193.91:0/3744615041 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f1b50003380 con 0x7f1b6405a7c0 2026-02-12T03:58:45.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.785+0000 7f1b3ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:45.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.785+0000 7f1b3ffff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:45.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.785+0000 7f1b3ffff640 10 monclient(hunting): dump: 2026-02-12T03:58:45.862 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.862 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.862 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.862 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.862 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.862 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.862 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.862 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.862 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.862 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.785+0000 7f1b3ffff640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:45.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.785+0000 7fbd73fff640 1 -- 10.20.193.91:0/286286997 <== mon.2 v1:10.20.193.111:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7fbd90003d60 con 0x7fbd9c0b57a0 2026-02-12T03:58:45.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.786+0000 7f47e5ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:45.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.786+0000 7f47e5ffb640 1 -- 10.20.193.91:0/4153586687 <== mon.1 v1:10.20.193.98:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f47e8002e30 con 0x7f47f80b57a0 2026-02-12T03:58:45.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.786+0000 7f47e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.786+0000 7f47e77fe640 4 set_mon_vals no callback set 2026-02-12T03:58:45.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.786+0000 7f47e5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:45.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.786+0000 7f47e5ffb640 10 monclient: dump: 2026-02-12T03:58:45.862 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.862 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.862 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.862 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.862 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.862 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.862 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.862 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.862 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.863 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.786+0000 7f47e5ffb640 1 -- 10.20.193.91:0/4153586687 <== mon.1 v1:10.20.193.98:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f47e801dec0 con 0x7f47f80b57a0 2026-02-12T03:58:45.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.786+0000 7fbd9a7fc640 10 monclient: get_auth_request con 0x7fbd6c079eb0 auth_method 0 2026-02-12T03:58:45.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.786+0000 7fbd73fff640 10 client.4424.objecter ms_handle_connect 0x7fbd6c079eb0 2026-02-12T03:58:45.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.786+0000 7f47fcb40640 10 monclient: get_auth_request con 0x7f47c8079f80 auth_method 0 2026-02-12T03:58:45.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.786+0000 7f47e5ffb640 10 client.4456.objecter ms_handle_connect 0x7f47c8079f80 2026-02-12T03:58:45.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.787+0000 7fbd73fff640 1 -- 10.20.193.91:0/286286997 <== mon.2 v1:10.20.193.111:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7fbd90095bf0 con 0x7fbd9c0b57a0 2026-02-12T03:58:45.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.787+0000 7fbd73fff640 10 client.4424.objecter ms_dispatch2 0x7fbd9c000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:45.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.787+0000 7fbd73fff640 3 client.4424.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:45.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.787+0000 7fbd73fff640 3 client.4424.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:45.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.787+0000 7fbd73fff640 10 client.4424.objecter checking command 1 2026-02-12T03:58:45.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.787+0000 7fbd73fff640 20 client.4424.objecter _get_session s=0x7fbd6c0a2d30 osd=0 3 2026-02-12T03:58:45.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.787+0000 7fbd73fff640 20 client.4424.objecter put_session s=0x7fbd6c0a2d30 osd=0 3 2026-02-12T03:58:45.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.787+0000 7fbd73fff640 15 client.4424.objecter _session_command_op_remove -1 1 2026-02-12T03:58:45.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.787+0000 7fbd73fff640 20 client.4424.objecter _get_session s=0x7fbd6c0a2d30 osd=0 3 2026-02-12T03:58:45.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.787+0000 7fbd73fff640 20 client.4424.objecter get_session s=0x7fbd6c0a2d30 osd=0 3 2026-02-12T03:58:45.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.787+0000 7fbd73fff640 15 client.4424.objecter _session_command_op_assign 0 1 2026-02-12T03:58:45.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.787+0000 7fbd73fff640 20 client.4424.objecter put_session s=0x7fbd6c0a2d30 osd=0 4 2026-02-12T03:58:45.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.787+0000 7fbd73fff640 10 client.4424.objecter _send_command 1 2026-02-12T03:58:45.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.787+0000 7fbd73fff640 1 -- 10.20.193.91:0/286286997 --> v1:10.20.193.91:6801/1203233578 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd6c0c5080 con 0x7fbd6c0a33e0 2026-02-12T03:58:45.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.787+0000 7fbd73fff640 20 client.4424.objecter dump_active .. 0 homeless 2026-02-12T03:58:45.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.787+0000 7fbd73fff640 1 -- 10.20.193.91:0/286286997 <== mon.2 v1:10.20.193.111:6789/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7fbd9005b1c0 con 0x7fbd9c0b57a0 2026-02-12T03:58:45.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.787+0000 7fbd73fff640 10 monclient: handle_get_version_reply finishing 1 version 28 2026-02-12T03:58:45.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.787+0000 7fbd9b7fe640 10 monclient: get_auth_request con 0x7fbd6c0a33e0 auth_method 0 2026-02-12T03:58:45.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.787+0000 7f47e5ffb640 1 -- 10.20.193.91:0/4153586687 <== mon.1 v1:10.20.193.98:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7f47e80958e0 con 0x7f47f80b57a0 2026-02-12T03:58:45.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.787+0000 7f47e5ffb640 10 client.4456.objecter ms_dispatch2 0x7f47f8000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:45.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.787+0000 7f47e5ffb640 3 client.4456.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:45.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.787+0000 7f47e5ffb640 3 client.4456.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:45.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.788+0000 7f47e5ffb640 10 client.4456.objecter checking command 1 2026-02-12T03:58:45.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.788+0000 7f47e5ffb640 20 client.4456.objecter _get_session s=0x7f47c80a2e00 osd=7 3 2026-02-12T03:58:45.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.788+0000 7f47e5ffb640 20 client.4456.objecter put_session s=0x7f47c80a2e00 osd=7 3 2026-02-12T03:58:45.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.788+0000 7f47e5ffb640 15 client.4456.objecter _session_command_op_remove -1 1 2026-02-12T03:58:45.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.788+0000 7f47e5ffb640 20 client.4456.objecter _get_session s=0x7f47c80a2e00 osd=7 3 2026-02-12T03:58:45.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.788+0000 7f47e5ffb640 20 client.4456.objecter get_session s=0x7f47c80a2e00 osd=7 3 2026-02-12T03:58:45.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.788+0000 7f47e5ffb640 15 client.4456.objecter _session_command_op_assign 7 1 2026-02-12T03:58:45.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.788+0000 7f47e5ffb640 20 client.4456.objecter put_session s=0x7f47c80a2e00 osd=7 4 2026-02-12T03:58:45.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.788+0000 7f47e5ffb640 10 client.4456.objecter _send_command 1 2026-02-12T03:58:45.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.788+0000 7f47e5ffb640 1 -- 10.20.193.91:0/4153586687 --> v1:10.20.193.154:6808/903276772 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f47c80c50b0 con 0x7f47c80a34b0 2026-02-12T03:58:45.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.788+0000 7f47e5ffb640 20 client.4456.objecter dump_active .. 0 homeless 2026-02-12T03:58:45.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.788+0000 7f47e5ffb640 1 -- 10.20.193.91:0/4153586687 <== mon.1 v1:10.20.193.98:6789/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7f47e805e9b0 con 0x7f47f80b57a0 2026-02-12T03:58:45.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.788+0000 7f47e5ffb640 10 monclient: handle_get_version_reply finishing 1 version 28 2026-02-12T03:58:45.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.788+0000 7f47fdb42640 10 monclient: get_auth_request con 0x7f47c80a34b0 auth_method 0 2026-02-12T03:58:45.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.789+0000 7fbd73fff640 10 client.4424.objecter ms_handle_connect 0x7fbd6c0a33e0 2026-02-12T03:58:45.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.790+0000 7f47e5ffb640 10 client.4456.objecter ms_handle_connect 0x7f47c80a34b0 2026-02-12T03:58:45.865 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.790+0000 7ff238ff9640 1 -- 10.20.193.91:0/4164622660 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1279418041 0 0) 0x7ff23c166500 con 0x7ff23c0564d0 2026-02-12T03:58:45.865 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.790+0000 7ff238ff9640 1 -- 10.20.193.91:0/4164622660 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff23c166220 con 0x7ff23c0564d0 2026-02-12T03:58:45.865 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.790+0000 7ff238ff9640 1 -- 10.20.193.91:0/4164622660 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7ff228003260 con 0x7ff23c0564d0 2026-02-12T03:58:45.865 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.790+0000 7ff238ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:45.865 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.790+0000 7ff238ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:45.865 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.790+0000 7ff238ff9640 10 monclient(hunting): dump: 2026-02-12T03:58:45.865 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.865 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.865 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.865 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.865 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.865 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.865 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.865 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.865 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.865 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.865 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.790+0000 7ff238ff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:45.865 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.791+0000 7ff212ffd640 1 -- 10.20.193.91:0/861051702 <== osd.6 v1:10.20.193.111:6804/727190484 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7ff22c1659f0 con 0x7ff1fc0a3570 2026-02-12T03:58:45.865 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.791+0000 7ff212ffd640 10 client.4409.objecter ms_dispatch2 0x7ff22c000b90 command_reply(tid 2: 0 ) 2026-02-12T03:58:45.865 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.791+0000 7ff212ffd640 10 client.4409.objecter _finish_command 2 = system:0 2026-02-12T03:58:45.865 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.791+0000 7ff212ffd640 20 client.4409.objecter put_session s=0x7ff1fc0a2ec0 osd=6 4 2026-02-12T03:58:45.865 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.791+0000 7ff212ffd640 15 client.4409.objecter _session_command_op_remove 6 2 2026-02-12T03:58:45.866 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.791+0000 7ff2342c4640 10 librados: watch_flush enter 2026-02-12T03:58:45.866 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.791+0000 7ff2342c4640 10 librados: watch_flush exit 2026-02-12T03:58:45.866 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.791+0000 7ff2342c4640 10 client.4409.objecter close_session for osd.6 2026-02-12T03:58:45.866 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.791+0000 7ff2342c4640 1 -- 10.20.193.91:0/861051702 >> v1:10.20.193.111:6804/727190484 conn(0x7ff1fc0a3570 legacy=0x7ff1fc0c39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.866 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.791+0000 7ff2342c4640 20 client.4409.objecter put_session s=0x7ff1fc0a2ec0 osd=6 1 2026-02-12T03:58:45.866 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.791+0000 7ff2342c4640 20 client.4409.objecter shutdown clearing up homeless session... 2026-02-12T03:58:45.866 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.791+0000 7ff2342c4640 10 client.4409.objecter successfully canceled tick 2026-02-12T03:58:45.866 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.791+0000 7ff2342c4640 1 -- 10.20.193.91:0/861051702 >> v1:10.20.193.91:6800/2929217192 conn(0x7ff1fc07a040 legacy=0x7ff1fc09a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.866 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.791+0000 7ff2342c4640 10 monclient: shutdown 2026-02-12T03:58:45.866 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.791+0000 7ff2342c4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:45.866 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.791+0000 7ff2342c4640 1 -- 10.20.193.91:0/861051702 >> v1:10.20.193.111:6789/0 conn(0x7ff22c166f70 legacy=0x7ff22c11eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.866 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.791+0000 7ff23283a640 1 -- 10.20.193.91:0/861051702 reap_dead start 2026-02-12T03:58:45.866 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.791+0000 7ff2342c4640 1 -- 10.20.193.91:0/861051702 shutdown_connections 2026-02-12T03:58:45.866 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.791+0000 7ff2342c4640 1 -- 10.20.193.91:0/861051702 >> 10.20.193.91:0/861051702 conn(0x7ff22c0bab20 msgr2=0x7ff22c158d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:45.866 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.791+0000 7ff2342c4640 1 -- 10.20.193.91:0/861051702 shutdown_connections 2026-02-12T03:58:45.866 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.791+0000 7ff2342c4640 1 -- 10.20.193.91:0/861051702 wait complete. 2026-02-12T03:58:45.866 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.791+0000 7ff2342c4640 1 librados: shutdown 2026-02-12T03:58:45.866 INFO:teuthology.orchestra.run.trial091.stdout:90194313221 2026-02-12T03:58:45.866 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-12T03:58:45.867 INFO:teuthology.orchestra.run.trial091.stdout:90194313221 2026-02-12T03:58:45.867 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2026-02-12T03:58:45.867 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.792+0000 7fd0baffd640 1 -- 10.20.193.91:0/2911181674 <== osd.8 v1:10.20.193.91:6809/443384425 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fd0a00c5390 con 0x7fd0a00a36f0 2026-02-12T03:58:45.867 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.792+0000 7fd0baffd640 10 client.4412.objecter ms_dispatch2 0x7fd0d4000b90 command_reply(tid 1: 0 ) 2026-02-12T03:58:45.867 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.792+0000 7fd0baffd640 10 client.4412.objecter _finish_command 1 = system:0 2026-02-12T03:58:45.867 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.792+0000 7fd0baffd640 20 client.4412.objecter put_session s=0x7fd0a00a3040 osd=8 4 2026-02-12T03:58:45.867 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.792+0000 7fd0baffd640 15 client.4412.objecter _session_command_op_remove 8 1 2026-02-12T03:58:45.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.792+0000 7ff728ff9640 1 -- 10.20.193.91:0/2171776711 <== mon.2 v1:10.20.193.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3963208596 0 0) 0x7ff72c11ba80 con 0x7ff72c0b3f60 2026-02-12T03:58:45.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.792+0000 7ff728ff9640 1 -- 10.20.193.91:0/2171776711 >> v1:10.20.193.98:6789/0 conn(0x7ff72c0abe50 legacy=0x7ff72c0b1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.792+0000 7ff728ff9640 1 -- 10.20.193.91:0/2171776711 >> v1:10.20.193.91:6789/0 conn(0x7ff72c0aba80 legacy=0x7ff72c13b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.792+0000 7ff728ff9640 10 monclient: _finish_hunting 0 2026-02-12T03:58:45.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.792+0000 7ff728ff9640 1 monclient: found mon.c 2026-02-12T03:58:45.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.792+0000 7ff728ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:45.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.792+0000 7ff728ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:45.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.792+0000 7ff728ff9640 1 -- 10.20.193.91:0/2171776711 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff72c13afc0 con 0x7ff72c0b3f60 2026-02-12T03:58:45.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.792+0000 7ff728ff9640 10 monclient: _finish_auth 0 2026-02-12T03:58:45.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.792+0000 7ff728ff9640 10 monclient: _check_auth_tickets 2026-02-12T03:58:45.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.792+0000 7ff728ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:45.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.792+0000 7ff73134a640 5 monclient: authenticate success, global_id 4433 2026-02-12T03:58:45.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.792+0000 7ff73134a640 10 monclient: _renew_subs 2026-02-12T03:58:45.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.792+0000 7ff73134a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:45.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.792+0000 7ff73134a640 1 -- 10.20.193.91:0/2171776711 --> v1:10.20.193.111:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff72c13b2a0 con 0x7ff72c0b3f60 2026-02-12T03:58:45.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.793+0000 7ff73134a640 10 client.4433.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:45.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.793+0000 7ff73134a640 10 monclient: _renew_subs 2026-02-12T03:58:45.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.793+0000 7ff73134a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:45.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.793+0000 7ff73134a640 1 -- 10.20.193.91:0/2171776711 --> v1:10.20.193.111:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff72c118d00 con 0x7ff72c0b3f60 2026-02-12T03:58:45.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.793+0000 7ff73134a640 1 librados: init done 2026-02-12T03:58:45.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.793+0000 7ff73134a640 10 client.4433.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:45.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.793+0000 7ff73134a640 15 client.4433.objecter _session_command_op_assign -1 1 2026-02-12T03:58:45.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.793+0000 7ff73134a640 20 client.4433.objecter _get_session osd=-1 returning homeless 2026-02-12T03:58:45.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.793+0000 7ff73134a640 10 client.4433.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:45.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.793+0000 7ff73134a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:45.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.793+0000 7ff73134a640 1 -- 10.20.193.91:0/2171776711 --> v1:10.20.193.111:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7ff72c164c50 con 0x7ff72c0b3f60 2026-02-12T03:58:45.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.793+0000 7ff238ff9640 1 -- 10.20.193.91:0/4164622660 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4044047842 0 0) 0x7ff23c1667e0 con 0x7ff23c161ad0 2026-02-12T03:58:45.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.793+0000 7ff238ff9640 1 -- 10.20.193.91:0/4164622660 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff23c166500 con 0x7ff23c161ad0 2026-02-12T03:58:45.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.793+0000 7ff238ff9640 1 -- 10.20.193.91:0/4164622660 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7ff22c0030b0 con 0x7ff23c161ad0 2026-02-12T03:58:45.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.793+0000 7ff238ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:45.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.793+0000 7ff238ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:45.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.793+0000 7ff238ff9640 10 monclient(hunting): dump: 2026-02-12T03:58:45.868 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.868 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.868 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.868 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.869 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.869 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.869 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.869 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.869 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.869 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.869 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.794+0000 7f71d6ffd640 1 -- 10.20.193.91:0/3729138105 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f71f415f650 con 0x7f71f4164760 2026-02-12T03:58:45.869 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.794+0000 7f71d6ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:45.869 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.794+0000 7f71d6ffd640 1 -- 10.20.193.91:0/3729138105 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f71dc0039b0 con 0x7f71f4164760 2026-02-12T03:58:45.869 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.794+0000 7f71d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.869 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.794+0000 7f71d6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:45.869 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.794+0000 7f71f0d72640 4 set_mon_vals no callback set 2026-02-12T03:58:45.869 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.794+0000 7f71d6ffd640 10 monclient: dump: 2026-02-12T03:58:45.869 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.869 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.869 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.869 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.869 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.869 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.869 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.869 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.869 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.869 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.869 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.795+0000 7f71d6ffd640 1 -- 10.20.193.91:0/3729138105 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f71dc003bc0 con 0x7f71f4164760 2026-02-12T03:58:45.869 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.795+0000 7f71f2575640 10 monclient: get_auth_request con 0x7f71c0079fe0 auth_method 0 2026-02-12T03:58:45.869 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.796+0000 7f71d6ffd640 10 client.4485.objecter ms_handle_connect 0x7f71c0079fe0 2026-02-12T03:58:45.869 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.797+0000 7f50967fc640 1 -- 10.20.193.91:0/1727122728 <== mon.2 v1:10.20.193.111:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f50a80b60e0 con 0x7f50a80b7180 2026-02-12T03:58:45.870 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.797+0000 7f50967fc640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:45.870 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.797+0000 7f50967fc640 1 -- 10.20.193.91:0/1727122728 <== mon.2 v1:10.20.193.111:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f50a4003d30 con 0x7f50a80b7180 2026-02-12T03:58:45.870 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.797+0000 7f50967fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.870 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.797+0000 7f50967fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:45.870 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.797+0000 7f50967fc640 10 monclient: dump: 2026-02-12T03:58:45.870 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.870 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.870 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.870 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.870 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.870 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.870 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.870 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.870 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.870 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.870 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.797+0000 7f5097fff640 4 set_mon_vals no callback set 2026-02-12T03:58:45.870 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.797+0000 7f1b3ffff640 1 -- 10.20.193.91:0/3744615041 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 810072908 0 0) 0x7f1b34003610 con 0x7f1b640b5e90 2026-02-12T03:58:45.870 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.797+0000 7f1b3ffff640 1 -- 10.20.193.91:0/3744615041 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1b640b1ea0 con 0x7f1b640b5e90 2026-02-12T03:58:45.870 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.797+0000 7f1b3ffff640 1 -- 10.20.193.91:0/3744615041 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f1b54003060 con 0x7f1b640b5e90 2026-02-12T03:58:45.870 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.797+0000 7f1b3ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:45.870 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.797+0000 7f1b3ffff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:45.870 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.797+0000 7f1b3ffff640 10 monclient(hunting): dump: 2026-02-12T03:58:45.870 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.870 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.870 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.870 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.870 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.870 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.870 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.870 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.870 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.870 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.870 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.798+0000 7f50967fc640 1 -- 10.20.193.91:0/1727122728 <== mon.2 v1:10.20.193.111:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f50a4003f40 con 0x7f50a80b7180 2026-02-12T03:58:45.871 INFO:teuthology.orchestra.run.trial091.stdout:90194313220 2026-02-12T03:58:45.871 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2026-02-12T03:58:45.871 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.799+0000 7f50adc49640 10 monclient: get_auth_request con 0x7f5078079fb0 auth_method 0 2026-02-12T03:58:45.871 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.799+0000 7f50967fc640 10 client.4421.objecter ms_handle_connect 0x7f5078079fb0 2026-02-12T03:58:45.871 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7f71d6ffd640 1 -- 10.20.193.91:0/3729138105 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7f71dc095af0 con 0x7f71f4164760 2026-02-12T03:58:45.871 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7f71d6ffd640 10 client.4485.objecter ms_dispatch2 0x7f71f4000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:45.871 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7f71d6ffd640 3 client.4485.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:45.871 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7f71d6ffd640 3 client.4485.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:45.871 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7f71d6ffd640 10 client.4485.objecter checking command 1 2026-02-12T03:58:45.871 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7f50967fc640 1 -- 10.20.193.91:0/1727122728 <== mon.2 v1:10.20.193.111:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7f50a4095e10 con 0x7f50a80b7180 2026-02-12T03:58:45.871 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7f50967fc640 10 client.4421.objecter ms_dispatch2 0x7f50a8000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:45.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7f50967fc640 3 client.4421.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:45.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7f50967fc640 3 client.4421.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:45.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7f71d6ffd640 20 client.4485.objecter _get_session s=0x7f71c00a2e60 osd=10 3 2026-02-12T03:58:45.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7f71d6ffd640 20 client.4485.objecter put_session s=0x7f71c00a2e60 osd=10 3 2026-02-12T03:58:45.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7f71d6ffd640 15 client.4485.objecter _session_command_op_remove -1 1 2026-02-12T03:58:45.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7f71d6ffd640 20 client.4485.objecter _get_session s=0x7f71c00a2e60 osd=10 3 2026-02-12T03:58:45.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7f71d6ffd640 20 client.4485.objecter get_session s=0x7f71c00a2e60 osd=10 3 2026-02-12T03:58:45.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7f71d6ffd640 15 client.4485.objecter _session_command_op_assign 10 1 2026-02-12T03:58:45.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7f71d6ffd640 20 client.4485.objecter put_session s=0x7f71c00a2e60 osd=10 4 2026-02-12T03:58:45.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7f71d6ffd640 10 client.4485.objecter _send_command 1 2026-02-12T03:58:45.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7f71d6ffd640 1 -- 10.20.193.91:0/3729138105 --> v1:10.20.193.111:6808/1268343515 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f71c00c51b0 con 0x7f71c00a3510 2026-02-12T03:58:45.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7f71d6ffd640 20 client.4485.objecter dump_active .. 0 homeless 2026-02-12T03:58:45.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7f71d6ffd640 1 -- 10.20.193.91:0/3729138105 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7f71dc05b0c0 con 0x7f71f4164760 2026-02-12T03:58:45.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7f71d6ffd640 10 monclient: handle_get_version_reply finishing 1 version 28 2026-02-12T03:58:45.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7fd0d8a96640 10 client.4412.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-12T03:58:45.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7fd0d8a96640 15 client.4412.objecter _session_command_op_assign -1 2 2026-02-12T03:58:45.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7fd0d8a96640 20 client.4412.objecter _get_session s=0x7fd0a00a3040 osd=8 3 2026-02-12T03:58:45.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7fd0d8a96640 20 client.4412.objecter put_session s=0x7fd0a00a3040 osd=8 3 2026-02-12T03:58:45.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7fd0d8a96640 20 client.4412.objecter _get_session s=0x7fd0a00a3040 osd=8 3 2026-02-12T03:58:45.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7fd0d8a96640 15 client.4412.objecter _session_command_op_remove -1 2 2026-02-12T03:58:45.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7fd0d8a96640 20 client.4412.objecter get_session s=0x7fd0a00a3040 osd=8 3 2026-02-12T03:58:45.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7fd0d8a96640 15 client.4412.objecter _session_command_op_assign 8 2 2026-02-12T03:58:45.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7fd0d8a96640 20 client.4412.objecter put_session s=0x7fd0a00a3040 osd=8 4 2026-02-12T03:58:45.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7fd0d8a96640 10 client.4412.objecter _send_command 2 2026-02-12T03:58:45.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7fd0d8a96640 1 -- 10.20.193.91:0/2911181674 --> v1:10.20.193.91:6809/443384425 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd0d4053250 con 0x7fd0a00a36f0 2026-02-12T03:58:45.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7f50967fc640 10 client.4421.objecter checking command 1 2026-02-12T03:58:45.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7f50967fc640 20 client.4421.objecter _get_session s=0x7f50780a2e30 osd=3 3 2026-02-12T03:58:45.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7f50967fc640 20 client.4421.objecter put_session s=0x7f50780a2e30 osd=3 3 2026-02-12T03:58:45.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7f50967fc640 15 client.4421.objecter _session_command_op_remove -1 1 2026-02-12T03:58:45.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7f50967fc640 20 client.4421.objecter _get_session s=0x7f50780a2e30 osd=3 3 2026-02-12T03:58:45.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7f50967fc640 20 client.4421.objecter get_session s=0x7f50780a2e30 osd=3 3 2026-02-12T03:58:45.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7f50967fc640 15 client.4421.objecter _session_command_op_assign 3 1 2026-02-12T03:58:45.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7f50967fc640 20 client.4421.objecter put_session s=0x7f50780a2e30 osd=3 4 2026-02-12T03:58:45.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7f50967fc640 10 client.4421.objecter _send_command 1 2026-02-12T03:58:45.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7f50967fc640 1 -- 10.20.193.91:0/1727122728 --> v1:10.20.193.154:6800/4779434 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f50780c50e0 con 0x7f50780a34e0 2026-02-12T03:58:45.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7f50967fc640 20 client.4421.objecter dump_active .. 0 homeless 2026-02-12T03:58:45.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7f50967fc640 1 -- 10.20.193.91:0/1727122728 <== mon.2 v1:10.20.193.111:6789/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7f50a405b3e0 con 0x7f50a80b7180 2026-02-12T03:58:45.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.800+0000 7f50967fc640 10 monclient: handle_get_version_reply finishing 1 version 28 2026-02-12T03:58:45.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.801+0000 7f50ad448640 10 monclient: get_auth_request con 0x7f50780a34e0 auth_method 0 2026-02-12T03:58:45.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.801+0000 7f71f2d76640 10 monclient: get_auth_request con 0x7f71c00a3510 auth_method 0 2026-02-12T03:58:45.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.802+0000 7f50967fc640 10 client.4421.objecter ms_handle_connect 0x7f50780a34e0 2026-02-12T03:58:45.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.802+0000 7f71d6ffd640 10 client.4485.objecter ms_handle_connect 0x7f71c00a3510 2026-02-12T03:58:45.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.803+0000 7fd0baffd640 1 -- 10.20.193.91:0/2911181674 <== osd.8 v1:10.20.193.91:6809/443384425 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7fd0d4053250 con 0x7fd0a00a36f0 2026-02-12T03:58:45.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.803+0000 7fd0baffd640 10 client.4412.objecter ms_dispatch2 0x7fd0d4000b90 command_reply(tid 2: 0 ) 2026-02-12T03:58:45.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.803+0000 7fd0baffd640 10 client.4412.objecter _finish_command 2 = system:0 2026-02-12T03:58:45.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.803+0000 7fd0baffd640 20 client.4412.objecter put_session s=0x7fd0a00a3040 osd=8 4 2026-02-12T03:58:45.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.803+0000 7fd0baffd640 15 client.4412.objecter _session_command_op_remove 8 2 2026-02-12T03:58:45.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.803+0000 7fd0d8a96640 10 librados: watch_flush enter 2026-02-12T03:58:45.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.803+0000 7fd0d8a96640 10 librados: watch_flush exit 2026-02-12T03:58:45.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.803+0000 7fd0d8a96640 10 client.4412.objecter close_session for osd.8 2026-02-12T03:58:45.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.803+0000 7fd0d8a96640 1 -- 10.20.193.91:0/2911181674 >> v1:10.20.193.91:6809/443384425 conn(0x7fd0a00a36f0 legacy=0x7fd0a00c3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.803+0000 7fd0d8a96640 20 client.4412.objecter put_session s=0x7fd0a00a3040 osd=8 1 2026-02-12T03:58:45.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.803+0000 7fd0d8a96640 20 client.4412.objecter shutdown clearing up homeless session... 2026-02-12T03:58:45.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.803+0000 7fd0d8a96640 10 client.4412.objecter successfully canceled tick 2026-02-12T03:58:45.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.803+0000 7fd0d8a96640 1 -- 10.20.193.91:0/2911181674 >> v1:10.20.193.91:6800/2929217192 conn(0x7fd0a007a160 legacy=0x7fd0a009a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.803+0000 7fd0d8a96640 10 monclient: shutdown 2026-02-12T03:58:45.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.803+0000 7fd0d8a96640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:45.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.803+0000 7fd0d8a96640 1 -- 10.20.193.91:0/2911181674 >> v1:10.20.193.111:6789/0 conn(0x7fd0d40b8080 legacy=0x7fd0d415ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.803+0000 7fd0d2d76640 1 -- 10.20.193.91:0/2911181674 reap_dead start 2026-02-12T03:58:45.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.803+0000 7fd0d8a96640 1 -- 10.20.193.91:0/2911181674 shutdown_connections 2026-02-12T03:58:45.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.803+0000 7fd0d8a96640 1 -- 10.20.193.91:0/2911181674 >> 10.20.193.91:0/2911181674 conn(0x7fd0d40b7570 msgr2=0x7fd0d4056c70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:45.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.803+0000 7fd0d8a96640 1 -- 10.20.193.91:0/2911181674 shutdown_connections 2026-02-12T03:58:45.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.803+0000 7fd0d8a96640 1 -- 10.20.193.91:0/2911181674 wait complete. 2026-02-12T03:58:45.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.803+0000 7fd0d8a96640 1 librados: shutdown 2026-02-12T03:58:45.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.804+0000 7f72497fa640 1 -- 10.20.193.91:0/1817416077 <== osd.9 v1:10.20.193.98:6801/4165741185 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f72240c5100 con 0x7f72240a3500 2026-02-12T03:58:45.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.804+0000 7f72497fa640 10 client.4473.objecter ms_dispatch2 0x7f7254000b90 command_reply(tid 1: 0 ) 2026-02-12T03:58:45.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.804+0000 7f72497fa640 10 client.4473.objecter _finish_command 1 = system:0 2026-02-12T03:58:45.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.804+0000 7f72497fa640 20 client.4473.objecter put_session s=0x7f72240a2e50 osd=9 4 2026-02-12T03:58:45.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.804+0000 7f72497fa640 15 client.4473.objecter _session_command_op_remove 9 1 2026-02-12T03:58:45.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.805+0000 7ff238ff9640 1 -- 10.20.193.91:0/4164622660 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3845201256 0 0) 0x7ff23c166220 con 0x7ff23c0564d0 2026-02-12T03:58:45.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.805+0000 7ff238ff9640 1 -- 10.20.193.91:0/4164622660 >> v1:10.20.193.111:6789/0 conn(0x7ff23c167e90 legacy=0x7ff23c169a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.805+0000 7ff238ff9640 1 -- 10.20.193.91:0/4164622660 >> v1:10.20.193.98:6789/0 conn(0x7ff23c161ad0 legacy=0x7ff23c202fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.805+0000 7ff238ff9640 10 monclient: _finish_hunting 0 2026-02-12T03:58:45.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.805+0000 7ff238ff9640 1 monclient: found mon.a 2026-02-12T03:58:45.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.805+0000 7ff238ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:45.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.805+0000 7ff238ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:45.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.805+0000 7ff238ff9640 1 -- 10.20.193.91:0/4164622660 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff23c166ac0 con 0x7ff23c0564d0 2026-02-12T03:58:45.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.805+0000 7ff238ff9640 10 monclient: _finish_auth 0 2026-02-12T03:58:45.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.805+0000 7ff238ff9640 10 monclient: _check_auth_tickets 2026-02-12T03:58:45.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.805+0000 7ff238ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:45.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.805+0000 7ff2425a8640 5 monclient: authenticate success, global_id 4491 2026-02-12T03:58:45.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.805+0000 7ff2425a8640 10 monclient: _renew_subs 2026-02-12T03:58:45.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.805+0000 7ff2425a8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:45.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.805+0000 7ff2425a8640 1 -- 10.20.193.91:0/4164622660 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff23c166da0 con 0x7ff23c0564d0 2026-02-12T03:58:45.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.805+0000 7ff2425a8640 10 client.4491.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:45.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.805+0000 7ff2425a8640 10 monclient: _renew_subs 2026-02-12T03:58:45.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.805+0000 7ff2425a8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:45.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.805+0000 7ff2425a8640 1 -- 10.20.193.91:0/4164622660 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff23c165ea0 con 0x7ff23c0564d0 2026-02-12T03:58:45.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.805+0000 7ff2425a8640 1 librados: init done 2026-02-12T03:58:45.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.806+0000 7ff2425a8640 10 client.4491.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:45.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.806+0000 7ff2425a8640 15 client.4491.objecter _session_command_op_assign -1 1 2026-02-12T03:58:45.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.806+0000 7ff2425a8640 20 client.4491.objecter _get_session osd=-1 returning homeless 2026-02-12T03:58:45.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.806+0000 7ff2425a8640 10 client.4491.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:45.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.806+0000 7ff2425a8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:45.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.806+0000 7ff2425a8640 1 -- 10.20.193.91:0/4164622660 --> v1:10.20.193.91:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7ff23c0b1c90 con 0x7ff23c0564d0 2026-02-12T03:58:45.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.808+0000 7f07c37fe640 1 -- 10.20.193.91:0/198827363 <== mon.1 v1:10.20.193.98:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f07e40b60e0 con 0x7f07e40b5b70 2026-02-12T03:58:45.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.808+0000 7f07c37fe640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:45.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.808+0000 7f07c37fe640 1 -- 10.20.193.91:0/198827363 <== mon.1 v1:10.20.193.98:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f07cc004b80 con 0x7f07e40b5b70 2026-02-12T03:58:45.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.808+0000 7f07c37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.808+0000 7f07c37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:45.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.808+0000 7f07c37fe640 10 monclient: dump: 2026-02-12T03:58:45.876 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.876 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.876 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.876 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.876 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.876 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.876 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.876 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.876 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.876 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.808+0000 7f07e17fa640 4 set_mon_vals no callback set 2026-02-12T03:58:45.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.809+0000 7fbd73fff640 1 -- 10.20.193.91:0/286286997 <== osd.0 v1:10.20.193.91:6801/1203233578 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fbd6c0c5080 con 0x7fbd6c0a33e0 2026-02-12T03:58:45.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.809+0000 7fbd73fff640 10 client.4424.objecter ms_dispatch2 0x7fbd9c000b90 command_reply(tid 1: 0 ) 2026-02-12T03:58:45.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.809+0000 7fbd73fff640 10 client.4424.objecter _finish_command 1 = system:0 2026-02-12T03:58:45.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.809+0000 7fbd73fff640 20 client.4424.objecter put_session s=0x7fbd6c0a2d30 osd=0 4 2026-02-12T03:58:45.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.809+0000 7fbd73fff640 15 client.4424.objecter _session_command_op_remove 0 1 2026-02-12T03:58:45.877 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.809+0000 7f07c37fe640 1 -- 10.20.193.91:0/198827363 <== mon.1 v1:10.20.193.98:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f07cc01e060 con 0x7f07e40b5b70 2026-02-12T03:58:45.877 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.810+0000 7f07e2ffd640 10 monclient: get_auth_request con 0x7f07b0079dc0 auth_method 0 2026-02-12T03:58:45.877 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.810+0000 7f07c37fe640 10 client.4474.objecter ms_handle_connect 0x7f07b0079dc0 2026-02-12T03:58:45.877 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.811+0000 7f07c37fe640 1 -- 10.20.193.91:0/198827363 <== mon.1 v1:10.20.193.98:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7f07cc095a50 con 0x7f07e40b5b70 2026-02-12T03:58:45.877 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.811+0000 7f07c37fe640 10 client.4474.objecter ms_dispatch2 0x7f07e4000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:45.877 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.811+0000 7f07c37fe640 3 client.4474.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:45.877 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.811+0000 7f07c37fe640 3 client.4474.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:45.877 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.811+0000 7f07c37fe640 10 client.4474.objecter checking command 1 2026-02-12T03:58:45.877 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.811+0000 7f07c37fe640 20 client.4474.objecter _get_session s=0x7f07b00a2c40 osd=5 3 2026-02-12T03:58:45.877 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.811+0000 7f07c37fe640 20 client.4474.objecter put_session s=0x7f07b00a2c40 osd=5 3 2026-02-12T03:58:45.877 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.811+0000 7f07c37fe640 15 client.4474.objecter _session_command_op_remove -1 1 2026-02-12T03:58:45.877 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.811+0000 7f07c37fe640 20 client.4474.objecter _get_session s=0x7f07b00a2c40 osd=5 3 2026-02-12T03:58:45.877 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.811+0000 7f07c37fe640 20 client.4474.objecter get_session s=0x7f07b00a2c40 osd=5 3 2026-02-12T03:58:45.877 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.811+0000 7f07c37fe640 15 client.4474.objecter _session_command_op_assign 5 1 2026-02-12T03:58:45.877 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.811+0000 7f07c37fe640 20 client.4474.objecter put_session s=0x7f07b00a2c40 osd=5 4 2026-02-12T03:58:45.877 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.811+0000 7f07c37fe640 10 client.4474.objecter _send_command 1 2026-02-12T03:58:45.877 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.811+0000 7f07c37fe640 1 -- 10.20.193.91:0/198827363 --> v1:10.20.193.98:6808/3918277953 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f07b00c4f90 con 0x7f07b00a32f0 2026-02-12T03:58:45.877 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.811+0000 7f07c37fe640 20 client.4474.objecter dump_active .. 0 homeless 2026-02-12T03:58:45.877 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.811+0000 7f07c37fe640 1 -- 10.20.193.91:0/198827363 <== mon.1 v1:10.20.193.98:6789/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7f07cc05b020 con 0x7f07e40b5b70 2026-02-12T03:58:45.877 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.811+0000 7f07c37fe640 10 monclient: handle_get_version_reply finishing 1 version 28 2026-02-12T03:58:45.877 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.811+0000 7ff728ff9640 1 -- 10.20.193.91:0/2171776711 <== mon.2 v1:10.20.193.111:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff72c164c50 con 0x7ff72c0b3f60 2026-02-12T03:58:45.877 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.811+0000 7ff728ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:45.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.811+0000 7ff728ff9640 1 -- 10.20.193.91:0/2171776711 <== mon.2 v1:10.20.193.111:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7ff720003ab0 con 0x7ff72c0b3f60 2026-02-12T03:58:45.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.811+0000 7ff728ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.811+0000 7ff728ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:45.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.811+0000 7ff728ff9640 10 monclient: dump: 2026-02-12T03:58:45.878 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.878 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.878 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.878 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.878 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.878 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.878 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.878 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.878 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.878 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.811+0000 7ff72a7fc640 4 set_mon_vals no callback set 2026-02-12T03:58:45.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.811+0000 7f47e5ffb640 1 -- 10.20.193.91:0/4153586687 <== osd.7 v1:10.20.193.154:6808/903276772 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f47c80c50b0 con 0x7f47c80a34b0 2026-02-12T03:58:45.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.811+0000 7f47e5ffb640 10 client.4456.objecter ms_dispatch2 0x7f47f8000b90 command_reply(tid 1: 0 ) 2026-02-12T03:58:45.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.811+0000 7f47e5ffb640 10 client.4456.objecter _finish_command 1 = system:0 2026-02-12T03:58:45.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.811+0000 7f47e5ffb640 20 client.4456.objecter put_session s=0x7f47c80a2e00 osd=7 4 2026-02-12T03:58:45.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.811+0000 7f47e5ffb640 15 client.4456.objecter _session_command_op_remove 7 1 2026-02-12T03:58:45.878 INFO:teuthology.orchestra.run.trial091.stdout:90194313220 2026-02-12T03:58:45.879 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2026-02-12T03:58:45.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.811+0000 7f07e37fe640 10 monclient: get_auth_request con 0x7f07b00a32f0 auth_method 0 2026-02-12T03:58:45.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.812+0000 7f1b3ffff640 1 -- 10.20.193.91:0/3744615041 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2493942377 0 0) 0x7f1b640b1bc0 con 0x7f1b64161c10 2026-02-12T03:58:45.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.812+0000 7f1b3ffff640 1 -- 10.20.193.91:0/3744615041 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1b34003610 con 0x7f1b64161c10 2026-02-12T03:58:45.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.812+0000 7f1b3ffff640 1 -- 10.20.193.91:0/3744615041 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f1b58003430 con 0x7f1b64161c10 2026-02-12T03:58:45.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.812+0000 7f1b3ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:45.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.812+0000 7f1b3ffff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:45.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.812+0000 7f1b3ffff640 10 monclient(hunting): dump: 2026-02-12T03:58:45.879 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.879 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.879 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.879 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.879 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.879 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.879 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.879 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.879 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.879 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.812+0000 7ff728ff9640 1 -- 10.20.193.91:0/2171776711 <== mon.2 v1:10.20.193.111:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7ff720003cc0 con 0x7ff72c0b3f60 2026-02-12T03:58:45.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.812+0000 7f725b251640 10 client.4473.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-12T03:58:45.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.812+0000 7f725b251640 15 client.4473.objecter _session_command_op_assign -1 2 2026-02-12T03:58:45.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.812+0000 7f725b251640 20 client.4473.objecter _get_session s=0x7f72240a2e50 osd=9 3 2026-02-12T03:58:45.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.812+0000 7f725b251640 20 client.4473.objecter put_session s=0x7f72240a2e50 osd=9 3 2026-02-12T03:58:45.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.812+0000 7f725b251640 20 client.4473.objecter _get_session s=0x7f72240a2e50 osd=9 3 2026-02-12T03:58:45.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.812+0000 7f725b251640 15 client.4473.objecter _session_command_op_remove -1 2 2026-02-12T03:58:45.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.812+0000 7f725b251640 20 client.4473.objecter get_session s=0x7f72240a2e50 osd=9 3 2026-02-12T03:58:45.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.812+0000 7f725b251640 15 client.4473.objecter _session_command_op_assign 9 2 2026-02-12T03:58:45.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.812+0000 7f725b251640 20 client.4473.objecter put_session s=0x7f72240a2e50 osd=9 4 2026-02-12T03:58:45.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.812+0000 7f725b251640 10 client.4473.objecter _send_command 2 2026-02-12T03:58:45.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.812+0000 7f725b251640 1 -- 10.20.193.91:0/1817416077 --> v1:10.20.193.98:6801/4165741185 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7254134c90 con 0x7f72240a3500 2026-02-12T03:58:45.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.812+0000 7ff72bfff640 10 monclient: get_auth_request con 0x7ff6fc079f50 auth_method 0 2026-02-12T03:58:45.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.812+0000 7ff728ff9640 10 client.4433.objecter ms_handle_connect 0x7ff6fc079f50 2026-02-12T03:58:45.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.813+0000 7f07c37fe640 10 client.4474.objecter ms_handle_connect 0x7f07b00a32f0 2026-02-12T03:58:45.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.813+0000 7ff728ff9640 1 -- 10.20.193.91:0/2171776711 <== mon.2 v1:10.20.193.111:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7ff720094b30 con 0x7ff72c0b3f60 2026-02-12T03:58:45.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.813+0000 7ff728ff9640 10 client.4433.objecter ms_dispatch2 0x7ff72c000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:45.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.813+0000 7ff728ff9640 3 client.4433.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:45.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.813+0000 7ff728ff9640 3 client.4433.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:45.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.813+0000 7ff728ff9640 10 client.4433.objecter checking command 1 2026-02-12T03:58:45.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.813+0000 7ff728ff9640 20 client.4433.objecter _get_session s=0x7ff6fc0a2e30 osd=14 3 2026-02-12T03:58:45.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.813+0000 7ff728ff9640 20 client.4433.objecter put_session s=0x7ff6fc0a2e30 osd=14 3 2026-02-12T03:58:45.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.813+0000 7ff728ff9640 15 client.4433.objecter _session_command_op_remove -1 1 2026-02-12T03:58:45.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.813+0000 7ff728ff9640 20 client.4433.objecter _get_session s=0x7ff6fc0a2e30 osd=14 3 2026-02-12T03:58:45.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.813+0000 7ff728ff9640 20 client.4433.objecter get_session s=0x7ff6fc0a2e30 osd=14 3 2026-02-12T03:58:45.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.813+0000 7ff728ff9640 15 client.4433.objecter _session_command_op_assign 14 1 2026-02-12T03:58:45.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.813+0000 7ff728ff9640 20 client.4433.objecter put_session s=0x7ff6fc0a2e30 osd=14 4 2026-02-12T03:58:45.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.813+0000 7ff728ff9640 10 client.4433.objecter _send_command 1 2026-02-12T03:58:45.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.813+0000 7ff728ff9640 1 -- 10.20.193.91:0/2171776711 --> v1:10.20.193.111:6800/1665676360 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff720003490 con 0x7ff6fc0a34e0 2026-02-12T03:58:45.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.813+0000 7ff728ff9640 20 client.4433.objecter dump_active .. 0 homeless 2026-02-12T03:58:45.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.814+0000 7ff728ff9640 1 -- 10.20.193.91:0/2171776711 <== mon.2 v1:10.20.193.111:6789/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7ff72005db60 con 0x7ff72c0b3f60 2026-02-12T03:58:45.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.814+0000 7ff728ff9640 10 monclient: handle_get_version_reply finishing 1 version 28 2026-02-12T03:58:45.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.814+0000 7ff72b7fe640 10 monclient: get_auth_request con 0x7ff6fc0a34e0 auth_method 0 2026-02-12T03:58:45.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.815+0000 7fb2b17fa640 1 -- 10.20.193.91:0/3624527245 <== mon.1 v1:10.20.193.98:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb2bc15a630 con 0x7fb2bc0b57a0 2026-02-12T03:58:45.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.815+0000 7fb2b17fa640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:45.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.815+0000 7fb2b17fa640 1 -- 10.20.193.91:0/3624527245 <== mon.1 v1:10.20.193.98:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fb2ac0038a0 con 0x7fb2bc0b57a0 2026-02-12T03:58:45.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.815+0000 7fb2b17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.815+0000 7fb2b17fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:45.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.815+0000 7fb2b17fa640 10 monclient: dump: 2026-02-12T03:58:45.881 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.881 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.881 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.881 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.881 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.881 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.881 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.881 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.881 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.881 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.815+0000 7fb2b2ffd640 4 set_mon_vals no callback set 2026-02-12T03:58:45.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7ff728ff9640 10 client.4433.objecter ms_handle_connect 0x7ff6fc0a34e0 2026-02-12T03:58:45.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7fb2b17fa640 1 -- 10.20.193.91:0/3624527245 <== mon.1 v1:10.20.193.98:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7fb2ac003ab0 con 0x7fb2bc0b57a0 2026-02-12T03:58:45.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7ff238ff9640 1 -- 10.20.193.91:0/4164622660 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff23c0b1c90 con 0x7ff23c0564d0 2026-02-12T03:58:45.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7ff238ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:45.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7ff238ff9640 1 -- 10.20.193.91:0/4164622660 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7ff2280038a0 con 0x7ff23c0564d0 2026-02-12T03:58:45.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7ff238ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7ff238ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:45.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7ff238ff9640 10 monclient: dump: 2026-02-12T03:58:45.882 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.882 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.882 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.882 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.882 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.882 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.882 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.882 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.882 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.882 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7ff23a7fc640 4 set_mon_vals no callback set 2026-02-12T03:58:45.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7f72497fa640 1 -- 10.20.193.91:0/1817416077 <== osd.9 v1:10.20.193.98:6801/4165741185 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1506399442) 0x7f7254134c90 con 0x7f72240a3500 2026-02-12T03:58:45.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7f72497fa640 10 client.4473.objecter ms_dispatch2 0x7f7254000b90 command_reply(tid 2: 0 ) 2026-02-12T03:58:45.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7f72497fa640 10 client.4473.objecter _finish_command 2 = system:0 2026-02-12T03:58:45.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7f72497fa640 20 client.4473.objecter put_session s=0x7f72240a2e50 osd=9 4 2026-02-12T03:58:45.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7f72497fa640 15 client.4473.objecter _session_command_op_remove 9 2 2026-02-12T03:58:45.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7f1b3ffff640 1 -- 10.20.193.91:0/3744615041 <== mon.2 v1:10.20.193.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2465861004 0 0) 0x7f1b640b1ea0 con 0x7f1b640b5e90 2026-02-12T03:58:45.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7f1b3ffff640 1 -- 10.20.193.91:0/3744615041 >> v1:10.20.193.98:6789/0 conn(0x7f1b6405a7c0 legacy=0x7f1b641648a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7f1b3ffff640 1 -- 10.20.193.91:0/3744615041 >> v1:10.20.193.91:6789/0 conn(0x7f1b64161c10 legacy=0x7f1b64162490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7f1b3ffff640 10 monclient: _finish_hunting 0 2026-02-12T03:58:45.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7f1b3ffff640 1 monclient: found mon.c 2026-02-12T03:58:45.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7fb2b3fff640 10 monclient: get_auth_request con 0x7fb28c079f60 auth_method 0 2026-02-12T03:58:45.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7f1b3ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:45.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7f1b3ffff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:45.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7f1b3ffff640 1 -- 10.20.193.91:0/3744615041 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b640b2180 con 0x7f1b640b5e90 2026-02-12T03:58:45.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7f1b3ffff640 10 monclient: _finish_auth 0 2026-02-12T03:58:45.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7f1b3ffff640 10 monclient: _check_auth_tickets 2026-02-12T03:58:45.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7f1b3ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:45.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7f1b69b1c640 5 monclient: authenticate success, global_id 4436 2026-02-12T03:58:45.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7f1b69b1c640 10 monclient: _renew_subs 2026-02-12T03:58:45.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7f1b69b1c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:45.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7f1b69b1c640 1 -- 10.20.193.91:0/3744615041 --> v1:10.20.193.111:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1b640b2460 con 0x7f1b640b5e90 2026-02-12T03:58:45.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7f725b251640 10 librados: watch_flush enter 2026-02-12T03:58:45.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7f725b251640 10 librados: watch_flush exit 2026-02-12T03:58:45.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7f725b251640 10 client.4473.objecter close_session for osd.9 2026-02-12T03:58:45.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7f725b251640 1 -- 10.20.193.91:0/1817416077 >> v1:10.20.193.98:6801/4165741185 conn(0x7f72240a3500 legacy=0x7f72240c3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7f725b251640 20 client.4473.objecter put_session s=0x7f72240a2e50 osd=9 1 2026-02-12T03:58:45.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7f725b251640 20 client.4473.objecter shutdown clearing up homeless session... 2026-02-12T03:58:45.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7f725b251640 10 client.4473.objecter successfully canceled tick 2026-02-12T03:58:45.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7f1b69b1c640 10 client.4436.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:45.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7f1b69b1c640 10 monclient: _renew_subs 2026-02-12T03:58:45.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7f1b69b1c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:45.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7f1b69b1c640 1 -- 10.20.193.91:0/3744615041 --> v1:10.20.193.111:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1b640b0b90 con 0x7f1b640b5e90 2026-02-12T03:58:45.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7f1b69b1c640 1 librados: init done 2026-02-12T03:58:45.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7fb2b17fa640 10 client.4480.objecter ms_handle_connect 0x7fb28c079f60 2026-02-12T03:58:45.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7f725b251640 1 -- 10.20.193.91:0/1817416077 >> v1:10.20.193.91:6800/2929217192 conn(0x7f7224079fd0 legacy=0x7f722409a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7f725b251640 10 monclient: shutdown 2026-02-12T03:58:45.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7f725b251640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:45.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.816+0000 7f725b251640 1 -- 10.20.193.91:0/1817416077 >> v1:10.20.193.91:6789/0 conn(0x7f72540b7180 legacy=0x7f7254142f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.817+0000 7f72597c7640 1 -- 10.20.193.91:0/1817416077 reap_dead start 2026-02-12T03:58:45.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.817+0000 7f725b251640 1 -- 10.20.193.91:0/1817416077 shutdown_connections 2026-02-12T03:58:45.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.817+0000 7f725b251640 1 -- 10.20.193.91:0/1817416077 >> 10.20.193.91:0/1817416077 conn(0x7f72540559c0 msgr2=0x7f72541351b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:45.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.817+0000 7f725b251640 1 -- 10.20.193.91:0/1817416077 shutdown_connections 2026-02-12T03:58:45.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.817+0000 7f725b251640 1 -- 10.20.193.91:0/1817416077 wait complete. 2026-02-12T03:58:45.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.817+0000 7f725b251640 1 librados: shutdown 2026-02-12T03:58:45.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.817+0000 7fbda1a50640 10 client.4424.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-12T03:58:45.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.817+0000 7fbda1a50640 15 client.4424.objecter _session_command_op_assign -1 2 2026-02-12T03:58:45.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.817+0000 7fbda1a50640 20 client.4424.objecter _get_session s=0x7fbd6c0a2d30 osd=0 3 2026-02-12T03:58:45.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.817+0000 7fbda1a50640 20 client.4424.objecter put_session s=0x7fbd6c0a2d30 osd=0 3 2026-02-12T03:58:45.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.817+0000 7fbda1a50640 20 client.4424.objecter _get_session s=0x7fbd6c0a2d30 osd=0 3 2026-02-12T03:58:45.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.817+0000 7fbda1a50640 15 client.4424.objecter _session_command_op_remove -1 2 2026-02-12T03:58:45.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.817+0000 7fbda1a50640 20 client.4424.objecter get_session s=0x7fbd6c0a2d30 osd=0 3 2026-02-12T03:58:45.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.817+0000 7fbda1a50640 15 client.4424.objecter _session_command_op_assign 0 2 2026-02-12T03:58:45.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.817+0000 7fbda1a50640 20 client.4424.objecter put_session s=0x7fbd6c0a2d30 osd=0 4 2026-02-12T03:58:45.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.817+0000 7fbda1a50640 10 client.4424.objecter _send_command 2 2026-02-12T03:58:45.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.817+0000 7fbda1a50640 1 -- 10.20.193.91:0/286286997 --> v1:10.20.193.91:6801/1203233578 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbd9c0b60e0 con 0x7fbd6c0a33e0 2026-02-12T03:58:45.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.817+0000 7ff238ff9640 1 -- 10.20.193.91:0/4164622660 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7ff22801cd80 con 0x7ff23c0564d0 2026-02-12T03:58:45.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.817+0000 7f1b69b1c640 10 client.4436.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:45.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.817+0000 7f1b69b1c640 15 client.4436.objecter _session_command_op_assign -1 1 2026-02-12T03:58:45.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.817+0000 7f1b69b1c640 20 client.4436.objecter _get_session osd=-1 returning homeless 2026-02-12T03:58:45.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.817+0000 7f1b69b1c640 10 client.4436.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:45.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.817+0000 7f1b69b1c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:45.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.817+0000 7f1b69b1c640 1 -- 10.20.193.91:0/3744615041 --> v1:10.20.193.111:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f1b64146520 con 0x7f1b640b5e90 2026-02-12T03:58:45.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.817+0000 7ff23b7fe640 10 monclient: get_auth_request con 0x7ff20c07a020 auth_method 0 2026-02-12T03:58:45.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.817+0000 7ff238ff9640 10 client.4491.objecter ms_handle_connect 0x7ff20c07a020 2026-02-12T03:58:45.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.818+0000 7fb2b17fa640 1 -- 10.20.193.91:0/3624527245 <== mon.1 v1:10.20.193.98:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7fb2ac0948c0 con 0x7fb2bc0b57a0 2026-02-12T03:58:45.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.818+0000 7fb2b17fa640 10 client.4480.objecter ms_dispatch2 0x7fb2bc000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:45.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.818+0000 7fb2b17fa640 3 client.4480.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:45.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.818+0000 7fb2b17fa640 3 client.4480.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:45.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.818+0000 7fb2b17fa640 10 client.4480.objecter checking command 1 2026-02-12T03:58:45.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.818+0000 7fb2b17fa640 20 client.4480.objecter _get_session s=0x7fb28c0a2de0 osd=11 3 2026-02-12T03:58:45.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.818+0000 7fb2b17fa640 20 client.4480.objecter put_session s=0x7fb28c0a2de0 osd=11 3 2026-02-12T03:58:45.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.818+0000 7fb2b17fa640 15 client.4480.objecter _session_command_op_remove -1 1 2026-02-12T03:58:45.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.818+0000 7fb2b17fa640 20 client.4480.objecter _get_session s=0x7fb28c0a2de0 osd=11 3 2026-02-12T03:58:45.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.818+0000 7fb2b17fa640 20 client.4480.objecter get_session s=0x7fb28c0a2de0 osd=11 3 2026-02-12T03:58:45.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.818+0000 7fb2b17fa640 15 client.4480.objecter _session_command_op_assign 11 1 2026-02-12T03:58:45.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.818+0000 7fb2b17fa640 20 client.4480.objecter put_session s=0x7fb28c0a2de0 osd=11 4 2026-02-12T03:58:45.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.818+0000 7fb2b17fa640 10 client.4480.objecter _send_command 1 2026-02-12T03:58:45.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.818+0000 7fb2b17fa640 1 -- 10.20.193.91:0/3624527245 --> v1:10.20.193.154:6804/2902069275 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb28c0c5090 con 0x7fb28c0a3490 2026-02-12T03:58:45.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.818+0000 7fb2b17fa640 20 client.4480.objecter dump_active .. 0 homeless 2026-02-12T03:58:45.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.819+0000 7ff238ff9640 1 -- 10.20.193.91:0/4164622660 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7ff2280948d0 con 0x7ff23c0564d0 2026-02-12T03:58:45.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.819+0000 7ff238ff9640 10 client.4491.objecter ms_dispatch2 0x7ff23c000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:45.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.819+0000 7ff238ff9640 3 client.4491.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:45.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.819+0000 7ff238ff9640 3 client.4491.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:45.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.819+0000 7ff238ff9640 10 client.4491.objecter checking command 1 2026-02-12T03:58:45.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.819+0000 7ff238ff9640 20 client.4491.objecter _get_session s=0x7ff20c0a2ea0 osd=15 3 2026-02-12T03:58:45.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.819+0000 7ff238ff9640 20 client.4491.objecter put_session s=0x7ff20c0a2ea0 osd=15 3 2026-02-12T03:58:45.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.819+0000 7ff238ff9640 15 client.4491.objecter _session_command_op_remove -1 1 2026-02-12T03:58:45.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.819+0000 7ff238ff9640 20 client.4491.objecter _get_session s=0x7ff20c0a2ea0 osd=15 3 2026-02-12T03:58:45.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.819+0000 7ff238ff9640 20 client.4491.objecter get_session s=0x7ff20c0a2ea0 osd=15 3 2026-02-12T03:58:45.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.819+0000 7ff238ff9640 15 client.4491.objecter _session_command_op_assign 15 1 2026-02-12T03:58:45.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.819+0000 7ff238ff9640 20 client.4491.objecter put_session s=0x7ff20c0a2ea0 osd=15 4 2026-02-12T03:58:45.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.819+0000 7ff238ff9640 10 client.4491.objecter _send_command 1 2026-02-12T03:58:45.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.819+0000 7ff238ff9640 1 -- 10.20.193.91:0/4164622660 --> v1:10.20.193.154:6809/2343771552 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff20c0c5150 con 0x7ff20c0a3550 2026-02-12T03:58:45.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.819+0000 7ff238ff9640 20 client.4491.objecter dump_active .. 0 homeless 2026-02-12T03:58:45.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.819+0000 7ff238ff9640 1 -- 10.20.193.91:0/4164622660 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7ff22805d900 con 0x7ff23c0564d0 2026-02-12T03:58:45.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.819+0000 7ff238ff9640 10 monclient: handle_get_version_reply finishing 1 version 28 2026-02-12T03:58:45.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.819+0000 7f47ff5cc640 10 client.4456.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-12T03:58:45.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.819+0000 7f47ff5cc640 15 client.4456.objecter _session_command_op_assign -1 2 2026-02-12T03:58:45.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.819+0000 7f47ff5cc640 20 client.4456.objecter _get_session s=0x7f47c80a2e00 osd=7 3 2026-02-12T03:58:45.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.819+0000 7f47ff5cc640 20 client.4456.objecter put_session s=0x7f47c80a2e00 osd=7 3 2026-02-12T03:58:45.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.819+0000 7f47ff5cc640 20 client.4456.objecter _get_session s=0x7f47c80a2e00 osd=7 3 2026-02-12T03:58:45.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.819+0000 7f47ff5cc640 15 client.4456.objecter _session_command_op_remove -1 2 2026-02-12T03:58:45.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.819+0000 7f47ff5cc640 20 client.4456.objecter get_session s=0x7f47c80a2e00 osd=7 3 2026-02-12T03:58:45.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.819+0000 7f47ff5cc640 15 client.4456.objecter _session_command_op_assign 7 2 2026-02-12T03:58:45.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.819+0000 7f47ff5cc640 20 client.4456.objecter put_session s=0x7f47c80a2e00 osd=7 4 2026-02-12T03:58:45.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.819+0000 7f47ff5cc640 10 client.4456.objecter _send_command 2 2026-02-12T03:58:45.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.819+0000 7f47ff5cc640 1 -- 10.20.193.91:0/4153586687 --> v1:10.20.193.154:6808/903276772 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f47f815bae0 con 0x7f47c80a34b0 2026-02-12T03:58:45.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.819+0000 7fb2c1289640 10 monclient: get_auth_request con 0x7fb28c0a3490 auth_method 0 2026-02-12T03:58:45.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.819+0000 7ff240b1e640 10 monclient: get_auth_request con 0x7ff20c0a3550 auth_method 0 2026-02-12T03:58:45.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.820+0000 7fb2b17fa640 10 client.4480.objecter ms_handle_connect 0x7fb28c0a3490 2026-02-12T03:58:45.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.820+0000 7fbd73fff640 1 -- 10.20.193.91:0/286286997 <== osd.0 v1:10.20.193.91:6801/1203233578 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7fbd9c0b60e0 con 0x7fbd6c0a33e0 2026-02-12T03:58:45.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.820+0000 7fbd73fff640 10 client.4424.objecter ms_dispatch2 0x7fbd9c000b90 command_reply(tid 2: 0 ) 2026-02-12T03:58:45.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.820+0000 7fbd73fff640 10 client.4424.objecter _finish_command 2 = system:0 2026-02-12T03:58:45.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.820+0000 7fbd73fff640 20 client.4424.objecter put_session s=0x7fbd6c0a2d30 osd=0 4 2026-02-12T03:58:45.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.820+0000 7fbd73fff640 15 client.4424.objecter _session_command_op_remove 0 2 2026-02-12T03:58:45.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.820+0000 7fbda1a50640 10 librados: watch_flush enter 2026-02-12T03:58:45.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.820+0000 7fbda1a50640 10 librados: watch_flush exit 2026-02-12T03:58:45.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.820+0000 7fbda1a50640 10 client.4424.objecter close_session for osd.0 2026-02-12T03:58:45.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.820+0000 7fbda1a50640 1 -- 10.20.193.91:0/286286997 >> v1:10.20.193.91:6801/1203233578 conn(0x7fbd6c0a33e0 legacy=0x7fbd6c0c3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.820+0000 7fbda1a50640 20 client.4424.objecter put_session s=0x7fbd6c0a2d30 osd=0 1 2026-02-12T03:58:45.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.820+0000 7fbda1a50640 20 client.4424.objecter shutdown clearing up homeless session... 2026-02-12T03:58:45.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.820+0000 7fbda1a50640 10 client.4424.objecter successfully canceled tick 2026-02-12T03:58:45.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.820+0000 7fbda1a50640 1 -- 10.20.193.91:0/286286997 >> v1:10.20.193.91:6800/2929217192 conn(0x7fbd6c079eb0 legacy=0x7fbd6c09a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.820+0000 7fbda1a50640 10 monclient: shutdown 2026-02-12T03:58:45.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.820+0000 7fbda1a50640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:45.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.820+0000 7fbda1a50640 1 -- 10.20.193.91:0/286286997 >> v1:10.20.193.111:6789/0 conn(0x7fbd9c0b57a0 legacy=0x7fbd9c129810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.820+0000 7fbd9b7fe640 1 -- 10.20.193.91:0/286286997 reap_dead start 2026-02-12T03:58:45.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.821+0000 7fbda1a50640 1 -- 10.20.193.91:0/286286997 shutdown_connections 2026-02-12T03:58:45.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.821+0000 7fbda1a50640 1 -- 10.20.193.91:0/286286997 >> 10.20.193.91:0/286286997 conn(0x7fbd9c0559c0 msgr2=0x7fbd9c05f700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:45.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.821+0000 7fbda1a50640 1 -- 10.20.193.91:0/286286997 shutdown_connections 2026-02-12T03:58:45.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.821+0000 7fbda1a50640 1 -- 10.20.193.91:0/286286997 wait complete. 2026-02-12T03:58:45.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.821+0000 7fbda1a50640 1 librados: shutdown 2026-02-12T03:58:45.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.821+0000 7ff238ff9640 10 client.4491.objecter ms_handle_connect 0x7ff20c0a3550 2026-02-12T03:58:45.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.821+0000 7f47e5ffb640 1 -- 10.20.193.91:0/4153586687 <== osd.7 v1:10.20.193.154:6808/903276772 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 3529919842) 0x7f47f815bae0 con 0x7f47c80a34b0 2026-02-12T03:58:45.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.821+0000 7f47e5ffb640 10 client.4456.objecter ms_dispatch2 0x7f47f8000b90 command_reply(tid 2: 0 ) 2026-02-12T03:58:45.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.821+0000 7f47e5ffb640 10 client.4456.objecter _finish_command 2 = system:0 2026-02-12T03:58:45.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.821+0000 7f47e5ffb640 20 client.4456.objecter put_session s=0x7f47c80a2e00 osd=7 4 2026-02-12T03:58:45.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.821+0000 7f47e5ffb640 15 client.4456.objecter _session_command_op_remove 7 2 2026-02-12T03:58:45.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.821+0000 7f47ff5cc640 10 librados: watch_flush enter 2026-02-12T03:58:45.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.821+0000 7f47ff5cc640 10 librados: watch_flush exit 2026-02-12T03:58:45.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.821+0000 7f47ff5cc640 10 client.4456.objecter close_session for osd.7 2026-02-12T03:58:45.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.822+0000 7f47ff5cc640 1 -- 10.20.193.91:0/4153586687 >> v1:10.20.193.154:6808/903276772 conn(0x7f47c80a34b0 legacy=0x7f47c80c38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.822+0000 7f47ff5cc640 20 client.4456.objecter put_session s=0x7f47c80a2e00 osd=7 1 2026-02-12T03:58:45.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.822+0000 7f47ff5cc640 20 client.4456.objecter shutdown clearing up homeless session... 2026-02-12T03:58:45.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.822+0000 7f47ff5cc640 10 client.4456.objecter successfully canceled tick 2026-02-12T03:58:45.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.822+0000 7f47ff5cc640 1 -- 10.20.193.91:0/4153586687 >> v1:10.20.193.91:6800/2929217192 conn(0x7f47c8079f80 legacy=0x7f47c809a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.822+0000 7f47ff5cc640 10 monclient: shutdown 2026-02-12T03:58:45.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.822+0000 7f47ff5cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:45.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.822+0000 7f47ff5cc640 1 -- 10.20.193.91:0/4153586687 >> v1:10.20.193.98:6789/0 conn(0x7f47f80b57a0 legacy=0x7f47f812f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.822+0000 7f47fdb42640 1 -- 10.20.193.91:0/4153586687 reap_dead start 2026-02-12T03:58:45.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.822+0000 7f47ff5cc640 1 -- 10.20.193.91:0/4153586687 shutdown_connections 2026-02-12T03:58:45.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.822+0000 7f47ff5cc640 1 -- 10.20.193.91:0/4153586687 >> 10.20.193.91:0/4153586687 conn(0x7f47f80559c0 msgr2=0x7f47f80b96f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:45.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.822+0000 7f47ff5cc640 1 -- 10.20.193.91:0/4153586687 shutdown_connections 2026-02-12T03:58:45.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.822+0000 7f47ff5cc640 1 -- 10.20.193.91:0/4153586687 wait complete. 2026-02-12T03:58:45.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.822+0000 7f47ff5cc640 1 librados: shutdown 2026-02-12T03:58:45.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.822+0000 7f50967fc640 1 -- 10.20.193.91:0/1727122728 <== osd.3 v1:10.20.193.154:6800/4779434 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f50780c50e0 con 0x7f50780a34e0 2026-02-12T03:58:45.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.822+0000 7f50967fc640 10 client.4421.objecter ms_dispatch2 0x7f50a8000b90 command_reply(tid 1: 0 ) 2026-02-12T03:58:45.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.822+0000 7f50967fc640 10 client.4421.objecter _finish_command 1 = system:0 2026-02-12T03:58:45.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.822+0000 7f50967fc640 20 client.4421.objecter put_session s=0x7f50780a2e30 osd=3 4 2026-02-12T03:58:45.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.822+0000 7f50967fc640 15 client.4421.objecter _session_command_op_remove 3 1 2026-02-12T03:58:45.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.823+0000 7f71d6ffd640 1 -- 10.20.193.91:0/3729138105 <== osd.10 v1:10.20.193.111:6808/1268343515 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f71c00c51b0 con 0x7f71c00a3510 2026-02-12T03:58:45.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.823+0000 7f71d6ffd640 10 client.4485.objecter ms_dispatch2 0x7f71f4000b90 command_reply(tid 1: 0 ) 2026-02-12T03:58:45.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.823+0000 7f71d6ffd640 10 client.4485.objecter _finish_command 1 = system:0 2026-02-12T03:58:45.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.823+0000 7f71d6ffd640 20 client.4485.objecter put_session s=0x7f71c00a2e60 osd=10 4 2026-02-12T03:58:45.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.823+0000 7f71d6ffd640 15 client.4485.objecter _session_command_op_remove 10 1 2026-02-12T03:58:45.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.823+0000 7fb2b17fa640 1 -- 10.20.193.91:0/3624527245 <== mon.1 v1:10.20.193.98:6789/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7fb2ac059e90 con 0x7fb2bc0b57a0 2026-02-12T03:58:45.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.823+0000 7fb2b17fa640 10 monclient: handle_get_version_reply finishing 1 version 28 2026-02-12T03:58:45.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.825+0000 7f1b3ffff640 1 -- 10.20.193.91:0/3744615041 <== mon.2 v1:10.20.193.111:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1b64146520 con 0x7f1b640b5e90 2026-02-12T03:58:45.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.825+0000 7f1b3ffff640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:45.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.825+0000 7f1b3ffff640 1 -- 10.20.193.91:0/3744615041 <== mon.2 v1:10.20.193.111:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f1b540038a0 con 0x7f1b640b5e90 2026-02-12T03:58:45.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.825+0000 7f1b3ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.825+0000 7f1b3ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:45.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.825+0000 7f1b3ffff640 10 monclient: dump: 2026-02-12T03:58:45.891 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.891 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.891 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.891 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.891 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.891 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.892 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.892 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.892 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.892 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.825+0000 7f1b61ffb640 4 set_mon_vals no callback set 2026-02-12T03:58:45.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.826+0000 7f1b3ffff640 1 -- 10.20.193.91:0/3744615041 <== mon.2 v1:10.20.193.111:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f1b5401cd80 con 0x7f1b640b5e90 2026-02-12T03:58:45.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.826+0000 7f1b637fe640 10 monclient: get_auth_request con 0x7f1b3407a070 auth_method 0 2026-02-12T03:58:45.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.826+0000 7f1b3ffff640 10 client.4436.objecter ms_handle_connect 0x7f1b3407a070 2026-02-12T03:58:45.892 INFO:teuthology.orchestra.run.trial091.stdout:90194313221 2026-02-12T03:58:45.893 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-12T03:58:45.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.828+0000 7f1b3ffff640 1 -- 10.20.193.91:0/3744615041 <== mon.2 v1:10.20.193.111:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7f1b540946b0 con 0x7f1b640b5e90 2026-02-12T03:58:45.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.828+0000 7f1b3ffff640 10 client.4436.objecter ms_dispatch2 0x7f1b64000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:45.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.828+0000 7f1b3ffff640 3 client.4436.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:45.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.828+0000 7f1b3ffff640 3 client.4436.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:45.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.828+0000 7f1b3ffff640 10 client.4436.objecter checking command 1 2026-02-12T03:58:45.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.828+0000 7f1b3ffff640 20 client.4436.objecter _get_session s=0x7f1b340a2ef0 osd=4 3 2026-02-12T03:58:45.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.828+0000 7f1b3ffff640 20 client.4436.objecter put_session s=0x7f1b340a2ef0 osd=4 3 2026-02-12T03:58:45.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.828+0000 7f1b3ffff640 15 client.4436.objecter _session_command_op_remove -1 1 2026-02-12T03:58:45.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.828+0000 7f1b3ffff640 20 client.4436.objecter _get_session s=0x7f1b340a2ef0 osd=4 3 2026-02-12T03:58:45.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.828+0000 7f1b3ffff640 20 client.4436.objecter get_session s=0x7f1b340a2ef0 osd=4 3 2026-02-12T03:58:45.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.828+0000 7f1b3ffff640 15 client.4436.objecter _session_command_op_assign 4 1 2026-02-12T03:58:45.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.828+0000 7f1b3ffff640 20 client.4436.objecter put_session s=0x7f1b340a2ef0 osd=4 4 2026-02-12T03:58:45.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.828+0000 7f1b3ffff640 10 client.4436.objecter _send_command 1 2026-02-12T03:58:45.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.828+0000 7f1b3ffff640 1 -- 10.20.193.91:0/3744615041 --> v1:10.20.193.91:6805/1766507926 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1b340c51a0 con 0x7f1b340a35a0 2026-02-12T03:58:45.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.828+0000 7f1b3ffff640 20 client.4436.objecter dump_active .. 0 homeless 2026-02-12T03:58:45.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.828+0000 7f1b3ffff640 1 -- 10.20.193.91:0/3744615041 <== mon.2 v1:10.20.193.111:6789/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7f1b54059c80 con 0x7f1b640b5e90 2026-02-12T03:58:45.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.828+0000 7f1b3ffff640 10 monclient: handle_get_version_reply finishing 1 version 28 2026-02-12T03:58:45.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.828+0000 7f1b63fff640 10 monclient: get_auth_request con 0x7f1b340a35a0 auth_method 0 2026-02-12T03:58:45.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.828+0000 7f3e4effd640 1 -- 10.20.193.91:0/1309264919 <== mon.1 v1:10.20.193.98:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3e681fa1f0 con 0x7f3e681639c0 2026-02-12T03:58:45.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.828+0000 7f3e4effd640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:45.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.828+0000 7f3e4effd640 1 -- 10.20.193.91:0/1309264919 <== mon.1 v1:10.20.193.98:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f3e58003300 con 0x7f3e681639c0 2026-02-12T03:58:45.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.828+0000 7f3e4effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:45.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.828+0000 7f3e4effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:45.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.828+0000 7f3e4effd640 10 monclient: dump: 2026-02-12T03:58:45.894 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:45.894 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.895 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.895 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:45.895 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:45.895 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.895 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:45.895 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:45.895 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:45.895 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.828+0000 7f3e64d72640 4 set_mon_vals no callback set 2026-02-12T03:58:45.895 INFO:teuthology.orchestra.run.trial091.stdout:90194313220 2026-02-12T03:58:45.895 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-12T03:58:45.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.829+0000 7f3e4effd640 1 -- 10.20.193.91:0/1309264919 <== mon.1 v1:10.20.193.98:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f3e5801d020 con 0x7f3e681639c0 2026-02-12T03:58:45.896 INFO:teuthology.orchestra.run.trial091.stdout:94489280518 2026-02-12T03:58:45.896 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-12T03:58:45.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.830+0000 7f3e66575640 10 monclient: get_auth_request con 0x7f3e34079ff0 auth_method 0 2026-02-12T03:58:45.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.830+0000 7f3e4effd640 10 client.4465.objecter ms_handle_connect 0x7f3e34079ff0 2026-02-12T03:58:45.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.830+0000 7f1b3ffff640 10 client.4436.objecter ms_handle_connect 0x7f1b340a35a0 2026-02-12T03:58:45.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f3e4effd640 1 -- 10.20.193.91:0/1309264919 <== mon.1 v1:10.20.193.98:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7f3e58094900 con 0x7f3e681639c0 2026-02-12T03:58:45.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f3e4effd640 10 client.4465.objecter ms_dispatch2 0x7f3e68000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:45.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f3e4effd640 3 client.4465.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:45.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f3e4effd640 3 client.4465.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:45.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f3e4effd640 10 client.4465.objecter checking command 1 2026-02-12T03:58:45.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f3e4effd640 20 client.4465.objecter _get_session s=0x7f3e340a2e70 osd=13 3 2026-02-12T03:58:45.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f3e4effd640 20 client.4465.objecter put_session s=0x7f3e340a2e70 osd=13 3 2026-02-12T03:58:45.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f3e4effd640 15 client.4465.objecter _session_command_op_remove -1 1 2026-02-12T03:58:45.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f3e4effd640 20 client.4465.objecter _get_session s=0x7f3e340a2e70 osd=13 3 2026-02-12T03:58:45.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f3e4effd640 20 client.4465.objecter get_session s=0x7f3e340a2e70 osd=13 3 2026-02-12T03:58:45.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f3e4effd640 15 client.4465.objecter _session_command_op_assign 13 1 2026-02-12T03:58:45.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f3e4effd640 20 client.4465.objecter put_session s=0x7f3e340a2e70 osd=13 4 2026-02-12T03:58:45.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f3e4effd640 10 client.4465.objecter _send_command 1 2026-02-12T03:58:45.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f3e4effd640 1 -- 10.20.193.91:0/1309264919 --> v1:10.20.193.98:6800/1665089474 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3e58003690 con 0x7f3e340a3520 2026-02-12T03:58:45.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f3e4effd640 20 client.4465.objecter dump_active .. 0 homeless 2026-02-12T03:58:45.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f3e4effd640 1 -- 10.20.193.91:0/1309264919 <== mon.1 v1:10.20.193.98:6789/0 9 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (unknown 2863928538 0 0) 0x7f3e58059ed0 con 0x7f3e681639c0 2026-02-12T03:58:45.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f3e4effd640 10 monclient: handle_get_version_reply finishing 1 version 28 2026-02-12T03:58:45.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f71f8bcc640 10 client.4485.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-12T03:58:45.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f71f8bcc640 15 client.4485.objecter _session_command_op_assign -1 2 2026-02-12T03:58:45.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f71f8bcc640 20 client.4485.objecter _get_session s=0x7f71c00a2e60 osd=10 3 2026-02-12T03:58:45.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f71f8bcc640 20 client.4485.objecter put_session s=0x7f71c00a2e60 osd=10 3 2026-02-12T03:58:45.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f71f8bcc640 20 client.4485.objecter _get_session s=0x7f71c00a2e60 osd=10 3 2026-02-12T03:58:45.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f71f8bcc640 15 client.4485.objecter _session_command_op_remove -1 2 2026-02-12T03:58:45.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f71f8bcc640 20 client.4485.objecter get_session s=0x7f71c00a2e60 osd=10 3 2026-02-12T03:58:45.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f71f8bcc640 15 client.4485.objecter _session_command_op_assign 10 2 2026-02-12T03:58:45.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f71f8bcc640 20 client.4485.objecter put_session s=0x7f71c00a2e60 osd=10 4 2026-02-12T03:58:45.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f71f8bcc640 10 client.4485.objecter _send_command 2 2026-02-12T03:58:45.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f71f8bcc640 1 -- 10.20.193.91:0/3729138105 --> v1:10.20.193.111:6808/1268343515 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f71f4157d30 con 0x7f71c00a3510 2026-02-12T03:58:45.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f50afed4640 10 client.4421.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-12T03:58:45.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f50afed4640 15 client.4421.objecter _session_command_op_assign -1 2 2026-02-12T03:58:45.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f50afed4640 20 client.4421.objecter _get_session s=0x7f50780a2e30 osd=3 3 2026-02-12T03:58:45.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f50afed4640 20 client.4421.objecter put_session s=0x7f50780a2e30 osd=3 3 2026-02-12T03:58:45.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f50afed4640 20 client.4421.objecter _get_session s=0x7f50780a2e30 osd=3 3 2026-02-12T03:58:45.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f50afed4640 15 client.4421.objecter _session_command_op_remove -1 2 2026-02-12T03:58:45.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f50afed4640 20 client.4421.objecter get_session s=0x7f50780a2e30 osd=3 3 2026-02-12T03:58:45.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f50afed4640 15 client.4421.objecter _session_command_op_assign 3 2 2026-02-12T03:58:45.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f50afed4640 20 client.4421.objecter put_session s=0x7f50780a2e30 osd=3 4 2026-02-12T03:58:45.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f50afed4640 10 client.4421.objecter _send_command 2 2026-02-12T03:58:45.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f50afed4640 1 -- 10.20.193.91:0/1727122728 --> v1:10.20.193.154:6800/4779434 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f50a80b9cd0 con 0x7f50780a34e0 2026-02-12T03:58:45.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.831+0000 7f3e65d74640 10 monclient: get_auth_request con 0x7f3e340a3520 auth_method 0 2026-02-12T03:58:45.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.833+0000 7f07c37fe640 1 -- 10.20.193.91:0/198827363 <== osd.5 v1:10.20.193.98:6808/3918277953 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f07b00c4f90 con 0x7f07b00a32f0 2026-02-12T03:58:45.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.833+0000 7f07c37fe640 10 client.4474.objecter ms_dispatch2 0x7f07e4000b90 command_reply(tid 1: 0 ) 2026-02-12T03:58:45.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.833+0000 7f07c37fe640 10 client.4474.objecter _finish_command 1 = system:0 2026-02-12T03:58:45.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.833+0000 7f07c37fe640 20 client.4474.objecter put_session s=0x7f07b00a2c40 osd=5 4 2026-02-12T03:58:45.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.833+0000 7f07c37fe640 15 client.4474.objecter _session_command_op_remove 5 1 2026-02-12T03:58:45.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.833+0000 7f3e4effd640 10 client.4465.objecter ms_handle_connect 0x7f3e340a3520 2026-02-12T03:58:45.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.834+0000 7f71d6ffd640 1 -- 10.20.193.91:0/3729138105 <== osd.10 v1:10.20.193.111:6808/1268343515 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1506399442) 0x7f71f4157d30 con 0x7f71c00a3510 2026-02-12T03:58:45.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.834+0000 7f71d6ffd640 10 client.4485.objecter ms_dispatch2 0x7f71f4000b90 command_reply(tid 2: 0 ) 2026-02-12T03:58:45.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.834+0000 7f71d6ffd640 10 client.4485.objecter _finish_command 2 = system:0 2026-02-12T03:58:45.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.834+0000 7f71d6ffd640 20 client.4485.objecter put_session s=0x7f71c00a2e60 osd=10 4 2026-02-12T03:58:45.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.834+0000 7f71d6ffd640 15 client.4485.objecter _session_command_op_remove 10 2 2026-02-12T03:58:45.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.834+0000 7f71f8bcc640 10 librados: watch_flush enter 2026-02-12T03:58:45.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.834+0000 7f71f8bcc640 10 librados: watch_flush exit 2026-02-12T03:58:45.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.834+0000 7f71f8bcc640 10 client.4485.objecter close_session for osd.10 2026-02-12T03:58:45.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.834+0000 7f71f8bcc640 1 -- 10.20.193.91:0/3729138105 >> v1:10.20.193.111:6808/1268343515 conn(0x7f71c00a3510 legacy=0x7f71c00c3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.834+0000 7f71f8bcc640 20 client.4485.objecter put_session s=0x7f71c00a2e60 osd=10 1 2026-02-12T03:58:45.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.834+0000 7f71f8bcc640 20 client.4485.objecter shutdown clearing up homeless session... 2026-02-12T03:58:45.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.834+0000 7f71f8bcc640 10 client.4485.objecter successfully canceled tick 2026-02-12T03:58:45.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.834+0000 7f71f8bcc640 1 -- 10.20.193.91:0/3729138105 >> v1:10.20.193.91:6800/2929217192 conn(0x7f71c0079fe0 legacy=0x7f71c009a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.834+0000 7f71f8bcc640 10 monclient: shutdown 2026-02-12T03:58:45.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.834+0000 7f71f8bcc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:45.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.834+0000 7f71f8bcc640 1 -- 10.20.193.91:0/3729138105 >> v1:10.20.193.91:6789/0 conn(0x7f71f4164760 legacy=0x7f71f4145e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.834+0000 7f71f2d76640 1 -- 10.20.193.91:0/3729138105 reap_dead start 2026-02-12T03:58:45.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.834+0000 7f71f8bcc640 1 -- 10.20.193.91:0/3729138105 shutdown_connections 2026-02-12T03:58:45.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.834+0000 7f71f8bcc640 1 -- 10.20.193.91:0/3729138105 >> 10.20.193.91:0/3729138105 conn(0x7f71f40bab20 msgr2=0x7f71f4136840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:45.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.834+0000 7f71f8bcc640 1 -- 10.20.193.91:0/3729138105 shutdown_connections 2026-02-12T03:58:45.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.834+0000 7f71f8bcc640 1 -- 10.20.193.91:0/3729138105 wait complete. 2026-02-12T03:58:45.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.834+0000 7f71f8bcc640 1 librados: shutdown 2026-02-12T03:58:45.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.834+0000 7f50967fc640 1 -- 10.20.193.91:0/1727122728 <== osd.3 v1:10.20.193.154:6800/4779434 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2356506950) 0x7f50a80b9cd0 con 0x7f50780a34e0 2026-02-12T03:58:45.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.834+0000 7f50967fc640 10 client.4421.objecter ms_dispatch2 0x7f50a8000b90 command_reply(tid 2: 0 ) 2026-02-12T03:58:45.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.834+0000 7f50967fc640 10 client.4421.objecter _finish_command 2 = system:0 2026-02-12T03:58:45.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.834+0000 7f50967fc640 20 client.4421.objecter put_session s=0x7f50780a2e30 osd=3 4 2026-02-12T03:58:45.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.834+0000 7f50967fc640 15 client.4421.objecter _session_command_op_remove 3 2 2026-02-12T03:58:45.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.835+0000 7f50afed4640 10 librados: watch_flush enter 2026-02-12T03:58:45.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.835+0000 7f50afed4640 10 librados: watch_flush exit 2026-02-12T03:58:45.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.835+0000 7f50afed4640 10 client.4421.objecter close_session for osd.3 2026-02-12T03:58:45.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.835+0000 7f50afed4640 1 -- 10.20.193.91:0/1727122728 >> v1:10.20.193.154:6800/4779434 conn(0x7f50780a34e0 legacy=0x7f50780c3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.835+0000 7f50afed4640 20 client.4421.objecter put_session s=0x7f50780a2e30 osd=3 1 2026-02-12T03:58:45.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.835+0000 7f50afed4640 20 client.4421.objecter shutdown clearing up homeless session... 2026-02-12T03:58:45.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.835+0000 7f50afed4640 10 client.4421.objecter successfully canceled tick 2026-02-12T03:58:45.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.835+0000 7f50afed4640 1 -- 10.20.193.91:0/1727122728 >> v1:10.20.193.91:6800/2929217192 conn(0x7f5078079fb0 legacy=0x7f507809a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.835+0000 7f50afed4640 10 monclient: shutdown 2026-02-12T03:58:45.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.835+0000 7f50afed4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:45.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.835+0000 7f50afed4640 1 -- 10.20.193.91:0/1727122728 >> v1:10.20.193.111:6789/0 conn(0x7f50a80b7180 legacy=0x7f50a81334d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.835+0000 7f50ae44a640 1 -- 10.20.193.91:0/1727122728 reap_dead start 2026-02-12T03:58:45.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.835+0000 7f50afed4640 1 -- 10.20.193.91:0/1727122728 shutdown_connections 2026-02-12T03:58:45.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.835+0000 7f50afed4640 1 -- 10.20.193.91:0/1727122728 >> 10.20.193.91:0/1727122728 conn(0x7f50a80559c0 msgr2=0x7f50a805f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:45.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.835+0000 7f50afed4640 1 -- 10.20.193.91:0/1727122728 shutdown_connections 2026-02-12T03:58:45.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.835+0000 7f50afed4640 1 -- 10.20.193.91:0/1727122728 wait complete. 2026-02-12T03:58:45.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.835+0000 7f50afed4640 1 librados: shutdown 2026-02-12T03:58:45.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.836+0000 7ff728ff9640 1 -- 10.20.193.91:0/2171776711 <== osd.14 v1:10.20.193.111:6800/1665676360 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7ff720003490 con 0x7ff6fc0a34e0 2026-02-12T03:58:45.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.836+0000 7ff728ff9640 10 client.4433.objecter ms_dispatch2 0x7ff72c000b90 command_reply(tid 1: 0 ) 2026-02-12T03:58:45.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.836+0000 7ff728ff9640 10 client.4433.objecter _finish_command 1 = system:0 2026-02-12T03:58:45.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.836+0000 7ff728ff9640 20 client.4433.objecter put_session s=0x7ff6fc0a2e30 osd=14 4 2026-02-12T03:58:45.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.836+0000 7ff728ff9640 15 client.4433.objecter _session_command_op_remove 14 1 2026-02-12T03:58:45.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.840+0000 7fb2b17fa640 1 -- 10.20.193.91:0/3624527245 <== osd.11 v1:10.20.193.154:6804/2902069275 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fb28c0c5090 con 0x7fb28c0a3490 2026-02-12T03:58:45.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.840+0000 7fb2b17fa640 10 client.4480.objecter ms_dispatch2 0x7fb2bc000b90 command_reply(tid 1: 0 ) 2026-02-12T03:58:45.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.840+0000 7fb2b17fa640 10 client.4480.objecter _finish_command 1 = system:0 2026-02-12T03:58:45.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.840+0000 7fb2b17fa640 20 client.4480.objecter put_session s=0x7fb28c0a2de0 osd=11 4 2026-02-12T03:58:45.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.840+0000 7fb2b17fa640 15 client.4480.objecter _session_command_op_remove 11 1 2026-02-12T03:58:45.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.840+0000 7ff238ff9640 1 -- 10.20.193.91:0/4164622660 <== osd.15 v1:10.20.193.154:6809/2343771552 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7ff20c0c5150 con 0x7ff20c0a3550 2026-02-12T03:58:45.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.840+0000 7ff238ff9640 10 client.4491.objecter ms_dispatch2 0x7ff23c000b90 command_reply(tid 1: 0 ) 2026-02-12T03:58:45.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.840+0000 7ff238ff9640 10 client.4491.objecter _finish_command 1 = system:0 2026-02-12T03:58:45.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.840+0000 7ff238ff9640 20 client.4491.objecter put_session s=0x7ff20c0a2ea0 osd=15 4 2026-02-12T03:58:45.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.840+0000 7ff238ff9640 15 client.4491.objecter _session_command_op_remove 15 1 2026-02-12T03:58:45.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.841+0000 7f07e9528640 10 client.4474.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-12T03:58:45.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.841+0000 7f07e9528640 15 client.4474.objecter _session_command_op_assign -1 2 2026-02-12T03:58:45.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.841+0000 7f07e9528640 20 client.4474.objecter _get_session s=0x7f07b00a2c40 osd=5 3 2026-02-12T03:58:45.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.841+0000 7f07e9528640 20 client.4474.objecter put_session s=0x7f07b00a2c40 osd=5 3 2026-02-12T03:58:45.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.841+0000 7f07e9528640 20 client.4474.objecter _get_session s=0x7f07b00a2c40 osd=5 3 2026-02-12T03:58:45.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.841+0000 7f07e9528640 15 client.4474.objecter _session_command_op_remove -1 2 2026-02-12T03:58:45.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.841+0000 7f07e9528640 20 client.4474.objecter get_session s=0x7f07b00a2c40 osd=5 3 2026-02-12T03:58:45.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.841+0000 7f07e9528640 15 client.4474.objecter _session_command_op_assign 5 2 2026-02-12T03:58:45.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.841+0000 7f07e9528640 20 client.4474.objecter put_session s=0x7f07b00a2c40 osd=5 4 2026-02-12T03:58:45.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.841+0000 7f07e9528640 10 client.4474.objecter _send_command 2 2026-02-12T03:58:45.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.841+0000 7f07e9528640 1 -- 10.20.193.91:0/198827363 --> v1:10.20.193.98:6808/3918277953 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f07e4052b70 con 0x7f07b00a32f0 2026-02-12T03:58:45.902 INFO:teuthology.orchestra.run.trial091.stdout:94489280517 2026-02-12T03:58:45.902 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-12T03:58:45.902 INFO:teuthology.orchestra.run.trial091.stdout:90194313221 2026-02-12T03:58:45.902 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2026-02-12T03:58:45.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.844+0000 7f07c37fe640 1 -- 10.20.193.91:0/198827363 <== osd.5 v1:10.20.193.98:6808/3918277953 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1506399442) 0x7f07e4052b70 con 0x7f07b00a32f0 2026-02-12T03:58:45.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.844+0000 7f07c37fe640 10 client.4474.objecter ms_dispatch2 0x7f07e4000b90 command_reply(tid 2: 0 ) 2026-02-12T03:58:45.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.844+0000 7f07c37fe640 10 client.4474.objecter _finish_command 2 = system:0 2026-02-12T03:58:45.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.844+0000 7f07c37fe640 20 client.4474.objecter put_session s=0x7f07b00a2c40 osd=5 4 2026-02-12T03:58:45.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.844+0000 7f07c37fe640 15 client.4474.objecter _session_command_op_remove 5 2 2026-02-12T03:58:45.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.844+0000 7f07e9528640 10 librados: watch_flush enter 2026-02-12T03:58:45.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.844+0000 7f07e9528640 10 librados: watch_flush exit 2026-02-12T03:58:45.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.844+0000 7f07e9528640 10 client.4474.objecter close_session for osd.5 2026-02-12T03:58:45.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.844+0000 7f07e9528640 1 -- 10.20.193.91:0/198827363 >> v1:10.20.193.98:6808/3918277953 conn(0x7f07b00a32f0 legacy=0x7f07b00c3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.844+0000 7f07e9528640 20 client.4474.objecter put_session s=0x7f07b00a2c40 osd=5 1 2026-02-12T03:58:45.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.844+0000 7f07e9528640 20 client.4474.objecter shutdown clearing up homeless session... 2026-02-12T03:58:45.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.844+0000 7f07e9528640 10 client.4474.objecter successfully canceled tick 2026-02-12T03:58:45.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.844+0000 7f07e9528640 1 -- 10.20.193.91:0/198827363 >> v1:10.20.193.91:6800/2929217192 conn(0x7f07b0079dc0 legacy=0x7f07b009a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.844+0000 7f07e9528640 10 monclient: shutdown 2026-02-12T03:58:45.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.844+0000 7f07e9528640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:45.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.844+0000 7f07e9528640 1 -- 10.20.193.91:0/198827363 >> v1:10.20.193.98:6789/0 conn(0x7f07e40b5b70 legacy=0x7f07e415cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.844+0000 7f07e37fe640 1 -- 10.20.193.91:0/198827363 reap_dead start 2026-02-12T03:58:45.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.844+0000 7f07e9528640 1 -- 10.20.193.91:0/198827363 shutdown_connections 2026-02-12T03:58:45.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.844+0000 7f07e9528640 1 -- 10.20.193.91:0/198827363 >> 10.20.193.91:0/198827363 conn(0x7f07e40559c0 msgr2=0x7f07e41351e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:45.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.844+0000 7f07e9528640 1 -- 10.20.193.91:0/198827363 shutdown_connections 2026-02-12T03:58:45.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.844+0000 7f07e9528640 1 -- 10.20.193.91:0/198827363 wait complete. 2026-02-12T03:58:45.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.844+0000 7f07e9528640 1 librados: shutdown 2026-02-12T03:58:45.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.844+0000 7ff73134a640 10 client.4433.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-12T03:58:45.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.844+0000 7ff73134a640 15 client.4433.objecter _session_command_op_assign -1 2 2026-02-12T03:58:45.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.844+0000 7ff73134a640 20 client.4433.objecter _get_session s=0x7ff6fc0a2e30 osd=14 3 2026-02-12T03:58:45.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.844+0000 7ff73134a640 20 client.4433.objecter put_session s=0x7ff6fc0a2e30 osd=14 3 2026-02-12T03:58:45.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.844+0000 7ff73134a640 20 client.4433.objecter _get_session s=0x7ff6fc0a2e30 osd=14 3 2026-02-12T03:58:45.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.844+0000 7ff73134a640 15 client.4433.objecter _session_command_op_remove -1 2 2026-02-12T03:58:45.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.844+0000 7ff73134a640 20 client.4433.objecter get_session s=0x7ff6fc0a2e30 osd=14 3 2026-02-12T03:58:45.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.844+0000 7ff73134a640 15 client.4433.objecter _session_command_op_assign 14 2 2026-02-12T03:58:45.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.844+0000 7ff73134a640 20 client.4433.objecter put_session s=0x7ff6fc0a2e30 osd=14 4 2026-02-12T03:58:45.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.844+0000 7ff73134a640 10 client.4433.objecter _send_command 2 2026-02-12T03:58:45.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.844+0000 7ff73134a640 1 -- 10.20.193.91:0/2171776711 --> v1:10.20.193.111:6800/1665676360 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff72c0b01e0 con 0x7ff6fc0a34e0 2026-02-12T03:58:45.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.847+0000 7ff728ff9640 1 -- 10.20.193.91:0/2171776711 <== osd.14 v1:10.20.193.111:6800/1665676360 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7ff72c0b01e0 con 0x7ff6fc0a34e0 2026-02-12T03:58:45.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.847+0000 7ff728ff9640 10 client.4433.objecter ms_dispatch2 0x7ff72c000b90 command_reply(tid 2: 0 ) 2026-02-12T03:58:45.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.847+0000 7ff728ff9640 10 client.4433.objecter _finish_command 2 = system:0 2026-02-12T03:58:45.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.847+0000 7ff728ff9640 20 client.4433.objecter put_session s=0x7ff6fc0a2e30 osd=14 4 2026-02-12T03:58:45.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.847+0000 7ff728ff9640 15 client.4433.objecter _session_command_op_remove 14 2 2026-02-12T03:58:45.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.847+0000 7ff73134a640 10 librados: watch_flush enter 2026-02-12T03:58:45.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.847+0000 7ff73134a640 10 librados: watch_flush exit 2026-02-12T03:58:45.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.847+0000 7ff73134a640 10 client.4433.objecter close_session for osd.14 2026-02-12T03:58:45.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.847+0000 7ff73134a640 1 -- 10.20.193.91:0/2171776711 >> v1:10.20.193.111:6800/1665676360 conn(0x7ff6fc0a34e0 legacy=0x7ff6fc0c3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.847+0000 7ff73134a640 20 client.4433.objecter put_session s=0x7ff6fc0a2e30 osd=14 1 2026-02-12T03:58:45.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.847+0000 7ff73134a640 20 client.4433.objecter shutdown clearing up homeless session... 2026-02-12T03:58:45.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.847+0000 7ff73134a640 10 client.4433.objecter successfully canceled tick 2026-02-12T03:58:45.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.847+0000 7ff73134a640 1 -- 10.20.193.91:0/2171776711 >> v1:10.20.193.91:6800/2929217192 conn(0x7ff6fc079f50 legacy=0x7ff6fc09a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.847+0000 7ff73134a640 10 monclient: shutdown 2026-02-12T03:58:45.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.847+0000 7ff73134a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:45.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.847+0000 7ff73134a640 1 -- 10.20.193.91:0/2171776711 >> v1:10.20.193.111:6789/0 conn(0x7ff72c0b3f60 legacy=0x7ff72c11ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.847+0000 7ff730b49640 1 -- 10.20.193.91:0/2171776711 reap_dead start 2026-02-12T03:58:45.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.847+0000 7ff73134a640 1 -- 10.20.193.91:0/2171776711 shutdown_connections 2026-02-12T03:58:45.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.847+0000 7ff73134a640 1 -- 10.20.193.91:0/2171776711 >> 10.20.193.91:0/2171776711 conn(0x7ff72c0b8780 msgr2=0x7ff72c15a370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:45.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.847+0000 7ff73134a640 1 -- 10.20.193.91:0/2171776711 shutdown_connections 2026-02-12T03:58:45.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.847+0000 7ff73134a640 1 -- 10.20.193.91:0/2171776711 wait complete. 2026-02-12T03:58:45.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.847+0000 7ff73134a640 1 librados: shutdown 2026-02-12T03:58:45.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.848+0000 7fb2c2d13640 10 client.4480.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-12T03:58:45.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.848+0000 7fb2c2d13640 15 client.4480.objecter _session_command_op_assign -1 2 2026-02-12T03:58:45.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.848+0000 7fb2c2d13640 20 client.4480.objecter _get_session s=0x7fb28c0a2de0 osd=11 3 2026-02-12T03:58:45.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.848+0000 7fb2c2d13640 20 client.4480.objecter put_session s=0x7fb28c0a2de0 osd=11 3 2026-02-12T03:58:45.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.848+0000 7fb2c2d13640 20 client.4480.objecter _get_session s=0x7fb28c0a2de0 osd=11 3 2026-02-12T03:58:45.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.848+0000 7fb2c2d13640 15 client.4480.objecter _session_command_op_remove -1 2 2026-02-12T03:58:45.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.848+0000 7fb2c2d13640 20 client.4480.objecter get_session s=0x7fb28c0a2de0 osd=11 3 2026-02-12T03:58:45.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.848+0000 7fb2c2d13640 15 client.4480.objecter _session_command_op_assign 11 2 2026-02-12T03:58:45.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.848+0000 7fb2c2d13640 20 client.4480.objecter put_session s=0x7fb28c0a2de0 osd=11 4 2026-02-12T03:58:45.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.848+0000 7fb2c2d13640 10 client.4480.objecter _send_command 2 2026-02-12T03:58:45.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.848+0000 7fb2c2d13640 1 -- 10.20.193.91:0/3624527245 --> v1:10.20.193.154:6804/2902069275 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb2bc0b60e0 con 0x7fb28c0a3490 2026-02-12T03:58:45.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.849+0000 7ff2425a8640 10 client.4491.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-12T03:58:45.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.849+0000 7ff2425a8640 15 client.4491.objecter _session_command_op_assign -1 2 2026-02-12T03:58:45.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.849+0000 7ff2425a8640 20 client.4491.objecter _get_session s=0x7ff20c0a2ea0 osd=15 3 2026-02-12T03:58:45.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.849+0000 7ff2425a8640 20 client.4491.objecter put_session s=0x7ff20c0a2ea0 osd=15 3 2026-02-12T03:58:45.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.849+0000 7ff2425a8640 20 client.4491.objecter _get_session s=0x7ff20c0a2ea0 osd=15 3 2026-02-12T03:58:45.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.849+0000 7ff2425a8640 15 client.4491.objecter _session_command_op_remove -1 2 2026-02-12T03:58:45.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.849+0000 7ff2425a8640 20 client.4491.objecter get_session s=0x7ff20c0a2ea0 osd=15 3 2026-02-12T03:58:45.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.849+0000 7ff2425a8640 15 client.4491.objecter _session_command_op_assign 15 2 2026-02-12T03:58:45.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.849+0000 7ff2425a8640 20 client.4491.objecter put_session s=0x7ff20c0a2ea0 osd=15 4 2026-02-12T03:58:45.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.849+0000 7ff2425a8640 10 client.4491.objecter _send_command 2 2026-02-12T03:58:45.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.849+0000 7ff2425a8640 1 -- 10.20.193.91:0/4164622660 --> v1:10.20.193.154:6809/2343771552 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff23c15ddc0 con 0x7ff20c0a3550 2026-02-12T03:58:45.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7fb2b17fa640 1 -- 10.20.193.91:0/3624527245 <== osd.11 v1:10.20.193.154:6804/2902069275 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2356506950) 0x7fb2bc0b60e0 con 0x7fb28c0a3490 2026-02-12T03:58:45.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7fb2b17fa640 10 client.4480.objecter ms_dispatch2 0x7fb2bc000b90 command_reply(tid 2: 0 ) 2026-02-12T03:58:45.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7fb2b17fa640 10 client.4480.objecter _finish_command 2 = system:0 2026-02-12T03:58:45.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7ff238ff9640 1 -- 10.20.193.91:0/4164622660 <== osd.15 v1:10.20.193.154:6809/2343771552 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 3529919842) 0x7ff23c15ddc0 con 0x7ff20c0a3550 2026-02-12T03:58:45.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7ff238ff9640 10 client.4491.objecter ms_dispatch2 0x7ff23c000b90 command_reply(tid 2: 0 ) 2026-02-12T03:58:45.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7ff238ff9640 10 client.4491.objecter _finish_command 2 = system:0 2026-02-12T03:58:45.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7ff238ff9640 20 client.4491.objecter put_session s=0x7ff20c0a2ea0 osd=15 4 2026-02-12T03:58:45.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7ff238ff9640 15 client.4491.objecter _session_command_op_remove 15 2 2026-02-12T03:58:45.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7fb2b17fa640 20 client.4480.objecter put_session s=0x7fb28c0a2de0 osd=11 4 2026-02-12T03:58:45.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7fb2b17fa640 15 client.4480.objecter _session_command_op_remove 11 2 2026-02-12T03:58:45.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7fb2c2d13640 10 librados: watch_flush enter 2026-02-12T03:58:45.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7ff2425a8640 10 librados: watch_flush enter 2026-02-12T03:58:45.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7fb2c2d13640 10 librados: watch_flush exit 2026-02-12T03:58:45.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7ff2425a8640 10 librados: watch_flush exit 2026-02-12T03:58:45.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7fb2c2d13640 10 client.4480.objecter close_session for osd.11 2026-02-12T03:58:45.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7ff2425a8640 10 client.4491.objecter close_session for osd.15 2026-02-12T03:58:45.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7ff2425a8640 1 -- 10.20.193.91:0/4164622660 >> v1:10.20.193.154:6809/2343771552 conn(0x7ff20c0a3550 legacy=0x7ff20c0c3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7fb2c2d13640 1 -- 10.20.193.91:0/3624527245 >> v1:10.20.193.154:6804/2902069275 conn(0x7fb28c0a3490 legacy=0x7fb28c0c38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7fb2c2d13640 20 client.4480.objecter put_session s=0x7fb28c0a2de0 osd=11 1 2026-02-12T03:58:45.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7ff2425a8640 20 client.4491.objecter put_session s=0x7ff20c0a2ea0 osd=15 1 2026-02-12T03:58:45.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7ff2425a8640 20 client.4491.objecter shutdown clearing up homeless session... 2026-02-12T03:58:45.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7ff2425a8640 10 client.4491.objecter successfully canceled tick 2026-02-12T03:58:45.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7fb2c2d13640 20 client.4480.objecter shutdown clearing up homeless session... 2026-02-12T03:58:45.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7fb2c2d13640 10 client.4480.objecter successfully canceled tick 2026-02-12T03:58:45.907 INFO:teuthology.orchestra.run.trial091.stdout:90194313221 2026-02-12T03:58:45.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7fb2c2d13640 1 -- 10.20.193.91:0/3624527245 >> v1:10.20.193.91:6800/2929217192 conn(0x7fb28c079f60 legacy=0x7fb28c09a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7ff2425a8640 1 -- 10.20.193.91:0/4164622660 >> v1:10.20.193.91:6800/2929217192 conn(0x7ff20c07a020 legacy=0x7ff20c09a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.908 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-12T03:58:45.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7fb2c2d13640 10 monclient: shutdown 2026-02-12T03:58:45.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7fb2c2d13640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:45.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7fb2c2d13640 1 -- 10.20.193.91:0/3624527245 >> v1:10.20.193.98:6789/0 conn(0x7fb2bc0b57a0 legacy=0x7fb2bc1fc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7fb2c1289640 1 -- 10.20.193.91:0/3624527245 reap_dead start 2026-02-12T03:58:45.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7ff2425a8640 10 monclient: shutdown 2026-02-12T03:58:45.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7ff2425a8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:45.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7ff2425a8640 1 -- 10.20.193.91:0/4164622660 >> v1:10.20.193.91:6789/0 conn(0x7ff23c0564d0 legacy=0x7ff23c202550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7ff240b1e640 1 -- 10.20.193.91:0/4164622660 reap_dead start 2026-02-12T03:58:45.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7ff2425a8640 1 -- 10.20.193.91:0/4164622660 shutdown_connections 2026-02-12T03:58:45.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7ff2425a8640 1 -- 10.20.193.91:0/4164622660 >> 10.20.193.91:0/4164622660 conn(0x7ff23c0559c0 msgr2=0x7ff23c0ba3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:45.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7fb2c2d13640 1 -- 10.20.193.91:0/3624527245 shutdown_connections 2026-02-12T03:58:45.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7fb2c2d13640 1 -- 10.20.193.91:0/3624527245 >> 10.20.193.91:0/3624527245 conn(0x7fb2bc0559c0 msgr2=0x7fb2bc0b1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:45.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.851+0000 7ff2425a8640 1 -- 10.20.193.91:0/4164622660 shutdown_connections 2026-02-12T03:58:45.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.852+0000 7fb2c2d13640 1 -- 10.20.193.91:0/3624527245 shutdown_connections 2026-02-12T03:58:45.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.852+0000 7ff2425a8640 1 -- 10.20.193.91:0/4164622660 wait complete. 2026-02-12T03:58:45.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.852+0000 7fb2c2d13640 1 -- 10.20.193.91:0/3624527245 wait complete. 2026-02-12T03:58:45.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.852+0000 7ff2425a8640 1 librados: shutdown 2026-02-12T03:58:45.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.852+0000 7fb2c2d13640 1 librados: shutdown 2026-02-12T03:58:45.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.852+0000 7f1b3ffff640 1 -- 10.20.193.91:0/3744615041 <== osd.4 v1:10.20.193.91:6805/1766507926 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f1b340c51a0 con 0x7f1b340a35a0 2026-02-12T03:58:45.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.852+0000 7f1b3ffff640 10 client.4436.objecter ms_dispatch2 0x7f1b64000b90 command_reply(tid 1: 0 ) 2026-02-12T03:58:45.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.852+0000 7f1b3ffff640 10 client.4436.objecter _finish_command 1 = system:0 2026-02-12T03:58:45.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.852+0000 7f1b3ffff640 20 client.4436.objecter put_session s=0x7f1b340a2ef0 osd=4 4 2026-02-12T03:58:45.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.852+0000 7f1b3ffff640 15 client.4436.objecter _session_command_op_remove 4 1 2026-02-12T03:58:45.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.853+0000 7f3e4effd640 1 -- 10.20.193.91:0/1309264919 <== osd.13 v1:10.20.193.98:6800/1665089474 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f3e58003690 con 0x7f3e340a3520 2026-02-12T03:58:45.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.853+0000 7f3e4effd640 10 client.4465.objecter ms_dispatch2 0x7f3e68000b90 command_reply(tid 1: 0 ) 2026-02-12T03:58:45.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.853+0000 7f3e4effd640 10 client.4465.objecter _finish_command 1 = system:0 2026-02-12T03:58:45.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.853+0000 7f3e4effd640 20 client.4465.objecter put_session s=0x7f3e340a2e70 osd=13 4 2026-02-12T03:58:45.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.853+0000 7f3e4effd640 15 client.4465.objecter _session_command_op_remove 13 1 2026-02-12T03:58:45.909 INFO:teuthology.orchestra.run.trial091.stdout:90194313220 2026-02-12T03:58:45.910 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.14 2026-02-12T03:58:45.910 INFO:teuthology.orchestra.run.trial091.stdout:94489280518 2026-02-12T03:58:45.910 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2026-02-12T03:58:45.910 INFO:teuthology.orchestra.run.trial091.stdout:94489280517 2026-02-12T03:58:45.910 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2026-02-12T03:58:45.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.860+0000 7f1b69b1c640 10 client.4436.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-12T03:58:45.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.860+0000 7f1b69b1c640 15 client.4436.objecter _session_command_op_assign -1 2 2026-02-12T03:58:45.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.860+0000 7f1b69b1c640 20 client.4436.objecter _get_session s=0x7f1b340a2ef0 osd=4 3 2026-02-12T03:58:45.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.860+0000 7f1b69b1c640 20 client.4436.objecter put_session s=0x7f1b340a2ef0 osd=4 3 2026-02-12T03:58:45.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.860+0000 7f1b69b1c640 20 client.4436.objecter _get_session s=0x7f1b340a2ef0 osd=4 3 2026-02-12T03:58:45.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.860+0000 7f1b69b1c640 15 client.4436.objecter _session_command_op_remove -1 2 2026-02-12T03:58:45.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.860+0000 7f1b69b1c640 20 client.4436.objecter get_session s=0x7f1b340a2ef0 osd=4 3 2026-02-12T03:58:45.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.860+0000 7f1b69b1c640 15 client.4436.objecter _session_command_op_assign 4 2 2026-02-12T03:58:45.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.860+0000 7f1b69b1c640 20 client.4436.objecter put_session s=0x7f1b340a2ef0 osd=4 4 2026-02-12T03:58:45.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.860+0000 7f1b69b1c640 10 client.4436.objecter _send_command 2 2026-02-12T03:58:45.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.860+0000 7f1b69b1c640 1 -- 10.20.193.91:0/3744615041 --> v1:10.20.193.91:6805/1766507926 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1b640b2f50 con 0x7f1b340a35a0 2026-02-12T03:58:45.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.862+0000 7f3e6cda9640 10 client.4465.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-12T03:58:45.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.862+0000 7f3e6cda9640 15 client.4465.objecter _session_command_op_assign -1 2 2026-02-12T03:58:45.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.862+0000 7f3e6cda9640 20 client.4465.objecter _get_session s=0x7f3e340a2e70 osd=13 3 2026-02-12T03:58:45.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.862+0000 7f3e6cda9640 20 client.4465.objecter put_session s=0x7f3e340a2e70 osd=13 3 2026-02-12T03:58:45.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.862+0000 7f3e6cda9640 20 client.4465.objecter _get_session s=0x7f3e340a2e70 osd=13 3 2026-02-12T03:58:45.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.862+0000 7f3e6cda9640 15 client.4465.objecter _session_command_op_remove -1 2 2026-02-12T03:58:45.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.862+0000 7f3e6cda9640 20 client.4465.objecter get_session s=0x7f3e340a2e70 osd=13 3 2026-02-12T03:58:45.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.862+0000 7f3e6cda9640 15 client.4465.objecter _session_command_op_assign 13 2 2026-02-12T03:58:45.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.862+0000 7f3e6cda9640 20 client.4465.objecter put_session s=0x7f3e340a2e70 osd=13 4 2026-02-12T03:58:45.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.862+0000 7f3e6cda9640 10 client.4465.objecter _send_command 2 2026-02-12T03:58:45.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.862+0000 7f3e6cda9640 1 -- 10.20.193.91:0/1309264919 --> v1:10.20.193.98:6800/1665089474 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3e6805a0f0 con 0x7f3e340a3520 2026-02-12T03:58:45.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.863+0000 7f1b3ffff640 1 -- 10.20.193.91:0/3744615041 <== osd.4 v1:10.20.193.91:6805/1766507926 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7f1b640b2f50 con 0x7f1b340a35a0 2026-02-12T03:58:45.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.863+0000 7f1b3ffff640 10 client.4436.objecter ms_dispatch2 0x7f1b64000b90 command_reply(tid 2: 0 ) 2026-02-12T03:58:45.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.863+0000 7f1b3ffff640 10 client.4436.objecter _finish_command 2 = system:0 2026-02-12T03:58:45.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.863+0000 7f1b3ffff640 20 client.4436.objecter put_session s=0x7f1b340a2ef0 osd=4 4 2026-02-12T03:58:45.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.863+0000 7f1b3ffff640 15 client.4436.objecter _session_command_op_remove 4 2 2026-02-12T03:58:45.912 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.863+0000 7f1b69b1c640 10 librados: watch_flush enter 2026-02-12T03:58:45.912 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.863+0000 7f1b69b1c640 10 librados: watch_flush exit 2026-02-12T03:58:45.912 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.863+0000 7f1b69b1c640 10 client.4436.objecter close_session for osd.4 2026-02-12T03:58:45.912 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.863+0000 7f1b69b1c640 1 -- 10.20.193.91:0/3744615041 >> v1:10.20.193.91:6805/1766507926 conn(0x7f1b340a35a0 legacy=0x7f1b340c39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.912 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.863+0000 7f1b69b1c640 20 client.4436.objecter put_session s=0x7f1b340a2ef0 osd=4 1 2026-02-12T03:58:45.912 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.863+0000 7f1b69b1c640 20 client.4436.objecter shutdown clearing up homeless session... 2026-02-12T03:58:45.912 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.863+0000 7f1b69b1c640 10 client.4436.objecter successfully canceled tick 2026-02-12T03:58:45.912 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.863+0000 7f1b69b1c640 1 -- 10.20.193.91:0/3744615041 >> v1:10.20.193.91:6800/2929217192 conn(0x7f1b3407a070 legacy=0x7f1b3409a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.912 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.863+0000 7f1b69b1c640 10 monclient: shutdown 2026-02-12T03:58:45.912 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.863+0000 7f1b69b1c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:45.912 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.863+0000 7f1b69b1c640 1 -- 10.20.193.91:0/3744615041 >> v1:10.20.193.111:6789/0 conn(0x7f1b640b5e90 legacy=0x7f1b640b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.912 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.863+0000 7f1b63fff640 1 -- 10.20.193.91:0/3744615041 reap_dead start 2026-02-12T03:58:45.912 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.863+0000 7f1b69b1c640 1 -- 10.20.193.91:0/3744615041 shutdown_connections 2026-02-12T03:58:45.912 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.863+0000 7f1b69b1c640 1 -- 10.20.193.91:0/3744615041 >> 10.20.193.91:0/3744615041 conn(0x7f1b640b5380 msgr2=0x7f1b64145e10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:45.912 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.863+0000 7f1b69b1c640 1 -- 10.20.193.91:0/3744615041 shutdown_connections 2026-02-12T03:58:45.912 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.863+0000 7f1b69b1c640 1 -- 10.20.193.91:0/3744615041 wait complete. 2026-02-12T03:58:45.912 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.863+0000 7f1b69b1c640 1 librados: shutdown 2026-02-12T03:58:45.912 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.864+0000 7f3e4effd640 1 -- 10.20.193.91:0/1309264919 <== osd.13 v1:10.20.193.98:6800/1665089474 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2879543249) 0x7f3e6805a0f0 con 0x7f3e340a3520 2026-02-12T03:58:45.912 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.864+0000 7f3e4effd640 10 client.4465.objecter ms_dispatch2 0x7f3e68000b90 command_reply(tid 2: 0 ) 2026-02-12T03:58:45.912 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.864+0000 7f3e4effd640 10 client.4465.objecter _finish_command 2 = system:0 2026-02-12T03:58:45.912 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.864+0000 7f3e4effd640 20 client.4465.objecter put_session s=0x7f3e340a2e70 osd=13 4 2026-02-12T03:58:45.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.864+0000 7f3e4effd640 15 client.4465.objecter _session_command_op_remove 13 2 2026-02-12T03:58:45.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.864+0000 7f3e6cda9640 10 librados: watch_flush enter 2026-02-12T03:58:45.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.864+0000 7f3e6cda9640 10 librados: watch_flush exit 2026-02-12T03:58:45.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.864+0000 7f3e6cda9640 10 client.4465.objecter close_session for osd.13 2026-02-12T03:58:45.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.864+0000 7f3e6cda9640 1 -- 10.20.193.91:0/1309264919 >> v1:10.20.193.98:6800/1665089474 conn(0x7f3e340a3520 legacy=0x7f3e340c3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.864+0000 7f3e6cda9640 20 client.4465.objecter put_session s=0x7f3e340a2e70 osd=13 1 2026-02-12T03:58:45.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.864+0000 7f3e6cda9640 20 client.4465.objecter shutdown clearing up homeless session... 2026-02-12T03:58:45.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.864+0000 7f3e6cda9640 10 client.4465.objecter successfully canceled tick 2026-02-12T03:58:45.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.864+0000 7f3e6cda9640 1 -- 10.20.193.91:0/1309264919 >> v1:10.20.193.91:6800/2929217192 conn(0x7f3e34079ff0 legacy=0x7f3e3409a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.864+0000 7f3e6cda9640 10 monclient: shutdown 2026-02-12T03:58:45.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.864+0000 7f3e6cda9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:45.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.864+0000 7f3e6cda9640 1 -- 10.20.193.91:0/1309264919 >> v1:10.20.193.98:6789/0 conn(0x7f3e681639c0 legacy=0x7f3e68154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:45.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.864+0000 7f3e66d76640 1 -- 10.20.193.91:0/1309264919 reap_dead start 2026-02-12T03:58:45.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.864+0000 7f3e6cda9640 1 -- 10.20.193.91:0/1309264919 shutdown_connections 2026-02-12T03:58:45.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.864+0000 7f3e6cda9640 1 -- 10.20.193.91:0/1309264919 >> 10.20.193.91:0/1309264919 conn(0x7f3e680b6560 msgr2=0x7f3e680b6930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:45.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.864+0000 7f3e6cda9640 1 -- 10.20.193.91:0/1309264919 shutdown_connections 2026-02-12T03:58:45.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.864+0000 7f3e6cda9640 1 -- 10.20.193.91:0/1309264919 wait complete. 2026-02-12T03:58:45.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.864+0000 7f3e6cda9640 1 librados: shutdown 2026-02-12T03:58:45.914 INFO:teuthology.orchestra.run.trial091.stdout:90194313220 2026-02-12T03:58:45.914 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-12T03:58:45.914 INFO:teuthology.orchestra.run.trial091.stdout:90194313220 2026-02-12T03:58:45.914 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2026-02-12T03:58:45.994 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.992+0000 7f719750a640 10 monclient: get_monmap_and_config 2026-02-12T03:58:45.995 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.992+0000 7f719750a640 10 monclient: build_initial_monmap 2026-02-12T03:58:45.995 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.993+0000 7f719750a640 10 monclient: monmap: 2026-02-12T03:58:45.995 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:45.995 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.995 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:45.993589+0000 2026-02-12T03:58:45.995 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:45.993589+0000 2026-02-12T03:58:45.995 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:45.995 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.995 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:45.995 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:45.996 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:45.996 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.996 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.993+0000 7f719750a640 1 Processor -- start 2026-02-12T03:58:45.996 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.993+0000 7f719750a640 1 -- start start 2026-02-12T03:58:45.996 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.993+0000 7f719750a640 10 monclient: init 2026-02-12T03:58:45.996 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.994+0000 7f719750a640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:45.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.994+0000 7f719750a640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T03:58:45.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.994+0000 7f719750a640 10 monclient(hunting): picked mon.noname-c con 0x7f71901599b0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:45.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.994+0000 7f719750a640 10 monclient(hunting): picked mon.noname-a con 0x7f719005d180 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:45.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.994+0000 7f719750a640 10 monclient(hunting): picked mon.noname-b con 0x7f7190166580 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:45.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.994+0000 7f719750a640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f719005c0e0 con 0x7f719005d180 2026-02-12T03:58:45.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.994+0000 7f719750a640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f719005c3c0 con 0x7f7190166580 2026-02-12T03:58:45.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.994+0000 7f719750a640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f719005c6a0 con 0x7f71901599b0 2026-02-12T03:58:45.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.994+0000 7f719750a640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:45.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.994+0000 7f719750a640 10 monclient(hunting): authenticate will time out at 1128.737299s 2026-02-12T03:58:45.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.994+0000 7faffffdf640 10 monclient: get_monmap_and_config 2026-02-12T03:58:45.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.994+0000 7faffffdf640 10 monclient: build_initial_monmap 2026-02-12T03:58:45.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.994+0000 7faffffdf640 10 monclient: monmap: 2026-02-12T03:58:45.997 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:45.997 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:45.997 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:45.994909+0000 2026-02-12T03:58:45.997 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:45.994909+0000 2026-02-12T03:58:45.998 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:45.998 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:45.998 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:45.998 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:45.998 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:45.998 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:45.998 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.994+0000 7f7195a80640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f7190166580 0x7f71901669a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:48574/0 (socket says 10.20.193.91:48574) 2026-02-12T03:58:45.998 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.994+0000 7f7195a80640 1 -- 10.20.193.91:0/4284131503 learned_addr learned my addr 10.20.193.91:0/4284131503 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:45.998 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.994+0000 7f719527f640 1 --1- 10.20.193.91:0/4284131503 >> v1:10.20.193.111:6789/0 conn(0x7f71901599b0 0x7f719005b730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:37886/0 (socket says 10.20.193.91:37886) 2026-02-12T03:58:45.999 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.995+0000 7faffffdf640 1 Processor -- start 2026-02-12T03:58:45.999 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.995+0000 7faffffdf640 1 -- start start 2026-02-12T03:58:45.999 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.995+0000 7faffffdf640 10 monclient: init 2026-02-12T03:58:45.999 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.995+0000 7faffffdf640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:45.999 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.995+0000 7faffffdf640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T03:58:45.999 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.995+0000 7faffffdf640 10 monclient(hunting): picked mon.noname-c con 0x7faff8161ad0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:45.999 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.995+0000 7faffffdf640 10 monclient(hunting): picked mon.noname-b con 0x7faff8167e90 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:45.999 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.995+0000 7faffffdf640 10 monclient(hunting): picked mon.noname-a con 0x7faff80564d0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:45.999 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.995+0000 7faffffdf640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faff8161ea0 con 0x7faff80564d0 2026-02-12T03:58:45.999 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.996+0000 7faffffdf640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faff80b6290 con 0x7faff8167e90 2026-02-12T03:58:45.999 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.996+0000 7faffffdf640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faff8056b30 con 0x7faff8161ad0 2026-02-12T03:58:45.999 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.996+0000 7faffffdf640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:45.999 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.996+0000 7faffffdf640 10 monclient(hunting): authenticate will time out at 1128.739021s 2026-02-12T03:58:45.999 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.996+0000 7f717ffff640 1 -- 10.20.193.91:0/4284131503 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3975087521 0 0) 0x7f719005c6a0 con 0x7f71901599b0 2026-02-12T03:58:46.000 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.996+0000 7f717ffff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.000 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.996+0000 7f717ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.000 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.996+0000 7f717ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.000 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.996+0000 7f717ffff640 10 monclient(hunting): my global_id is 4451 2026-02-12T03:58:46.000 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.996+0000 7f717ffff640 1 -- 10.20.193.91:0/4284131503 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7178003610 con 0x7f71901599b0 2026-02-12T03:58:46.000 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.996+0000 7f717ffff640 1 -- 10.20.193.91:0/4284131503 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3792292139 0 0) 0x7f719005c3c0 con 0x7f7190166580 2026-02-12T03:58:46.000 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.996+0000 7f717ffff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.000 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.996+0000 7f717ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.000 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.996+0000 7f717ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.000 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.996+0000 7f717ffff640 10 monclient(hunting): my global_id is 4489 2026-02-12T03:58:46.000 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.996+0000 7f717ffff640 1 -- 10.20.193.91:0/4284131503 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f719005c6a0 con 0x7f7190166580 2026-02-12T03:58:46.000 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.996+0000 7faffdd54640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7faff8161ad0 0x7faff8167780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:37892/0 (socket says 10.20.193.91:37892) 2026-02-12T03:58:46.000 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.996+0000 7faffdd54640 1 -- 10.20.193.91:0/1225327832 learned_addr learned my addr 10.20.193.91:0/1225327832 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:46.001 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.996+0000 7fd4e54d4640 10 monclient: get_monmap_and_config 2026-02-12T03:58:46.001 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.996+0000 7fd4e54d4640 10 monclient: build_initial_monmap 2026-02-12T03:58:46.001 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.996+0000 7fd4e54d4640 10 monclient: monmap: 2026-02-12T03:58:46.001 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:46.001 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.001 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:45.997173+0000 2026-02-12T03:58:46.001 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:45.997173+0000 2026-02-12T03:58:46.001 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:46.001 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.001 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:46.001 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:46.001 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:46.001 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.001 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.997+0000 7fd4e54d4640 1 Processor -- start 2026-02-12T03:58:46.001 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.997+0000 7fd4e54d4640 1 -- start start 2026-02-12T03:58:46.001 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.997+0000 7fd4e54d4640 10 monclient: init 2026-02-12T03:58:46.002 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.997+0000 7f717ffff640 1 -- 10.20.193.91:0/4284131503 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 244652161 0 0) 0x7f719005c0e0 con 0x7f719005d180 2026-02-12T03:58:46.002 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.997+0000 7f717ffff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.002 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.997+0000 7f717ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.002 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.997+0000 7f717ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.002 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.997+0000 7f717ffff640 10 monclient(hunting): my global_id is 4497 2026-02-12T03:58:46.002 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.997+0000 7f717ffff640 1 -- 10.20.193.91:0/4284131503 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f719005c3c0 con 0x7f719005d180 2026-02-12T03:58:46.003 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.997+0000 7fd4e54d4640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:46.003 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.997+0000 7fd4e54d4640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T03:58:46.003 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.997+0000 7fd4e54d4640 10 monclient(hunting): picked mon.noname-a con 0x7fd4e01575d0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:46.003 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.997+0000 7fd4e54d4640 10 monclient(hunting): picked mon.noname-b con 0x7fd4e0163310 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:46.003 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.997+0000 7fd4e54d4640 10 monclient(hunting): picked mon.noname-c con 0x7fd4e00560d0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:46.003 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.997+0000 7fd4e54d4640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4e00b20b0 con 0x7fd4e01575d0 2026-02-12T03:58:46.003 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.997+0000 7fd4e54d4640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4e00b2390 con 0x7fd4e0163310 2026-02-12T03:58:46.003 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.997+0000 7fd4e54d4640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4e00b2670 con 0x7fd4e00560d0 2026-02-12T03:58:46.003 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.997+0000 7fd4e54d4640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:46.003 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.997+0000 7fd4e54d4640 10 monclient(hunting): authenticate will time out at 1128.740945s 2026-02-12T03:58:46.004 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.998+0000 7f717ffff640 1 -- 10.20.193.91:0/4284131503 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3692393660 0 0) 0x7f7178003610 con 0x7f71901599b0 2026-02-12T03:58:46.004 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.998+0000 7f717ffff640 1 -- 10.20.193.91:0/4284131503 >> v1:10.20.193.98:6789/0 conn(0x7f7190166580 legacy=0x7f71901669a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.004 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.998+0000 7f717ffff640 1 -- 10.20.193.91:0/4284131503 >> v1:10.20.193.91:6789/0 conn(0x7f719005d180 legacy=0x7f719005d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.004 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.998+0000 7f717ffff640 10 monclient: _finish_hunting 0 2026-02-12T03:58:46.004 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.998+0000 7f717ffff640 1 monclient: found mon.noname-c 2026-02-12T03:58:46.004 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.998+0000 7f717ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:46.004 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.998+0000 7f717ffff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.111:6789/0 2026-02-12T03:58:46.004 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.998+0000 7f717ffff640 1 -- 10.20.193.91:0/4284131503 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f719005c980 con 0x7f71901599b0 2026-02-12T03:58:46.004 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.998+0000 7f717ffff640 10 monclient: _finish_auth 0 2026-02-12T03:58:46.004 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.998+0000 7f717ffff640 10 monclient: _check_auth_tickets 2026-02-12T03:58:46.004 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.998+0000 7f717ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:46.004 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.998+0000 7f717ffff640 1 -- 10.20.193.91:0/4284131503 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f7180002df0 con 0x7f71901599b0 2026-02-12T03:58:46.004 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.998+0000 7f717ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.004 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.998+0000 7f717ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:46.004 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.998+0000 7f717ffff640 10 monclient: dump: 2026-02-12T03:58:46.004 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.004 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.005 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.005 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.005 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.005 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.005 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.005 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.005 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.005 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.005 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.998+0000 7f719750a640 5 monclient: authenticate success, global_id 4451 2026-02-12T03:58:46.005 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.998+0000 7f719750a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:46.005 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.998+0000 7fd49ccae640 10 monclient: get_monmap_and_config 2026-02-12T03:58:46.005 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.998+0000 7fd49ccae640 10 monclient: build_initial_monmap 2026-02-12T03:58:46.005 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.998+0000 7fd49ccae640 10 monclient: monmap: 2026-02-12T03:58:46.005 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:46.005 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.005 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:45.998995+0000 2026-02-12T03:58:46.005 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:45.998995+0000 2026-02-12T03:58:46.006 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:46.006 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.006 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:46.006 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:46.006 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:46.006 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.006 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.999+0000 7fd4df7fe640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7fd4e00560d0 0x7fd4e01c56f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:37908/0 (socket says 10.20.193.91:37908) 2026-02-12T03:58:46.006 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.999+0000 7fd4df7fe640 1 -- 10.20.193.91:0/1867496613 learned_addr learned my addr 10.20.193.91:0/1867496613 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:46.006 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.999+0000 7faffcd52640 1 -- 10.20.193.91:0/1225327832 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1522091513 0 0) 0x7faff8056b30 con 0x7faff8161ad0 2026-02-12T03:58:46.006 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.999+0000 7faffcd52640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.006 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.999+0000 7faffcd52640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.006 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.999+0000 7faffcd52640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.006 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.999+0000 7faffcd52640 10 monclient(hunting): my global_id is 4454 2026-02-12T03:58:46.006 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:45.999+0000 7faffcd52640 1 -- 10.20.193.91:0/1225327832 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafe0003610 con 0x7faff8161ad0 2026-02-12T03:58:46.007 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.000+0000 7fd7db224640 10 monclient: get_monmap_and_config 2026-02-12T03:58:46.007 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.000+0000 7fd7db224640 10 monclient: build_initial_monmap 2026-02-12T03:58:46.007 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.000+0000 7fd7db224640 10 monclient: monmap: 2026-02-12T03:58:46.007 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:46.007 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.007 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:46.000617+0000 2026-02-12T03:58:46.007 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:46.000617+0000 2026-02-12T03:58:46.007 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:46.007 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.007 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:46.007 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:46.007 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:46.007 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.007 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.000+0000 7faffcd52640 1 -- 10.20.193.91:0/1225327832 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4137590724 0 0) 0x7faff80b6290 con 0x7faff8167e90 2026-02-12T03:58:46.008 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.000+0000 7fd7db224640 1 Processor -- start 2026-02-12T03:58:46.008 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.000+0000 7faffcd52640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.008 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.000+0000 7faffcd52640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.008 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.000+0000 7faffcd52640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.008 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.000+0000 7faffcd52640 10 monclient(hunting): my global_id is 4492 2026-02-12T03:58:46.008 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.000+0000 7faffcd52640 1 -- 10.20.193.91:0/1225327832 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faff8056b30 con 0x7faff8167e90 2026-02-12T03:58:46.009 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.000+0000 7fd7db224640 1 -- start start 2026-02-12T03:58:46.009 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.000+0000 7fd7db224640 10 monclient: init 2026-02-12T03:58:46.009 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.000+0000 7fa5c1044640 10 monclient: get_monmap_and_config 2026-02-12T03:58:46.009 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.000+0000 7fa5c1044640 10 monclient: build_initial_monmap 2026-02-12T03:58:46.009 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.000+0000 7fa5c1044640 10 monclient: monmap: 2026-02-12T03:58:46.009 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:46.009 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.009 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:46.001484+0000 2026-02-12T03:58:46.009 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:46.001484+0000 2026-02-12T03:58:46.009 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:46.009 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.009 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:46.009 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:46.009 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:46.009 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.010 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.001+0000 7fd49ccae640 1 Processor -- start 2026-02-12T03:58:46.010 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.001+0000 7fd7db224640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:46.010 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.001+0000 7fd49ccae640 1 -- start start 2026-02-12T03:58:46.010 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.001+0000 7fd49ccae640 10 monclient: init 2026-02-12T03:58:46.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.001+0000 7fd7db224640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T03:58:46.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.001+0000 7fd7db224640 10 monclient(hunting): picked mon.noname-b con 0x7fd7d415d740 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:46.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.001+0000 7fd7db224640 10 monclient(hunting): picked mon.noname-c con 0x7fd7d40b8090 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:46.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.001+0000 7fd7db224640 10 monclient(hunting): picked mon.noname-a con 0x7fd7d40b5480 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:46.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.001+0000 7fd7db224640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7d40577f0 con 0x7fd7d40b5480 2026-02-12T03:58:46.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.001+0000 7fd7db224640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7d415db10 con 0x7fd7d415d740 2026-02-12T03:58:46.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.001+0000 7fd7db224640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7d40b8c50 con 0x7fd7d40b8090 2026-02-12T03:58:46.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.001+0000 7fd7db224640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:46.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.001+0000 7fd7db224640 10 monclient(hunting): authenticate will time out at 1128.744325s 2026-02-12T03:58:46.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.001+0000 7faffcd52640 1 -- 10.20.193.91:0/1225327832 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3187753636 0 0) 0x7fafe0003610 con 0x7faff8161ad0 2026-02-12T03:58:46.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.001+0000 7faffcd52640 1 -- 10.20.193.91:0/1225327832 >> v1:10.20.193.98:6789/0 conn(0x7faff8167e90 legacy=0x7faff81ac060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.001+0000 7faffcd52640 1 -- 10.20.193.91:0/1225327832 >> v1:10.20.193.91:6789/0 conn(0x7faff80564d0 legacy=0x7faff81cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.001+0000 7faffcd52640 10 monclient: _finish_hunting 0 2026-02-12T03:58:46.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.001+0000 7faffcd52640 1 monclient: found mon.noname-c 2026-02-12T03:58:46.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.001+0000 7faffcd52640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:46.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.001+0000 7faffcd52640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.111:6789/0 2026-02-12T03:58:46.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.001+0000 7faffcd52640 1 -- 10.20.193.91:0/1225327832 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faff80b6530 con 0x7faff8161ad0 2026-02-12T03:58:46.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.001+0000 7faffcd52640 10 monclient: _finish_auth 0 2026-02-12T03:58:46.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.001+0000 7faffcd52640 10 monclient: _check_auth_tickets 2026-02-12T03:58:46.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.001+0000 7f66b2c4c640 10 monclient: get_monmap_and_config 2026-02-12T03:58:46.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.001+0000 7f66b2c4c640 10 monclient: build_initial_monmap 2026-02-12T03:58:46.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.001+0000 7faffcd52640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:46.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.001+0000 7f66b2c4c640 10 monclient: monmap: 2026-02-12T03:58:46.013 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:46.013 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.013 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:46.002108+0000 2026-02-12T03:58:46.013 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:46.002108+0000 2026-02-12T03:58:46.013 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:46.013 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.013 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:46.013 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:46.013 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:46.013 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.001+0000 7faffcd52640 1 -- 10.20.193.91:0/1225327832 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fafe8002df0 con 0x7faff8161ad0 2026-02-12T03:58:46.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.001+0000 7faffcd52640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.001+0000 7faffcd52640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:46.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.001+0000 7faffcd52640 10 monclient: dump: 2026-02-12T03:58:46.014 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.014 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.014 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.014 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.014 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.014 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.014 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.014 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.014 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.015 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.001+0000 7fa5c1044640 1 Processor -- start 2026-02-12T03:58:46.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.001+0000 7faffffdf640 5 monclient: authenticate success, global_id 4454 2026-02-12T03:58:46.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.001+0000 7faffffdf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:46.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7fd49ccae640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:46.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7f66b2c4c640 1 Processor -- start 2026-02-12T03:58:46.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7fd49ccae640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T03:58:46.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7fd49ccae640 10 monclient(hunting): picked mon.noname-c con 0x7fd4980b57a0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:46.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7f66b2c4c640 1 -- start start 2026-02-12T03:58:46.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7f66b2c4c640 10 monclient: init 2026-02-12T03:58:46.017 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7fd49ccae640 10 monclient(hunting): picked mon.noname-b con 0x7fd4980b7180 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:46.017 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7fd49ccae640 10 monclient(hunting): picked mon.noname-a con 0x7fd4980b5b70 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:46.017 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.001+0000 7fa5c1044640 1 -- start start 2026-02-12T03:58:46.017 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.001+0000 7fa5c1044640 10 monclient: init 2026-02-12T03:58:46.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7fd49ccae640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd498163f30 con 0x7fd4980b5b70 2026-02-12T03:58:46.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7fd49ccae640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4980b63c0 con 0x7fd4980b7180 2026-02-12T03:58:46.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7fd49ccae640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4980b66a0 con 0x7fd4980b57a0 2026-02-12T03:58:46.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7fd49ccae640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:46.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7fd49ccae640 10 monclient(hunting): authenticate will time out at 1128.745323s 2026-02-12T03:58:46.019 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7fd4ddffb640 1 -- 10.20.193.91:0/1867496613 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3469180020 0 0) 0x7fd4e00b2390 con 0x7fd4e0163310 2026-02-12T03:58:46.019 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7fd4ddffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.019 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7fd4ddffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.019 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7fd4ddffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.019 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7fd4ddffb640 10 monclient(hunting): my global_id is 4495 2026-02-12T03:58:46.019 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7fd4ddffb640 1 -- 10.20.193.91:0/1867496613 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4cc003610 con 0x7fd4e0163310 2026-02-12T03:58:46.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7fa5c1044640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:46.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7fa5c1044640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T03:58:46.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7fa5c1044640 10 monclient(hunting): picked mon.noname-a con 0x7fa5bc0b57a0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:46.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7fa5c1044640 10 monclient(hunting): picked mon.noname-c con 0x7fa5bc0b7180 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:46.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7fa5c1044640 10 monclient(hunting): picked mon.noname-b con 0x7fa5bc0b5b70 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:46.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7fd4ddffb640 1 -- 10.20.193.91:0/1867496613 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3921765614 0 0) 0x7fd4e00b2670 con 0x7fd4e00560d0 2026-02-12T03:58:46.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7fd4ddffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7fd4ddffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7fd4ddffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7fd4ddffb640 10 monclient(hunting): my global_id is 4457 2026-02-12T03:58:46.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7fd4ddffb640 1 -- 10.20.193.91:0/1867496613 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4e00b2390 con 0x7fd4e00560d0 2026-02-12T03:58:46.021 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7fa5c1044640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5bc163f30 con 0x7fa5bc0b57a0 2026-02-12T03:58:46.021 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7fa5c1044640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5bc0b63c0 con 0x7fa5bc0b5b70 2026-02-12T03:58:46.021 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7fa5c1044640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5bc0b66a0 con 0x7fa5bc0b7180 2026-02-12T03:58:46.021 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7fa5c1044640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:46.021 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7fa5c1044640 10 monclient(hunting): authenticate will time out at 1128.745638s 2026-02-12T03:58:46.021 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7fd7d8f99640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7fd7d415d740 0x7fd7d40569d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:48598/0 (socket says 10.20.193.91:48598) 2026-02-12T03:58:46.021 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7fd7d8f99640 1 -- 10.20.193.91:0/2091269236 learned_addr learned my addr 10.20.193.91:0/2091269236 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:46.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7f66b2c4c640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:46.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7f66b2c4c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T03:58:46.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7f66b2c4c640 10 monclient(hunting): picked mon.noname-a con 0x7f66ac0b57a0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:46.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7f66b2c4c640 10 monclient(hunting): picked mon.noname-b con 0x7f66ac0b7180 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:46.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7f66b2c4c640 10 monclient(hunting): picked mon.noname-c con 0x7f66ac0b5b70 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:46.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.002+0000 7f66b2c4c640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66ac163f30 con 0x7f66ac0b57a0 2026-02-12T03:58:46.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.003+0000 7f6ff24a2640 10 monclient: get_monmap_and_config 2026-02-12T03:58:46.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.003+0000 7f6ff24a2640 10 monclient: build_initial_monmap 2026-02-12T03:58:46.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.003+0000 7f6ff24a2640 10 monclient: monmap: 2026-02-12T03:58:46.022 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:46.022 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.022 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:46.003840+0000 2026-02-12T03:58:46.022 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:46.003840+0000 2026-02-12T03:58:46.022 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:46.023 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.023 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:46.023 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:46.023 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:46.023 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.003+0000 7faffcd52640 1 -- 10.20.193.91:0/1225327832 <== mon.2 v1:10.20.193.111:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fafe8003000 con 0x7faff8161ad0 2026-02-12T03:58:46.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.003+0000 7faffcd52640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:46.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.003+0000 7faffffdf640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:46.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.003+0000 7faffffdf640 4 set_mon_vals no callback set 2026-02-12T03:58:46.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.003+0000 7faffcd52640 1 -- 10.20.193.91:0/1225327832 <== mon.2 v1:10.20.193.111:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fafe8003440 con 0x7faff8161ad0 2026-02-12T03:58:46.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.003+0000 7faffcd52640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.003+0000 7f6ff24a2640 1 Processor -- start 2026-02-12T03:58:46.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.003+0000 7faffcd52640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:46.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.003+0000 7faffcd52640 10 monclient: dump: 2026-02-12T03:58:46.024 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.024 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.024 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.024 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.024 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.024 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.024 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.024 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.024 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.024 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.003+0000 7f6ff24a2640 1 -- start start 2026-02-12T03:58:46.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.003+0000 7f6ff24a2640 10 monclient: init 2026-02-12T03:58:46.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.004+0000 7f66b2c4c640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66ac0b63c0 con 0x7f66ac0b7180 2026-02-12T03:58:46.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.004+0000 7faffffdf640 10 monclient: shutdown 2026-02-12T03:58:46.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.004+0000 7faffffdf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:46.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.004+0000 7faffffdf640 1 -- 10.20.193.91:0/1225327832 >> v1:10.20.193.111:6789/0 conn(0x7faff8161ad0 legacy=0x7faff8167780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.004+0000 7f66b2c4c640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66ac0b66a0 con 0x7f66ac0b5b70 2026-02-12T03:58:46.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.004+0000 7f66b2c4c640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:46.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.004+0000 7f66b2c4c640 10 monclient(hunting): authenticate will time out at 1128.747388s 2026-02-12T03:58:46.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.004+0000 7faffffdf640 1 -- 10.20.193.91:0/1225327832 shutdown_connections 2026-02-12T03:58:46.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.004+0000 7faffffdf640 1 -- 10.20.193.91:0/1225327832 >> 10.20.193.91:0/1225327832 conn(0x7faff80559c0 msgr2=0x7faff8055dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:46.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.004+0000 7f6ff24a2640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:46.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.004+0000 7faffffdf640 1 -- 10.20.193.91:0/1225327832 shutdown_connections 2026-02-12T03:58:46.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.004+0000 7f6ff24a2640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T03:58:46.027 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.004+0000 7f6ff24a2640 10 monclient(hunting): picked mon.noname-c con 0x7f6fec0b57a0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:46.027 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.004+0000 7f6ff24a2640 10 monclient(hunting): picked mon.noname-a con 0x7f6fec0b7180 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:46.027 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.004+0000 7faffffdf640 1 -- 10.20.193.91:0/1225327832 wait complete. 2026-02-12T03:58:46.027 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.004+0000 7f6ff24a2640 10 monclient(hunting): picked mon.noname-b con 0x7f6fec0b5b70 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:46.027 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.004+0000 7f6ff24a2640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fec163f30 con 0x7f6fec0b7180 2026-02-12T03:58:46.027 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.004+0000 7f6ff24a2640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fec0b63c0 con 0x7f6fec0b5b70 2026-02-12T03:58:46.027 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.004+0000 7f6ff24a2640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fec0b66a0 con 0x7f6fec0b57a0 2026-02-12T03:58:46.027 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.004+0000 7f6ff24a2640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:46.027 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.004+0000 7f6ff24a2640 10 monclient(hunting): authenticate will time out at 1128.747559s 2026-02-12T03:58:46.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.005+0000 7faffffdf640 10 monclient: build_initial_monmap 2026-02-12T03:58:46.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.005+0000 7faffffdf640 10 monclient: monmap: 2026-02-12T03:58:46.028 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:46.028 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:46.028 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:46.028 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:46.028 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:46.028 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:46.028 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:46.028 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:46.028 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:46.028 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.005+0000 7f0ac4dbb640 10 monclient: get_monmap_and_config 2026-02-12T03:58:46.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.005+0000 7f0ac4dbb640 10 monclient: build_initial_monmap 2026-02-12T03:58:46.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.005+0000 7f0ac4dbb640 10 monclient: monmap: 2026-02-12T03:58:46.028 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:46.028 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.029 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:46.005712+0000 2026-02-12T03:58:46.029 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:46.005712+0000 2026-02-12T03:58:46.029 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:46.029 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.029 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:46.029 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:46.029 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:46.029 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.004+0000 7fd495d74640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7fd4980b7180 0x7fd4980565b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:48606/0 (socket says 10.20.193.91:48606) 2026-02-12T03:58:46.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.004+0000 7fd495d74640 1 -- 10.20.193.91:0/1727918842 learned_addr learned my addr 10.20.193.91:0/1727918842 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:46.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.005+0000 7faffffdf640 1 librados: starting msgr at 2026-02-12T03:58:46.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.005+0000 7faffffdf640 1 librados: starting objecter 2026-02-12T03:58:46.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.005+0000 7faffffdf640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:46.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.005+0000 7faffffdf640 1 Processor -- start 2026-02-12T03:58:46.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.005+0000 7faffffdf640 1 -- start start 2026-02-12T03:58:46.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.005+0000 7faffffdf640 1 librados: setting wanted keys 2026-02-12T03:58:46.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.005+0000 7faffffdf640 1 librados: calling monclient init 2026-02-12T03:58:46.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.005+0000 7faffffdf640 10 monclient: init 2026-02-12T03:58:46.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.005+0000 7f717ffff640 1 -- 10.20.193.91:0/4284131503 <== mon.2 v1:10.20.193.111:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7180002fc0 con 0x7f71901599b0 2026-02-12T03:58:46.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.005+0000 7f717ffff640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:46.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.005+0000 7f717ffff640 1 -- 10.20.193.91:0/4284131503 <== mon.2 v1:10.20.193.111:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f7180003400 con 0x7f71901599b0 2026-02-12T03:58:46.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.005+0000 7f717ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.005+0000 7f717ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:46.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.005+0000 7f717ffff640 10 monclient: dump: 2026-02-12T03:58:46.030 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.030 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.030 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.030 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.030 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.030 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.030 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.030 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.030 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.030 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.005+0000 7f719750a640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:46.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.005+0000 7f719750a640 4 set_mon_vals no callback set 2026-02-12T03:58:46.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.005+0000 7f0ac4dbb640 1 Processor -- start 2026-02-12T03:58:46.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.005+0000 7f0ac4dbb640 1 -- start start 2026-02-12T03:58:46.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.005+0000 7f0ac4dbb640 10 monclient: init 2026-02-12T03:58:46.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7faffffdf640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:46.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7faffffdf640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T03:58:46.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7faffffdf640 10 monclient(hunting): picked mon.noname-c con 0x7faff80564d0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:46.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7faffffdf640 10 monclient(hunting): picked mon.noname-a con 0x7faff8161ad0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:46.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7faffffdf640 10 monclient(hunting): picked mon.noname-b con 0x7faff8167e90 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:46.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7faffffdf640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faff8138c50 con 0x7faff8161ad0 2026-02-12T03:58:46.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7faffffdf640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faff8138f30 con 0x7faff8167e90 2026-02-12T03:58:46.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7faffffdf640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faff8139210 con 0x7faff80564d0 2026-02-12T03:58:46.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7faffffdf640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:46.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7faffffdf640 10 monclient(hunting): authenticate will time out at 1128.749111s 2026-02-12T03:58:46.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7f719750a640 10 monclient: shutdown 2026-02-12T03:58:46.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7f719750a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:46.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7f719750a640 1 -- 10.20.193.91:0/4284131503 >> v1:10.20.193.111:6789/0 conn(0x7f71901599b0 legacy=0x7f719005b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7fb07741f640 10 monclient: get_monmap_and_config 2026-02-12T03:58:46.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7fb07741f640 10 monclient: build_initial_monmap 2026-02-12T03:58:46.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7fb07741f640 10 monclient: monmap: 2026-02-12T03:58:46.032 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:46.032 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.032 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:46.006766+0000 2026-02-12T03:58:46.032 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:46.006766+0000 2026-02-12T03:58:46.032 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:46.032 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.032 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:46.032 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:46.032 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:46.032 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7f0ac4dbb640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:46.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7f0ac4dbb640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T03:58:46.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7f0ac4dbb640 10 monclient(hunting): picked mon.noname-b con 0x7f0ac00b57a0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:46.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7f0ac4dbb640 10 monclient(hunting): picked mon.noname-c con 0x7f0ac00b7180 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:46.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7f0ac4dbb640 10 monclient(hunting): picked mon.noname-a con 0x7f0ac00b5b70 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:46.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7f0ac4dbb640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ac0163f30 con 0x7f0ac00b5b70 2026-02-12T03:58:46.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7f0ac4dbb640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ac00b63c0 con 0x7f0ac00b57a0 2026-02-12T03:58:46.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7f0ac4dbb640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ac00b66a0 con 0x7f0ac00b7180 2026-02-12T03:58:46.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7f0ac4dbb640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:46.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7f0ac4dbb640 10 monclient(hunting): authenticate will time out at 1128.749329s 2026-02-12T03:58:46.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7f719750a640 1 -- 10.20.193.91:0/4284131503 shutdown_connections 2026-02-12T03:58:46.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7f719750a640 1 -- 10.20.193.91:0/4284131503 >> 10.20.193.91:0/4284131503 conn(0x7f71900b6560 msgr2=0x7f71900b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:46.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7f719750a640 1 -- 10.20.193.91:0/4284131503 shutdown_connections 2026-02-12T03:58:46.034 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7f12887b0640 10 monclient: get_monmap_and_config 2026-02-12T03:58:46.034 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7f12887b0640 10 monclient: build_initial_monmap 2026-02-12T03:58:46.034 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7f719750a640 1 -- 10.20.193.91:0/4284131503 wait complete. 2026-02-12T03:58:46.034 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7f12887b0640 10 monclient: monmap: 2026-02-12T03:58:46.034 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:46.034 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.034 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:46.007000+0000 2026-02-12T03:58:46.034 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:46.007000+0000 2026-02-12T03:58:46.034 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:46.034 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.034 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:46.034 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:46.034 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:46.034 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.034 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7fa5ba575640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7fa5bc0b7180 0x7fa5bc0565b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:37924/0 (socket says 10.20.193.91:37924) 2026-02-12T03:58:46.035 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7fa5ba575640 1 -- 10.20.193.91:0/2891735911 learned_addr learned my addr 10.20.193.91:0/2891735911 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:46.035 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7fb07741f640 1 Processor -- start 2026-02-12T03:58:46.035 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7f66b11c2640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f66ac0b5b70 0x7f66ac1633b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:37928/0 (socket says 10.20.193.91:37928) 2026-02-12T03:58:46.035 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7f66b11c2640 1 -- 10.20.193.91:0/528631649 learned_addr learned my addr 10.20.193.91:0/528631649 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:46.035 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7fb07741f640 1 -- start start 2026-02-12T03:58:46.035 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7fb07741f640 10 monclient: init 2026-02-12T03:58:46.035 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.006+0000 7f12887b0640 1 Processor -- start 2026-02-12T03:58:46.035 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7fd4ddffb640 1 -- 10.20.193.91:0/1867496613 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 275271897 0 0) 0x7fd4cc003610 con 0x7fd4e0163310 2026-02-12T03:58:46.035 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7fd4ddffb640 1 -- 10.20.193.91:0/1867496613 >> v1:10.20.193.111:6789/0 conn(0x7fd4e00560d0 legacy=0x7fd4e01c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.036 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7f12887b0640 1 -- start start 2026-02-12T03:58:46.036 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7f12887b0640 10 monclient: init 2026-02-12T03:58:46.036 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7fd4ddffb640 1 -- 10.20.193.91:0/1867496613 >> v1:10.20.193.91:6789/0 conn(0x7fd4e01575d0 legacy=0x7fd4e0162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.036 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7f719750a640 10 monclient: build_initial_monmap 2026-02-12T03:58:46.036 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7f719750a640 10 monclient: monmap: 2026-02-12T03:58:46.036 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:46.036 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:46.036 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:46.036 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:46.036 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:46.036 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:46.036 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:46.036 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:46.036 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:46.036 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.037 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7fd4ddffb640 10 monclient: _finish_hunting 0 2026-02-12T03:58:46.037 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7fd4ddffb640 1 monclient: found mon.noname-b 2026-02-12T03:58:46.037 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7fd4ddffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:46.037 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7fd4ddffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T03:58:46.037 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7fd4ddffb640 1 -- 10.20.193.91:0/1867496613 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e0162400 con 0x7fd4e0163310 2026-02-12T03:58:46.037 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7fd4ddffb640 10 monclient: _finish_auth 0 2026-02-12T03:58:46.037 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7fd4ddffb640 10 monclient: _check_auth_tickets 2026-02-12T03:58:46.037 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7fd4ddffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:46.037 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7fd4e54d4640 5 monclient: authenticate success, global_id 4495 2026-02-12T03:58:46.037 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7fb07741f640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:46.037 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7fd4e54d4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:46.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7f719750a640 1 librados: starting msgr at 2026-02-12T03:58:46.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7f719750a640 1 librados: starting objecter 2026-02-12T03:58:46.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7f719750a640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:46.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7f719750a640 1 Processor -- start 2026-02-12T03:58:46.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7fb07741f640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T03:58:46.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7f719750a640 1 -- start start 2026-02-12T03:58:46.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7f719750a640 1 librados: setting wanted keys 2026-02-12T03:58:46.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7f719750a640 1 librados: calling monclient init 2026-02-12T03:58:46.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7f719750a640 10 monclient: init 2026-02-12T03:58:46.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7fb07741f640 10 monclient(hunting): picked mon.noname-c con 0x7fb0700b57a0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:46.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7fb07741f640 10 monclient(hunting): picked mon.noname-a con 0x7fb0700b7180 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:46.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7fb07741f640 10 monclient(hunting): picked mon.noname-b con 0x7fb0700b5b70 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:46.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7fb07741f640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb070163f30 con 0x7fb0700b7180 2026-02-12T03:58:46.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7f12887b0640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:46.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7f12887b0640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T03:58:46.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7f12887b0640 10 monclient(hunting): picked mon.noname-c con 0x7f1280159b70 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:46.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7fb07741f640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0700b63c0 con 0x7fb0700b5b70 2026-02-12T03:58:46.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7f12887b0640 10 monclient(hunting): picked mon.noname-b con 0x7f1280166f70 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:46.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7f12887b0640 10 monclient(hunting): picked mon.noname-a con 0x7f1280164760 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:46.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7f12887b0640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12800b8a20 con 0x7f1280164760 2026-02-12T03:58:46.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7fb07741f640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0700b66a0 con 0x7fb0700b57a0 2026-02-12T03:58:46.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7f12887b0640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12800b8cc0 con 0x7f1280166f70 2026-02-12T03:58:46.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7f12887b0640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12800b8fa0 con 0x7f1280159b70 2026-02-12T03:58:46.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7f12887b0640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:46.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7fb07741f640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:46.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7f12887b0640 10 monclient(hunting): authenticate will time out at 1128.750684s 2026-02-12T03:58:46.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7fb07741f640 10 monclient(hunting): authenticate will time out at 1128.750692s 2026-02-12T03:58:46.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7f719750a640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:46.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7f719750a640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T03:58:46.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7f719750a640 10 monclient(hunting): picked mon.noname-b con 0x7f719005d180 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:46.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7f719750a640 10 monclient(hunting): picked mon.noname-a con 0x7f71901599b0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:46.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7f719750a640 10 monclient(hunting): picked mon.noname-c con 0x7f7190166580 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:46.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7f719750a640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f719011c220 con 0x7f71901599b0 2026-02-12T03:58:46.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.008+0000 7f719750a640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f719011c500 con 0x7f719005d180 2026-02-12T03:58:46.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.008+0000 7f719750a640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7190135d70 con 0x7f7190166580 2026-02-12T03:58:46.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.008+0000 7f719750a640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:46.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.008+0000 7f719750a640 10 monclient(hunting): authenticate will time out at 1128.751069s 2026-02-12T03:58:46.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7fd4ddffb640 1 -- 10.20.193.91:0/1867496613 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd4c8002df0 con 0x7fd4e0163310 2026-02-12T03:58:46.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7fd4ddffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7fd4ddffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:46.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.007+0000 7fd4ddffb640 10 monclient: dump: 2026-02-12T03:58:46.041 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.041 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.041 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.041 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.041 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.041 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.041 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.041 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.041 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.041 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.008+0000 7f6ff0a18640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f6fec0b5b70 0x7f6fec1633b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:48620/0 (socket says 10.20.193.91:48620) 2026-02-12T03:58:46.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.008+0000 7f6ff0a18640 1 -- 10.20.193.91:0/8385487 learned_addr learned my addr 10.20.193.91:0/8385487 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:46.042 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.008+0000 7fd4e54d4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:46.042 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.008+0000 7fd495573640 1 -- 10.20.193.91:0/1727918842 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 634630572 0 0) 0x7fd4980b66a0 con 0x7fd4980b57a0 2026-02-12T03:58:46.042 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.008+0000 7fd495573640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.042 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.008+0000 7fd495573640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.042 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.008+0000 7fd495573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.042 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.008+0000 7fd495573640 10 monclient(hunting): my global_id is 4463 2026-02-12T03:58:46.042 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.009+0000 7fd7cb7fe640 1 -- 10.20.193.91:0/2091269236 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 643411493 0 0) 0x7fd7d40b8c50 con 0x7fd7d40b8090 2026-02-12T03:58:46.042 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.009+0000 7fd7cb7fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.042 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.009+0000 7fd7cb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.042 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.009+0000 7fd7cb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.042 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.009+0000 7fd7cb7fe640 10 monclient(hunting): my global_id is 4460 2026-02-12T03:58:46.042 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.009+0000 7fd7cb7fe640 1 -- 10.20.193.91:0/2091269236 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7c0003610 con 0x7fd7d40b8090 2026-02-12T03:58:46.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.008+0000 7fd495573640 1 -- 10.20.193.91:0/1727918842 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd484003610 con 0x7fd4980b57a0 2026-02-12T03:58:46.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.009+0000 7fd495573640 1 -- 10.20.193.91:0/1727918842 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2152450706 0 0) 0x7fd4980b63c0 con 0x7fd4980b7180 2026-02-12T03:58:46.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.009+0000 7fd495573640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.009+0000 7fd495573640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.009+0000 7fd495573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.009+0000 7fd495573640 10 monclient(hunting): my global_id is 4501 2026-02-12T03:58:46.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.009+0000 7fd495573640 1 -- 10.20.193.91:0/1727918842 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4980b66a0 con 0x7fd4980b7180 2026-02-12T03:58:46.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.010+0000 7fd7cb7fe640 1 -- 10.20.193.91:0/2091269236 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1357794430 0 0) 0x7fd7d415db10 con 0x7fd7d415d740 2026-02-12T03:58:46.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.010+0000 7fd7cb7fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.010+0000 7fd7cb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.010+0000 7fd7cb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.010+0000 7fd7cb7fe640 10 monclient(hunting): my global_id is 4498 2026-02-12T03:58:46.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.010+0000 7fd7cb7fe640 1 -- 10.20.193.91:0/2091269236 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7d40b8c50 con 0x7fd7d415d740 2026-02-12T03:58:46.044 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.010+0000 7f8c10768640 10 monclient: get_monmap_and_config 2026-02-12T03:58:46.044 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.010+0000 7f8c10768640 10 monclient: build_initial_monmap 2026-02-12T03:58:46.044 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.010+0000 7f8c10768640 10 monclient: monmap: 2026-02-12T03:58:46.044 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:46.044 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.044 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:46.010891+0000 2026-02-12T03:58:46.044 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:46.010891+0000 2026-02-12T03:58:46.044 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:46.044 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.044 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:46.044 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:46.044 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:46.044 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.044 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.010+0000 7f8c10768640 1 Processor -- start 2026-02-12T03:58:46.044 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.010+0000 7f8c10768640 1 -- start start 2026-02-12T03:58:46.044 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.010+0000 7f8c10768640 10 monclient: init 2026-02-12T03:58:46.044 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.010+0000 7f0abe575640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f0ac00b57a0 0x7f0ac00b3990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:48644/0 (socket says 10.20.193.91:48644) 2026-02-12T03:58:46.044 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.010+0000 7f0abe575640 1 -- 10.20.193.91:0/2133286447 learned_addr learned my addr 10.20.193.91:0/2133286447 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:46.044 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.010+0000 7fa5b9d74640 1 -- 10.20.193.91:0/2891735911 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3995610219 0 0) 0x7fa5bc163f30 con 0x7fa5bc0b57a0 2026-02-12T03:58:46.044 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.010+0000 7fa5b9d74640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.044 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.010+0000 7fa5b9d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.045 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.010+0000 7fa5b9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.045 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.010+0000 7fa5b9d74640 10 monclient(hunting): my global_id is 4509 2026-02-12T03:58:46.045 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.011+0000 7fa5b9d74640 1 -- 10.20.193.91:0/2891735911 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5a8003610 con 0x7fa5bc0b57a0 2026-02-12T03:58:46.045 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.011+0000 7faffd553640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7faff8161ad0 0x7faff815b230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:59448/0 (socket says 10.20.193.91:59448) 2026-02-12T03:58:46.045 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.011+0000 7faffd553640 1 -- 10.20.193.91:0/3045807994 learned_addr learned my addr 10.20.193.91:0/3045807994 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:46.045 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.011+0000 7f8c10768640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:46.045 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.011+0000 7f8c10768640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T03:58:46.045 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.011+0000 7f8c10768640 10 monclient(hunting): picked mon.noname-a con 0x7f8c080b57a0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:46.045 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.011+0000 7f8c10768640 10 monclient(hunting): picked mon.noname-b con 0x7f8c080b7180 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:46.045 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.011+0000 7f8c10768640 10 monclient(hunting): picked mon.noname-c con 0x7f8c080b5b70 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:46.045 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.011+0000 7f8c10768640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c08163f30 con 0x7f8c080b57a0 2026-02-12T03:58:46.045 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.011+0000 7f8c10768640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c080b63c0 con 0x7f8c080b7180 2026-02-12T03:58:46.045 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.011+0000 7fd6f70ec640 10 monclient: get_monmap_and_config 2026-02-12T03:58:46.045 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.011+0000 7fd6f70ec640 10 monclient: build_initial_monmap 2026-02-12T03:58:46.045 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.011+0000 7fd6f70ec640 10 monclient: monmap: 2026-02-12T03:58:46.045 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:46.046 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.046 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:46.011995+0000 2026-02-12T03:58:46.046 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:46.011995+0000 2026-02-12T03:58:46.046 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:46.046 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.046 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:46.046 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:46.046 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:46.046 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.046 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.011+0000 7f8c10768640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c080b66a0 con 0x7f8c080b5b70 2026-02-12T03:58:46.046 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.011+0000 7f8c10768640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:46.046 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.011+0000 7f8c10768640 10 monclient(hunting): authenticate will time out at 1128.754505s 2026-02-12T03:58:46.046 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.011+0000 7fb628eec640 10 monclient: get_monmap_and_config 2026-02-12T03:58:46.046 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.011+0000 7fb628eec640 10 monclient: build_initial_monmap 2026-02-12T03:58:46.046 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.011+0000 7fb628eec640 10 monclient: monmap: 2026-02-12T03:58:46.046 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:46.046 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.046 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:46.012214+0000 2026-02-12T03:58:46.046 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:46.012214+0000 2026-02-12T03:58:46.046 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:46.046 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.046 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:46.047 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:46.047 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:46.047 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.047 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.011+0000 7f66a37fe640 1 -- 10.20.193.91:0/528631649 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3775017550 0 0) 0x7f66ac0b66a0 con 0x7f66ac0b5b70 2026-02-12T03:58:46.047 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.011+0000 7f66a37fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.047 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.011+0000 7f66a37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.047 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.011+0000 7f66a37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.047 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.011+0000 7f66a37fe640 10 monclient(hunting): my global_id is 4466 2026-02-12T03:58:46.047 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.011+0000 7fafe67fc640 10 client.?.objecter ms_handle_connect 0x7faff8161ad0 2026-02-12T03:58:46.047 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.011+0000 7fafe67fc640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.047 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.011+0000 7f66a37fe640 1 -- 10.20.193.91:0/528631649 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6698003610 con 0x7f66ac0b5b70 2026-02-12T03:58:46.047 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.011+0000 7fd6f70ec640 1 Processor -- start 2026-02-12T03:58:46.047 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.011+0000 7fd6f70ec640 1 -- start start 2026-02-12T03:58:46.047 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.011+0000 7fd6f70ec640 10 monclient: init 2026-02-12T03:58:46.048 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.012+0000 7fb628eec640 1 Processor -- start 2026-02-12T03:58:46.048 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.012+0000 7fa6cba60640 10 monclient: get_monmap_and_config 2026-02-12T03:58:46.048 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.012+0000 7fa6cba60640 10 monclient: build_initial_monmap 2026-02-12T03:58:46.048 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.012+0000 7fa6cba60640 10 monclient: monmap: 2026-02-12T03:58:46.048 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:46.048 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.048 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:46.012659+0000 2026-02-12T03:58:46.048 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:46.012659+0000 2026-02-12T03:58:46.048 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:46.048 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.048 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:46.048 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:46.048 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:46.048 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.048 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.012+0000 7fb628eec640 1 -- start start 2026-02-12T03:58:46.048 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.012+0000 7fb628eec640 10 monclient: init 2026-02-12T03:58:46.048 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.012+0000 7fafe67fc640 10 client.?.objecter ms_handle_connect 0x7faff8167e90 2026-02-12T03:58:46.048 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.012+0000 7fafe67fc640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.048 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.012+0000 7fd6f70ec640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:46.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.012+0000 7fd6f70ec640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T03:58:46.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.012+0000 7fa6cba60640 1 Processor -- start 2026-02-12T03:58:46.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.012+0000 7fd6f70ec640 10 monclient(hunting): picked mon.noname-c con 0x7fd6f00b57a0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:46.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.012+0000 7fa6cba60640 1 -- start start 2026-02-12T03:58:46.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.012+0000 7fa6cba60640 10 monclient: init 2026-02-12T03:58:46.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.012+0000 7fb628eec640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:46.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.012+0000 7fb628eec640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T03:58:46.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.012+0000 7fb628eec640 10 monclient(hunting): picked mon.noname-c con 0x7fb62415e530 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:46.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.012+0000 7fd6f70ec640 10 monclient(hunting): picked mon.noname-a con 0x7fd6f00b7180 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:46.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.012+0000 7fd6f70ec640 10 monclient(hunting): picked mon.noname-b con 0x7fd6f00b5b70 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:46.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.012+0000 7fd6f70ec640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6f0163f30 con 0x7fd6f00b7180 2026-02-12T03:58:46.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.012+0000 7fb628eec640 10 monclient(hunting): picked mon.noname-a con 0x7fb62415e900 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:46.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.012+0000 7fb628eec640 10 monclient(hunting): picked mon.noname-b con 0x7fb6240b3210 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:46.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.012+0000 7fb628eec640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb624163320 con 0x7fb62415e900 2026-02-12T03:58:46.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.012+0000 7fb628eec640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb624164030 con 0x7fb6240b3210 2026-02-12T03:58:46.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.012+0000 7fb628eec640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb624164310 con 0x7fb62415e530 2026-02-12T03:58:46.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.012+0000 7fb628eec640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:46.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.012+0000 7fb628eec640 10 monclient(hunting): authenticate will time out at 1128.755695s 2026-02-12T03:58:46.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.012+0000 7fd6f70ec640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6f00b63c0 con 0x7fd6f00b5b70 2026-02-12T03:58:46.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.012+0000 7fd6f70ec640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6f00b66a0 con 0x7fd6f00b57a0 2026-02-12T03:58:46.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.012+0000 7fd6f70ec640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:46.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.012+0000 7fd6f70ec640 10 monclient(hunting): authenticate will time out at 1128.755740s 2026-02-12T03:58:46.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.012+0000 7fd7cb7fe640 1 -- 10.20.193.91:0/2091269236 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 75327250 0 0) 0x7fd7d40577f0 con 0x7fd7d40b5480 2026-02-12T03:58:46.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.012+0000 7fd7cb7fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.012+0000 7fd7cb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.012+0000 7fd7cb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.012+0000 7fd7cb7fe640 10 monclient(hunting): my global_id is 4506 2026-02-12T03:58:46.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.012+0000 7fd7cb7fe640 1 -- 10.20.193.91:0/2091269236 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7d415db10 con 0x7fd7d40b5480 2026-02-12T03:58:46.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.013+0000 7fa6cba60640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:46.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.013+0000 7fa6cba60640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T03:58:46.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.013+0000 7fa6cba60640 10 monclient(hunting): picked mon.noname-b con 0x7fa6c40b57a0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:46.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.013+0000 7fa6cba60640 10 monclient(hunting): picked mon.noname-a con 0x7fa6c40b7180 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:46.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.013+0000 7fa6cba60640 10 monclient(hunting): picked mon.noname-c con 0x7fa6c40b5b70 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:46.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.013+0000 7fa6cba60640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6c4163f30 con 0x7fa6c40b7180 2026-02-12T03:58:46.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.013+0000 7fa6cba60640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6c40b63c0 con 0x7fa6c40b57a0 2026-02-12T03:58:46.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.013+0000 7fa6cba60640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6c40b66a0 con 0x7fa6c40b5b70 2026-02-12T03:58:46.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.013+0000 7fa6cba60640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:46.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.013+0000 7fa6cba60640 10 monclient(hunting): authenticate will time out at 1128.756307s 2026-02-12T03:58:46.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.013+0000 7f6feaffd640 1 -- 10.20.193.91:0/8385487 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2826725444 0 0) 0x7f6fec0b63c0 con 0x7f6fec0b5b70 2026-02-12T03:58:46.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.013+0000 7f6feaffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.013+0000 7f6feaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.013+0000 7f6feaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.013+0000 7f6feaffd640 10 monclient(hunting): my global_id is 4510 2026-02-12T03:58:46.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.013+0000 7f6feaffd640 1 -- 10.20.193.91:0/8385487 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fd0003610 con 0x7f6fec0b5b70 2026-02-12T03:58:46.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.013+0000 7fb074993640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7fb0700b7180 0x7fb0700565b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:59456/0 (socket says 10.20.193.91:59456) 2026-02-12T03:58:46.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.013+0000 7fb074993640 1 -- 10.20.193.91:0/3514197820 learned_addr learned my addr 10.20.193.91:0/3514197820 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:46.052 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.016+0000 7fd7cb7fe640 1 -- 10.20.193.91:0/2091269236 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2887164163 0 0) 0x7fd7c0003610 con 0x7fd7d40b8090 2026-02-12T03:58:46.052 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.016+0000 7fd7cb7fe640 1 -- 10.20.193.91:0/2091269236 >> v1:10.20.193.98:6789/0 conn(0x7fd7d415d740 legacy=0x7fd7d40569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.052 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.016+0000 7fd7cb7fe640 1 -- 10.20.193.91:0/2091269236 >> v1:10.20.193.91:6789/0 conn(0x7fd7d40b5480 legacy=0x7fd7d41c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.052 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.016+0000 7fd7cb7fe640 10 monclient: _finish_hunting 0 2026-02-12T03:58:46.052 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.016+0000 7fd7cb7fe640 1 monclient: found mon.noname-c 2026-02-12T03:58:46.052 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.016+0000 7fd7cb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:46.052 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.016+0000 7fd7cb7fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.111:6789/0 2026-02-12T03:58:46.052 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.016+0000 7fd7cb7fe640 1 -- 10.20.193.91:0/2091269236 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d40b8f30 con 0x7fd7d40b8090 2026-02-12T03:58:46.052 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.016+0000 7fd7cb7fe640 10 monclient: _finish_auth 0 2026-02-12T03:58:46.052 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.016+0000 7fd7cb7fe640 10 monclient: _check_auth_tickets 2026-02-12T03:58:46.052 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.016+0000 7fd7cb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:46.052 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.016+0000 7fd7cb7fe640 1 -- 10.20.193.91:0/2091269236 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd7bc002df0 con 0x7fd7d40b8090 2026-02-12T03:58:46.052 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.016+0000 7fd7cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.052 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.016+0000 7f66a37fe640 1 -- 10.20.193.91:0/528631649 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3906485460 0 0) 0x7f66ac0b63c0 con 0x7f66ac0b7180 2026-02-12T03:58:46.052 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.016+0000 7f66a37fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.052 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.016+0000 7f66a37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.052 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.016+0000 7fd7cb7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:46.052 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.016+0000 7fd7cb7fe640 10 monclient: dump: 2026-02-12T03:58:46.052 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.052 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.052 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.052 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.052 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.052 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.053 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.053 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.053 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.053 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.053 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.016+0000 7fd7db224640 5 monclient: authenticate success, global_id 4460 2026-02-12T03:58:46.053 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.016+0000 7fd7db224640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:46.053 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.016+0000 7f66a37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.053 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.016+0000 7f66a37fe640 10 monclient(hunting): my global_id is 4504 2026-02-12T03:58:46.053 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.016+0000 7f66a37fe640 1 -- 10.20.193.91:0/528631649 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66ac0b66a0 con 0x7f66ac0b7180 2026-02-12T03:58:46.053 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.016+0000 7fafe67fc640 10 client.?.objecter ms_handle_connect 0x7faff80564d0 2026-02-12T03:58:46.053 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.016+0000 7fafe67fc640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.053 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.016+0000 7f0abd573640 1 -- 10.20.193.91:0/2133286447 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1218494267 0 0) 0x7f0ac00b63c0 con 0x7f0ac00b57a0 2026-02-12T03:58:46.053 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.016+0000 7f0abd573640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.053 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.016+0000 7f0abd573640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.053 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.016+0000 7f0abd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.053 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.016+0000 7f0abd573640 10 monclient(hunting): my global_id is 4513 2026-02-12T03:58:46.053 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.016+0000 7f0abd573640 1 -- 10.20.193.91:0/2133286447 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0aac003610 con 0x7f0ac00b57a0 2026-02-12T03:58:46.053 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.016+0000 7f719527f640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f719005d180 0x7f7190133f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:48670/0 (socket says 10.20.193.91:48670) 2026-02-12T03:58:46.053 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.016+0000 7f719527f640 1 -- 10.20.193.91:0/3447493771 learned_addr learned my addr 10.20.193.91:0/3447493771 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:46.054 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.016+0000 7f9244407640 10 monclient: get_monmap_and_config 2026-02-12T03:58:46.054 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.016+0000 7f9244407640 10 monclient: build_initial_monmap 2026-02-12T03:58:46.054 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.016+0000 7f9244407640 10 monclient: monmap: 2026-02-12T03:58:46.054 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:46.054 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.054 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:46.017568+0000 2026-02-12T03:58:46.054 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:46.017568+0000 2026-02-12T03:58:46.054 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:46.054 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.054 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:46.054 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:46.054 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:46.054 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.054 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.017+0000 7f1286d26640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f1280164760 0x7f1280056ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:59468/0 (socket says 10.20.193.91:59468) 2026-02-12T03:58:46.054 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.017+0000 7f1286d26640 1 -- 10.20.193.91:0/639671653 learned_addr learned my addr 10.20.193.91:0/639671653 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:46.054 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.017+0000 7fa5b9d74640 1 -- 10.20.193.91:0/2891735911 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3019006516 0 0) 0x7fa5bc0b63c0 con 0x7fa5bc0b5b70 2026-02-12T03:58:46.054 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.017+0000 7fa5b9d74640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.054 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.017+0000 7fa5b9d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.054 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.017+0000 7fa5b9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.054 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.017+0000 7fa5b9d74640 10 monclient(hunting): my global_id is 4507 2026-02-12T03:58:46.054 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.017+0000 7fa5b9d74640 1 -- 10.20.193.91:0/2891735911 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5bc163f30 con 0x7fa5bc0b5b70 2026-02-12T03:58:46.054 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.017+0000 7f9244407640 1 Processor -- start 2026-02-12T03:58:46.054 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.017+0000 7f9244407640 1 -- start start 2026-02-12T03:58:46.055 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.017+0000 7f9244407640 10 monclient: init 2026-02-12T03:58:46.055 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.017+0000 7f66a37fe640 1 -- 10.20.193.91:0/528631649 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 826881596 0 0) 0x7f66ac163f30 con 0x7f66ac0b57a0 2026-02-12T03:58:46.055 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.017+0000 7f66a37fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.055 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.017+0000 7f66a37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.055 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.017+0000 7f66a37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.055 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.017+0000 7f66a37fe640 10 monclient(hunting): my global_id is 4518 2026-02-12T03:58:46.055 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.017+0000 7f66a37fe640 1 -- 10.20.193.91:0/528631649 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66ac0b63c0 con 0x7f66ac0b57a0 2026-02-12T03:58:46.055 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.017+0000 7f8c0dcdc640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f8c080b7180 0x7f8c080565b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:48672/0 (socket says 10.20.193.91:48672) 2026-02-12T03:58:46.055 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.017+0000 7f8c0dcdc640 1 -- 10.20.193.91:0/2878119928 learned_addr learned my addr 10.20.193.91:0/2878119928 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:46.055 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.018+0000 7fa5b9d74640 1 -- 10.20.193.91:0/2891735911 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2091341260 0 0) 0x7fa5bc0b66a0 con 0x7fa5bc0b7180 2026-02-12T03:58:46.055 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.018+0000 7fa5b9d74640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.055 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.018+0000 7fa5b9d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.055 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.018+0000 7fa5b9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.055 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.018+0000 7fa5b9d74640 10 monclient(hunting): my global_id is 4469 2026-02-12T03:58:46.055 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.018+0000 7fa5b9d74640 1 -- 10.20.193.91:0/2891735911 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5bc0b63c0 con 0x7fa5bc0b7180 2026-02-12T03:58:46.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.018+0000 7f9244407640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:46.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.018+0000 7f9244407640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T03:58:46.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.018+0000 7f9244407640 10 monclient(hunting): picked mon.noname-c con 0x7f923c0b57a0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:46.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.018+0000 7f9244407640 10 monclient(hunting): picked mon.noname-b con 0x7f923c0b7180 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:46.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.018+0000 7f9244407640 10 monclient(hunting): picked mon.noname-a con 0x7f923c0b5b70 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:46.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.018+0000 7f9244407640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f923c163f30 con 0x7f923c0b5b70 2026-02-12T03:58:46.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.018+0000 7f9244407640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f923c0b63c0 con 0x7f923c0b7180 2026-02-12T03:58:46.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.018+0000 7f9244407640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f923c0b66a0 con 0x7f923c0b57a0 2026-02-12T03:58:46.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.018+0000 7f9244407640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:46.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.018+0000 7f9244407640 10 monclient(hunting): authenticate will time out at 1128.761285s 2026-02-12T03:58:46.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.018+0000 7f717dffb640 10 client.?.objecter ms_handle_connect 0x7f719005d180 2026-02-12T03:58:46.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.018+0000 7f717dffb640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.019+0000 7fd495573640 1 -- 10.20.193.91:0/1727918842 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3279821800 0 0) 0x7fd484003610 con 0x7fd4980b57a0 2026-02-12T03:58:46.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.019+0000 7fd495573640 1 -- 10.20.193.91:0/1727918842 >> v1:10.20.193.98:6789/0 conn(0x7fd4980b7180 legacy=0x7fd4980565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.019+0000 7fd495573640 1 -- 10.20.193.91:0/1727918842 >> v1:10.20.193.91:6789/0 conn(0x7fd4980b5b70 legacy=0x7fd4981633b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.019+0000 7fd495573640 10 monclient: _finish_hunting 0 2026-02-12T03:58:46.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.019+0000 7fd495573640 1 monclient: found mon.noname-c 2026-02-12T03:58:46.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.019+0000 7fd495573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:46.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.019+0000 7fd495573640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.111:6789/0 2026-02-12T03:58:46.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.019+0000 7fd495573640 1 -- 10.20.193.91:0/1727918842 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4980b6980 con 0x7fd4980b57a0 2026-02-12T03:58:46.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.019+0000 7fd495573640 10 monclient: _finish_auth 0 2026-02-12T03:58:46.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.019+0000 7fd495573640 10 monclient: _check_auth_tickets 2026-02-12T03:58:46.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.019+0000 7fd495573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:46.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.019+0000 7fd495573640 1 -- 10.20.193.91:0/1727918842 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd48c002df0 con 0x7fd4980b57a0 2026-02-12T03:58:46.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.019+0000 7fd495573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.019+0000 7fd495573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:46.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.019+0000 7fd495573640 10 monclient: dump: 2026-02-12T03:58:46.056 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.056 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.057 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.057 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.057 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.057 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.057 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.057 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.057 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.057 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.019+0000 7fd49ccae640 5 monclient: authenticate success, global_id 4463 2026-02-12T03:58:46.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.019+0000 7fd49ccae640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:46.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.020+0000 7fb05ffff640 1 -- 10.20.193.91:0/3514197820 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3221435064 0 0) 0x7fb070163f30 con 0x7fb0700b7180 2026-02-12T03:58:46.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.020+0000 7fb05ffff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.020+0000 7fb05ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.020+0000 7fb05ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.020+0000 7fb05ffff640 10 monclient(hunting): my global_id is 4524 2026-02-12T03:58:46.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.020+0000 7fb05ffff640 1 -- 10.20.193.91:0/3514197820 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb058003610 con 0x7fb0700b7180 2026-02-12T03:58:46.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.021+0000 7fafe67fc640 1 -- 10.20.193.91:0/3045807994 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 493073714 0 0) 0x7faff8138f30 con 0x7faff8167e90 2026-02-12T03:58:46.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.021+0000 7fafe67fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.021+0000 7fafe67fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.021+0000 7fafe67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.021+0000 7fafe67fc640 10 monclient(hunting): my global_id is 4516 2026-02-12T03:58:46.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.021+0000 7fafe67fc640 1 -- 10.20.193.91:0/3045807994 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafc8003610 con 0x7faff8167e90 2026-02-12T03:58:46.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.021+0000 7fa6c9fd6640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7fa6c40b5b70 0x7fa6c41633b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:37996/0 (socket says 10.20.193.91:37996) 2026-02-12T03:58:46.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.021+0000 7fa6c9fd6640 1 -- 10.20.193.91:0/211391712 learned_addr learned my addr 10.20.193.91:0/211391712 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:46.058 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.021+0000 7f717dffb640 10 client.?.objecter ms_handle_connect 0x7f7190166580 2026-02-12T03:58:46.058 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.021+0000 7f717dffb640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.058 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.022+0000 7fd6f4e61640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7fd6f00b57a0 0x7fd6f00b3990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:37982/0 (socket says 10.20.193.91:37982) 2026-02-12T03:58:46.058 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.022+0000 7fd6f4e61640 1 -- 10.20.193.91:0/109502485 learned_addr learned my addr 10.20.193.91:0/109502485 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:46.058 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.023+0000 7f717dffb640 10 client.?.objecter ms_handle_connect 0x7f71901599b0 2026-02-12T03:58:46.058 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.023+0000 7f717dffb640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.058 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.023+0000 7fb622575640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7fb62415e530 0x7fb624162500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:37984/0 (socket says 10.20.193.91:37984) 2026-02-12T03:58:46.058 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.023+0000 7fb622575640 1 -- 10.20.193.91:0/2979198272 learned_addr learned my addr 10.20.193.91:0/2979198272 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:46.058 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.024+0000 7fd4ddffb640 1 -- 10.20.193.91:0/1867496613 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd4c8003040 con 0x7fd4e0163310 2026-02-12T03:58:46.058 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.024+0000 7fd4ddffb640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:46.058 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.024+0000 7fd4ddffb640 1 -- 10.20.193.91:0/1867496613 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd4c8003480 con 0x7fd4e0163310 2026-02-12T03:58:46.058 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.024+0000 7fd4ddffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.058 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.024+0000 7fd4ddffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:46.058 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.024+0000 7fd4ddffb640 10 monclient: dump: 2026-02-12T03:58:46.058 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.058 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.058 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.058 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.058 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.058 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.058 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.058 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.059 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.059 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.059 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.024+0000 7fd4e54d4640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:46.059 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.024+0000 7fd4e54d4640 4 set_mon_vals no callback set 2026-02-12T03:58:46.059 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.025+0000 7f66a37fe640 1 -- 10.20.193.91:0/528631649 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1332571302 0 0) 0x7f6698003610 con 0x7f66ac0b5b70 2026-02-12T03:58:46.059 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.025+0000 7f66a37fe640 1 -- 10.20.193.91:0/528631649 >> v1:10.20.193.98:6789/0 conn(0x7f66ac0b7180 legacy=0x7f66ac0565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.059 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.025+0000 7f66a37fe640 1 -- 10.20.193.91:0/528631649 >> v1:10.20.193.91:6789/0 conn(0x7f66ac0b57a0 legacy=0x7f66ac0b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.059 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.025+0000 7f66a37fe640 10 monclient: _finish_hunting 0 2026-02-12T03:58:46.059 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.025+0000 7f66a37fe640 1 monclient: found mon.noname-c 2026-02-12T03:58:46.059 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.025+0000 7f66a37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:46.059 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.025+0000 7f66a37fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.111:6789/0 2026-02-12T03:58:46.059 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.025+0000 7f66a37fe640 1 -- 10.20.193.91:0/528631649 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66ac0b6980 con 0x7f66ac0b5b70 2026-02-12T03:58:46.059 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.025+0000 7f66a37fe640 10 monclient: _finish_auth 0 2026-02-12T03:58:46.059 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.025+0000 7f66a37fe640 10 monclient: _check_auth_tickets 2026-02-12T03:58:46.059 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.025+0000 7f66a37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:46.059 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.025+0000 7f66a37fe640 1 -- 10.20.193.91:0/528631649 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f66a8003170 con 0x7f66ac0b5b70 2026-02-12T03:58:46.059 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.025+0000 7f66a37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.059 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.025+0000 7f66a37fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:46.059 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.025+0000 7f66a37fe640 10 monclient: dump: 2026-02-12T03:58:46.059 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.059 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.059 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.059 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.059 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.059 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.059 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.059 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.059 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.059 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.059 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.025+0000 7f66b2c4c640 5 monclient: authenticate success, global_id 4466 2026-02-12T03:58:46.059 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.025+0000 7f66b2c4c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:46.060 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.025+0000 7fd4e54d4640 10 monclient: shutdown 2026-02-12T03:58:46.060 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.025+0000 7fd4e54d4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:46.060 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.025+0000 7fd4e54d4640 1 -- 10.20.193.91:0/1867496613 >> v1:10.20.193.98:6789/0 conn(0x7fd4e0163310 legacy=0x7fd4e00559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.060 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.025+0000 7fd4e54d4640 1 -- 10.20.193.91:0/1867496613 shutdown_connections 2026-02-12T03:58:46.060 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.025+0000 7fd4e54d4640 1 -- 10.20.193.91:0/1867496613 >> 10.20.193.91:0/1867496613 conn(0x7fd4e00b6560 msgr2=0x7fd4e00b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:46.060 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.025+0000 7fd4e54d4640 1 -- 10.20.193.91:0/1867496613 shutdown_connections 2026-02-12T03:58:46.060 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.025+0000 7fd4e54d4640 1 -- 10.20.193.91:0/1867496613 wait complete. 2026-02-12T03:58:46.060 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.026+0000 7fd4e54d4640 10 monclient: build_initial_monmap 2026-02-12T03:58:46.060 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.026+0000 7fd4e54d4640 10 monclient: monmap: 2026-02-12T03:58:46.060 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:46.060 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:46.060 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:46.060 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:46.060 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:46.060 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:46.060 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:46.060 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:46.060 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:46.060 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.060 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.026+0000 7f6feaffd640 1 -- 10.20.193.91:0/8385487 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3302105081 0 0) 0x7f6fec163f30 con 0x7f6fec0b7180 2026-02-12T03:58:46.060 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.026+0000 7f6feaffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.060 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.026+0000 7f6feaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.060 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.026+0000 7f6feaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.060 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.026+0000 7f6feaffd640 10 monclient(hunting): my global_id is 4521 2026-02-12T03:58:46.060 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.026+0000 7f6feaffd640 1 -- 10.20.193.91:0/8385487 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fec0b63c0 con 0x7f6fec0b7180 2026-02-12T03:58:46.060 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.026+0000 7fd4e54d4640 1 librados: starting msgr at 2026-02-12T03:58:46.061 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.026+0000 7fd4e54d4640 1 librados: starting objecter 2026-02-12T03:58:46.061 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.026+0000 7fd4e54d4640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:46.061 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.026+0000 7f6feaffd640 1 -- 10.20.193.91:0/8385487 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3512160727 0 0) 0x7f6fec0b66a0 con 0x7f6fec0b57a0 2026-02-12T03:58:46.061 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.026+0000 7f6feaffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.061 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.026+0000 7f6feaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.061 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.026+0000 7f6feaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.061 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.026+0000 7f6feaffd640 10 monclient(hunting): my global_id is 4472 2026-02-12T03:58:46.061 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.026+0000 7f6feaffd640 1 -- 10.20.193.91:0/8385487 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fec163f30 con 0x7f6fec0b57a0 2026-02-12T03:58:46.061 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.026+0000 7fd4e54d4640 1 Processor -- start 2026-02-12T03:58:46.061 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.026+0000 7fd4e54d4640 1 -- start start 2026-02-12T03:58:46.061 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.026+0000 7fd4e54d4640 1 librados: setting wanted keys 2026-02-12T03:58:46.061 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.026+0000 7fd4e54d4640 1 librados: calling monclient init 2026-02-12T03:58:46.061 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.026+0000 7fd4e54d4640 10 monclient: init 2026-02-12T03:58:46.061 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.026+0000 7fafe67fc640 1 -- 10.20.193.91:0/3045807994 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2855560721 0 0) 0x7faff8139210 con 0x7faff80564d0 2026-02-12T03:58:46.061 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.026+0000 7fafe67fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.061 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.026+0000 7fafe67fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.061 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.026+0000 7fafe67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.061 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.026+0000 7fafe67fc640 10 monclient(hunting): my global_id is 4475 2026-02-12T03:58:46.061 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.026+0000 7fafe67fc640 1 -- 10.20.193.91:0/3045807994 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faff8138f30 con 0x7faff80564d0 2026-02-12T03:58:46.062 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.026+0000 7fd4e54d4640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:46.062 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.026+0000 7fd4e54d4640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T03:58:46.062 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.026+0000 7fd4e54d4640 10 monclient(hunting): picked mon.noname-b con 0x7fd4e00560d0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:46.062 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.026+0000 7fd4e54d4640 10 monclient(hunting): picked mon.noname-a con 0x7fd4e01575d0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:46.062 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.026+0000 7fd4e54d4640 10 monclient(hunting): picked mon.noname-c con 0x7fd4e0163310 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:46.062 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.026+0000 7fd4e54d4640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4e01489b0 con 0x7fd4e01575d0 2026-02-12T03:58:46.062 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.026+0000 7fd4e54d4640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4e0058f90 con 0x7fd4e00560d0 2026-02-12T03:58:46.062 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.026+0000 7fd4e54d4640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4e0059270 con 0x7fd4e0163310 2026-02-12T03:58:46.062 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.027+0000 7fd4e54d4640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:46.062 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.027+0000 7fd4e54d4640 10 monclient(hunting): authenticate will time out at 1128.770027s 2026-02-12T03:58:46.062 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.027+0000 7fb05ffff640 1 -- 10.20.193.91:0/3514197820 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4229735776 0 0) 0x7fb0700b66a0 con 0x7fb0700b57a0 2026-02-12T03:58:46.062 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.027+0000 7fb05ffff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.062 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.027+0000 7fb05ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.062 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.027+0000 7fb05ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.062 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.027+0000 7fb05ffff640 10 monclient(hunting): my global_id is 4478 2026-02-12T03:58:46.062 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.027+0000 7fb05ffff640 1 -- 10.20.193.91:0/3514197820 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb070163f30 con 0x7fb0700b57a0 2026-02-12T03:58:46.062 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.027+0000 7fb05ffff640 1 -- 10.20.193.91:0/3514197820 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3239976516 0 0) 0x7fb0700b63c0 con 0x7fb0700b5b70 2026-02-12T03:58:46.062 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.027+0000 7fb05ffff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.062 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.027+0000 7fb05ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.062 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.027+0000 7fb05ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.063 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.027+0000 7fb05ffff640 10 monclient(hunting): my global_id is 4519 2026-02-12T03:58:46.063 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.027+0000 7fb05ffff640 1 -- 10.20.193.91:0/3514197820 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0700b66a0 con 0x7fb0700b5b70 2026-02-12T03:58:46.063 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.028+0000 7fb05ffff640 1 -- 10.20.193.91:0/3514197820 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 499010409 0 0) 0x7fb058003610 con 0x7fb0700b7180 2026-02-12T03:58:46.063 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.028+0000 7fb05ffff640 1 -- 10.20.193.91:0/3514197820 >> v1:10.20.193.111:6789/0 conn(0x7fb0700b57a0 legacy=0x7fb0700b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.063 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.028+0000 7fb05ffff640 1 -- 10.20.193.91:0/3514197820 >> v1:10.20.193.98:6789/0 conn(0x7fb0700b5b70 legacy=0x7fb0701633b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.063 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.028+0000 7fb05ffff640 10 monclient: _finish_hunting 0 2026-02-12T03:58:46.063 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.028+0000 7fb05ffff640 1 monclient: found mon.noname-a 2026-02-12T03:58:46.063 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.028+0000 7fb05ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:46.063 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.028+0000 7fb05ffff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.91:6789/0 2026-02-12T03:58:46.063 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.028+0000 7fb05ffff640 1 -- 10.20.193.91:0/3514197820 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0700b6980 con 0x7fb0700b7180 2026-02-12T03:58:46.063 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.028+0000 7fb05ffff640 10 monclient: _finish_auth 0 2026-02-12T03:58:46.063 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.028+0000 7fb05ffff640 10 monclient: _check_auth_tickets 2026-02-12T03:58:46.063 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.028+0000 7fb05ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:46.063 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.028+0000 7fb05ffff640 1 -- 10.20.193.91:0/3514197820 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fb064002df0 con 0x7fb0700b7180 2026-02-12T03:58:46.063 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.028+0000 7fb05ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.063 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.028+0000 7fb05ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:46.063 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.028+0000 7fb05ffff640 10 monclient: dump: 2026-02-12T03:58:46.063 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.063 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.063 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.063 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.063 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.063 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.063 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.063 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.063 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.063 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.063 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.028+0000 7fb07741f640 5 monclient: authenticate success, global_id 4524 2026-02-12T03:58:46.063 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.028+0000 7fb07741f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:46.063 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.028+0000 7f8c0d4db640 1 -- 10.20.193.91:0/2878119928 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3438837917 0 0) 0x7f8c080b66a0 con 0x7f8c080b5b70 2026-02-12T03:58:46.063 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.028+0000 7f8c0d4db640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.063 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.028+0000 7f8c0d4db640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.063 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.028+0000 7f8c0d4db640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.063 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.028+0000 7f8c0d4db640 10 monclient(hunting): my global_id is 4487 2026-02-12T03:58:46.063 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.028+0000 7f8c0d4db640 1 -- 10.20.193.91:0/2878119928 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bf0003610 con 0x7f8c080b5b70 2026-02-12T03:58:46.064 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.029+0000 7fa6b3fff640 1 -- 10.20.193.91:0/211391712 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1011326921 0 0) 0x7fa6c40b66a0 con 0x7fa6c40b5b70 2026-02-12T03:58:46.064 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.029+0000 7fa6b3fff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.064 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.029+0000 7fa6b3fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.064 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.029+0000 7fa6b3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.064 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.029+0000 7fa6b3fff640 10 monclient(hunting): my global_id is 4493 2026-02-12T03:58:46.064 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.029+0000 7fa6b3fff640 1 -- 10.20.193.91:0/211391712 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6ac003610 con 0x7fa6c40b5b70 2026-02-12T03:58:46.064 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.029+0000 7f1285523640 1 -- 10.20.193.91:0/639671653 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1508495216 0 0) 0x7f12800b8a20 con 0x7f1280164760 2026-02-12T03:58:46.064 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.029+0000 7f1285523640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.064 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.029+0000 7f1285523640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.064 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.029+0000 7f1285523640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.064 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.029+0000 7f1285523640 10 monclient(hunting): my global_id is 4530 2026-02-12T03:58:46.064 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.029+0000 7f1285523640 1 -- 10.20.193.91:0/639671653 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1268003610 con 0x7f1280164760 2026-02-12T03:58:46.064 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.029+0000 7f8c0d4db640 1 -- 10.20.193.91:0/2878119928 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2211663627 0 0) 0x7f8c080b63c0 con 0x7f8c080b7180 2026-02-12T03:58:46.064 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.029+0000 7f8c0d4db640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.064 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.029+0000 7f8c0d4db640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.064 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.030+0000 7f8c0d4db640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.064 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.030+0000 7f8c0d4db640 10 monclient(hunting): my global_id is 4522 2026-02-12T03:58:46.064 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.030+0000 7f8c0d4db640 1 -- 10.20.193.91:0/2878119928 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c080b66a0 con 0x7f8c080b7180 2026-02-12T03:58:46.064 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.030+0000 7f1285523640 1 -- 10.20.193.91:0/639671653 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 727307383 0 0) 0x7f12800b8cc0 con 0x7f1280166f70 2026-02-12T03:58:46.064 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.030+0000 7f1285523640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.064 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.030+0000 7f1285523640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.064 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.030+0000 7f1285523640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.064 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.030+0000 7f1285523640 10 monclient(hunting): my global_id is 4528 2026-02-12T03:58:46.065 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.030+0000 7f924197b640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f923c0b7180 0x7f923c0565b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:48710/0 (socket says 10.20.193.91:48710) 2026-02-12T03:58:46.065 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.030+0000 7f1285523640 1 -- 10.20.193.91:0/639671653 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12800b8a20 con 0x7f1280166f70 2026-02-12T03:58:46.065 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.030+0000 7f924197b640 1 -- 10.20.193.91:0/1354613179 learned_addr learned my addr 10.20.193.91:0/1354613179 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:46.065 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.030+0000 7f717dffb640 1 -- 10.20.193.91:0/3447493771 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1799815228 0 0) 0x7f719011c500 con 0x7f719005d180 2026-02-12T03:58:46.065 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.030+0000 7f717dffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.065 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.030+0000 7f717dffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.065 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.030+0000 7f717dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.065 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.030+0000 7f717dffb640 10 monclient(hunting): my global_id is 4525 2026-02-12T03:58:46.065 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.030+0000 7f717dffb640 1 -- 10.20.193.91:0/3447493771 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7160003610 con 0x7f719005d180 2026-02-12T03:58:46.065 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.031+0000 7fafe67fc640 1 -- 10.20.193.91:0/3045807994 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3667008778 0 0) 0x7faff8138c50 con 0x7faff8161ad0 2026-02-12T03:58:46.065 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.031+0000 7fafe67fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.065 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.031+0000 7fafe67fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.065 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.031+0000 7fafe67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.065 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.031+0000 7fafe67fc640 10 monclient(hunting): my global_id is 4515 2026-02-12T03:58:46.065 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.031+0000 7fafe67fc640 1 -- 10.20.193.91:0/3045807994 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faff8139210 con 0x7faff8161ad0 2026-02-12T03:58:46.065 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.031+0000 7f0abd573640 1 -- 10.20.193.91:0/2133286447 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2603296760 0 0) 0x7f0ac0163f30 con 0x7f0ac00b5b70 2026-02-12T03:58:46.065 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.031+0000 7f0abd573640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.065 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.032+0000 7f0abd573640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.065 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.032+0000 7f0abd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.065 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.032+0000 7f0abd573640 10 monclient(hunting): my global_id is 4527 2026-02-12T03:58:46.066 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.032+0000 7f0abd573640 1 -- 10.20.193.91:0/2133286447 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ac00b63c0 con 0x7f0ac00b5b70 2026-02-12T03:58:46.066 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.032+0000 7f717dffb640 1 -- 10.20.193.91:0/3447493771 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4053800398 0 0) 0x7f719011c220 con 0x7f71901599b0 2026-02-12T03:58:46.066 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.032+0000 7f717dffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.066 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.032+0000 7f717dffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.066 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.032+0000 7f717dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.066 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.032+0000 7f717dffb640 10 monclient(hunting): my global_id is 4533 2026-02-12T03:58:46.066 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.032+0000 7f717dffb640 1 -- 10.20.193.91:0/3447493771 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f719011c500 con 0x7f71901599b0 2026-02-12T03:58:46.066 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.032+0000 7f1285523640 1 -- 10.20.193.91:0/639671653 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2947675650 0 0) 0x7f12800b8fa0 con 0x7f1280159b70 2026-02-12T03:58:46.066 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.032+0000 7f1285523640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.066 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.032+0000 7f1285523640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.066 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.032+0000 7f1285523640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.066 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.032+0000 7f1285523640 10 monclient(hunting): my global_id is 4484 2026-02-12T03:58:46.066 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.032+0000 7f1285523640 1 -- 10.20.193.91:0/639671653 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12800b8cc0 con 0x7f1280159b70 2026-02-12T03:58:46.066 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.032+0000 7fa5b9d74640 1 -- 10.20.193.91:0/2891735911 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2949568844 0 0) 0x7fa5a8003610 con 0x7fa5bc0b57a0 2026-02-12T03:58:46.066 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.032+0000 7fa5b9d74640 1 -- 10.20.193.91:0/2891735911 >> v1:10.20.193.111:6789/0 conn(0x7fa5bc0b7180 legacy=0x7fa5bc0565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.066 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.032+0000 7fa5b9d74640 1 -- 10.20.193.91:0/2891735911 >> v1:10.20.193.98:6789/0 conn(0x7fa5bc0b5b70 legacy=0x7fa5bc1633b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.066 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.032+0000 7fa5b9d74640 10 monclient: _finish_hunting 0 2026-02-12T03:58:46.066 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.032+0000 7fa5b9d74640 1 monclient: found mon.noname-a 2026-02-12T03:58:46.066 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.032+0000 7fa5b9d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:46.066 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.032+0000 7fa5b9d74640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.91:6789/0 2026-02-12T03:58:46.066 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.032+0000 7fa5b9d74640 1 -- 10.20.193.91:0/2891735911 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5bc0b6980 con 0x7fa5bc0b57a0 2026-02-12T03:58:46.066 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.032+0000 7fa5b9d74640 10 monclient: _finish_auth 0 2026-02-12T03:58:46.066 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.032+0000 7fa5b9d74640 10 monclient: _check_auth_tickets 2026-02-12T03:58:46.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.032+0000 7fa5b9d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:46.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.032+0000 7fa5b9d74640 1 -- 10.20.193.91:0/2891735911 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fa5b0002df0 con 0x7fa5bc0b57a0 2026-02-12T03:58:46.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.032+0000 7fa5b9d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.032+0000 7fa5b9d74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:46.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.032+0000 7fa5b9d74640 10 monclient: dump: 2026-02-12T03:58:46.067 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.067 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.067 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.067 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.067 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.067 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.067 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.067 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.067 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.067 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.032+0000 7fa5c1044640 5 monclient: authenticate success, global_id 4509 2026-02-12T03:58:46.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.032+0000 7fa5c1044640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:46.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.034+0000 7f0abd573640 1 -- 10.20.193.91:0/2133286447 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3512069932 0 0) 0x7f0aac003610 con 0x7f0ac00b57a0 2026-02-12T03:58:46.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.034+0000 7f0abd573640 1 -- 10.20.193.91:0/2133286447 >> v1:10.20.193.111:6789/0 conn(0x7f0ac00b7180 legacy=0x7f0ac00565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.034+0000 7f0abd573640 1 -- 10.20.193.91:0/2133286447 >> v1:10.20.193.91:6789/0 conn(0x7f0ac00b5b70 legacy=0x7f0ac01633b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.034+0000 7f0abd573640 10 monclient: _finish_hunting 0 2026-02-12T03:58:46.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.034+0000 7f0abd573640 1 monclient: found mon.noname-b 2026-02-12T03:58:46.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.034+0000 7f0abd573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:46.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.034+0000 7f0abd573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T03:58:46.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.034+0000 7f0abd573640 1 -- 10.20.193.91:0/2133286447 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ac00b6980 con 0x7f0ac00b57a0 2026-02-12T03:58:46.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.034+0000 7f0abd573640 10 monclient: _finish_auth 0 2026-02-12T03:58:46.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.034+0000 7f0abd573640 10 monclient: _check_auth_tickets 2026-02-12T03:58:46.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.034+0000 7f0abd573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:46.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.034+0000 7f0abd573640 1 -- 10.20.193.91:0/2133286447 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f0ab4002df0 con 0x7f0ac00b57a0 2026-02-12T03:58:46.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.034+0000 7f0abd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.034+0000 7f0abd573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:46.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.034+0000 7f0abd573640 10 monclient: dump: 2026-02-12T03:58:46.067 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.068 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.068 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.068 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.068 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.068 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.068 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.068 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.068 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.068 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.068 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.034+0000 7f0ac4dbb640 5 monclient: authenticate success, global_id 4513 2026-02-12T03:58:46.068 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.034+0000 7f0ac4dbb640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:46.068 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.035+0000 7fd6e77fe640 1 -- 10.20.193.91:0/109502485 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 505330269 0 0) 0x7fd6f00b66a0 con 0x7fd6f00b57a0 2026-02-12T03:58:46.068 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.035+0000 7fd6e77fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.068 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.035+0000 7fd6e77fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.068 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.035+0000 7fd6e77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.068 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.035+0000 7fd6e77fe640 10 monclient(hunting): my global_id is 4496 2026-02-12T03:58:46.068 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.035+0000 7fd6e77fe640 1 -- 10.20.193.91:0/109502485 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6dc003610 con 0x7fd6f00b57a0 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.036+0000 7fd495573640 1 -- 10.20.193.91:0/1727918842 <== mon.2 v1:10.20.193.111:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd48c003000 con 0x7fd4980b57a0 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.036+0000 7fd495573640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.036+0000 7fd495573640 1 -- 10.20.193.91:0/1727918842 <== mon.2 v1:10.20.193.111:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd48c003440 con 0x7fd4980b57a0 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.036+0000 7fd495573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.036+0000 7fd495573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.036+0000 7fd495573640 10 monclient: dump: 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.036+0000 7fd49ccae640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.036+0000 7fd49ccae640 4 set_mon_vals no callback set 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.037+0000 7fd49ccae640 10 monclient: shutdown 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.037+0000 7fd49ccae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.037+0000 7fd49ccae640 1 -- 10.20.193.91:0/1727918842 >> v1:10.20.193.111:6789/0 conn(0x7fd4980b57a0 legacy=0x7fd4980b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.037+0000 7fd49ccae640 1 -- 10.20.193.91:0/1727918842 shutdown_connections 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.037+0000 7fd49ccae640 1 -- 10.20.193.91:0/1727918842 >> 10.20.193.91:0/1727918842 conn(0x7fd4980559c0 msgr2=0x7fd498055dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.037+0000 7fd49ccae640 1 -- 10.20.193.91:0/1727918842 shutdown_connections 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.037+0000 7fd49ccae640 1 -- 10.20.193.91:0/1727918842 wait complete. 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.038+0000 7fd49ccae640 10 monclient: build_initial_monmap 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.038+0000 7fd49ccae640 10 monclient: monmap: 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.038+0000 7fd49ccae640 1 librados: starting msgr at 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.038+0000 7fd49ccae640 1 librados: starting objecter 2026-02-12T03:58:46.069 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.038+0000 7fd49ccae640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:46.070 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.038+0000 7fd49ccae640 1 Processor -- start 2026-02-12T03:58:46.070 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.038+0000 7fd49ccae640 1 -- start start 2026-02-12T03:58:46.070 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.038+0000 7fd49ccae640 1 librados: setting wanted keys 2026-02-12T03:58:46.070 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.038+0000 7fd49ccae640 1 librados: calling monclient init 2026-02-12T03:58:46.070 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.038+0000 7fd49ccae640 10 monclient: init 2026-02-12T03:58:46.070 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.038+0000 7fd49ccae640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:46.070 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.038+0000 7fd49ccae640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T03:58:46.070 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.038+0000 7fd49ccae640 10 monclient(hunting): picked mon.noname-a con 0x7fd4980b57a0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:46.070 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.038+0000 7fd49ccae640 10 monclient(hunting): picked mon.noname-b con 0x7fd4980b5b70 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:46.070 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.038+0000 7fd49ccae640 10 monclient(hunting): picked mon.noname-c con 0x7fd4980b7180 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:46.070 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.038+0000 7fd49ccae640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd498155d80 con 0x7fd4980b57a0 2026-02-12T03:58:46.070 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.038+0000 7fd49ccae640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd498161a60 con 0x7fd4980b5b70 2026-02-12T03:58:46.070 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.038+0000 7fd49ccae640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd498161d40 con 0x7fd4980b7180 2026-02-12T03:58:46.070 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.038+0000 7fd49ccae640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:46.070 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.038+0000 7fd49ccae640 10 monclient(hunting): authenticate will time out at 1128.781966s 2026-02-12T03:58:46.070 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.039+0000 7f6feaffd640 1 -- 10.20.193.91:0/8385487 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 789249519 0 0) 0x7f6fec163f30 con 0x7f6fec0b57a0 2026-02-12T03:58:46.070 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.039+0000 7f6feaffd640 1 -- 10.20.193.91:0/8385487 >> v1:10.20.193.98:6789/0 conn(0x7f6fec0b5b70 legacy=0x7f6fec1633b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.070 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.039+0000 7f6feaffd640 1 -- 10.20.193.91:0/8385487 >> v1:10.20.193.91:6789/0 conn(0x7f6fec0b7180 legacy=0x7f6fec0565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.070 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.039+0000 7f6feaffd640 10 monclient: _finish_hunting 0 2026-02-12T03:58:46.070 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.039+0000 7f6feaffd640 1 monclient: found mon.noname-c 2026-02-12T03:58:46.070 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.039+0000 7f6feaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:46.070 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.039+0000 7f6feaffd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.111:6789/0 2026-02-12T03:58:46.070 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.039+0000 7f6feaffd640 1 -- 10.20.193.91:0/8385487 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fec0b6980 con 0x7f6fec0b57a0 2026-02-12T03:58:46.070 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.039+0000 7f6feaffd640 10 monclient: _finish_auth 0 2026-02-12T03:58:46.070 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.039+0000 7fafe67fc640 1 -- 10.20.193.91:0/3045807994 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1622476025 0 0) 0x7fafc8003610 con 0x7faff8167e90 2026-02-12T03:58:46.071 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.039+0000 7f6feaffd640 10 monclient: _check_auth_tickets 2026-02-12T03:58:46.071 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.039+0000 7f6feaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:46.071 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.039+0000 7f6feaffd640 1 -- 10.20.193.91:0/8385487 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f6fd8002dd0 con 0x7f6fec0b57a0 2026-02-12T03:58:46.071 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.039+0000 7f6ff24a2640 5 monclient: authenticate success, global_id 4472 2026-02-12T03:58:46.071 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.039+0000 7f6ff24a2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:46.071 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.039+0000 7f6feaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.071 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.039+0000 7f6feaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:46.071 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.039+0000 7f6feaffd640 10 monclient: dump: 2026-02-12T03:58:46.071 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.071 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.071 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.071 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.071 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.071 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.071 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.071 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.071 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.071 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.071 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.039+0000 7f6ff24a2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:46.071 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.039+0000 7fafe67fc640 1 -- 10.20.193.91:0/3045807994 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faff8138c50 con 0x7faff8167e90 2026-02-12T03:58:46.071 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.039+0000 7fafe67fc640 1 -- 10.20.193.91:0/3045807994 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7faff40032f0 con 0x7faff8167e90 2026-02-12T03:58:46.071 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.039+0000 7fafe67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:46.071 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.039+0000 7fafe67fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:46.071 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.039+0000 7fafe67fc640 10 monclient(hunting): dump: 2026-02-12T03:58:46.071 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.071 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.071 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.071 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.071 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.071 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.071 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.071 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.071 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.071 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.071 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.039+0000 7fafe67fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:46.072 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.040+0000 7fd7cb7fe640 1 -- 10.20.193.91:0/2091269236 <== mon.2 v1:10.20.193.111:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd7bc002fc0 con 0x7fd7d40b8090 2026-02-12T03:58:46.072 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.040+0000 7fd7cb7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:46.072 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.040+0000 7fd7cb7fe640 1 -- 10.20.193.91:0/2091269236 <== mon.2 v1:10.20.193.111:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd7bc003400 con 0x7fd7d40b8090 2026-02-12T03:58:46.072 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.040+0000 7fd7db224640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:46.072 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.040+0000 7fd7db224640 4 set_mon_vals no callback set 2026-02-12T03:58:46.072 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.040+0000 7fd7cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.072 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.040+0000 7fd7cb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:46.072 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.040+0000 7fd7cb7fe640 10 monclient: dump: 2026-02-12T03:58:46.072 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.072 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.072 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.072 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.072 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.072 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.072 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.072 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.072 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.072 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.072 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.040+0000 7f717dffb640 1 -- 10.20.193.91:0/3447493771 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2235859187 0 0) 0x7f7190135d70 con 0x7f7190166580 2026-02-12T03:58:46.072 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.040+0000 7f717dffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.072 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.040+0000 7f717dffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.072 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.040+0000 7f717dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.072 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.040+0000 7f717dffb640 10 monclient(hunting): my global_id is 4490 2026-02-12T03:58:46.072 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.040+0000 7f717dffb640 1 -- 10.20.193.91:0/3447493771 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f719011c220 con 0x7f7190166580 2026-02-12T03:58:46.073 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.040+0000 7f66a37fe640 1 -- 10.20.193.91:0/528631649 <== mon.2 v1:10.20.193.111:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f66a8003340 con 0x7f66ac0b5b70 2026-02-12T03:58:46.073 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.040+0000 7f66a37fe640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:46.073 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.040+0000 7f66a37fe640 1 -- 10.20.193.91:0/528631649 <== mon.2 v1:10.20.193.111:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f66a8003780 con 0x7f66ac0b5b70 2026-02-12T03:58:46.073 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.040+0000 7f66a37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.073 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.040+0000 7f66a37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:46.073 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.040+0000 7f66a37fe640 10 monclient: dump: 2026-02-12T03:58:46.073 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.073 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.073 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.073 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.073 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.073 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.073 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.073 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.073 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.073 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.073 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.040+0000 7f66b2c4c640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:46.073 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.040+0000 7f66b2c4c640 4 set_mon_vals no callback set 2026-02-12T03:58:46.073 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.040+0000 7fd7db224640 10 monclient: shutdown 2026-02-12T03:58:46.073 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.040+0000 7fd7db224640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:46.073 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.040+0000 7fd7db224640 1 -- 10.20.193.91:0/2091269236 >> v1:10.20.193.111:6789/0 conn(0x7fd7d40b8090 legacy=0x7fd7d40570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.073 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.040+0000 7fd7db224640 1 -- 10.20.193.91:0/2091269236 shutdown_connections 2026-02-12T03:58:46.073 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.040+0000 7fd7db224640 1 -- 10.20.193.91:0/2091269236 >> 10.20.193.91:0/2091269236 conn(0x7fd7d40b7580 msgr2=0x7fd7d40b7980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:46.073 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.040+0000 7fb621573640 1 -- 10.20.193.91:0/2979198272 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3707303112 0 0) 0x7fb624164310 con 0x7fb62415e530 2026-02-12T03:58:46.073 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.040+0000 7fb621573640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.073 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.040+0000 7fb621573640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.073 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.040+0000 7fb621573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.073 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.040+0000 7fb621573640 10 monclient(hunting): my global_id is 4499 2026-02-12T03:58:46.073 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.040+0000 7fb621573640 1 -- 10.20.193.91:0/2979198272 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb610003610 con 0x7fb62415e530 2026-02-12T03:58:46.074 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.040+0000 7fd7db224640 1 -- 10.20.193.91:0/2091269236 shutdown_connections 2026-02-12T03:58:46.074 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.041+0000 7f66b2c4c640 10 monclient: shutdown 2026-02-12T03:58:46.074 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.041+0000 7f66b2c4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:46.074 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.041+0000 7f66b2c4c640 1 -- 10.20.193.91:0/528631649 >> v1:10.20.193.111:6789/0 conn(0x7f66ac0b5b70 legacy=0x7f66ac1633b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.074 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.040+0000 7fd7db224640 1 -- 10.20.193.91:0/2091269236 wait complete. 2026-02-12T03:58:46.074 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.041+0000 7f66b2c4c640 1 -- 10.20.193.91:0/528631649 shutdown_connections 2026-02-12T03:58:46.074 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.041+0000 7f66b2c4c640 1 -- 10.20.193.91:0/528631649 >> 10.20.193.91:0/528631649 conn(0x7f66ac0559c0 msgr2=0x7f66ac055dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:46.074 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.041+0000 7f8c0d4db640 1 -- 10.20.193.91:0/2878119928 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 987510501 0 0) 0x7f8bf0003610 con 0x7f8c080b5b70 2026-02-12T03:58:46.074 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.041+0000 7f8c0d4db640 1 -- 10.20.193.91:0/2878119928 >> v1:10.20.193.98:6789/0 conn(0x7f8c080b7180 legacy=0x7f8c080565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.074 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.041+0000 7f8c0d4db640 1 -- 10.20.193.91:0/2878119928 >> v1:10.20.193.91:6789/0 conn(0x7f8c080b57a0 legacy=0x7f8c080b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.074 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.041+0000 7f8c0d4db640 10 monclient: _finish_hunting 0 2026-02-12T03:58:46.074 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.041+0000 7f8c0d4db640 1 monclient: found mon.noname-c 2026-02-12T03:58:46.074 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.041+0000 7f8c0d4db640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:46.074 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.041+0000 7f8c0d4db640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.111:6789/0 2026-02-12T03:58:46.074 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.041+0000 7f8c0d4db640 1 -- 10.20.193.91:0/2878119928 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c080b6980 con 0x7f8c080b5b70 2026-02-12T03:58:46.074 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.041+0000 7f8c0d4db640 10 monclient: _finish_auth 0 2026-02-12T03:58:46.075 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.041+0000 7f8c0d4db640 10 monclient: _check_auth_tickets 2026-02-12T03:58:46.075 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.041+0000 7f8c0d4db640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:46.075 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.041+0000 7f8c0d4db640 1 -- 10.20.193.91:0/2878119928 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8c04003170 con 0x7f8c080b5b70 2026-02-12T03:58:46.075 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.041+0000 7f8c10768640 5 monclient: authenticate success, global_id 4487 2026-02-12T03:58:46.075 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.041+0000 7f8c10768640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:46.075 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.041+0000 7f8c0d4db640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.075 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.041+0000 7f8c0d4db640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:46.075 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.041+0000 7f8c0d4db640 10 monclient: dump: 2026-02-12T03:58:46.075 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.075 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.075 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.075 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.075 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.075 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.075 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.075 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.075 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.075 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.075 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.041+0000 7f8c10768640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:46.075 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.041+0000 7fd7db224640 10 monclient: build_initial_monmap 2026-02-12T03:58:46.075 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.041+0000 7fd7db224640 10 monclient: monmap: 2026-02-12T03:58:46.075 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:46.075 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:46.075 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:46.075 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:46.075 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:46.075 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:46.075 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:46.075 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:46.075 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:46.075 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.076 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.041+0000 7fd7db224640 1 librados: starting msgr at 2026-02-12T03:58:46.076 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.041+0000 7fd7db224640 1 librados: starting objecter 2026-02-12T03:58:46.076 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.041+0000 7f66b2c4c640 1 -- 10.20.193.91:0/528631649 shutdown_connections 2026-02-12T03:58:46.076 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.041+0000 7fd7db224640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:46.076 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.041+0000 7f66b2c4c640 1 -- 10.20.193.91:0/528631649 wait complete. 2026-02-12T03:58:46.076 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.041+0000 7fd7db224640 1 Processor -- start 2026-02-12T03:58:46.076 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.042+0000 7f924117a640 1 -- 10.20.193.91:0/1354613179 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1714793355 0 0) 0x7f923c0b63c0 con 0x7f923c0b7180 2026-02-12T03:58:46.076 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.042+0000 7f924117a640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.076 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.042+0000 7f924117a640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.076 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.042+0000 7f924117a640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.076 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.042+0000 7f924117a640 10 monclient(hunting): my global_id is 4531 2026-02-12T03:58:46.076 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.042+0000 7f924117a640 1 -- 10.20.193.91:0/1354613179 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9224003610 con 0x7f923c0b7180 2026-02-12T03:58:46.076 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.041+0000 7fd7db224640 1 -- start start 2026-02-12T03:58:46.076 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.041+0000 7fd7db224640 1 librados: setting wanted keys 2026-02-12T03:58:46.076 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.041+0000 7fd7db224640 1 librados: calling monclient init 2026-02-12T03:58:46.076 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.041+0000 7fd7db224640 10 monclient: init 2026-02-12T03:58:46.077 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.042+0000 7f66b2c4c640 10 monclient: build_initial_monmap 2026-02-12T03:58:46.077 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.042+0000 7f66b2c4c640 10 monclient: monmap: 2026-02-12T03:58:46.077 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:46.077 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:46.077 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:46.077 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:46.077 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:46.077 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:46.077 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:46.077 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:46.077 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:46.077 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.077 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.042+0000 7fd7db224640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:46.077 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.042+0000 7fd7db224640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T03:58:46.077 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.042+0000 7fd7db224640 10 monclient(hunting): picked mon.noname-b con 0x7fd7d40b5480 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:46.077 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.042+0000 7fd7db224640 10 monclient(hunting): picked mon.noname-c con 0x7fd7d40b8090 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:46.077 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.042+0000 7fd7db224640 10 monclient(hunting): picked mon.noname-a con 0x7fd7d415d740 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:46.077 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.042+0000 7fd7db224640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7d40ae500 con 0x7fd7d415d740 2026-02-12T03:58:46.077 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.042+0000 7fd7db224640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7d42037c0 con 0x7fd7d40b5480 2026-02-12T03:58:46.077 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.042+0000 7fa6b3fff640 1 -- 10.20.193.91:0/211391712 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3255906109 0 0) 0x7fa6c40b63c0 con 0x7fa6c40b57a0 2026-02-12T03:58:46.077 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.042+0000 7fa6b3fff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.077 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.042+0000 7fa6b3fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.077 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.042+0000 7fa6b3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.077 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.042+0000 7fa6b3fff640 10 monclient(hunting): my global_id is 4537 2026-02-12T03:58:46.077 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.042+0000 7fa6b3fff640 1 -- 10.20.193.91:0/211391712 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6c40b66a0 con 0x7fa6c40b57a0 2026-02-12T03:58:46.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.042+0000 7f66b2c4c640 1 librados: starting msgr at 2026-02-12T03:58:46.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.042+0000 7f66b2c4c640 1 librados: starting objecter 2026-02-12T03:58:46.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.042+0000 7fd7db224640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7d415f680 con 0x7fd7d40b8090 2026-02-12T03:58:46.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.042+0000 7fd7db224640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:46.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.042+0000 7fd7db224640 10 monclient(hunting): authenticate will time out at 1128.785729s 2026-02-12T03:58:46.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.042+0000 7f66b2c4c640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:46.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.042+0000 7f66b2c4c640 1 Processor -- start 2026-02-12T03:58:46.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.042+0000 7f66b2c4c640 1 -- start start 2026-02-12T03:58:46.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.042+0000 7f66b2c4c640 1 librados: setting wanted keys 2026-02-12T03:58:46.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.042+0000 7f66b2c4c640 1 librados: calling monclient init 2026-02-12T03:58:46.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.042+0000 7f66b2c4c640 10 monclient: init 2026-02-12T03:58:46.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.043+0000 7fafe67fc640 1 -- 10.20.193.91:0/3045807994 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1134659177 0 0) 0x7faff8139210 con 0x7faff8161ad0 2026-02-12T03:58:46.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.043+0000 7fafe67fc640 1 -- 10.20.193.91:0/3045807994 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fafc8003610 con 0x7faff8161ad0 2026-02-12T03:58:46.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.043+0000 7fafe67fc640 1 -- 10.20.193.91:0/3045807994 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fafec003170 con 0x7faff8161ad0 2026-02-12T03:58:46.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.043+0000 7fafe67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:46.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.043+0000 7fafe67fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:46.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.043+0000 7fafe67fc640 10 monclient(hunting): dump: 2026-02-12T03:58:46.078 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.078 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.078 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.078 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.078 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.078 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.078 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.078 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.079 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.079 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.043+0000 7f66b2c4c640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:46.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.043+0000 7f66b2c4c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T03:58:46.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.043+0000 7f66b2c4c640 10 monclient(hunting): picked mon.noname-b con 0x7f66ac0b57a0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:46.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.043+0000 7f66b2c4c640 10 monclient(hunting): picked mon.noname-a con 0x7f66ac0b5b70 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:46.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.043+0000 7f66b2c4c640 10 monclient(hunting): picked mon.noname-c con 0x7f66ac0b7180 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:46.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.043+0000 7f66b2c4c640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66ac152fa0 con 0x7f66ac0b5b70 2026-02-12T03:58:46.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.043+0000 7f66b2c4c640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66ac152700 con 0x7f66ac0b57a0 2026-02-12T03:58:46.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.043+0000 7f66b2c4c640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66ac1529e0 con 0x7f66ac0b7180 2026-02-12T03:58:46.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.043+0000 7f717dffb640 1 -- 10.20.193.91:0/3447493771 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2205969293 0 0) 0x7f719011c500 con 0x7f71901599b0 2026-02-12T03:58:46.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.043+0000 7f717dffb640 1 -- 10.20.193.91:0/3447493771 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7190135d70 con 0x7f71901599b0 2026-02-12T03:58:46.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.043+0000 7f66b2c4c640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:46.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.043+0000 7f717dffb640 1 -- 10.20.193.91:0/3447493771 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f7184003060 con 0x7f71901599b0 2026-02-12T03:58:46.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.043+0000 7f66b2c4c640 10 monclient(hunting): authenticate will time out at 1128.786834s 2026-02-12T03:58:46.080 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.043+0000 7f717dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:46.080 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.043+0000 7f717dffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:46.080 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.043+0000 7f717dffb640 10 monclient(hunting): dump: 2026-02-12T03:58:46.080 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.080 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.080 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.080 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.080 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.080 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.080 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.080 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.080 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.080 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.080 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.043+0000 7f717dffb640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:46.080 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.044+0000 7fd4deffd640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7fd4e00560d0 0x7fd4e014b1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:48724/0 (socket says 10.20.193.91:48724) 2026-02-12T03:58:46.080 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.044+0000 7fd4deffd640 1 -- 10.20.193.91:0/876055338 learned_addr learned my addr 10.20.193.91:0/876055338 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:46.080 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.045+0000 7fa6b3fff640 1 -- 10.20.193.91:0/211391712 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3583388292 0 0) 0x7fa6ac003610 con 0x7fa6c40b5b70 2026-02-12T03:58:46.080 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.045+0000 7fa6b3fff640 1 -- 10.20.193.91:0/211391712 >> v1:10.20.193.98:6789/0 conn(0x7fa6c40b57a0 legacy=0x7fa6c40b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.080 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.045+0000 7fa6b3fff640 1 -- 10.20.193.91:0/211391712 >> v1:10.20.193.91:6789/0 conn(0x7fa6c40b7180 legacy=0x7fa6c40565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.080 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.045+0000 7fa6b3fff640 10 monclient: _finish_hunting 0 2026-02-12T03:58:46.080 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.045+0000 7fa6b3fff640 1 monclient: found mon.noname-c 2026-02-12T03:58:46.081 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.045+0000 7fa6b3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:46.081 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.045+0000 7fa6b3fff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.111:6789/0 2026-02-12T03:58:46.081 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.045+0000 7fa6b3fff640 1 -- 10.20.193.91:0/211391712 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6c40b6980 con 0x7fa6c40b5b70 2026-02-12T03:58:46.081 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.045+0000 7fa6b3fff640 10 monclient: _finish_auth 0 2026-02-12T03:58:46.081 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.045+0000 7fa6b3fff640 10 monclient: _check_auth_tickets 2026-02-12T03:58:46.081 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.045+0000 7fa6b3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:46.081 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.045+0000 7fa6b3fff640 1 -- 10.20.193.91:0/211391712 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fa6c0003170 con 0x7fa6c40b5b70 2026-02-12T03:58:46.081 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.045+0000 7fa6b3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.081 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.045+0000 7fd4bf7fe640 10 client.?.objecter ms_handle_connect 0x7fd4e00560d0 2026-02-12T03:58:46.081 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.045+0000 7fd4bf7fe640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.081 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.045+0000 7fa6b3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:46.081 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.045+0000 7fa6b3fff640 10 monclient: dump: 2026-02-12T03:58:46.081 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.081 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.081 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.081 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.081 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.081 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.081 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.081 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.081 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.081 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.081 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.045+0000 7fa6cba60640 5 monclient: authenticate success, global_id 4493 2026-02-12T03:58:46.081 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.045+0000 7fa6cba60640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:46.081 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.045+0000 7fd6e77fe640 1 -- 10.20.193.91:0/109502485 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3624542768 0 0) 0x7fd6f00b63c0 con 0x7fd6f00b5b70 2026-02-12T03:58:46.081 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.045+0000 7fd6e77fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.081 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.045+0000 7fd6e77fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.081 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.045+0000 7fd6e77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.081 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.045+0000 7fd6e77fe640 10 monclient(hunting): my global_id is 4534 2026-02-12T03:58:46.081 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.045+0000 7fd6e77fe640 1 -- 10.20.193.91:0/109502485 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6f00b66a0 con 0x7fd6f00b5b70 2026-02-12T03:58:46.082 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.046+0000 7fd4bf7fe640 10 client.?.objecter ms_handle_connect 0x7fd4e01575d0 2026-02-12T03:58:46.082 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.046+0000 7fd4bf7fe640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.082 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.047+0000 7fb621573640 1 -- 10.20.193.91:0/2979198272 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2227688240 0 0) 0x7fb624164030 con 0x7fb6240b3210 2026-02-12T03:58:46.082 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.047+0000 7fb621573640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.082 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.047+0000 7fb621573640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.082 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.047+0000 7fb621573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.082 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.047+0000 7fb621573640 10 monclient(hunting): my global_id is 4540 2026-02-12T03:58:46.082 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.047+0000 7fb621573640 1 -- 10.20.193.91:0/2979198272 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb624164310 con 0x7fb6240b3210 2026-02-12T03:58:46.082 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fb05ffff640 1 -- 10.20.193.91:0/3514197820 <== mon.0 v1:10.20.193.91:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb064002fc0 con 0x7fb0700b7180 2026-02-12T03:58:46.082 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fb05ffff640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:46.082 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fb05ffff640 1 -- 10.20.193.91:0/3514197820 <== mon.0 v1:10.20.193.91:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fb064003400 con 0x7fb0700b7180 2026-02-12T03:58:46.082 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fb07741f640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:46.082 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fb07741f640 4 set_mon_vals no callback set 2026-02-12T03:58:46.082 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fb05ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.082 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fb05ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:46.082 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fb05ffff640 10 monclient: dump: 2026-02-12T03:58:46.082 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.082 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.082 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.082 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.082 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.082 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.082 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.082 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.082 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.082 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.083 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7f1285523640 1 -- 10.20.193.91:0/639671653 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1036396820 0 0) 0x7f12800b8a20 con 0x7f1280166f70 2026-02-12T03:58:46.083 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7f1285523640 1 -- 10.20.193.91:0/639671653 >> v1:10.20.193.111:6789/0 conn(0x7f1280159b70 legacy=0x7f1280166860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.083 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7f1285523640 1 -- 10.20.193.91:0/639671653 >> v1:10.20.193.91:6789/0 conn(0x7f1280164760 legacy=0x7f1280056ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.083 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7f1285523640 10 monclient: _finish_hunting 0 2026-02-12T03:58:46.083 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7f1285523640 1 monclient: found mon.noname-b 2026-02-12T03:58:46.083 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7f1285523640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:46.083 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7f1285523640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T03:58:46.083 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fa5b9d74640 1 -- 10.20.193.91:0/2891735911 <== mon.0 v1:10.20.193.91:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa5b0002fc0 con 0x7fa5bc0b57a0 2026-02-12T03:58:46.083 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fa5b9d74640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:46.083 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fa5b9d74640 1 -- 10.20.193.91:0/2891735911 <== mon.0 v1:10.20.193.91:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fa5b0003400 con 0x7fa5bc0b57a0 2026-02-12T03:58:46.083 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fa5c1044640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:46.083 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fa5c1044640 4 set_mon_vals no callback set 2026-02-12T03:58:46.083 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fa5b9d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.083 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fa5b9d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:46.083 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fa5b9d74640 10 monclient: dump: 2026-02-12T03:58:46.083 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.083 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.083 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.083 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.083 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.083 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.083 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.083 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.083 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.083 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.083 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7f1285523640 1 -- 10.20.193.91:0/639671653 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12800b9280 con 0x7f1280166f70 2026-02-12T03:58:46.083 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7f1285523640 10 monclient: _finish_auth 0 2026-02-12T03:58:46.083 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7f1285523640 10 monclient: _check_auth_tickets 2026-02-12T03:58:46.083 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7f1285523640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:46.083 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7f1285523640 1 -- 10.20.193.91:0/639671653 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f1274002df0 con 0x7f1280166f70 2026-02-12T03:58:46.083 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7f1285523640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.084 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7f1285523640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:46.084 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7f1285523640 10 monclient: dump: 2026-02-12T03:58:46.084 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.084 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.084 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.084 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.084 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.084 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.084 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.084 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.084 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.084 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.084 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7f12887b0640 5 monclient: authenticate success, global_id 4528 2026-02-12T03:58:46.084 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7f12887b0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:46.084 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fafe67fc640 1 -- 10.20.193.91:0/3045807994 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3852937665 0 0) 0x7faff8138f30 con 0x7faff80564d0 2026-02-12T03:58:46.084 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fafe67fc640 1 -- 10.20.193.91:0/3045807994 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faff8139210 con 0x7faff80564d0 2026-02-12T03:58:46.084 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fafe67fc640 1 -- 10.20.193.91:0/3045807994 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fafe80031b0 con 0x7faff80564d0 2026-02-12T03:58:46.084 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fafe67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:46.084 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fafe67fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:46.084 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fafe67fc640 10 monclient(hunting): dump: 2026-02-12T03:58:46.084 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.084 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.084 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.084 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.084 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.084 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.084 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.084 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.084 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.084 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.084 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fd4bf7fe640 10 client.?.objecter ms_handle_connect 0x7fd4e0163310 2026-02-12T03:58:46.084 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fd4bf7fe640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.085 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fd496575640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7fd4980b57a0 0x7fd498155670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:59558/0 (socket says 10.20.193.91:59558) 2026-02-12T03:58:46.085 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fd496575640 1 -- 10.20.193.91:0/1771820188 learned_addr learned my addr 10.20.193.91:0/1771820188 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:46.085 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fb07741f640 10 monclient: shutdown 2026-02-12T03:58:46.085 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fb07741f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:46.085 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fb07741f640 1 -- 10.20.193.91:0/3514197820 >> v1:10.20.193.91:6789/0 conn(0x7fb0700b7180 legacy=0x7fb0700565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.085 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fb07741f640 1 -- 10.20.193.91:0/3514197820 shutdown_connections 2026-02-12T03:58:46.085 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fb07741f640 1 -- 10.20.193.91:0/3514197820 >> 10.20.193.91:0/3514197820 conn(0x7fb0700559c0 msgr2=0x7fb070055dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:46.085 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fb07741f640 1 -- 10.20.193.91:0/3514197820 shutdown_connections 2026-02-12T03:58:46.085 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fb07741f640 1 -- 10.20.193.91:0/3514197820 wait complete. 2026-02-12T03:58:46.085 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fd47effd640 10 client.?.objecter ms_handle_connect 0x7fd4980b57a0 2026-02-12T03:58:46.085 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fd47effd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.085 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fa5c1044640 10 monclient: shutdown 2026-02-12T03:58:46.085 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fa5c1044640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:46.085 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fa5c1044640 1 -- 10.20.193.91:0/2891735911 >> v1:10.20.193.91:6789/0 conn(0x7fa5bc0b57a0 legacy=0x7fa5bc0b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.085 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fa5c1044640 1 -- 10.20.193.91:0/2891735911 shutdown_connections 2026-02-12T03:58:46.085 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fa5c1044640 1 -- 10.20.193.91:0/2891735911 >> 10.20.193.91:0/2891735911 conn(0x7fa5bc0559c0 msgr2=0x7fa5bc055dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:46.085 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.049+0000 7fb07741f640 10 monclient: build_initial_monmap 2026-02-12T03:58:46.085 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.049+0000 7fb07741f640 10 monclient: monmap: 2026-02-12T03:58:46.085 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:46.086 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:46.086 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:46.086 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:46.086 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:46.086 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:46.086 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:46.086 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:46.086 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:46.086 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.086 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7f717dffb640 1 -- 10.20.193.91:0/3447493771 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2990286647 0 0) 0x7f7160003610 con 0x7f719005d180 2026-02-12T03:58:46.086 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7f717dffb640 1 -- 10.20.193.91:0/3447493771 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f719011c500 con 0x7f719005d180 2026-02-12T03:58:46.086 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.049+0000 7f717dffb640 1 -- 10.20.193.91:0/3447493771 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f7180003310 con 0x7f719005d180 2026-02-12T03:58:46.086 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.049+0000 7f717dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:46.086 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.049+0000 7f717dffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:46.086 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.049+0000 7f717dffb640 10 monclient(hunting): dump: 2026-02-12T03:58:46.086 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.086 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.086 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.086 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.086 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.086 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.086 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.086 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.086 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.086 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.086 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.048+0000 7fa5c1044640 1 -- 10.20.193.91:0/2891735911 shutdown_connections 2026-02-12T03:58:46.086 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.049+0000 7fa5c1044640 1 -- 10.20.193.91:0/2891735911 wait complete. 2026-02-12T03:58:46.086 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.049+0000 7fa5c1044640 10 monclient: build_initial_monmap 2026-02-12T03:58:46.086 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.049+0000 7fa5c1044640 10 monclient: monmap: 2026-02-12T03:58:46.086 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:46.086 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:46.086 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:46.086 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:46.086 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:46.086 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:46.086 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:46.087 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:46.087 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:46.087 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.087 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.049+0000 7fb07741f640 1 librados: starting msgr at 2026-02-12T03:58:46.087 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.049+0000 7fb07741f640 1 librados: starting objecter 2026-02-12T03:58:46.087 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.049+0000 7fb07741f640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:46.087 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.049+0000 7fb07741f640 1 Processor -- start 2026-02-12T03:58:46.087 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.049+0000 7fa5c1044640 1 librados: starting msgr at 2026-02-12T03:58:46.087 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.049+0000 7fa5c1044640 1 librados: starting objecter 2026-02-12T03:58:46.087 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.049+0000 7fa5c1044640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:46.087 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.049+0000 7fa5c1044640 1 Processor -- start 2026-02-12T03:58:46.087 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.049+0000 7fd7d979a640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7fd7d415d740 0x7fd7d42030b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:59562/0 (socket says 10.20.193.91:59562) 2026-02-12T03:58:46.087 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.049+0000 7fd7d979a640 1 -- 10.20.193.91:0/1283175197 learned_addr learned my addr 10.20.193.91:0/1283175197 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:46.087 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.049+0000 7fb07741f640 1 -- start start 2026-02-12T03:58:46.087 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.049+0000 7fb07741f640 1 librados: setting wanted keys 2026-02-12T03:58:46.087 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.049+0000 7fb07741f640 1 librados: calling monclient init 2026-02-12T03:58:46.087 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.049+0000 7fb07741f640 10 monclient: init 2026-02-12T03:58:46.088 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.049+0000 7fa5c1044640 1 -- start start 2026-02-12T03:58:46.088 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.049+0000 7fa5c1044640 1 librados: setting wanted keys 2026-02-12T03:58:46.088 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.049+0000 7fa5c1044640 1 librados: calling monclient init 2026-02-12T03:58:46.088 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.049+0000 7fa5c1044640 10 monclient: init 2026-02-12T03:58:46.088 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fa5c1044640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:46.088 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fa5c1044640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T03:58:46.088 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fa5c1044640 10 monclient(hunting): picked mon.noname-b con 0x7fa5bc0b57a0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:46.088 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fb07741f640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:46.088 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fb07741f640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T03:58:46.088 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fa5c1044640 10 monclient(hunting): picked mon.noname-c con 0x7fa5bc0b5b70 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:46.088 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fa5c1044640 10 monclient(hunting): picked mon.noname-a con 0x7fa5bc0b7180 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:46.088 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fb07741f640 10 monclient(hunting): picked mon.noname-c con 0x7fb0700b57a0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:46.088 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fa5c1044640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5bc120140 con 0x7fa5bc0b7180 2026-02-12T03:58:46.088 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fa5c1044640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5bc120420 con 0x7fa5bc0b57a0 2026-02-12T03:58:46.088 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fb07741f640 10 monclient(hunting): picked mon.noname-a con 0x7fb0700b5b70 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:46.088 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fb07741f640 10 monclient(hunting): picked mon.noname-b con 0x7fb0700b7180 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:46.088 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fa5c1044640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5bc120700 con 0x7fa5bc0b5b70 2026-02-12T03:58:46.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fb07741f640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb070133f10 con 0x7fb0700b5b70 2026-02-12T03:58:46.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fa5c1044640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:46.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fa5c1044640 10 monclient(hunting): authenticate will time out at 1128.793572s 2026-02-12T03:58:46.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fb07741f640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0701341f0 con 0x7fb0700b7180 2026-02-12T03:58:46.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fd6e77fe640 1 -- 10.20.193.91:0/109502485 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1379690825 0 0) 0x7fd6f0163f30 con 0x7fd6f00b7180 2026-02-12T03:58:46.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fd6e77fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fd6e77fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fd6e77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fd6e77fe640 10 monclient(hunting): my global_id is 4536 2026-02-12T03:58:46.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fd6e77fe640 1 -- 10.20.193.91:0/109502485 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6f00b63c0 con 0x7fd6f00b7180 2026-02-12T03:58:46.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fb07741f640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0701344d0 con 0x7fb0700b57a0 2026-02-12T03:58:46.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fb07741f640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:46.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fb07741f640 10 monclient(hunting): authenticate will time out at 1128.793628s 2026-02-12T03:58:46.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fd6e77fe640 1 -- 10.20.193.91:0/109502485 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3449899986 0 0) 0x7fd6dc003610 con 0x7fd6f00b57a0 2026-02-12T03:58:46.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fd6e77fe640 1 -- 10.20.193.91:0/109502485 >> v1:10.20.193.98:6789/0 conn(0x7fd6f00b5b70 legacy=0x7fd6f01633b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fd6e77fe640 1 -- 10.20.193.91:0/109502485 >> v1:10.20.193.91:6789/0 conn(0x7fd6f00b7180 legacy=0x7fd6f00565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fd6e77fe640 10 monclient: _finish_hunting 0 2026-02-12T03:58:46.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fd6e77fe640 1 monclient: found mon.noname-c 2026-02-12T03:58:46.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fd6e77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:46.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fd6e77fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.111:6789/0 2026-02-12T03:58:46.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fd6e77fe640 1 -- 10.20.193.91:0/109502485 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f00b6980 con 0x7fd6f00b57a0 2026-02-12T03:58:46.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fd6e77fe640 10 monclient: _finish_auth 0 2026-02-12T03:58:46.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fd6e77fe640 10 monclient: _check_auth_tickets 2026-02-12T03:58:46.090 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fd6e77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:46.090 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fd6e77fe640 1 -- 10.20.193.91:0/109502485 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd6e0002df0 con 0x7fd6f00b57a0 2026-02-12T03:58:46.090 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fd6e77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.090 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fd6e77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:46.090 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fd6e77fe640 10 monclient: dump: 2026-02-12T03:58:46.090 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.090 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.090 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.090 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.090 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.090 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.090 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.090 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.090 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.090 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.090 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fd6f70ec640 5 monclient: authenticate success, global_id 4496 2026-02-12T03:58:46.090 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.050+0000 7fd6f70ec640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:46.090 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.051+0000 7fd7c97fa640 10 client.?.objecter ms_handle_connect 0x7fd7d415d740 2026-02-12T03:58:46.090 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.051+0000 7fd7c97fa640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.090 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.051+0000 7f6feaffd640 1 -- 10.20.193.91:0/8385487 <== mon.2 v1:10.20.193.111:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6fd8002fe0 con 0x7f6fec0b57a0 2026-02-12T03:58:46.090 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.051+0000 7f6feaffd640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:46.090 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.051+0000 7f6ff24a2640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:46.090 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.051+0000 7f6ff24a2640 4 set_mon_vals no callback set 2026-02-12T03:58:46.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.051+0000 7f6feaffd640 1 -- 10.20.193.91:0/8385487 <== mon.2 v1:10.20.193.111:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f6fd80033e0 con 0x7f6fec0b57a0 2026-02-12T03:58:46.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.051+0000 7f6feaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.051+0000 7f6feaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:46.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.051+0000 7f6feaffd640 10 monclient: dump: 2026-02-12T03:58:46.091 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.091 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.091 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.091 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.091 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.091 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.091 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.091 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.091 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.091 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.051+0000 7f6ff24a2640 10 monclient: shutdown 2026-02-12T03:58:46.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.051+0000 7f6ff24a2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:46.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.051+0000 7f6ff24a2640 1 -- 10.20.193.91:0/8385487 >> v1:10.20.193.111:6789/0 conn(0x7f6fec0b57a0 legacy=0x7f6fec0b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7f6ff24a2640 1 -- 10.20.193.91:0/8385487 shutdown_connections 2026-02-12T03:58:46.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7f6ff24a2640 1 -- 10.20.193.91:0/8385487 >> 10.20.193.91:0/8385487 conn(0x7f6fec0559c0 msgr2=0x7f6fec055dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:46.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7f6ff24a2640 1 -- 10.20.193.91:0/8385487 shutdown_connections 2026-02-12T03:58:46.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7f6ff24a2640 1 -- 10.20.193.91:0/8385487 wait complete. 2026-02-12T03:58:46.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7fafe67fc640 1 -- 10.20.193.91:0/3045807994 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2694616231 0 0) 0x7fafc8003610 con 0x7faff8161ad0 2026-02-12T03:58:46.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7fafe67fc640 1 -- 10.20.193.91:0/3045807994 >> v1:10.20.193.111:6789/0 conn(0x7faff80564d0 legacy=0x7faff81ffe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7fafe67fc640 1 -- 10.20.193.91:0/3045807994 >> v1:10.20.193.98:6789/0 conn(0x7faff8167e90 legacy=0x7faff81380d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7fafe67fc640 10 monclient: _finish_hunting 0 2026-02-12T03:58:46.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7fafe67fc640 1 monclient: found mon.a 2026-02-12T03:58:46.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7fafe67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:46.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7fafe67fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:46.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7fafe67fc640 1 -- 10.20.193.91:0/3045807994 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faff81394f0 con 0x7faff8161ad0 2026-02-12T03:58:46.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7fafe67fc640 10 monclient: _finish_auth 0 2026-02-12T03:58:46.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7fafe67fc640 10 monclient: _check_auth_tickets 2026-02-12T03:58:46.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7fafe67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:46.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7faffffdf640 5 monclient: authenticate success, global_id 4515 2026-02-12T03:58:46.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7faffffdf640 10 monclient: _renew_subs 2026-02-12T03:58:46.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7faffffdf640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:46.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7faffffdf640 1 -- 10.20.193.91:0/3045807994 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7faff81397d0 con 0x7faff8161ad0 2026-02-12T03:58:46.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7faffffdf640 10 client.4515.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:46.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7faffffdf640 10 monclient: _renew_subs 2026-02-12T03:58:46.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7faffffdf640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:46.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7faffffdf640 1 -- 10.20.193.91:0/3045807994 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7faff81387e0 con 0x7faff8161ad0 2026-02-12T03:58:46.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7faffffdf640 1 librados: init done 2026-02-12T03:58:46.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7f6ff24a2640 10 monclient: build_initial_monmap 2026-02-12T03:58:46.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7f6ff24a2640 10 monclient: monmap: 2026-02-12T03:58:46.092 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:46.092 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:46.092 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:46.092 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:46.092 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:46.092 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:46.092 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:46.092 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:46.092 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:46.092 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7fb621573640 1 -- 10.20.193.91:0/2979198272 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2702420127 0 0) 0x7fb624163320 con 0x7fb62415e900 2026-02-12T03:58:46.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7fb621573640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7fb621573640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7fb621573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7fb621573640 10 monclient(hunting): my global_id is 4542 2026-02-12T03:58:46.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7fb621573640 1 -- 10.20.193.91:0/2979198272 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb624164030 con 0x7fb62415e900 2026-02-12T03:58:46.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7f6ff24a2640 1 librados: starting msgr at 2026-02-12T03:58:46.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7f6ff24a2640 1 librados: starting objecter 2026-02-12T03:58:46.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7f8c0d4db640 1 -- 10.20.193.91:0/2878119928 <== mon.2 v1:10.20.193.111:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8c04003380 con 0x7f8c080b5b70 2026-02-12T03:58:46.093 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7f8c0d4db640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:46.093 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7f66a3fff640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f66ac0b5b70 0x7f66ac131080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:59574/0 (socket says 10.20.193.91:59574) 2026-02-12T03:58:46.093 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7f66a3fff640 1 -- 10.20.193.91:0/4196024287 learned_addr learned my addr 10.20.193.91:0/4196024287 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:46.093 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7f8c0d4db640 1 -- 10.20.193.91:0/2878119928 <== mon.2 v1:10.20.193.111:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8c040037c0 con 0x7f8c080b5b70 2026-02-12T03:58:46.093 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7f8c0d4db640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.093 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7f8c0d4db640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:46.093 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7f8c0d4db640 10 monclient: dump: 2026-02-12T03:58:46.093 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.093 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.093 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.093 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.093 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.093 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.093 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.093 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.093 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.093 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.094 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7f8c10768640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:46.094 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.052+0000 7f8c10768640 4 set_mon_vals no callback set 2026-02-12T03:58:46.094 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.053+0000 7f6ff24a2640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:46.094 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.053+0000 7f6ff24a2640 1 Processor -- start 2026-02-12T03:58:46.094 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.053+0000 7faffffdf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.094 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.053+0000 7faffffdf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.094 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.053+0000 7faffffdf640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:46.094 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.053+0000 7faffffdf640 1 -- 10.20.193.91:0/3045807994 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faff80b17b0 con 0x7faff8161ad0 2026-02-12T03:58:46.094 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.053+0000 7f8c10768640 10 monclient: shutdown 2026-02-12T03:58:46.094 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.053+0000 7f8c10768640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:46.094 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.053+0000 7f8c10768640 1 -- 10.20.193.91:0/2878119928 >> v1:10.20.193.111:6789/0 conn(0x7f8c080b5b70 legacy=0x7f8c081633b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.053+0000 7f6ff24a2640 1 -- start start 2026-02-12T03:58:46.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.053+0000 7f6ff24a2640 1 librados: setting wanted keys 2026-02-12T03:58:46.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.053+0000 7f6ff24a2640 1 librados: calling monclient init 2026-02-12T03:58:46.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.053+0000 7f6ff24a2640 10 monclient: init 2026-02-12T03:58:46.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.053+0000 7fd47effd640 10 client.?.objecter ms_handle_connect 0x7fd4980b5b70 2026-02-12T03:58:46.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.053+0000 7fd47effd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.053+0000 7f66a17fa640 10 client.?.objecter ms_handle_connect 0x7f66ac0b5b70 2026-02-12T03:58:46.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.053+0000 7f66a17fa640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.053+0000 7f8c10768640 1 -- 10.20.193.91:0/2878119928 shutdown_connections 2026-02-12T03:58:46.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.053+0000 7f8c10768640 1 -- 10.20.193.91:0/2878119928 >> 10.20.193.91:0/2878119928 conn(0x7f8c080559c0 msgr2=0x7f8c08055dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:46.096 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.053+0000 7f6ff24a2640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:46.096 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.053+0000 7f6ff24a2640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T03:58:46.096 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.053+0000 7f6ff24a2640 10 monclient(hunting): picked mon.noname-c con 0x7f6fec0b57a0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:46.096 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.053+0000 7f8c10768640 1 -- 10.20.193.91:0/2878119928 shutdown_connections 2026-02-12T03:58:46.096 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.054+0000 7f8c10768640 1 -- 10.20.193.91:0/2878119928 wait complete. 2026-02-12T03:58:46.097 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.054+0000 7f6ff24a2640 10 monclient(hunting): picked mon.noname-a con 0x7f6fec0b5b70 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:46.097 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.054+0000 7f6ff24a2640 10 monclient(hunting): picked mon.noname-b con 0x7f6fec0b7180 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:46.097 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.054+0000 7f6ff24a2640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fec153b40 con 0x7f6fec0b5b70 2026-02-12T03:58:46.097 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.054+0000 7f6ff24a2640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fec15dd40 con 0x7f6fec0b7180 2026-02-12T03:58:46.097 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.054+0000 7f6ff24a2640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fec15e020 con 0x7f6fec0b57a0 2026-02-12T03:58:46.097 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.054+0000 7f6ff24a2640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:46.097 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.054+0000 7f6ff24a2640 10 monclient(hunting): authenticate will time out at 1128.797147s 2026-02-12T03:58:46.098 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.054+0000 7f8c10768640 10 monclient: build_initial_monmap 2026-02-12T03:58:46.098 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.054+0000 7f8c10768640 10 monclient: monmap: 2026-02-12T03:58:46.098 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:46.098 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:46.098 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:46.098 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:46.098 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:46.098 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:46.098 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:46.098 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:46.098 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:46.098 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.098 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.054+0000 7f8c10768640 1 librados: starting msgr at 2026-02-12T03:58:46.098 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.054+0000 7f8c10768640 1 librados: starting objecter 2026-02-12T03:58:46.098 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.054+0000 7f8c10768640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:46.098 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.055+0000 7f8c10768640 1 Processor -- start 2026-02-12T03:58:46.098 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.055+0000 7f8c10768640 1 -- start start 2026-02-12T03:58:46.098 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.055+0000 7f8c10768640 1 librados: setting wanted keys 2026-02-12T03:58:46.098 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.055+0000 7f8c10768640 1 librados: calling monclient init 2026-02-12T03:58:46.099 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.055+0000 7f8c10768640 10 monclient: init 2026-02-12T03:58:46.099 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.055+0000 7f8c10768640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:46.099 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.055+0000 7f8c10768640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T03:58:46.099 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.055+0000 7f8c10768640 10 monclient(hunting): picked mon.noname-a con 0x7f8c080b57a0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:46.099 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.055+0000 7f8c10768640 10 monclient(hunting): picked mon.noname-b con 0x7f8c080b5b70 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:46.099 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.055+0000 7f8c10768640 10 monclient(hunting): picked mon.noname-c con 0x7f8c080b7180 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:46.099 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.055+0000 7f8c10768640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c0812a010 con 0x7f8c080b57a0 2026-02-12T03:58:46.099 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.055+0000 7f8c10768640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c08162c40 con 0x7f8c080b5b70 2026-02-12T03:58:46.099 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.055+0000 7f8c10768640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c08137600 con 0x7f8c080b7180 2026-02-12T03:58:46.099 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.055+0000 7f8c10768640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:46.099 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.055+0000 7f8c10768640 10 monclient(hunting): authenticate will time out at 1128.798881s 2026-02-12T03:58:46.099 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.056+0000 7f924117a640 1 -- 10.20.193.91:0/1354613179 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1390121706 0 0) 0x7f923c163f30 con 0x7f923c0b5b70 2026-02-12T03:58:46.099 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.056+0000 7f924117a640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.099 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.056+0000 7f924117a640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.099 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.056+0000 7f924117a640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.099 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.056+0000 7f924117a640 10 monclient(hunting): my global_id is 4548 2026-02-12T03:58:46.099 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.056+0000 7f924117a640 1 -- 10.20.193.91:0/1354613179 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f923c0b63c0 con 0x7f923c0b5b70 2026-02-12T03:58:46.100 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.056+0000 7fd47effd640 1 -- 10.20.193.91:0/1771820188 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3297885213 0 0) 0x7fd498155d80 con 0x7fd4980b57a0 2026-02-12T03:58:46.100 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.056+0000 7fd47effd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.100 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.056+0000 7fd47effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.100 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.056+0000 7fd47effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.100 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.056+0000 7fd47effd640 10 monclient(hunting): my global_id is 4551 2026-02-12T03:58:46.100 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.056+0000 7fd47effd640 1 -- 10.20.193.91:0/1771820188 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd464003610 con 0x7fd4980b57a0 2026-02-12T03:58:46.100 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7f0abd573640 1 -- 10.20.193.91:0/2133286447 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0ab4003000 con 0x7f0ac00b57a0 2026-02-12T03:58:46.100 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7f0abd573640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:46.100 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7f0abd573640 1 -- 10.20.193.91:0/2133286447 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f0ab4003440 con 0x7f0ac00b57a0 2026-02-12T03:58:46.100 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7f0abd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.100 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7f0abd573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:46.101 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7f0abd573640 10 monclient: dump: 2026-02-12T03:58:46.101 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.101 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.101 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.101 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.101 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.101 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.101 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.101 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.101 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.101 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.101 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7f0ac4dbb640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:46.101 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7f0ac4dbb640 4 set_mon_vals no callback set 2026-02-12T03:58:46.101 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7fd7c97fa640 1 -- 10.20.193.91:0/1283175197 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2081562960 0 0) 0x7fd7d40ae500 con 0x7fd7d415d740 2026-02-12T03:58:46.101 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7fd7c97fa640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.101 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7fd7c97fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.101 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7fd7c97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.102 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7fd7c97fa640 10 monclient(hunting): my global_id is 4557 2026-02-12T03:58:46.102 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7fd7c97fa640 1 -- 10.20.193.91:0/1283175197 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7a4003610 con 0x7fd7d415d740 2026-02-12T03:58:46.102 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7fd4bf7fe640 1 -- 10.20.193.91:0/876055338 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3396117921 0 0) 0x7fd4e0058f90 con 0x7fd4e00560d0 2026-02-12T03:58:46.102 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7fd4bf7fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.102 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7fd4bf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.102 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7fd4bf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.102 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7fd4bf7fe640 10 monclient(hunting): my global_id is 4543 2026-02-12T03:58:46.102 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7fd4bf7fe640 1 -- 10.20.193.91:0/876055338 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4ac003610 con 0x7fd4e00560d0 2026-02-12T03:58:46.103 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7f717dffb640 1 -- 10.20.193.91:0/3447493771 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3606833843 0 0) 0x7f7190135d70 con 0x7f71901599b0 2026-02-12T03:58:46.103 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7f717dffb640 1 -- 10.20.193.91:0/3447493771 >> v1:10.20.193.111:6789/0 conn(0x7f7190166580 legacy=0x7f7190136830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.103 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7f717dffb640 1 -- 10.20.193.91:0/3447493771 >> v1:10.20.193.98:6789/0 conn(0x7f719005d180 legacy=0x7f7190133f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.103 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7f0ac4dbb640 10 monclient: shutdown 2026-02-12T03:58:46.103 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7f0ac4dbb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:46.103 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7f0ac4dbb640 1 -- 10.20.193.91:0/2133286447 >> v1:10.20.193.98:6789/0 conn(0x7f0ac00b57a0 legacy=0x7f0ac00b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.103 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7f717dffb640 10 monclient: _finish_hunting 0 2026-02-12T03:58:46.103 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7f717dffb640 1 monclient: found mon.a 2026-02-12T03:58:46.103 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7f717dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:46.103 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7f717dffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:46.103 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7f717dffb640 1 -- 10.20.193.91:0/3447493771 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7190136050 con 0x7f71901599b0 2026-02-12T03:58:46.103 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7f717dffb640 10 monclient: _finish_auth 0 2026-02-12T03:58:46.104 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7f717dffb640 10 monclient: _check_auth_tickets 2026-02-12T03:58:46.104 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7f717dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:46.104 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7f719750a640 5 monclient: authenticate success, global_id 4533 2026-02-12T03:58:46.104 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7f719750a640 10 monclient: _renew_subs 2026-02-12T03:58:46.104 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7f719750a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:46.104 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7f719750a640 1 -- 10.20.193.91:0/3447493771 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7190136330 con 0x7f71901599b0 2026-02-12T03:58:46.104 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7f719750a640 10 client.4533.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:46.104 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7f719750a640 10 monclient: _renew_subs 2026-02-12T03:58:46.104 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7f719750a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:46.104 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7f719750a640 1 -- 10.20.193.91:0/3447493771 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7190136f40 con 0x7f71901599b0 2026-02-12T03:58:46.104 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7f719750a640 1 librados: init done 2026-02-12T03:58:46.104 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7fd4bf7fe640 1 -- 10.20.193.91:0/876055338 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3799383682 0 0) 0x7fd4e01489b0 con 0x7fd4e01575d0 2026-02-12T03:58:46.104 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7fd4bf7fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.104 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7fd4bf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.104 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7fd4bf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7fd4bf7fe640 10 monclient(hunting): my global_id is 4554 2026-02-12T03:58:46.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7fd4bf7fe640 1 -- 10.20.193.91:0/876055338 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4e0058f90 con 0x7fd4e01575d0 2026-02-12T03:58:46.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7f0ac4dbb640 1 -- 10.20.193.91:0/2133286447 shutdown_connections 2026-02-12T03:58:46.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7f0ac4dbb640 1 -- 10.20.193.91:0/2133286447 >> 10.20.193.91:0/2133286447 conn(0x7f0ac00559c0 msgr2=0x7f0ac0055dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:46.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7f0ac4dbb640 1 -- 10.20.193.91:0/2133286447 shutdown_connections 2026-02-12T03:58:46.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.057+0000 7f0ac4dbb640 1 -- 10.20.193.91:0/2133286447 wait complete. 2026-02-12T03:58:46.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.058+0000 7fd7c97fa640 10 client.?.objecter ms_handle_connect 0x7fd7d40b8090 2026-02-12T03:58:46.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.058+0000 7fd7c97fa640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.058+0000 7fd47effd640 10 client.?.objecter ms_handle_connect 0x7fd4980b7180 2026-02-12T03:58:46.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.058+0000 7fd47effd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.106 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.058+0000 7f6feb7fe640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f6fec0b5b70 0x7f6fec057450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:59596/0 (socket says 10.20.193.91:59596) 2026-02-12T03:58:46.106 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.058+0000 7f6feb7fe640 1 -- 10.20.193.91:0/2303746013 learned_addr learned my addr 10.20.193.91:0/2303746013 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:46.106 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.058+0000 7f719750a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.106 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.058+0000 7f719750a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.106 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.058+0000 7f719750a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:46.106 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.058+0000 7f719750a640 1 -- 10.20.193.91:0/3447493771 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71901676d0 con 0x7f71901599b0 2026-02-12T03:58:46.106 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.058+0000 7f924117a640 1 -- 10.20.193.91:0/1354613179 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 689629038 0 0) 0x7f923c0b66a0 con 0x7f923c0b57a0 2026-02-12T03:58:46.106 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.058+0000 7f924117a640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.106 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.058+0000 7f924117a640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.106 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.058+0000 7f924117a640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.106 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.058+0000 7f924117a640 10 monclient(hunting): my global_id is 4502 2026-02-12T03:58:46.106 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.058+0000 7f924117a640 1 -- 10.20.193.91:0/1354613179 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f923c163f30 con 0x7f923c0b57a0 2026-02-12T03:58:46.107 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.058+0000 7f0ac4dbb640 10 monclient: build_initial_monmap 2026-02-12T03:58:46.107 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.058+0000 7f0ac4dbb640 10 monclient: monmap: 2026-02-12T03:58:46.107 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:46.107 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:46.107 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:46.107 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:46.107 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:46.107 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:46.107 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:46.107 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:46.107 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:46.107 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.107 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.058+0000 7f0ac4dbb640 1 librados: starting msgr at 2026-02-12T03:58:46.107 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.058+0000 7f0ac4dbb640 1 librados: starting objecter 2026-02-12T03:58:46.107 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.058+0000 7f0ac4dbb640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:46.107 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.058+0000 7f0ac4dbb640 1 Processor -- start 2026-02-12T03:58:46.107 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.058+0000 7f0ac4dbb640 1 -- start start 2026-02-12T03:58:46.108 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.058+0000 7f0ac4dbb640 1 librados: setting wanted keys 2026-02-12T03:58:46.108 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.058+0000 7f0ac4dbb640 1 librados: calling monclient init 2026-02-12T03:58:46.108 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.058+0000 7f0ac4dbb640 10 monclient: init 2026-02-12T03:58:46.108 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.059+0000 7f66a17fa640 10 client.?.objecter ms_handle_connect 0x7f66ac0b57a0 2026-02-12T03:58:46.108 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.059+0000 7f66a17fa640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.108 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.059+0000 7f0ac4dbb640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:46.108 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.059+0000 7fd7c97fa640 10 client.?.objecter ms_handle_connect 0x7fd7d40b5480 2026-02-12T03:58:46.108 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.059+0000 7fd7c97fa640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.109 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.059+0000 7f0ac4dbb640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T03:58:46.109 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.059+0000 7f0ac4dbb640 10 monclient(hunting): picked mon.noname-a con 0x7f0ac00b57a0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:46.109 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.059+0000 7f0ac4dbb640 10 monclient(hunting): picked mon.noname-c con 0x7f0ac00b5b70 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:46.109 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.059+0000 7f0ac4dbb640 10 monclient(hunting): picked mon.noname-b con 0x7f0ac00b7180 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:46.109 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.059+0000 7f0ac4dbb640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ac0135b80 con 0x7f0ac00b57a0 2026-02-12T03:58:46.109 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.059+0000 7f0ac4dbb640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ac0135e60 con 0x7f0ac00b7180 2026-02-12T03:58:46.109 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.059+0000 7f0ac4dbb640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ac0136140 con 0x7f0ac00b5b70 2026-02-12T03:58:46.109 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.059+0000 7f0ac4dbb640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:46.109 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.059+0000 7f0ac4dbb640 10 monclient(hunting): authenticate will time out at 1128.802099s 2026-02-12T03:58:46.109 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.060+0000 7f924117a640 1 -- 10.20.193.91:0/1354613179 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3837663496 0 0) 0x7f9224003610 con 0x7f923c0b7180 2026-02-12T03:58:46.109 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.060+0000 7f924117a640 1 -- 10.20.193.91:0/1354613179 >> v1:10.20.193.111:6789/0 conn(0x7f923c0b57a0 legacy=0x7f923c0b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.109 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.060+0000 7f924117a640 1 -- 10.20.193.91:0/1354613179 >> v1:10.20.193.91:6789/0 conn(0x7f923c0b5b70 legacy=0x7f923c1633b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.109 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.060+0000 7f924117a640 10 monclient: _finish_hunting 0 2026-02-12T03:58:46.109 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.060+0000 7f924117a640 1 monclient: found mon.noname-b 2026-02-12T03:58:46.109 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.060+0000 7f924117a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:46.110 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.060+0000 7f924117a640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T03:58:46.110 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.060+0000 7f924117a640 1 -- 10.20.193.91:0/1354613179 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f923c0b6980 con 0x7f923c0b7180 2026-02-12T03:58:46.110 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.060+0000 7f924117a640 10 monclient: _finish_auth 0 2026-02-12T03:58:46.110 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.060+0000 7f924117a640 10 monclient: _check_auth_tickets 2026-02-12T03:58:46.110 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.060+0000 7f924117a640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:46.110 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.060+0000 7f924117a640 1 -- 10.20.193.91:0/1354613179 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f9230002df0 con 0x7f923c0b7180 2026-02-12T03:58:46.110 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.060+0000 7f924117a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.110 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.060+0000 7f924117a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:46.110 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.060+0000 7f924117a640 10 monclient: dump: 2026-02-12T03:58:46.110 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.110 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.110 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.110 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.110 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.110 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.110 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.110 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.110 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.110 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.110 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.060+0000 7f9244407640 5 monclient: authenticate success, global_id 4531 2026-02-12T03:58:46.110 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.060+0000 7f9244407640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:46.111 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.060+0000 7fd4bf7fe640 1 -- 10.20.193.91:0/876055338 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1655145372 0 0) 0x7fd4e0059270 con 0x7fd4e0163310 2026-02-12T03:58:46.111 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.060+0000 7fd4bf7fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.111 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.060+0000 7fd4bf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.111 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.060+0000 7fd4bf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.111 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.060+0000 7fd4bf7fe640 10 monclient(hunting): my global_id is 4505 2026-02-12T03:58:46.111 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.060+0000 7fd4bf7fe640 1 -- 10.20.193.91:0/876055338 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4e01489b0 con 0x7fd4e0163310 2026-02-12T03:58:46.111 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.061+0000 7fd47effd640 1 -- 10.20.193.91:0/1771820188 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1558091891 0 0) 0x7fd498161a60 con 0x7fd4980b5b70 2026-02-12T03:58:46.111 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.061+0000 7fd47effd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.111 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.061+0000 7fd47effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.111 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.061+0000 7fd47effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.111 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.061+0000 7fd47effd640 10 monclient(hunting): my global_id is 4546 2026-02-12T03:58:46.111 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.061+0000 7fd47effd640 1 -- 10.20.193.91:0/1771820188 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd498155d80 con 0x7fd4980b5b70 2026-02-12T03:58:46.111 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.062+0000 7fb075194640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7fb0700b57a0 0x7fb0701363e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:38054/0 (socket says 10.20.193.91:38054) 2026-02-12T03:58:46.112 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.062+0000 7fb075194640 1 -- 10.20.193.91:0/2633229468 learned_addr learned my addr 10.20.193.91:0/2633229468 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:46.112 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.063+0000 7fa6b3fff640 1 -- 10.20.193.91:0/211391712 <== mon.2 v1:10.20.193.111:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa6c0003380 con 0x7fa6c40b5b70 2026-02-12T03:58:46.112 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.063+0000 7fa6b3fff640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:46.112 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.063+0000 7fa6b3fff640 1 -- 10.20.193.91:0/211391712 <== mon.2 v1:10.20.193.111:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fa6c00037c0 con 0x7fa6c40b5b70 2026-02-12T03:58:46.112 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.063+0000 7fa6b3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.112 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.063+0000 7fa6b3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:46.112 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.063+0000 7fa6b3fff640 10 monclient: dump: 2026-02-12T03:58:46.112 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.112 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.112 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.112 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.112 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.112 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.112 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.112 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.113 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.113 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.113 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.063+0000 7fa6cba60640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:46.113 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.063+0000 7fa6cba60640 4 set_mon_vals no callback set 2026-02-12T03:58:46.113 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.063+0000 7f66a17fa640 10 client.?.objecter ms_handle_connect 0x7f66ac0b7180 2026-02-12T03:58:46.113 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.063+0000 7f66a17fa640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.113 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.063+0000 7fa5bad76640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7fa5bc0b57a0 0x7fa5bc1302b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:48760/0 (socket says 10.20.193.91:48760) 2026-02-12T03:58:46.113 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.063+0000 7fa5bad76640 1 -- 10.20.193.91:0/859043063 learned_addr learned my addr 10.20.193.91:0/859043063 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:46.113 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.063+0000 7fa6cba60640 10 monclient: shutdown 2026-02-12T03:58:46.114 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.063+0000 7fa6cba60640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:46.114 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.063+0000 7fa6cba60640 1 -- 10.20.193.91:0/211391712 >> v1:10.20.193.111:6789/0 conn(0x7fa6c40b5b70 legacy=0x7fa6c41633b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.114 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.063+0000 7fa6cba60640 1 -- 10.20.193.91:0/211391712 shutdown_connections 2026-02-12T03:58:46.114 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.063+0000 7fa6cba60640 1 -- 10.20.193.91:0/211391712 >> 10.20.193.91:0/211391712 conn(0x7fa6c40559c0 msgr2=0x7fa6c4055dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:46.114 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.063+0000 7fa6cba60640 1 -- 10.20.193.91:0/211391712 shutdown_connections 2026-02-12T03:58:46.114 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.063+0000 7fa6cba60640 1 -- 10.20.193.91:0/211391712 wait complete. 2026-02-12T03:58:46.114 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.063+0000 7fb05dffb640 10 client.?.objecter ms_handle_connect 0x7fb0700b57a0 2026-02-12T03:58:46.114 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.063+0000 7fb05dffb640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.114 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.064+0000 7fa6cba60640 10 monclient: build_initial_monmap 2026-02-12T03:58:46.114 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.064+0000 7fa6cba60640 10 monclient: monmap: 2026-02-12T03:58:46.114 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:46.114 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:46.114 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:46.114 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:46.114 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:46.115 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:46.115 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:46.115 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:46.115 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:46.115 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.115 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.064+0000 7fa59b7fe640 10 client.?.objecter ms_handle_connect 0x7fa5bc0b57a0 2026-02-12T03:58:46.115 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.064+0000 7fa59b7fe640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.115 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.064+0000 7fb621573640 1 -- 10.20.193.91:0/2979198272 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4275127195 0 0) 0x7fb624164310 con 0x7fb6240b3210 2026-02-12T03:58:46.115 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.064+0000 7fb621573640 1 -- 10.20.193.91:0/2979198272 >> v1:10.20.193.111:6789/0 conn(0x7fb62415e530 legacy=0x7fb624162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.115 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.064+0000 7fb621573640 1 -- 10.20.193.91:0/2979198272 >> v1:10.20.193.91:6789/0 conn(0x7fb62415e900 legacy=0x7fb624162c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.115 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.064+0000 7fb621573640 10 monclient: _finish_hunting 0 2026-02-12T03:58:46.115 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.064+0000 7fb621573640 1 monclient: found mon.noname-b 2026-02-12T03:58:46.115 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.064+0000 7fb621573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:46.116 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.064+0000 7fb621573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T03:58:46.116 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.064+0000 7fb621573640 1 -- 10.20.193.91:0/2979198272 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6241648c0 con 0x7fb6240b3210 2026-02-12T03:58:46.116 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.064+0000 7fb621573640 10 monclient: _finish_auth 0 2026-02-12T03:58:46.116 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.064+0000 7fb621573640 10 monclient: _check_auth_tickets 2026-02-12T03:58:46.116 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.064+0000 7fb621573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:46.116 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.064+0000 7fb621573640 1 -- 10.20.193.91:0/2979198272 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fb614003170 con 0x7fb6240b3210 2026-02-12T03:58:46.116 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.064+0000 7fb621573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.116 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.064+0000 7fb621573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:46.116 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.064+0000 7fb621573640 10 monclient: dump: 2026-02-12T03:58:46.116 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.116 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.116 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.116 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.116 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.116 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.116 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.116 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.116 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.116 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.116 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.064+0000 7fb628eec640 5 monclient: authenticate success, global_id 4540 2026-02-12T03:58:46.117 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.064+0000 7fb628eec640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:46.117 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.064+0000 7fa6cba60640 1 librados: starting msgr at 2026-02-12T03:58:46.117 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.064+0000 7fa6cba60640 1 librados: starting objecter 2026-02-12T03:58:46.117 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.064+0000 7fa6cba60640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:46.117 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.064+0000 7fa6cba60640 1 Processor -- start 2026-02-12T03:58:46.117 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.064+0000 7fa6cba60640 1 -- start start 2026-02-12T03:58:46.117 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.064+0000 7fa6cba60640 1 librados: setting wanted keys 2026-02-12T03:58:46.117 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.064+0000 7fa6cba60640 1 librados: calling monclient init 2026-02-12T03:58:46.117 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.064+0000 7fa6cba60640 10 monclient: init 2026-02-12T03:58:46.117 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.065+0000 7fa59b7fe640 10 client.?.objecter ms_handle_connect 0x7fa5bc0b5b70 2026-02-12T03:58:46.117 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.065+0000 7fa59b7fe640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.118 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.065+0000 7fa6cba60640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:46.118 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.065+0000 7fa6cba60640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T03:58:46.118 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.065+0000 7fa6cba60640 10 monclient(hunting): picked mon.noname-b con 0x7fa6c40b57a0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:46.118 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.065+0000 7fa6cba60640 10 monclient(hunting): picked mon.noname-c con 0x7fa6c40b5b70 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:46.118 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.065+0000 7fa6cba60640 10 monclient(hunting): picked mon.noname-a con 0x7fa6c40b7180 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:46.118 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.065+0000 7fa6cba60640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6c4131580 con 0x7fa6c40b7180 2026-02-12T03:58:46.118 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.065+0000 7fa6cba60640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6c4131860 con 0x7fa6c40b57a0 2026-02-12T03:58:46.118 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.065+0000 7fa6cba60640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6c4131b40 con 0x7fa6c40b5b70 2026-02-12T03:58:46.118 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.065+0000 7fa6cba60640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:46.118 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.065+0000 7fa6cba60640 10 monclient(hunting): authenticate will time out at 1128.808105s 2026-02-12T03:58:46.118 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.065+0000 7fd6e77fe640 1 -- 10.20.193.91:0/109502485 <== mon.2 v1:10.20.193.111:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd6e0002fc0 con 0x7fd6f00b57a0 2026-02-12T03:58:46.118 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.065+0000 7fd6e77fe640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:46.119 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.065+0000 7fd6e77fe640 1 -- 10.20.193.91:0/109502485 <== mon.2 v1:10.20.193.111:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd6e0003400 con 0x7fd6f00b57a0 2026-02-12T03:58:46.119 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.065+0000 7fd6e77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.119 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.066+0000 7fd6e77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:46.119 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.066+0000 7fd6e77fe640 10 monclient: dump: 2026-02-12T03:58:46.119 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.119 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.119 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.119 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.119 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.119 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.119 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.119 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.119 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.119 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.119 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.066+0000 7fd6f70ec640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:46.119 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.066+0000 7fd6f70ec640 4 set_mon_vals no callback set 2026-02-12T03:58:46.119 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.066+0000 7f6fe8ff9640 10 client.?.objecter ms_handle_connect 0x7f6fec0b7180 2026-02-12T03:58:46.119 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.066+0000 7f6fe8ff9640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.120 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.066+0000 7fd6f70ec640 10 monclient: shutdown 2026-02-12T03:58:46.120 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.066+0000 7fd6f70ec640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:46.120 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.066+0000 7fd6f70ec640 1 -- 10.20.193.91:0/109502485 >> v1:10.20.193.111:6789/0 conn(0x7fd6f00b57a0 legacy=0x7fd6f00b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.120 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.066+0000 7fd6f70ec640 1 -- 10.20.193.91:0/109502485 shutdown_connections 2026-02-12T03:58:46.120 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.066+0000 7fd6f70ec640 1 -- 10.20.193.91:0/109502485 >> 10.20.193.91:0/109502485 conn(0x7fd6f00559c0 msgr2=0x7fd6f0055dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:46.120 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.066+0000 7fd6f70ec640 1 -- 10.20.193.91:0/109502485 shutdown_connections 2026-02-12T03:58:46.120 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.066+0000 7fd6f70ec640 1 -- 10.20.193.91:0/109502485 wait complete. 2026-02-12T03:58:46.120 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.067+0000 7fb05dffb640 10 client.?.objecter ms_handle_connect 0x7fb0700b7180 2026-02-12T03:58:46.120 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.067+0000 7fb05dffb640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.121 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.067+0000 7fd6f70ec640 10 monclient: build_initial_monmap 2026-02-12T03:58:46.121 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.067+0000 7fd6f70ec640 10 monclient: monmap: 2026-02-12T03:58:46.121 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:46.121 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:46.121 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:46.121 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:46.121 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:46.121 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:46.121 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:46.121 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:46.121 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:46.121 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.121 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.067+0000 7fd6f70ec640 1 librados: starting msgr at 2026-02-12T03:58:46.121 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.067+0000 7fd6f70ec640 1 librados: starting objecter 2026-02-12T03:58:46.121 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.067+0000 7fd6f70ec640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:46.121 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.067+0000 7fd6f70ec640 1 Processor -- start 2026-02-12T03:58:46.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.067+0000 7f66a17fa640 1 -- 10.20.193.91:0/4196024287 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3209408355 0 0) 0x7f66ac152700 con 0x7f66ac0b57a0 2026-02-12T03:58:46.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.067+0000 7f66a17fa640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.067+0000 7f66a17fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.067+0000 7f66a17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.067+0000 7f66a17fa640 10 monclient(hunting): my global_id is 4549 2026-02-12T03:58:46.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.067+0000 7f66a17fa640 1 -- 10.20.193.91:0/4196024287 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f667c003610 con 0x7f66ac0b57a0 2026-02-12T03:58:46.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.067+0000 7fd6f70ec640 1 -- start start 2026-02-12T03:58:46.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.067+0000 7fd6f70ec640 1 librados: setting wanted keys 2026-02-12T03:58:46.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.067+0000 7fd6f70ec640 1 librados: calling monclient init 2026-02-12T03:58:46.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.067+0000 7fd6f70ec640 10 monclient: init 2026-02-12T03:58:46.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7f1285523640 1 -- 10.20.193.91:0/639671653 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1274002fc0 con 0x7f1280166f70 2026-02-12T03:58:46.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7f1285523640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:46.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7f1285523640 1 -- 10.20.193.91:0/639671653 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f1274003400 con 0x7f1280166f70 2026-02-12T03:58:46.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7f1285523640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7f1285523640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:46.123 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7f1285523640 10 monclient: dump: 2026-02-12T03:58:46.123 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.123 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.123 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.123 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.123 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.123 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.123 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.123 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.123 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.123 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.123 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7f12887b0640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:46.123 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7f12887b0640 4 set_mon_vals no callback set 2026-02-12T03:58:46.124 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7fd6f70ec640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:46.124 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7fd6f70ec640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T03:58:46.124 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7fd6f70ec640 10 monclient(hunting): picked mon.noname-c con 0x7fd6f00b57a0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:46.124 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7fd6f70ec640 10 monclient(hunting): picked mon.noname-b con 0x7fd6f00b5b70 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:46.124 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7fd6f70ec640 10 monclient(hunting): picked mon.noname-a con 0x7fd6f00b7180 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:46.124 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7fd6f70ec640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6f011d0c0 con 0x7fd6f00b7180 2026-02-12T03:58:46.124 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7fd6f70ec640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6f011d360 con 0x7fd6f00b5b70 2026-02-12T03:58:46.124 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7fd6f70ec640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6f011d640 con 0x7fd6f00b57a0 2026-02-12T03:58:46.124 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7fd6f70ec640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:46.124 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7fd6f70ec640 10 monclient(hunting): authenticate will time out at 1128.811435s 2026-02-12T03:58:46.124 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7f12887b0640 10 monclient: shutdown 2026-02-12T03:58:46.124 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7f12887b0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:46.124 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7f12887b0640 1 -- 10.20.193.91:0/639671653 >> v1:10.20.193.98:6789/0 conn(0x7f1280166f70 legacy=0x7f12800563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.125 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7fd47effd640 1 -- 10.20.193.91:0/1771820188 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3370612448 0 0) 0x7fd498161d40 con 0x7fd4980b7180 2026-02-12T03:58:46.125 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7fd47effd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.125 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7fd47effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.125 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7fd47effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.125 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7fd47effd640 10 monclient(hunting): my global_id is 4511 2026-02-12T03:58:46.125 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7f12887b0640 1 -- 10.20.193.91:0/639671653 shutdown_connections 2026-02-12T03:58:46.125 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7fd47effd640 1 -- 10.20.193.91:0/1771820188 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd498161a60 con 0x7fd4980b7180 2026-02-12T03:58:46.125 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7f12887b0640 1 -- 10.20.193.91:0/639671653 >> 10.20.193.91:0/639671653 conn(0x7f12800bab20 msgr2=0x7f12800baf20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:46.125 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7f12887b0640 1 -- 10.20.193.91:0/639671653 shutdown_connections 2026-02-12T03:58:46.126 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7f12887b0640 1 -- 10.20.193.91:0/639671653 wait complete. 2026-02-12T03:58:46.126 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7fd4bf7fe640 1 -- 10.20.193.91:0/876055338 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3115071761 0 0) 0x7fd4ac003610 con 0x7fd4e00560d0 2026-02-12T03:58:46.126 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7fd4bf7fe640 1 -- 10.20.193.91:0/876055338 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd4e0059270 con 0x7fd4e00560d0 2026-02-12T03:58:46.126 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7fd4bf7fe640 1 -- 10.20.193.91:0/876055338 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd4d4003190 con 0x7fd4e00560d0 2026-02-12T03:58:46.126 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7fd4bf7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:46.126 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7fd4bf7fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:46.126 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7fd4bf7fe640 10 monclient(hunting): dump: 2026-02-12T03:58:46.126 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.126 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.126 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.126 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.126 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.126 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.126 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.126 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.127 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.127 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.127 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7fd4bf7fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:46.127 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7fd7c97fa640 1 -- 10.20.193.91:0/1283175197 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 837307392 0 0) 0x7fd7d42037c0 con 0x7fd7d40b5480 2026-02-12T03:58:46.127 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7fd7c97fa640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.127 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7fd7c97fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.127 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7fd7c97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.127 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7fd7c97fa640 10 monclient(hunting): my global_id is 4552 2026-02-12T03:58:46.127 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.068+0000 7fd7c97fa640 1 -- 10.20.193.91:0/1283175197 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7d40ae500 con 0x7fd7d40b5480 2026-02-12T03:58:46.127 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.069+0000 7fa59b7fe640 1 -- 10.20.193.91:0/859043063 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2925335205 0 0) 0x7fa5bc120700 con 0x7fa5bc0b5b70 2026-02-12T03:58:46.127 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.069+0000 7fa59b7fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.127 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.069+0000 7fa59b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.127 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.069+0000 7fa59b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.127 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.069+0000 7fa59b7fe640 10 monclient(hunting): my global_id is 4520 2026-02-12T03:58:46.128 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.069+0000 7fa59b7fe640 1 -- 10.20.193.91:0/859043063 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa588003610 con 0x7fa5bc0b5b70 2026-02-12T03:58:46.128 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.069+0000 7f12887b0640 10 monclient: build_initial_monmap 2026-02-12T03:58:46.128 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.069+0000 7f12887b0640 10 monclient: monmap: 2026-02-12T03:58:46.128 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:46.128 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:46.128 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:46.128 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:46.128 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:46.128 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:46.128 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:46.128 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:46.128 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:46.128 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.128 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.069+0000 7f0abed76640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f0ac00b7180 0x7f0ac0162ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:48800/0 (socket says 10.20.193.91:48800) 2026-02-12T03:58:46.128 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.069+0000 7f0abed76640 1 -- 10.20.193.91:0/3309826704 learned_addr learned my addr 10.20.193.91:0/3309826704 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:46.129 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.069+0000 7f12887b0640 1 librados: starting msgr at 2026-02-12T03:58:46.129 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.069+0000 7f12887b0640 1 librados: starting objecter 2026-02-12T03:58:46.129 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.069+0000 7f12887b0640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:46.129 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.069+0000 7f12887b0640 1 Processor -- start 2026-02-12T03:58:46.129 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.069+0000 7f12887b0640 1 -- start start 2026-02-12T03:58:46.129 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.069+0000 7f12887b0640 1 librados: setting wanted keys 2026-02-12T03:58:46.129 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.069+0000 7f12887b0640 1 librados: calling monclient init 2026-02-12T03:58:46.129 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.069+0000 7f12887b0640 10 monclient: init 2026-02-12T03:58:46.129 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.069+0000 7f8c0dcdc640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f8c080b5b70 0x7f8c08162530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:48792/0 (socket says 10.20.193.91:48792) 2026-02-12T03:58:46.130 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.069+0000 7f12887b0640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:46.130 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.069+0000 7f12887b0640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T03:58:46.130 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.069+0000 7f12887b0640 10 monclient(hunting): picked mon.noname-c con 0x7f1280159b70 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:46.130 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.069+0000 7f12887b0640 10 monclient(hunting): picked mon.noname-a con 0x7f1280164760 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:46.130 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.069+0000 7f12887b0640 10 monclient(hunting): picked mon.noname-b con 0x7f1280166f70 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:46.130 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.069+0000 7f12887b0640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f128012c4e0 con 0x7f1280164760 2026-02-12T03:58:46.130 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.069+0000 7f12887b0640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f128012b680 con 0x7f1280166f70 2026-02-12T03:58:46.130 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.069+0000 7f12887b0640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f128012b960 con 0x7f1280159b70 2026-02-12T03:58:46.130 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.069+0000 7f12887b0640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:46.130 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.069+0000 7f12887b0640 10 monclient(hunting): authenticate will time out at 1128.812931s 2026-02-12T03:58:46.130 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.069+0000 7f8c0dcdc640 1 -- 10.20.193.91:0/3055226452 learned_addr learned my addr 10.20.193.91:0/3055226452 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:46.130 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.070+0000 7f6fe8ff9640 1 -- 10.20.193.91:0/2303746013 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 754443431 0 0) 0x7f6fec15dd40 con 0x7f6fec0b7180 2026-02-12T03:58:46.130 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.070+0000 7f6fe8ff9640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.131 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.070+0000 7f6fe8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.131 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.070+0000 7f6fe8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.131 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.070+0000 7f6fe8ff9640 10 monclient(hunting): my global_id is 4558 2026-02-12T03:58:46.131 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.070+0000 7f6fe8ff9640 1 -- 10.20.193.91:0/2303746013 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fb8003610 con 0x7f6fec0b7180 2026-02-12T03:58:46.131 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.070+0000 7f8beeffd640 10 client.?.objecter ms_handle_connect 0x7f8c080b5b70 2026-02-12T03:58:46.131 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.070+0000 7f8beeffd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.131 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.070+0000 7fd7c97fa640 1 -- 10.20.193.91:0/1283175197 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2147817425 0 0) 0x7fd7d415f680 con 0x7fd7d40b8090 2026-02-12T03:58:46.131 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.070+0000 7fd7c97fa640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.131 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.070+0000 7fd7c97fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.131 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.070+0000 7fd7c97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.131 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.070+0000 7fd7c97fa640 10 monclient(hunting): my global_id is 4508 2026-02-12T03:58:46.131 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.070+0000 7fd7c97fa640 1 -- 10.20.193.91:0/1283175197 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7d42037c0 con 0x7fd7d40b8090 2026-02-12T03:58:46.132 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.070+0000 7f0aa6ffd640 10 client.?.objecter ms_handle_connect 0x7f0ac00b7180 2026-02-12T03:58:46.132 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.070+0000 7f0aa6ffd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.132 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.070+0000 7fb05dffb640 1 -- 10.20.193.91:0/2633229468 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3581973969 0 0) 0x7fb0701344d0 con 0x7fb0700b57a0 2026-02-12T03:58:46.132 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.070+0000 7fb05dffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.132 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.070+0000 7fb05dffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.132 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.070+0000 7fb05dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.132 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.070+0000 7fb05dffb640 10 monclient(hunting): my global_id is 4517 2026-02-12T03:58:46.132 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.070+0000 7fb05dffb640 1 -- 10.20.193.91:0/2633229468 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb040003610 con 0x7fb0700b57a0 2026-02-12T03:58:46.132 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.073+0000 7f0aa6ffd640 10 client.?.objecter ms_handle_connect 0x7f0ac00b5b70 2026-02-12T03:58:46.132 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.073+0000 7f0aa6ffd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.132 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.073+0000 7f6fe8ff9640 10 client.?.objecter ms_handle_connect 0x7f6fec0b57a0 2026-02-12T03:58:46.132 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.073+0000 7f6fe8ff9640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.133 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.073+0000 7f66a17fa640 1 -- 10.20.193.91:0/4196024287 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 959635857 0 0) 0x7f66ac1529e0 con 0x7f66ac0b7180 2026-02-12T03:58:46.133 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.073+0000 7f66a17fa640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.133 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.073+0000 7f66a17fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.133 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.073+0000 7f66a17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.133 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.073+0000 7f66a17fa640 10 monclient(hunting): my global_id is 4514 2026-02-12T03:58:46.133 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.073+0000 7f66a17fa640 1 -- 10.20.193.91:0/4196024287 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66ac152700 con 0x7f66ac0b7180 2026-02-12T03:58:46.133 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.074+0000 7f8beeffd640 10 client.?.objecter ms_handle_connect 0x7f8c080b7180 2026-02-12T03:58:46.133 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.074+0000 7f8beeffd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.133 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.075+0000 7f66a17fa640 1 -- 10.20.193.91:0/4196024287 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3702331647 0 0) 0x7f667c003610 con 0x7f66ac0b57a0 2026-02-12T03:58:46.133 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.075+0000 7f66a17fa640 1 -- 10.20.193.91:0/4196024287 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f66ac1529e0 con 0x7f66ac0b57a0 2026-02-12T03:58:46.134 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.075+0000 7f66a17fa640 1 -- 10.20.193.91:0/4196024287 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f669c003060 con 0x7f66ac0b57a0 2026-02-12T03:58:46.134 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.075+0000 7f66a17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:46.134 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.075+0000 7f66a17fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:46.134 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.075+0000 7f66a17fa640 10 monclient(hunting): dump: 2026-02-12T03:58:46.134 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.134 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.134 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.134 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.134 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.134 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.134 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.134 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.134 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.134 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.134 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.075+0000 7f66a17fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:46.134 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.075+0000 7fa6c8fd4640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7fa6c40b5b70 0x7fa6c415cde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:38104/0 (socket says 10.20.193.91:38104) 2026-02-12T03:58:46.134 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.075+0000 7fa6c8fd4640 1 -- 10.20.193.91:0/4031026666 learned_addr learned my addr 10.20.193.91:0/4031026666 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:46.135 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.076+0000 7fd4bf7fe640 1 -- 10.20.193.91:0/876055338 <== mon.1 v1:10.20.193.98:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1156420096 0 0) 0x7fd4e0059270 con 0x7fd4e00560d0 2026-02-12T03:58:46.135 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.076+0000 7fd4bf7fe640 1 -- 10.20.193.91:0/876055338 >> v1:10.20.193.111:6789/0 conn(0x7fd4e0163310 legacy=0x7fd4e0154df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.135 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.076+0000 7fd4bf7fe640 1 -- 10.20.193.91:0/876055338 >> v1:10.20.193.91:6789/0 conn(0x7fd4e01575d0 legacy=0x7fd4e0149170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.135 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.076+0000 7fd4bf7fe640 10 monclient: _finish_hunting 0 2026-02-12T03:58:46.135 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.076+0000 7fd4bf7fe640 1 monclient: found mon.b 2026-02-12T03:58:46.135 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.076+0000 7fd4bf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:46.135 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.076+0000 7fd4bf7fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:46.135 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.076+0000 7fd4bf7fe640 1 -- 10.20.193.91:0/876055338 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e0059550 con 0x7fd4e00560d0 2026-02-12T03:58:46.135 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.076+0000 7fd4bf7fe640 10 monclient: _finish_auth 0 2026-02-12T03:58:46.135 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.076+0000 7fd4bf7fe640 10 monclient: _check_auth_tickets 2026-02-12T03:58:46.136 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.076+0000 7fd4bf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:46.136 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.076+0000 7fd4e54d4640 5 monclient: authenticate success, global_id 4543 2026-02-12T03:58:46.136 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.076+0000 7fd4e54d4640 10 monclient: _renew_subs 2026-02-12T03:58:46.136 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.076+0000 7fd4e54d4640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:46.136 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.076+0000 7fd4e54d4640 1 -- 10.20.193.91:0/876055338 --> v1:10.20.193.98:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd4e0059830 con 0x7fd4e00560d0 2026-02-12T03:58:46.136 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.076+0000 7fd4e54d4640 10 client.4543.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:46.136 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.076+0000 7fd4e54d4640 10 monclient: _renew_subs 2026-02-12T03:58:46.136 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.076+0000 7fd4e54d4640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:46.136 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.076+0000 7fd4e54d4640 1 -- 10.20.193.91:0/876055338 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd4e0149a60 con 0x7fd4e00560d0 2026-02-12T03:58:46.136 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.076+0000 7fd4e54d4640 1 librados: init done 2026-02-12T03:58:46.136 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.077+0000 7fd4e54d4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.136 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.077+0000 7fd4e54d4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.136 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.077+0000 7fd4e54d4640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:46.136 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.077+0000 7fd4e54d4640 1 -- 10.20.193.91:0/876055338 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4e005a0b0 con 0x7fd4e00560d0 2026-02-12T03:58:46.136 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.079+0000 7fa6b1ffb640 10 client.?.objecter ms_handle_connect 0x7fa6c40b5b70 2026-02-12T03:58:46.136 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.080+0000 7fa6b1ffb640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.137 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.082+0000 7f0aa6ffd640 1 -- 10.20.193.91:0/3309826704 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2464129601 0 0) 0x7f0ac0136140 con 0x7f0ac00b5b70 2026-02-12T03:58:46.137 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.082+0000 7f0aa6ffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.137 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.082+0000 7f0aa6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.137 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.082+0000 7f0aa6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.137 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.082+0000 7f0aa6ffd640 10 monclient(hunting): my global_id is 4523 2026-02-12T03:58:46.137 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.082+0000 7f0aa6ffd640 1 -- 10.20.193.91:0/3309826704 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a8c003610 con 0x7f0ac00b5b70 2026-02-12T03:58:46.137 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.082+0000 7fd47effd640 1 -- 10.20.193.91:0/1771820188 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 950061105 0 0) 0x7fd498161a60 con 0x7fd4980b7180 2026-02-12T03:58:46.137 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.082+0000 7fd47effd640 1 -- 10.20.193.91:0/1771820188 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd498161d40 con 0x7fd4980b7180 2026-02-12T03:58:46.137 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.082+0000 7fd47effd640 1 -- 10.20.193.91:0/1771820188 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd488003390 con 0x7fd4980b7180 2026-02-12T03:58:46.137 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.082+0000 7fd47effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:46.137 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.082+0000 7fd47effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:46.137 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.082+0000 7fd47effd640 10 monclient(hunting): dump: 2026-02-12T03:58:46.138 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.138 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.138 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.138 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.138 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.138 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.138 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.138 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.138 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.138 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.138 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.082+0000 7fd47effd640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:46.138 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.083+0000 7fa59b7fe640 1 -- 10.20.193.91:0/859043063 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1025063366 0 0) 0x7fa588003610 con 0x7fa5bc0b5b70 2026-02-12T03:58:46.138 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.083+0000 7fa59b7fe640 1 -- 10.20.193.91:0/859043063 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa5bc120700 con 0x7fa5bc0b5b70 2026-02-12T03:58:46.138 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.083+0000 7fa59b7fe640 1 -- 10.20.193.91:0/859043063 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fa5a4002fb0 con 0x7fa5bc0b5b70 2026-02-12T03:58:46.138 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.083+0000 7fa59b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:46.139 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.083+0000 7fa59b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:46.139 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.083+0000 7fa59b7fe640 10 monclient(hunting): dump: 2026-02-12T03:58:46.139 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.139 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.139 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.139 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.139 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.139 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.139 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.139 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.139 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.139 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.139 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.083+0000 7fa59b7fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:46.139 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.092+0000 7f6fe8ff9640 1 -- 10.20.193.91:0/2303746013 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1033494977 0 0) 0x7f6fec15e020 con 0x7f6fec0b57a0 2026-02-12T03:58:46.139 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.092+0000 7f6fe8ff9640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.139 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.092+0000 7f6fe8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.139 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.092+0000 7f6fe8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.140 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.092+0000 7f6fe8ff9640 10 monclient(hunting): my global_id is 4526 2026-02-12T03:58:46.140 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.092+0000 7f6fe8ff9640 1 -- 10.20.193.91:0/2303746013 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fec15dd40 con 0x7f6fec0b57a0 2026-02-12T03:58:46.140 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.092+0000 7f8beeffd640 1 -- 10.20.193.91:0/3055226452 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2382626500 0 0) 0x7f8c08137600 con 0x7f8c080b7180 2026-02-12T03:58:46.140 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.092+0000 7f8beeffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.140 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.092+0000 7f8beeffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.140 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.092+0000 7f8beeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.140 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.092+0000 7f8beeffd640 10 monclient(hunting): my global_id is 4529 2026-02-12T03:58:46.140 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.092+0000 7f8beeffd640 1 -- 10.20.193.91:0/3055226452 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bd8003610 con 0x7f8c080b7180 2026-02-12T03:58:46.140 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.092+0000 7fa6b1ffb640 1 -- 10.20.193.91:0/4031026666 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3025398641 0 0) 0x7fa6c4131b40 con 0x7fa6c40b5b70 2026-02-12T03:58:46.140 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.092+0000 7fa6b1ffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.140 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.092+0000 7fa6b1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.140 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.092+0000 7fa6b1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.141 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.092+0000 7fa6b1ffb640 10 monclient(hunting): my global_id is 4532 2026-02-12T03:58:46.141 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.092+0000 7fa6b1ffb640 1 -- 10.20.193.91:0/4031026666 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa694003610 con 0x7fa6c40b5b70 2026-02-12T03:58:46.141 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.094+0000 7fd6f4e61640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7fd6f00b57a0 0x7fd6f012e950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:38120/0 (socket says 10.20.193.91:38120) 2026-02-12T03:58:46.141 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.094+0000 7fd6f4e61640 1 -- 10.20.193.91:0/2036611536 learned_addr learned my addr 10.20.193.91:0/2036611536 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:46.141 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.096+0000 7fd7c97fa640 1 -- 10.20.193.91:0/1283175197 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1647142102 0 0) 0x7fd7d42037c0 con 0x7fd7d40b8090 2026-02-12T03:58:46.141 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.096+0000 7fd7c97fa640 1 -- 10.20.193.91:0/1283175197 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd7d415f680 con 0x7fd7d40b8090 2026-02-12T03:58:46.141 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.096+0000 7fd7c97fa640 1 -- 10.20.193.91:0/1283175197 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd7bc003310 con 0x7fd7d40b8090 2026-02-12T03:58:46.141 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.096+0000 7fd7c97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:46.141 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.096+0000 7fd7c97fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:46.141 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.096+0000 7fd7c97fa640 10 monclient(hunting): dump: 2026-02-12T03:58:46.141 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.141 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.141 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.141 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.142 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.142 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.142 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.142 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.142 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.142 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.142 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.096+0000 7fd7c97fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:46.142 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.096+0000 7fd6e57fa640 10 client.?.objecter ms_handle_connect 0x7fd6f00b57a0 2026-02-12T03:58:46.142 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.096+0000 7fd6e57fa640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.142 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.096+0000 7f0aa6ffd640 1 -- 10.20.193.91:0/3309826704 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1507257466 0 0) 0x7f0a8c003610 con 0x7f0ac00b5b70 2026-02-12T03:58:46.142 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.096+0000 7f0aa6ffd640 1 -- 10.20.193.91:0/3309826704 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0ac0136140 con 0x7f0ac00b5b70 2026-02-12T03:58:46.142 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.096+0000 7f0aa6ffd640 1 -- 10.20.193.91:0/3309826704 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f0aa8002ff0 con 0x7f0ac00b5b70 2026-02-12T03:58:46.142 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.096+0000 7f0aa6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:46.142 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.096+0000 7f0aa6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:46.143 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.096+0000 7f0aa6ffd640 10 monclient(hunting): dump: 2026-02-12T03:58:46.143 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.143 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.143 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.143 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.143 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.143 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.143 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.143 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.143 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.143 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.143 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.096+0000 7f0aa6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:46.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.096+0000 7fd47effd640 1 -- 10.20.193.91:0/1771820188 <== mon.2 v1:10.20.193.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2702236699 0 0) 0x7fd498161d40 con 0x7fd4980b7180 2026-02-12T03:58:46.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.096+0000 7fd47effd640 1 -- 10.20.193.91:0/1771820188 >> v1:10.20.193.98:6789/0 conn(0x7fd4980b5b70 legacy=0x7fd498133800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.096+0000 7fd47effd640 1 -- 10.20.193.91:0/1771820188 >> v1:10.20.193.91:6789/0 conn(0x7fd4980b57a0 legacy=0x7fd498155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fd47effd640 10 monclient: _finish_hunting 0 2026-02-12T03:58:46.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fd47effd640 1 monclient: found mon.c 2026-02-12T03:58:46.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fd47effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:46.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fd47effd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:46.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fd47effd640 1 -- 10.20.193.91:0/1771820188 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd498162020 con 0x7fd4980b7180 2026-02-12T03:58:46.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fd47effd640 10 monclient: _finish_auth 0 2026-02-12T03:58:46.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fd47effd640 10 monclient: _check_auth_tickets 2026-02-12T03:58:46.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fd47effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:46.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fd49ccae640 5 monclient: authenticate success, global_id 4511 2026-02-12T03:58:46.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fd49ccae640 10 monclient: _renew_subs 2026-02-12T03:58:46.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fd49ccae640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:46.144 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fd49ccae640 1 -- 10.20.193.91:0/1771820188 --> v1:10.20.193.111:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd498162300 con 0x7fd4980b7180 2026-02-12T03:58:46.145 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fd49ccae640 10 client.4511.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:46.145 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fd49ccae640 10 monclient: _renew_subs 2026-02-12T03:58:46.145 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fd49ccae640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:46.145 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fd49ccae640 1 -- 10.20.193.91:0/1771820188 --> v1:10.20.193.111:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd4981628c0 con 0x7fd4980b7180 2026-02-12T03:58:46.145 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fd49ccae640 1 librados: init done 2026-02-12T03:58:46.145 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fa59b7fe640 1 -- 10.20.193.91:0/859043063 <== mon.2 v1:10.20.193.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1664719890 0 0) 0x7fa5bc120700 con 0x7fa5bc0b5b70 2026-02-12T03:58:46.145 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fa59b7fe640 1 -- 10.20.193.91:0/859043063 >> v1:10.20.193.98:6789/0 conn(0x7fa5bc0b57a0 legacy=0x7fa5bc1302b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.145 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fa59b7fe640 1 -- 10.20.193.91:0/859043063 >> v1:10.20.193.91:6789/0 conn(0x7fa5bc0b7180 legacy=0x7fa5bc156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.145 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fa59b7fe640 10 monclient: _finish_hunting 0 2026-02-12T03:58:46.145 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fa59b7fe640 1 monclient: found mon.c 2026-02-12T03:58:46.145 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fa59b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:46.145 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fa59b7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:46.145 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fa59b7fe640 1 -- 10.20.193.91:0/859043063 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5bc1209e0 con 0x7fa5bc0b5b70 2026-02-12T03:58:46.145 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fa59b7fe640 10 monclient: _finish_auth 0 2026-02-12T03:58:46.146 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fa59b7fe640 10 monclient: _check_auth_tickets 2026-02-12T03:58:46.146 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fa59b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:46.146 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fa5c1044640 5 monclient: authenticate success, global_id 4520 2026-02-12T03:58:46.146 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fa5c1044640 10 monclient: _renew_subs 2026-02-12T03:58:46.146 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fa5c1044640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:46.146 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fa5c1044640 1 -- 10.20.193.91:0/859043063 --> v1:10.20.193.111:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa5bc12fd90 con 0x7fa5bc0b5b70 2026-02-12T03:58:46.146 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fa5c1044640 10 client.4520.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:46.146 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fa5c1044640 10 monclient: _renew_subs 2026-02-12T03:58:46.146 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fa5c1044640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:46.146 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fa5c1044640 1 -- 10.20.193.91:0/859043063 --> v1:10.20.193.111:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa5bc130ba0 con 0x7fa5bc0b5b70 2026-02-12T03:58:46.146 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fa5c1044640 1 librados: init done 2026-02-12T03:58:46.146 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fb05dffb640 1 -- 10.20.193.91:0/2633229468 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2966237377 0 0) 0x7fb040003610 con 0x7fb0700b57a0 2026-02-12T03:58:46.146 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fb05dffb640 1 -- 10.20.193.91:0/2633229468 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb0701344d0 con 0x7fb0700b57a0 2026-02-12T03:58:46.146 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fb05dffb640 1 -- 10.20.193.91:0/2633229468 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fb060003190 con 0x7fb0700b57a0 2026-02-12T03:58:46.146 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fb05dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:46.147 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fb05dffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:46.147 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fb05dffb640 10 monclient(hunting): dump: 2026-02-12T03:58:46.147 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.147 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.147 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.147 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.147 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.147 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.147 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.147 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.147 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.147 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.147 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fb05dffb640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:46.147 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fd49ccae640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.147 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fd49ccae640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.147 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fd49ccae640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:46.148 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fd49ccae640 1 -- 10.20.193.91:0/1771820188 --> v1:10.20.193.111:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4980b60e0 con 0x7fd4980b7180 2026-02-12T03:58:46.148 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fa5c1044640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.148 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fa5c1044640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.148 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fa5c1044640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:46.148 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.097+0000 7fa5c1044640 1 -- 10.20.193.91:0/859043063 --> v1:10.20.193.111:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5bc12fb80 con 0x7fa5bc0b5b70 2026-02-12T03:58:46.148 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.098+0000 7f1286525640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f1280159b70 0x7f1280133ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:38122/0 (socket says 10.20.193.91:38122) 2026-02-12T03:58:46.148 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.098+0000 7f1286525640 1 -- 10.20.193.91:0/1950003782 learned_addr learned my addr 10.20.193.91:0/1950003782 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:46.148 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.098+0000 7f1266ffd640 10 client.?.objecter ms_handle_connect 0x7f1280159b70 2026-02-12T03:58:46.148 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.098+0000 7f1266ffd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.158 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.157+0000 7f6fe8ff9640 10 client.?.objecter ms_handle_connect 0x7f6fec0b5b70 2026-02-12T03:58:46.158 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.157+0000 7f6fe8ff9640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.162 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.160+0000 7f66a17fa640 1 -- 10.20.193.91:0/4196024287 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1751099567 0 0) 0x7f66ac0b66a0 con 0x7f66ac0b5b70 2026-02-12T03:58:46.162 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.160+0000 7f66a17fa640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.162 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.160+0000 7f66a17fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.162 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.160+0000 7f66a17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.162 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.160+0000 7f66a17fa640 10 monclient(hunting): my global_id is 4560 2026-02-12T03:58:46.162 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.160+0000 7f66a17fa640 1 -- 10.20.193.91:0/4196024287 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f667c003610 con 0x7f66ac0b5b70 2026-02-12T03:58:46.162 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.160+0000 7fb05dffb640 10 client.?.objecter ms_handle_connect 0x7fb0700b5b70 2026-02-12T03:58:46.162 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.160+0000 7fb05dffb640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.165 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.163+0000 7f8beeffd640 10 client.?.objecter ms_handle_connect 0x7f8c080b57a0 2026-02-12T03:58:46.165 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.163+0000 7f8beeffd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.171+0000 7f6fe8ff9640 1 -- 10.20.193.91:0/2303746013 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2038273715 0 0) 0x7f6fb8003610 con 0x7f6fec0b7180 2026-02-12T03:58:46.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.171+0000 7f6fe8ff9640 1 -- 10.20.193.91:0/2303746013 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6fec15e020 con 0x7f6fec0b7180 2026-02-12T03:58:46.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.171+0000 7f6fe8ff9640 1 -- 10.20.193.91:0/2303746013 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f6fe0003430 con 0x7f6fec0b7180 2026-02-12T03:58:46.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.171+0000 7f6fe8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:46.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.171+0000 7f6fe8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:46.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.171+0000 7f6fe8ff9640 10 monclient(hunting): dump: 2026-02-12T03:58:46.173 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.173 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.173 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.173 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.173 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.173 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.173 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.173 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.173 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.173 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.171+0000 7f6fe8ff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:46.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.172+0000 7fb621573640 1 -- 10.20.193.91:0/2979198272 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb614003340 con 0x7fb6240b3210 2026-02-12T03:58:46.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.172+0000 7fb621573640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:46.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.172+0000 7fb621573640 1 -- 10.20.193.91:0/2979198272 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fb614003780 con 0x7fb6240b3210 2026-02-12T03:58:46.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.172+0000 7fb621573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.172+0000 7fb621573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:46.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.172+0000 7fb621573640 10 monclient: dump: 2026-02-12T03:58:46.173 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.174 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.174 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.174 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.174 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.174 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.174 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.174 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.174 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.174 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.172+0000 7fb628eec640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:46.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.172+0000 7fb628eec640 4 set_mon_vals no callback set 2026-02-12T03:58:46.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.172+0000 7fb628eec640 10 monclient: shutdown 2026-02-12T03:58:46.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.172+0000 7fb628eec640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:46.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.172+0000 7fb628eec640 1 -- 10.20.193.91:0/2979198272 >> v1:10.20.193.98:6789/0 conn(0x7fb6240b3210 legacy=0x7fb6241c6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.172+0000 7fb628eec640 1 -- 10.20.193.91:0/2979198272 shutdown_connections 2026-02-12T03:58:46.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.172+0000 7fb628eec640 1 -- 10.20.193.91:0/2979198272 >> 10.20.193.91:0/2979198272 conn(0x7fb6240b5310 msgr2=0x7fb6240b5710 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:46.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.172+0000 7fb628eec640 1 -- 10.20.193.91:0/2979198272 shutdown_connections 2026-02-12T03:58:46.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.172+0000 7fb628eec640 1 -- 10.20.193.91:0/2979198272 wait complete. 2026-02-12T03:58:46.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.173+0000 7fb628eec640 10 monclient: build_initial_monmap 2026-02-12T03:58:46.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.173+0000 7fb628eec640 10 monclient: monmap: 2026-02-12T03:58:46.174 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:46.174 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:46.174 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:46.175 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:46.175 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:46.175 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:46.175 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:46.175 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:46.175 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:46.175 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.173+0000 7fb628eec640 1 librados: starting msgr at 2026-02-12T03:58:46.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.173+0000 7fb628eec640 1 librados: starting objecter 2026-02-12T03:58:46.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.173+0000 7fb628eec640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:46.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.173+0000 7fb628eec640 1 Processor -- start 2026-02-12T03:58:46.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.173+0000 7fb628eec640 1 -- start start 2026-02-12T03:58:46.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.173+0000 7fb628eec640 1 librados: setting wanted keys 2026-02-12T03:58:46.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.173+0000 7fb628eec640 1 librados: calling monclient init 2026-02-12T03:58:46.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.173+0000 7fb628eec640 10 monclient: init 2026-02-12T03:58:46.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.174+0000 7fb628eec640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:46.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.174+0000 7fb628eec640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T03:58:46.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.174+0000 7fb628eec640 10 monclient(hunting): picked mon.noname-c con 0x7fb6240b3210 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:46.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.174+0000 7fb628eec640 10 monclient(hunting): picked mon.noname-a con 0x7fb62415e530 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:46.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.174+0000 7fb628eec640 10 monclient(hunting): picked mon.noname-b con 0x7fb62415e900 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:46.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.174+0000 7fb628eec640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb624132800 con 0x7fb62415e530 2026-02-12T03:58:46.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.174+0000 7fb628eec640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb624132ae0 con 0x7fb62415e900 2026-02-12T03:58:46.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.174+0000 7fb628eec640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb624132dc0 con 0x7fb6240b3210 2026-02-12T03:58:46.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.174+0000 7fb628eec640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:46.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.174+0000 7fb628eec640 10 monclient(hunting): authenticate will time out at 1128.917235s 2026-02-12T03:58:46.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.174+0000 7f0aa6ffd640 1 -- 10.20.193.91:0/3309826704 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2513780291 0 0) 0x7f0ac0135e60 con 0x7f0ac00b7180 2026-02-12T03:58:46.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.174+0000 7f0aa6ffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.174+0000 7f0aa6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.174+0000 7f0aa6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.174+0000 7f0aa6ffd640 10 monclient(hunting): my global_id is 4567 2026-02-12T03:58:46.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.174+0000 7f0aa6ffd640 1 -- 10.20.193.91:0/3309826704 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a8c003610 con 0x7f0ac00b7180 2026-02-12T03:58:46.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.174+0000 7fa6b1ffb640 10 client.?.objecter ms_handle_connect 0x7fa6c40b57a0 2026-02-12T03:58:46.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.174+0000 7fa6b1ffb640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.174+0000 7fb05dffb640 1 -- 10.20.193.91:0/2633229468 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2183198487 0 0) 0x7fb0701341f0 con 0x7fb0700b7180 2026-02-12T03:58:46.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.174+0000 7fb05dffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.174+0000 7fb05dffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.174+0000 7fb05dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.174+0000 7fb05dffb640 10 monclient(hunting): my global_id is 4561 2026-02-12T03:58:46.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.174+0000 7fb05dffb640 1 -- 10.20.193.91:0/2633229468 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb040003610 con 0x7fb0700b7180 2026-02-12T03:58:46.177 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.175+0000 7f8beeffd640 1 -- 10.20.193.91:0/3055226452 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3059316832 0 0) 0x7f8c08162c40 con 0x7f8c080b5b70 2026-02-12T03:58:46.177 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.175+0000 7f8beeffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.177 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.175+0000 7f8beeffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.177 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.175+0000 7f8beeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.177 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.175+0000 7f8beeffd640 10 monclient(hunting): my global_id is 4564 2026-02-12T03:58:46.177 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.175+0000 7f8beeffd640 1 -- 10.20.193.91:0/3055226452 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c08137600 con 0x7f8c080b5b70 2026-02-12T03:58:46.177 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.175+0000 7fd6e57fa640 10 client.?.objecter ms_handle_connect 0x7fd6f00b5b70 2026-02-12T03:58:46.177 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.175+0000 7fd6e57fa640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.176+0000 7f1266ffd640 10 client.?.objecter ms_handle_connect 0x7f1280166f70 2026-02-12T03:58:46.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.176+0000 7f1266ffd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.180+0000 7f924117a640 1 -- 10.20.193.91:0/1354613179 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9230003000 con 0x7f923c0b7180 2026-02-12T03:58:46.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.180+0000 7f924117a640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:46.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.180+0000 7f924117a640 1 -- 10.20.193.91:0/1354613179 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f9230003400 con 0x7f923c0b7180 2026-02-12T03:58:46.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.180+0000 7f924117a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.180+0000 7f924117a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:46.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.180+0000 7f924117a640 10 monclient: dump: 2026-02-12T03:58:46.182 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.182 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.182 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.182 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.182 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.182 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.182 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.182 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.182 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.182 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.180+0000 7f9244407640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:46.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.180+0000 7f9244407640 4 set_mon_vals no callback set 2026-02-12T03:58:46.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.180+0000 7f9244407640 10 monclient: shutdown 2026-02-12T03:58:46.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.180+0000 7f9244407640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:46.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.180+0000 7f9244407640 1 -- 10.20.193.91:0/1354613179 >> v1:10.20.193.98:6789/0 conn(0x7f923c0b7180 legacy=0x7f923c0565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.180+0000 7f9244407640 1 -- 10.20.193.91:0/1354613179 shutdown_connections 2026-02-12T03:58:46.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.180+0000 7f9244407640 1 -- 10.20.193.91:0/1354613179 >> 10.20.193.91:0/1354613179 conn(0x7f923c0559c0 msgr2=0x7f923c055dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:46.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.180+0000 7f9244407640 1 -- 10.20.193.91:0/1354613179 shutdown_connections 2026-02-12T03:58:46.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.181+0000 7f9244407640 1 -- 10.20.193.91:0/1354613179 wait complete. 2026-02-12T03:58:46.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.181+0000 7f9244407640 10 monclient: build_initial_monmap 2026-02-12T03:58:46.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.181+0000 7f9244407640 10 monclient: monmap: 2026-02-12T03:58:46.183 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:46.183 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:46.183 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:46.183 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:46.183 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:46.183 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:46.183 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:46.183 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:46.183 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:46.183 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.181+0000 7f9244407640 1 librados: starting msgr at 2026-02-12T03:58:46.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.181+0000 7f9244407640 1 librados: starting objecter 2026-02-12T03:58:46.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.181+0000 7f9244407640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:46.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.181+0000 7f9244407640 1 Processor -- start 2026-02-12T03:58:46.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.181+0000 7f9244407640 1 -- start start 2026-02-12T03:58:46.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.181+0000 7f9244407640 1 librados: setting wanted keys 2026-02-12T03:58:46.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.181+0000 7f9244407640 1 librados: calling monclient init 2026-02-12T03:58:46.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.181+0000 7f9244407640 10 monclient: init 2026-02-12T03:58:46.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.181+0000 7f66a17fa640 1 -- 10.20.193.91:0/4196024287 <== mon.1 v1:10.20.193.98:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1599095981 0 0) 0x7f66ac1529e0 con 0x7f66ac0b57a0 2026-02-12T03:58:46.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.181+0000 7f66a17fa640 1 -- 10.20.193.91:0/4196024287 >> v1:10.20.193.111:6789/0 conn(0x7f66ac0b7180 legacy=0x7f66ac15cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.181+0000 7f66a17fa640 1 -- 10.20.193.91:0/4196024287 >> v1:10.20.193.91:6789/0 conn(0x7f66ac0b5b70 legacy=0x7f66ac131080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.182+0000 7f66a17fa640 10 monclient: _finish_hunting 0 2026-02-12T03:58:46.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.182+0000 7f66a17fa640 1 monclient: found mon.b 2026-02-12T03:58:46.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.182+0000 7f66a17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:46.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.182+0000 7f66a17fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:46.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.182+0000 7f66a17fa640 1 -- 10.20.193.91:0/4196024287 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66ac152cc0 con 0x7f66ac0b57a0 2026-02-12T03:58:46.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.182+0000 7f66a17fa640 10 monclient: _finish_auth 0 2026-02-12T03:58:46.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.182+0000 7f66a17fa640 10 monclient: _check_auth_tickets 2026-02-12T03:58:46.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.182+0000 7f66a17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:46.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.182+0000 7f66b2c4c640 5 monclient: authenticate success, global_id 4549 2026-02-12T03:58:46.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.182+0000 7f66b2c4c640 10 monclient: _renew_subs 2026-02-12T03:58:46.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.182+0000 7f66b2c4c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:46.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.182+0000 7f66b2c4c640 1 -- 10.20.193.91:0/4196024287 --> v1:10.20.193.98:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f66ac1305a0 con 0x7f66ac0b57a0 2026-02-12T03:58:46.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.182+0000 7f66b2c4c640 10 client.4549.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:46.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.182+0000 7f66b2c4c640 10 monclient: _renew_subs 2026-02-12T03:58:46.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.182+0000 7f66b2c4c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:46.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.182+0000 7f66b2c4c640 1 -- 10.20.193.91:0/4196024287 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f66ac130b60 con 0x7f66ac0b57a0 2026-02-12T03:58:46.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.182+0000 7f66b2c4c640 1 librados: init done 2026-02-12T03:58:46.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.182+0000 7f9244407640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:46.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.182+0000 7f9244407640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T03:58:46.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.182+0000 7f9244407640 10 monclient(hunting): picked mon.noname-b con 0x7f923c0b57a0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:46.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.182+0000 7f9244407640 10 monclient(hunting): picked mon.noname-a con 0x7f923c0b5b70 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:46.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.182+0000 7f9244407640 10 monclient(hunting): picked mon.noname-c con 0x7f923c0b7180 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:46.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.182+0000 7f9244407640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f923c156a70 con 0x7f923c0b5b70 2026-02-12T03:58:46.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.182+0000 7f9244407640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f923c156d50 con 0x7f923c0b57a0 2026-02-12T03:58:46.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.182+0000 7f9244407640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f923c120070 con 0x7f923c0b7180 2026-02-12T03:58:46.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.182+0000 7f9244407640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:46.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.182+0000 7f9244407640 10 monclient(hunting): authenticate will time out at 1128.925374s 2026-02-12T03:58:46.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.182+0000 7f66b2c4c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.182+0000 7f66b2c4c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.182+0000 7f66b2c4c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:46.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.182+0000 7f66b2c4c640 1 -- 10.20.193.91:0/4196024287 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66ac057ee0 con 0x7f66ac0b57a0 2026-02-12T03:58:46.188 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.186+0000 7fd4bf7fe640 1 -- 10.20.193.91:0/876055338 <== mon.1 v1:10.20.193.98:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd4d4003330 con 0x7fd4e00560d0 2026-02-12T03:58:46.188 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.186+0000 7fd4bf7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:46.188 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.186+0000 7fd4bf7fe640 1 -- 10.20.193.91:0/876055338 <== mon.1 v1:10.20.193.98:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd4d4003b50 con 0x7fd4e00560d0 2026-02-12T03:58:46.188 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.186+0000 7fd4bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.188 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.186+0000 7fd4bf7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:46.188 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.186+0000 7fd4dd7fa640 4 set_mon_vals no callback set 2026-02-12T03:58:46.188 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.186+0000 7fd4bf7fe640 10 monclient: dump: 2026-02-12T03:58:46.188 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.188 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.188 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.188 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.188 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.188 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.188 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.188 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.188 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.188 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.188 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.187+0000 7fd4bf7fe640 1 -- 10.20.193.91:0/876055338 <== mon.1 v1:10.20.193.98:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7fd4d4003d30 con 0x7fd4e00560d0 2026-02-12T03:58:46.189 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.187+0000 7fd4de7fc640 10 monclient: get_auth_request con 0x7fd4ac079f80 auth_method 0 2026-02-12T03:58:46.189 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.187+0000 7fd4bf7fe640 10 client.4543.objecter ms_handle_connect 0x7fd4ac079f80 2026-02-12T03:58:46.190 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.188+0000 7fd4bf7fe640 1 -- 10.20.193.91:0/876055338 <== mon.1 v1:10.20.193.98:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7fd4d4095d10 con 0x7fd4e00560d0 2026-02-12T03:58:46.190 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.188+0000 7fd4bf7fe640 10 client.4543.objecter ms_dispatch2 0x7fd4e0000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:46.190 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.188+0000 7fd4bf7fe640 3 client.4543.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:46.190 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.188+0000 7fd4bf7fe640 3 client.4543.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:46.190 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.188+0000 7fd4bf7fe640 20 client.4543.objecter dump_active .. 0 homeless 2026-02-12T03:58:46.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.190+0000 7fd4bf7fe640 1 -- 10.20.193.91:0/876055338 <== mon.1 v1:10.20.193.98:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7fd4d405f670 con 0x7fd4e00560d0 2026-02-12T03:58:46.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.190+0000 7fd4bf7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.190+0000 7fd4bf7fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:46.194 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.193+0000 7fd7c97fa640 1 -- 10.20.193.91:0/1283175197 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4133600221 0 0) 0x7fd7d40ae500 con 0x7fd7d40b5480 2026-02-12T03:58:46.194 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.193+0000 7fd7c97fa640 1 -- 10.20.193.91:0/1283175197 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd7d42037c0 con 0x7fd7d40b5480 2026-02-12T03:58:46.194 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.193+0000 7fd7c97fa640 1 -- 10.20.193.91:0/1283175197 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd7c4002ff0 con 0x7fd7d40b5480 2026-02-12T03:58:46.194 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.193+0000 7fd7c97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:46.194 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.193+0000 7fd7c97fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:46.194 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.193+0000 7fd7c97fa640 10 monclient(hunting): dump: 2026-02-12T03:58:46.194 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.194 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.194 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.194 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.194 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.194 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.194 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.194 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.194 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.194 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.198 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.196+0000 7fd6e57fa640 1 -- 10.20.193.91:0/2036611536 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1210310858 0 0) 0x7fd6f011d360 con 0x7fd6f00b5b70 2026-02-12T03:58:46.198 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.196+0000 7fd6e57fa640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.198 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.196+0000 7fd6e57fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.198 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.196+0000 7fd6e57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.198 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.196+0000 7fd6e57fa640 10 monclient(hunting): my global_id is 4573 2026-02-12T03:58:46.198 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.196+0000 7fd6e57fa640 1 -- 10.20.193.91:0/2036611536 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6c0003610 con 0x7fd6f00b5b70 2026-02-12T03:58:46.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.197+0000 7f0aa6ffd640 1 -- 10.20.193.91:0/3309826704 <== mon.2 v1:10.20.193.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2267881635 0 0) 0x7f0ac0136140 con 0x7f0ac00b5b70 2026-02-12T03:58:46.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.197+0000 7f0aa6ffd640 1 -- 10.20.193.91:0/3309826704 >> v1:10.20.193.98:6789/0 conn(0x7f0ac00b7180 legacy=0x7f0ac0162ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.197+0000 7f0aa6ffd640 1 -- 10.20.193.91:0/3309826704 >> v1:10.20.193.91:6789/0 conn(0x7f0ac00b57a0 legacy=0x7f0ac0158ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.197+0000 7f0aa6ffd640 10 monclient: _finish_hunting 0 2026-02-12T03:58:46.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.197+0000 7f0aa6ffd640 1 monclient: found mon.c 2026-02-12T03:58:46.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.197+0000 7f0aa6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:46.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.197+0000 7f0aa6ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:46.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.197+0000 7f0aa6ffd640 1 -- 10.20.193.91:0/3309826704 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ac0136420 con 0x7f0ac00b5b70 2026-02-12T03:58:46.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.197+0000 7f0aa6ffd640 10 monclient: _finish_auth 0 2026-02-12T03:58:46.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.197+0000 7f0aa6ffd640 10 monclient: _check_auth_tickets 2026-02-12T03:58:46.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.197+0000 7f0aa6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:46.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.197+0000 7f0ac4dbb640 5 monclient: authenticate success, global_id 4523 2026-02-12T03:58:46.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.197+0000 7f0ac4dbb640 10 monclient: _renew_subs 2026-02-12T03:58:46.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.197+0000 7f0ac4dbb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:46.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.197+0000 7f0ac4dbb640 1 -- 10.20.193.91:0/3309826704 --> v1:10.20.193.111:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0ac0136700 con 0x7f0ac00b5b70 2026-02-12T03:58:46.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.198+0000 7f0ac4dbb640 10 client.4523.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:46.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.198+0000 7f0ac4dbb640 10 monclient: _renew_subs 2026-02-12T03:58:46.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.198+0000 7f0ac4dbb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:46.200 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.198+0000 7f0ac4dbb640 1 -- 10.20.193.91:0/3309826704 --> v1:10.20.193.111:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0ac01589a0 con 0x7f0ac00b5b70 2026-02-12T03:58:46.200 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.198+0000 7f0ac4dbb640 1 librados: init done 2026-02-12T03:58:46.200 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.198+0000 7fb622d76640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7fb62415e900 0x7fb624137030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:48832/0 (socket says 10.20.193.91:48832) 2026-02-12T03:58:46.200 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.198+0000 7fb622d76640 1 -- 10.20.193.91:0/4049698237 learned_addr learned my addr 10.20.193.91:0/4049698237 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:46.200 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.198+0000 7f0ac4dbb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.200 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.198+0000 7f0ac4dbb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.200 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.198+0000 7f0ac4dbb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:46.200 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.198+0000 7f0ac4dbb640 1 -- 10.20.193.91:0/3309826704 --> v1:10.20.193.111:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ac00b60e0 con 0x7f0ac00b5b70 2026-02-12T03:58:46.201 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.200+0000 7f924217c640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f923c0b57a0 0x7f923c133a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:48846/0 (socket says 10.20.193.91:48846) 2026-02-12T03:58:46.201 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.200+0000 7f924217c640 1 -- 10.20.193.91:0/598495024 learned_addr learned my addr 10.20.193.91:0/598495024 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:46.201 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.200+0000 7fb60affd640 10 client.?.objecter ms_handle_connect 0x7fb62415e900 2026-02-12T03:58:46.201 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.200+0000 7fb60affd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.203 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.201+0000 7fd47effd640 1 -- 10.20.193.91:0/1771820188 <== mon.2 v1:10.20.193.111:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd488003530 con 0x7fd4980b7180 2026-02-12T03:58:46.203 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.201+0000 7fd47effd640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:46.203 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.201+0000 7fd47effd640 1 -- 10.20.193.91:0/1771820188 <== mon.2 v1:10.20.193.111:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd488003940 con 0x7fd4980b7180 2026-02-12T03:58:46.203 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.201+0000 7fd47effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.203 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.201+0000 7fd47effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:46.203 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.201+0000 7fd47effd640 10 monclient: dump: 2026-02-12T03:58:46.203 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.203 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.203 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.203 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.203 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.203 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.203 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.203 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.203 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.203 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.203 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.201+0000 7fd494d72640 4 set_mon_vals no callback set 2026-02-12T03:58:46.204 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.202+0000 7fd47effd640 1 -- 10.20.193.91:0/1771820188 <== mon.2 v1:10.20.193.111:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7fd488003b20 con 0x7fd4980b7180 2026-02-12T03:58:46.204 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.203+0000 7fd496575640 10 monclient: get_auth_request con 0x7fd46407a040 auth_method 0 2026-02-12T03:58:46.204 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.203+0000 7fd47effd640 10 client.4511.objecter ms_handle_connect 0x7fd46407a040 2026-02-12T03:58:46.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.203+0000 7fd47effd640 1 -- 10.20.193.91:0/1771820188 <== mon.2 v1:10.20.193.111:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7fd488094d10 con 0x7fd4980b7180 2026-02-12T03:58:46.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.203+0000 7fd47effd640 10 client.4511.objecter ms_dispatch2 0x7fd498000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:46.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.203+0000 7fd47effd640 3 client.4511.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:46.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.203+0000 7fd47effd640 3 client.4511.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:46.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.203+0000 7fd47effd640 20 client.4511.objecter dump_active .. 0 homeless 2026-02-12T03:58:46.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.207+0000 7f6fe8ff9640 1 -- 10.20.193.91:0/2303746013 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1999277854 0 0) 0x7f6fec15dd40 con 0x7f6fec0b57a0 2026-02-12T03:58:46.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.207+0000 7f6fe8ff9640 1 -- 10.20.193.91:0/2303746013 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6fb8003610 con 0x7f6fec0b57a0 2026-02-12T03:58:46.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.207+0000 7f6fe8ff9640 1 -- 10.20.193.91:0/2303746013 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f6fd8002ce0 con 0x7f6fec0b57a0 2026-02-12T03:58:46.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.207+0000 7f6fe8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:46.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.207+0000 7f6fe8ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:46.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.207+0000 7f6fe8ff9640 10 monclient(hunting): dump: 2026-02-12T03:58:46.209 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.209 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.209 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.209 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.209 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.209 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.209 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.209 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.209 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.209 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.272 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.270+0000 7fafe67fc640 1 -- 10.20.193.91:0/3045807994 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fafec003450 con 0x7faff8161ad0 2026-02-12T03:58:46.272 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.270+0000 7fafe67fc640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:46.272 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.270+0000 7fafe67fc640 1 -- 10.20.193.91:0/3045807994 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fafec003b50 con 0x7faff8161ad0 2026-02-12T03:58:46.272 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.270+0000 7fafe67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.272 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.270+0000 7fafe67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:46.272 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.270+0000 7fafe67fc640 10 monclient: dump: 2026-02-12T03:58:46.272 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.273 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.273 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.273 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.273 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.273 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.273 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.273 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.273 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.273 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.273 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.270+0000 7fafe7fff640 4 set_mon_vals no callback set 2026-02-12T03:58:46.273 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.271+0000 7fafe67fc640 1 -- 10.20.193.91:0/3045807994 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7fafec003b50 con 0x7faff8161ad0 2026-02-12T03:58:46.273 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.271+0000 7fb05dffb640 1 -- 10.20.193.91:0/2633229468 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1760315328 0 0) 0x7fb070133f10 con 0x7fb0700b5b70 2026-02-12T03:58:46.273 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.271+0000 7fb05dffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.273 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.271+0000 7fb05dffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.273 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.271+0000 7fb05dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.273 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.271+0000 7fb05dffb640 10 monclient(hunting): my global_id is 4566 2026-02-12T03:58:46.274 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.271+0000 7fb05dffb640 1 -- 10.20.193.91:0/2633229468 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0701341f0 con 0x7fb0700b5b70 2026-02-12T03:58:46.274 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.272+0000 7faffdd54640 10 monclient: get_auth_request con 0x7fafc807a160 auth_method 0 2026-02-12T03:58:46.274 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.272+0000 7fafe67fc640 10 client.4515.objecter ms_handle_connect 0x7fafc807a160 2026-02-12T03:58:46.277 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.275+0000 7fafe67fc640 1 -- 10.20.193.91:0/3045807994 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7fafec095a70 con 0x7faff8161ad0 2026-02-12T03:58:46.277 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.275+0000 7fafe67fc640 10 client.4515.objecter ms_dispatch2 0x7faff8000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:46.277 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.275+0000 7fafe67fc640 3 client.4515.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:46.277 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.275+0000 7fafe67fc640 3 client.4515.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:46.277 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.275+0000 7fafe67fc640 20 client.4515.objecter dump_active .. 0 homeless 2026-02-12T03:58:46.277 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.275+0000 7fafe67fc640 1 -- 10.20.193.91:0/3045807994 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7fafec05f3d0 con 0x7faff8161ad0 2026-02-12T03:58:46.277 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.275+0000 7fafe67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.277 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.275+0000 7fafe67fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:46.278 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.276+0000 7f6fe8ff9640 1 -- 10.20.193.91:0/2303746013 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3064922861 0 0) 0x7f6fec153b40 con 0x7f6fec0b5b70 2026-02-12T03:58:46.278 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.276+0000 7f6fe8ff9640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.278 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.276+0000 7f6fe8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.278 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.276+0000 7f6fe8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.278 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.276+0000 7f6fe8ff9640 10 monclient(hunting): my global_id is 4563 2026-02-12T03:58:46.278 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.276+0000 7f6fe8ff9640 1 -- 10.20.193.91:0/2303746013 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fec15dd40 con 0x7f6fec0b5b70 2026-02-12T03:58:46.278 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.276+0000 7fa6b1ffb640 10 client.?.objecter ms_handle_connect 0x7fa6c40b7180 2026-02-12T03:58:46.278 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.276+0000 7fa6b1ffb640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.279 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.277+0000 7fd6e57fa640 10 client.?.objecter ms_handle_connect 0x7fd6f00b7180 2026-02-12T03:58:46.279 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.277+0000 7fd6e57fa640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.279 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.277+0000 7fd7c97fa640 1 -- 10.20.193.91:0/1283175197 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1747302248 0 0) 0x7fd7a4003610 con 0x7fd7d415d740 2026-02-12T03:58:46.279 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.277+0000 7fd7c97fa640 1 -- 10.20.193.91:0/1283175197 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd7d40ae500 con 0x7fd7d415d740 2026-02-12T03:58:46.279 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.277+0000 7fd7c97fa640 1 -- 10.20.193.91:0/1283175197 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd7d0003470 con 0x7fd7d415d740 2026-02-12T03:58:46.279 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.277+0000 7fd7c97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:46.279 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.277+0000 7fd7c97fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:46.279 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.277+0000 7fd7c97fa640 10 monclient(hunting): dump: 2026-02-12T03:58:46.279 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.279 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.279 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.279 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.279 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.279 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.279 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.279 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.279 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.280 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.280 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.278+0000 7f9222ffd640 10 client.?.objecter ms_handle_connect 0x7f923c0b57a0 2026-02-12T03:58:46.280 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.278+0000 7f9222ffd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.280 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.278+0000 7f1266ffd640 10 client.?.objecter ms_handle_connect 0x7f1280164760 2026-02-12T03:58:46.280 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.278+0000 7f1266ffd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.281 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.279+0000 7f8beeffd640 1 -- 10.20.193.91:0/3055226452 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2987768820 0 0) 0x7f8c0812a010 con 0x7f8c080b57a0 2026-02-12T03:58:46.281 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.279+0000 7f8beeffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.281 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.279+0000 7f8beeffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.281 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.279+0000 7f8beeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.281 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.279+0000 7f8beeffd640 10 monclient(hunting): my global_id is 4569 2026-02-12T03:58:46.281 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.279+0000 7f8beeffd640 1 -- 10.20.193.91:0/3055226452 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c08162c40 con 0x7f8c080b57a0 2026-02-12T03:58:46.281 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.279+0000 7fa6b1ffb640 1 -- 10.20.193.91:0/4031026666 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2438587579 0 0) 0x7fa6c4131860 con 0x7fa6c40b57a0 2026-02-12T03:58:46.281 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.279+0000 7fa6b1ffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.281 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.279+0000 7fa6b1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.282 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.279+0000 7fa6b1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.282 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.279+0000 7fa6b1ffb640 10 monclient(hunting): my global_id is 4570 2026-02-12T03:58:46.282 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.279+0000 7fa6b1ffb640 1 -- 10.20.193.91:0/4031026666 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6c4131b40 con 0x7fa6c40b57a0 2026-02-12T03:58:46.291 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.289+0000 7f717dffb640 1 -- 10.20.193.91:0/3447493771 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7184003200 con 0x7f71901599b0 2026-02-12T03:58:46.291 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.289+0000 7f717dffb640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:46.291 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.289+0000 7f717dffb640 1 -- 10.20.193.91:0/3447493771 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f7184003920 con 0x7f71901599b0 2026-02-12T03:58:46.291 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.289+0000 7f717dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.291 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.289+0000 7f717dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:46.291 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.289+0000 7f717dffb640 10 monclient: dump: 2026-02-12T03:58:46.291 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.291 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.291 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.291 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.291 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.291 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.291 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.291 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.291 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.292 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.292 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.289+0000 7f717f7fe640 4 set_mon_vals no callback set 2026-02-12T03:58:46.292 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.290+0000 7f717dffb640 1 -- 10.20.193.91:0/3447493771 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f7184003b00 con 0x7f71901599b0 2026-02-12T03:58:46.292 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.290+0000 7f719527f640 10 monclient: get_auth_request con 0x7f7160079eb0 auth_method 0 2026-02-12T03:58:46.292 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.290+0000 7f717dffb640 10 client.4533.objecter ms_handle_connect 0x7f7160079eb0 2026-02-12T03:58:46.293 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.290+0000 7f1266ffd640 1 -- 10.20.193.91:0/1950003782 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1074351190 0 0) 0x7f128012b680 con 0x7f1280166f70 2026-02-12T03:58:46.293 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.290+0000 7f1266ffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.293 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.290+0000 7f1266ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.293 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.290+0000 7f1266ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.293 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.290+0000 7f1266ffd640 10 monclient(hunting): my global_id is 4576 2026-02-12T03:58:46.293 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.290+0000 7f1266ffd640 1 -- 10.20.193.91:0/1950003782 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1250003610 con 0x7f1280166f70 2026-02-12T03:58:46.293 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.291+0000 7f6fe8ff9640 1 -- 10.20.193.91:0/2303746013 <== mon.1 v1:10.20.193.98:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3715359540 0 0) 0x7f6fec15e020 con 0x7f6fec0b7180 2026-02-12T03:58:46.294 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.291+0000 7f6fe8ff9640 1 -- 10.20.193.91:0/2303746013 >> v1:10.20.193.111:6789/0 conn(0x7f6fec0b57a0 legacy=0x7f6fec153430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.294 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.291+0000 7f6fe8ff9640 1 -- 10.20.193.91:0/2303746013 >> v1:10.20.193.91:6789/0 conn(0x7f6fec0b5b70 legacy=0x7f6fec057450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.294 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.291+0000 7f6fe8ff9640 10 monclient: _finish_hunting 0 2026-02-12T03:58:46.294 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.291+0000 7f6fe8ff9640 1 monclient: found mon.b 2026-02-12T03:58:46.294 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.291+0000 7f6fe8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:46.294 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.291+0000 7f6fe8ff9640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:46.294 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.291+0000 7f6fe8ff9640 1 -- 10.20.193.91:0/2303746013 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fec15e300 con 0x7f6fec0b7180 2026-02-12T03:58:46.294 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.291+0000 7f6fe8ff9640 10 monclient: _finish_auth 0 2026-02-12T03:58:46.294 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.291+0000 7f6fe8ff9640 10 monclient: _check_auth_tickets 2026-02-12T03:58:46.294 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.291+0000 7f6fe8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:46.294 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.291+0000 7f6ff24a2640 5 monclient: authenticate success, global_id 4558 2026-02-12T03:58:46.294 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.291+0000 7f6ff24a2640 10 monclient: _renew_subs 2026-02-12T03:58:46.294 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.291+0000 7f6ff24a2640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:46.294 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.291+0000 7f6ff24a2640 1 -- 10.20.193.91:0/2303746013 --> v1:10.20.193.98:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6fec15e5e0 con 0x7f6fec0b7180 2026-02-12T03:58:46.294 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.291+0000 7f6ff24a2640 10 client.4558.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:46.294 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.291+0000 7f6ff24a2640 10 monclient: _renew_subs 2026-02-12T03:58:46.295 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.291+0000 7f6ff24a2640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:46.295 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.291+0000 7f6ff24a2640 1 -- 10.20.193.91:0/2303746013 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6fec1fb720 con 0x7f6fec0b7180 2026-02-12T03:58:46.295 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.291+0000 7f6ff24a2640 1 librados: init done 2026-02-12T03:58:46.295 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.291+0000 7fb05dffb640 1 -- 10.20.193.91:0/2633229468 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3006919826 0 0) 0x7fb040003610 con 0x7fb0700b7180 2026-02-12T03:58:46.295 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.291+0000 7fb05dffb640 1 -- 10.20.193.91:0/2633229468 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb070133f10 con 0x7fb0700b7180 2026-02-12T03:58:46.295 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.291+0000 7fb05dffb640 1 -- 10.20.193.91:0/2633229468 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fb06c0033e0 con 0x7fb0700b7180 2026-02-12T03:58:46.295 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.291+0000 7fb05dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:46.295 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.291+0000 7fb05dffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:46.295 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.291+0000 7fb05dffb640 10 monclient(hunting): dump: 2026-02-12T03:58:46.295 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.295 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.296 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.296 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.296 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.296 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.296 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.296 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.296 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.296 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.296 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.291+0000 7f6ff24a2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.296 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.291+0000 7f6ff24a2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.296 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.291+0000 7f6ff24a2640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:46.296 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.291+0000 7f6ff24a2640 1 -- 10.20.193.91:0/2303746013 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fec163c70 con 0x7f6fec0b7180 2026-02-12T03:58:46.297 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.295+0000 7f66a17fa640 1 -- 10.20.193.91:0/4196024287 <== mon.1 v1:10.20.193.98:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f669c003700 con 0x7f66ac0b57a0 2026-02-12T03:58:46.297 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.295+0000 7f66a17fa640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:46.297 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.295+0000 7f66a17fa640 1 -- 10.20.193.91:0/4196024287 <== mon.1 v1:10.20.193.98:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f669c003930 con 0x7f66ac0b57a0 2026-02-12T03:58:46.297 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.295+0000 7f66a17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.297 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.295+0000 7f66a17fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:46.297 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.295+0000 7f66a2ffd640 4 set_mon_vals no callback set 2026-02-12T03:58:46.297 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.295+0000 7f66a17fa640 10 monclient: dump: 2026-02-12T03:58:46.297 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.298 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.298 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.298 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.298 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.298 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.298 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.298 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.298 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.298 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.298 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.296+0000 7f66a17fa640 1 -- 10.20.193.91:0/4196024287 <== mon.1 v1:10.20.193.98:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f669c003b10 con 0x7f66ac0b57a0 2026-02-12T03:58:46.298 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.297+0000 7f66a3fff640 10 monclient: get_auth_request con 0x7f667c079fa0 auth_method 0 2026-02-12T03:58:46.299 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.297+0000 7fa6b1ffb640 1 -- 10.20.193.91:0/4031026666 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 421309706 0 0) 0x7fa6c4131580 con 0x7fa6c40b7180 2026-02-12T03:58:46.299 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.297+0000 7fa6b1ffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.299 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.297+0000 7fa6b1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.299 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.297+0000 7fa6b1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.299 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.297+0000 7fa6b1ffb640 10 monclient(hunting): my global_id is 4572 2026-02-12T03:58:46.299 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.297+0000 7fa6b1ffb640 1 -- 10.20.193.91:0/4031026666 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6c4131860 con 0x7fa6c40b7180 2026-02-12T03:58:46.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.297+0000 7f66a17fa640 10 client.4549.objecter ms_handle_connect 0x7f667c079fa0 2026-02-12T03:58:46.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.297+0000 7fd6e57fa640 1 -- 10.20.193.91:0/2036611536 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2837881099 0 0) 0x7fd6f011d0c0 con 0x7fd6f00b7180 2026-02-12T03:58:46.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.297+0000 7fd6e57fa640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.297+0000 7fd6e57fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.297+0000 7fd6e57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.297+0000 7fd6e57fa640 10 monclient(hunting): my global_id is 4575 2026-02-12T03:58:46.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.297+0000 7fd6e57fa640 1 -- 10.20.193.91:0/2036611536 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6f011d360 con 0x7fd6f00b7180 2026-02-12T03:58:46.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.297+0000 7fa6b1ffb640 1 -- 10.20.193.91:0/4031026666 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1795568101 0 0) 0x7fa694003610 con 0x7fa6c40b5b70 2026-02-12T03:58:46.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.297+0000 7fa6b1ffb640 1 -- 10.20.193.91:0/4031026666 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa6c4131580 con 0x7fa6c40b5b70 2026-02-12T03:58:46.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.297+0000 7fa6b1ffb640 1 -- 10.20.193.91:0/4031026666 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fa6b80030f0 con 0x7fa6c40b5b70 2026-02-12T03:58:46.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.297+0000 7f66a17fa640 1 -- 10.20.193.91:0/4196024287 <== mon.1 v1:10.20.193.98:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7f669c094a60 con 0x7f66ac0b57a0 2026-02-12T03:58:46.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.297+0000 7f66a17fa640 10 client.4549.objecter ms_dispatch2 0x7f66ac000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:46.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.297+0000 7fa6b1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:46.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.297+0000 7fa6b1ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:46.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.297+0000 7f66a17fa640 3 client.4549.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:46.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.297+0000 7f66a17fa640 3 client.4549.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:46.302 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.297+0000 7fa6b1ffb640 10 monclient(hunting): dump: 2026-02-12T03:58:46.302 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.302 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.302 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.302 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.302 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.302 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.302 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.302 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.302 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.302 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.302 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.298+0000 7fa6b1ffb640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:46.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.298+0000 7f66a17fa640 20 client.4549.objecter dump_active .. 0 homeless 2026-02-12T03:58:46.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.298+0000 7fd47effd640 1 -- 10.20.193.91:0/1771820188 <== mon.2 v1:10.20.193.111:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7fd48805e670 con 0x7fd4980b7180 2026-02-12T03:58:46.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.298+0000 7fd47effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.298+0000 7fd47effd640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:46.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.298+0000 7f717dffb640 1 -- 10.20.193.91:0/3447493771 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7f7184094a80 con 0x7f71901599b0 2026-02-12T03:58:46.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.298+0000 7f717dffb640 10 client.4533.objecter ms_dispatch2 0x7f7190000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:46.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.298+0000 7f717dffb640 3 client.4533.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:46.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.298+0000 7f717dffb640 3 client.4533.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:46.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.298+0000 7f717dffb640 20 client.4533.objecter dump_active .. 0 homeless 2026-02-12T03:58:46.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.298+0000 7fd4e54d4640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-12T03:58:46.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.298+0000 7fd4e54d4640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-12T03:58:46.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.298+0000 7fd4e54d4640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:46.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.298+0000 7fd4e54d4640 1 -- 10.20.193.91:0/876055338 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fd4e00b7290 con 0x7fd4e00560d0 2026-02-12T03:58:46.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.298+0000 7f717dffb640 1 -- 10.20.193.91:0/3447493771 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f71901676d0 con 0x7f71901599b0 2026-02-12T03:58:46.305 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.298+0000 7f717dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.305 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.298+0000 7f717dffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:46.305 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.299+0000 7f9222ffd640 10 client.?.objecter ms_handle_connect 0x7f923c0b5b70 2026-02-12T03:58:46.305 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.299+0000 7f9222ffd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.305 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.299+0000 7f66a17fa640 1 -- 10.20.193.91:0/4196024287 <== mon.1 v1:10.20.193.98:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f669c05e3c0 con 0x7f66ac0b57a0 2026-02-12T03:58:46.305 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.299+0000 7f66a17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.305 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.299+0000 7f66a17fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:46.306 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.300+0000 7fd7c97fa640 1 -- 10.20.193.91:0/1283175197 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3036491663 0 0) 0x7fd7d40ae500 con 0x7fd7d415d740 2026-02-12T03:58:46.306 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.300+0000 7fd7c97fa640 1 -- 10.20.193.91:0/1283175197 >> v1:10.20.193.111:6789/0 conn(0x7fd7d40b8090 legacy=0x7fd7d40addf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.306 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.300+0000 7fd7c97fa640 1 -- 10.20.193.91:0/1283175197 >> v1:10.20.193.98:6789/0 conn(0x7fd7d40b5480 legacy=0x7fd7d4139960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.306 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.300+0000 7fd7c97fa640 10 monclient: _finish_hunting 0 2026-02-12T03:58:46.306 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.300+0000 7fd7c97fa640 1 monclient: found mon.a 2026-02-12T03:58:46.306 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.300+0000 7fd7c97fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:46.306 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.300+0000 7fd7c97fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:46.306 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.300+0000 7fd7c97fa640 1 -- 10.20.193.91:0/1283175197 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d415f960 con 0x7fd7d415d740 2026-02-12T03:58:46.306 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.300+0000 7fd7c97fa640 10 monclient: _finish_auth 0 2026-02-12T03:58:46.307 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.300+0000 7fd7c97fa640 10 monclient: _check_auth_tickets 2026-02-12T03:58:46.307 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.300+0000 7fd7c97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:46.307 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.300+0000 7fd7db224640 5 monclient: authenticate success, global_id 4557 2026-02-12T03:58:46.307 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.300+0000 7fd7db224640 10 monclient: _renew_subs 2026-02-12T03:58:46.307 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.300+0000 7fb60affd640 10 client.?.objecter ms_handle_connect 0x7fb62415e530 2026-02-12T03:58:46.307 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.300+0000 7fb60affd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.307 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.300+0000 7fd7db224640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:46.307 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.300+0000 7fd7db224640 1 -- 10.20.193.91:0/1283175197 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd7d415fc40 con 0x7fd7d415d740 2026-02-12T03:58:46.308 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.300+0000 7fd7db224640 10 client.4557.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:46.308 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.300+0000 7fd7db224640 10 monclient: _renew_subs 2026-02-12T03:58:46.308 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.300+0000 7fd7db224640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:46.308 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.300+0000 7fd7db224640 1 -- 10.20.193.91:0/1283175197 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd7d4160200 con 0x7fd7d415d740 2026-02-12T03:58:46.308 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.300+0000 7fd7db224640 1 librados: init done 2026-02-12T03:58:46.308 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.300+0000 7f8beeffd640 1 -- 10.20.193.91:0/3055226452 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2575582863 0 0) 0x7f8c08137600 con 0x7f8c080b5b70 2026-02-12T03:58:46.308 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.301+0000 7f8beeffd640 1 -- 10.20.193.91:0/3055226452 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8c0812a010 con 0x7f8c080b5b70 2026-02-12T03:58:46.308 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.301+0000 7f8beeffd640 1 -- 10.20.193.91:0/3055226452 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8bfc003050 con 0x7f8c080b5b70 2026-02-12T03:58:46.308 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.301+0000 7f8beeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:46.308 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.301+0000 7f8beeffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:46.308 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.301+0000 7f8beeffd640 10 monclient(hunting): dump: 2026-02-12T03:58:46.309 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.309 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.309 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.309 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.309 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.309 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.309 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.309 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.309 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.309 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.309 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.301+0000 7f8beeffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:46.309 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.301+0000 7f1266ffd640 1 -- 10.20.193.91:0/1950003782 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3736770562 0 0) 0x7f128012c4e0 con 0x7f1280164760 2026-02-12T03:58:46.309 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.301+0000 7f1266ffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.310 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.301+0000 7f1266ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.310 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.301+0000 7f1266ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.310 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.301+0000 7f1266ffd640 10 monclient(hunting): my global_id is 4578 2026-02-12T03:58:46.310 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.301+0000 7f1266ffd640 1 -- 10.20.193.91:0/1950003782 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f128012b680 con 0x7f1280164760 2026-02-12T03:58:46.310 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.301+0000 7fd7db224640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.310 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.301+0000 7fd7db224640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.310 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.301+0000 7fd7db224640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:46.310 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.301+0000 7fd7db224640 1 -- 10.20.193.91:0/1283175197 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7d40b22d0 con 0x7fd7d415d740 2026-02-12T03:58:46.311 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.302+0000 7fa59b7fe640 1 -- 10.20.193.91:0/859043063 <== mon.2 v1:10.20.193.111:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa5a40048d0 con 0x7fa5bc0b5b70 2026-02-12T03:58:46.311 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.302+0000 7fa59b7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:46.311 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.302+0000 7fa59b7fe640 1 -- 10.20.193.91:0/859043063 <== mon.2 v1:10.20.193.111:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fa5a4004ce0 con 0x7fa5bc0b5b70 2026-02-12T03:58:46.311 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.302+0000 7fa59b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.311 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.302+0000 7fa59b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:46.311 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.302+0000 7fa59b7fe640 10 monclient: dump: 2026-02-12T03:58:46.311 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.311 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.311 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.311 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.311 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.311 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.311 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.311 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.311 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.311 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.312 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.302+0000 7fa5b9573640 4 set_mon_vals no callback set 2026-02-12T03:58:46.312 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.302+0000 7fd6e57fa640 1 -- 10.20.193.91:0/2036611536 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3532520858 0 0) 0x7fd6f011d640 con 0x7fd6f00b57a0 2026-02-12T03:58:46.312 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.302+0000 7fd6e57fa640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.312 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.302+0000 7fd6e57fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.312 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.302+0000 7fd6e57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.312 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.302+0000 7fd6e57fa640 10 monclient(hunting): my global_id is 4535 2026-02-12T03:58:46.312 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.302+0000 7fd6e57fa640 1 -- 10.20.193.91:0/2036611536 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6f011d0c0 con 0x7fd6f00b57a0 2026-02-12T03:58:46.312 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.302+0000 7f1266ffd640 1 -- 10.20.193.91:0/1950003782 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3672030711 0 0) 0x7f128012b960 con 0x7f1280159b70 2026-02-12T03:58:46.313 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.302+0000 7f1266ffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.313 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.302+0000 7f1266ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.313 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.302+0000 7f1266ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.313 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.302+0000 7f1266ffd640 10 monclient(hunting): my global_id is 4538 2026-02-12T03:58:46.313 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.302+0000 7f1266ffd640 1 -- 10.20.193.91:0/1950003782 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f128012c4e0 con 0x7f1280159b70 2026-02-12T03:58:46.313 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.302+0000 7fb05dffb640 1 -- 10.20.193.91:0/2633229468 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1839875258 0 0) 0x7fb0701341f0 con 0x7fb0700b5b70 2026-02-12T03:58:46.313 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.302+0000 7fb05dffb640 1 -- 10.20.193.91:0/2633229468 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb040003610 con 0x7fb0700b5b70 2026-02-12T03:58:46.313 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.302+0000 7fb05dffb640 1 -- 10.20.193.91:0/2633229468 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fb064003310 con 0x7fb0700b5b70 2026-02-12T03:58:46.313 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.302+0000 7fb05dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:46.313 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.302+0000 7fb05dffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:46.314 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.302+0000 7fb05dffb640 10 monclient(hunting): dump: 2026-02-12T03:58:46.314 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.314 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.314 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.314 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.314 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.314 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.314 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.314 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.314 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.314 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.314 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.303+0000 7fa59b7fe640 1 -- 10.20.193.91:0/859043063 <== mon.2 v1:10.20.193.111:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7fa5a4004ec0 con 0x7fa5bc0b5b70 2026-02-12T03:58:46.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.303+0000 7f8beeffd640 1 -- 10.20.193.91:0/3055226452 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1940096065 0 0) 0x7f8c08162c40 con 0x7f8c080b57a0 2026-02-12T03:58:46.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.303+0000 7f8beeffd640 1 -- 10.20.193.91:0/3055226452 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8c08137600 con 0x7f8c080b57a0 2026-02-12T03:58:46.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.303+0000 7f8beeffd640 1 -- 10.20.193.91:0/3055226452 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8bf8003090 con 0x7f8c080b57a0 2026-02-12T03:58:46.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.303+0000 7f8beeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:46.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.303+0000 7f8beeffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:46.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.303+0000 7f8beeffd640 10 monclient(hunting): dump: 2026-02-12T03:58:46.315 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.315 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.315 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.315 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.315 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.315 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.315 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.315 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.315 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.315 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.303+0000 7fa5bad76640 10 monclient: get_auth_request con 0x7fa588079fb0 auth_method 0 2026-02-12T03:58:46.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.304+0000 7fa59b7fe640 10 client.4520.objecter ms_handle_connect 0x7fa588079fb0 2026-02-12T03:58:46.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.304+0000 7f9222ffd640 1 -- 10.20.193.91:0/598495024 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1142766777 0 0) 0x7f923c156a70 con 0x7f923c0b5b70 2026-02-12T03:58:46.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.304+0000 7f9222ffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.304+0000 7f9222ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.304+0000 7f9222ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.304+0000 7f9222ffd640 10 monclient(hunting): my global_id is 4581 2026-02-12T03:58:46.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.304+0000 7f9222ffd640 1 -- 10.20.193.91:0/598495024 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f920c003610 con 0x7f923c0b5b70 2026-02-12T03:58:46.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.304+0000 7fd7c97fa640 1 -- 10.20.193.91:0/1283175197 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd7d0003a80 con 0x7fd7d415d740 2026-02-12T03:58:46.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.304+0000 7fd7c97fa640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:46.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.304+0000 7fd7caffd640 4 set_mon_vals no callback set 2026-02-12T03:58:46.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.304+0000 7fa59b7fe640 1 -- 10.20.193.91:0/859043063 <== mon.2 v1:10.20.193.111:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7fa5a4095c20 con 0x7fa5bc0b5b70 2026-02-12T03:58:46.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.304+0000 7fa59b7fe640 10 client.4520.objecter ms_dispatch2 0x7fa5bc000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:46.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.304+0000 7fa59b7fe640 3 client.4520.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:46.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.304+0000 7fa59b7fe640 3 client.4520.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:46.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.304+0000 7fa59b7fe640 20 client.4520.objecter dump_active .. 0 homeless 2026-02-12T03:58:46.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.306+0000 7fa59b7fe640 1 -- 10.20.193.91:0/859043063 <== mon.2 v1:10.20.193.111:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7fa5a405f580 con 0x7fa5bc0b5b70 2026-02-12T03:58:46.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.306+0000 7fa59b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.306+0000 7fa59b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:46.318 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.307+0000 7fb60affd640 10 client.?.objecter ms_handle_connect 0x7fb6240b3210 2026-02-12T03:58:46.318 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.307+0000 7fb60affd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.346 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.345+0000 7fd7c97fa640 1 -- 10.20.193.91:0/1283175197 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd7d0003e50 con 0x7fd7d415d740 2026-02-12T03:58:46.346 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.345+0000 7fd7c97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.346 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.345+0000 7fd7c97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:46.346 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.345+0000 7fd7c97fa640 10 monclient: dump: 2026-02-12T03:58:46.347 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.347 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.347 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.347 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.347 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.347 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.347 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.347 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.347 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.347 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.392 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.391+0000 7faffffdf640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-12T03:58:46.392 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.391+0000 7faffffdf640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-12T03:58:46.393 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.391+0000 7faffffdf640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:46.393 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.391+0000 7faffffdf640 1 -- 10.20.193.91:0/3045807994 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7faff8056e10 con 0x7faff8161ad0 2026-02-12T03:58:46.399 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.397+0000 7f8beeffd640 1 -- 10.20.193.91:0/3055226452 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2591960980 0 0) 0x7f8bd8003610 con 0x7f8c080b7180 2026-02-12T03:58:46.399 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.397+0000 7f8beeffd640 1 -- 10.20.193.91:0/3055226452 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8c08162c40 con 0x7f8c080b7180 2026-02-12T03:58:46.399 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.397+0000 7f8beeffd640 1 -- 10.20.193.91:0/3055226452 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8c04003080 con 0x7f8c080b7180 2026-02-12T03:58:46.399 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.397+0000 7f8beeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:46.399 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.397+0000 7f8beeffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:46.399 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.397+0000 7f8beeffd640 10 monclient(hunting): dump: 2026-02-12T03:58:46.399 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.399 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.400 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.400 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.400 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.400 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.400 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.400 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.400 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.400 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.401 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.399+0000 7f9222ffd640 10 client.?.objecter ms_handle_connect 0x7f923c0b7180 2026-02-12T03:58:46.401 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.399+0000 7f9222ffd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:46.403 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.401+0000 7f6fe8ff9640 1 -- 10.20.193.91:0/2303746013 <== mon.1 v1:10.20.193.98:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6fe0004c50 con 0x7f6fec0b7180 2026-02-12T03:58:46.403 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.401+0000 7f6fe8ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:46.403 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.401+0000 7f6fe8ff9640 1 -- 10.20.193.91:0/2303746013 <== mon.1 v1:10.20.193.98:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f6fe0004fa0 con 0x7f6fec0b7180 2026-02-12T03:58:46.403 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.401+0000 7f6fe8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.403 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.401+0000 7f6fe8ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:46.403 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.401+0000 7f6fea7fc640 4 set_mon_vals no callback set 2026-02-12T03:58:46.403 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.401+0000 7f6fe8ff9640 10 monclient: dump: 2026-02-12T03:58:46.403 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.403 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.404 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.404 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.404 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.404 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.404 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.404 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.404 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.404 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.405 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.402+0000 7f6fe8ff9640 1 -- 10.20.193.91:0/2303746013 <== mon.1 v1:10.20.193.98:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f6fe001e480 con 0x7f6fec0b7180 2026-02-12T03:58:46.405 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.403+0000 7f6febfff640 10 monclient: get_auth_request con 0x7f6fb8079ef0 auth_method 0 2026-02-12T03:58:46.405 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.403+0000 7f6fe8ff9640 10 client.4558.objecter ms_handle_connect 0x7f6fb8079ef0 2026-02-12T03:58:46.405 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.403+0000 7f6fe8ff9640 1 -- 10.20.193.91:0/2303746013 <== mon.1 v1:10.20.193.98:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7f6fe0095f20 con 0x7f6fec0b7180 2026-02-12T03:58:46.406 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.403+0000 7f6fe8ff9640 10 client.4558.objecter ms_dispatch2 0x7f6fec000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:46.406 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.403+0000 7f6fe8ff9640 3 client.4558.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:46.406 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.403+0000 7f6fe8ff9640 3 client.4558.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:46.406 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.403+0000 7f6fe8ff9640 20 client.4558.objecter dump_active .. 0 homeless 2026-02-12T03:58:46.406 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.405+0000 7f6fe8ff9640 1 -- 10.20.193.91:0/2303746013 <== mon.1 v1:10.20.193.98:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f6fe00cfc30 con 0x7f6fec0b7180 2026-02-12T03:58:46.406 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.405+0000 7f6fe8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.406 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.405+0000 7f6fe8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:46.407 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.405+0000 7fd4bf7fe640 1 -- 10.20.193.91:0/876055338 <== mon.1 v1:10.20.193.98:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (unknown 1482059429 0 213165853) 0x7fd4d405ef70 con 0x7fd4e00560d0 2026-02-12T03:58:46.407 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.405+0000 7fd4bf7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-12T03:58:46.407 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.405+0000 7fd4bf7fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:46.408 INFO:teuthology.orchestra.run.trial091.stdout:94489280517 2026-02-12T03:58:46.408 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.405+0000 7f0aa6ffd640 1 -- 10.20.193.91:0/3309826704 <== mon.2 v1:10.20.193.111:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0aa8003700 con 0x7f0ac00b5b70 2026-02-12T03:58:46.408 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.405+0000 7f0aa6ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:46.408 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.405+0000 7f0aa6ffd640 1 -- 10.20.193.91:0/3309826704 <== mon.2 v1:10.20.193.111:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f0aa8003a90 con 0x7f0ac00b5b70 2026-02-12T03:58:46.408 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.405+0000 7f0aa6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.409 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.405+0000 7f0aa6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:46.409 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.405+0000 7f0aa6ffd640 10 monclient: dump: 2026-02-12T03:58:46.409 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.409 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.409 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.409 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.409 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.409 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.409 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.409 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.409 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.409 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.410 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.405+0000 7f0abcd72640 4 set_mon_vals no callback set 2026-02-12T03:58:46.410 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.406+0000 7f0aa6ffd640 1 -- 10.20.193.91:0/3309826704 <== mon.2 v1:10.20.193.111:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f0aa8003c70 con 0x7f0ac00b5b70 2026-02-12T03:58:46.410 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.407+0000 7f0abe575640 10 monclient: get_auth_request con 0x7f0a8c079fa0 auth_method 0 2026-02-12T03:58:46.411 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.407+0000 7f0aa6ffd640 10 client.4523.objecter ms_handle_connect 0x7f0a8c079fa0 2026-02-12T03:58:46.411 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.408+0000 7f0aa6ffd640 1 -- 10.20.193.91:0/3309826704 <== mon.2 v1:10.20.193.111:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7f0aa8094a70 con 0x7f0ac00b5b70 2026-02-12T03:58:46.411 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.408+0000 7f0aa6ffd640 10 client.4523.objecter ms_dispatch2 0x7f0ac0000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:46.411 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.408+0000 7f0aa6ffd640 3 client.4523.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:46.411 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.408+0000 7f0aa6ffd640 3 client.4523.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:46.411 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.408+0000 7f0aa6ffd640 20 client.4523.objecter dump_active .. 0 homeless 2026-02-12T03:58:46.412 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.408+0000 7fb05dffb640 1 -- 10.20.193.91:0/2633229468 <== mon.2 v1:10.20.193.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2881194732 0 0) 0x7fb0701344d0 con 0x7fb0700b57a0 2026-02-12T03:58:46.412 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.408+0000 7fb05dffb640 1 -- 10.20.193.91:0/2633229468 >> v1:10.20.193.98:6789/0 conn(0x7fb0700b7180 legacy=0x7fb070133070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.412 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.408+0000 7fb05dffb640 1 -- 10.20.193.91:0/2633229468 >> v1:10.20.193.91:6789/0 conn(0x7fb0700b5b70 legacy=0x7fb070057210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.412 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.408+0000 7fb05dffb640 10 monclient: _finish_hunting 0 2026-02-12T03:58:46.412 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.408+0000 7fb05dffb640 1 monclient: found mon.c 2026-02-12T03:58:46.412 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.408+0000 7fb05dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:46.413 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.408+0000 7fb05dffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:46.413 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.408+0000 7fb05dffb640 1 -- 10.20.193.91:0/2633229468 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0701347b0 con 0x7fb0700b57a0 2026-02-12T03:58:46.413 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.408+0000 7fb05dffb640 10 monclient: _finish_auth 0 2026-02-12T03:58:46.413 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.408+0000 7fb05dffb640 10 monclient: _check_auth_tickets 2026-02-12T03:58:46.413 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.408+0000 7fb05dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:46.413 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.408+0000 7fb07741f640 5 monclient: authenticate success, global_id 4517 2026-02-12T03:58:46.413 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.408+0000 7fb07741f640 10 monclient: _renew_subs 2026-02-12T03:58:46.413 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.408+0000 7fb07741f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:46.413 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.408+0000 7fb07741f640 1 -- 10.20.193.91:0/2633229468 --> v1:10.20.193.111:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb070135be0 con 0x7fb0700b57a0 2026-02-12T03:58:46.414 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.408+0000 7fd4e54d4640 10 librados: watch_flush enter 2026-02-12T03:58:46.414 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.408+0000 7fd4e54d4640 10 librados: watch_flush exit 2026-02-12T03:58:46.414 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.408+0000 7fb07741f640 10 client.4517.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:46.414 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.408+0000 7fb07741f640 10 monclient: _renew_subs 2026-02-12T03:58:46.415 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.408+0000 7fd4e54d4640 20 client.4543.objecter shutdown clearing up homeless session... 2026-02-12T03:58:46.415 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.408+0000 7fd4e54d4640 10 client.4543.objecter successfully canceled tick 2026-02-12T03:58:46.415 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.408+0000 7fb07741f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:46.415 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.408+0000 7fb07741f640 1 -- 10.20.193.91:0/2633229468 --> v1:10.20.193.111:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb070136af0 con 0x7fb0700b57a0 2026-02-12T03:58:46.416 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.408+0000 7fb07741f640 1 librados: init done 2026-02-12T03:58:46.416 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.408+0000 7fd4e54d4640 1 -- 10.20.193.91:0/876055338 >> v1:10.20.193.91:6800/2929217192 conn(0x7fd4ac079f80 legacy=0x7fd4ac09a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.408+0000 7fd4e54d4640 10 monclient: shutdown 2026-02-12T03:58:46.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.408+0000 7fd4e54d4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:46.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.408+0000 7fd4e54d4640 1 -- 10.20.193.91:0/876055338 >> v1:10.20.193.98:6789/0 conn(0x7fd4e00560d0 legacy=0x7fd4e014b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.408+0000 7fd4e54d4640 1 -- 10.20.193.91:0/876055338 shutdown_connections 2026-02-12T03:58:46.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.408+0000 7fd4e54d4640 1 -- 10.20.193.91:0/876055338 >> 10.20.193.91:0/876055338 conn(0x7fd4e00b6560 msgr2=0x7fd4e0056f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:46.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.408+0000 7fd4e54d4640 1 -- 10.20.193.91:0/876055338 shutdown_connections 2026-02-12T03:58:46.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.408+0000 7fd4e54d4640 1 -- 10.20.193.91:0/876055338 wait complete. 2026-02-12T03:58:46.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.409+0000 7fd4e54d4640 1 librados: shutdown 2026-02-12T03:58:46.418 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.409+0000 7fb07741f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.418 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.409+0000 7fb07741f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.418 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.409+0000 7fb07741f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:46.418 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.409+0000 7fb07741f640 1 -- 10.20.193.91:0/2633229468 --> v1:10.20.193.111:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb070136d80 con 0x7fb0700b57a0 2026-02-12T03:58:46.418 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.410+0000 7f0aa6ffd640 1 -- 10.20.193.91:0/3309826704 <== mon.2 v1:10.20.193.111:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f0aa805e3d0 con 0x7f0ac00b5b70 2026-02-12T03:58:46.418 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.410+0000 7f0aa6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.419 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.410+0000 7f0aa6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:46.419 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.410+0000 7fd49ccae640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-12T03:58:46.419 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.410+0000 7fd49ccae640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-12T03:58:46.419 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.410+0000 7fd49ccae640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:46.419 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.410+0000 7fd49ccae640 1 -- 10.20.193.91:0/1771820188 --> v1:10.20.193.111:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fd498134b20 con 0x7fd4980b7180 2026-02-12T03:58:46.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.410+0000 7fb60affd640 1 -- 10.20.193.91:0/4049698237 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 906582604 0 0) 0x7fb624132dc0 con 0x7fb6240b3210 2026-02-12T03:58:46.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.410+0000 7fb60affd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.410+0000 7fb60affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.410+0000 7fb60affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.410+0000 7fb60affd640 10 monclient(hunting): my global_id is 4541 2026-02-12T03:58:46.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.410+0000 7fb60affd640 1 -- 10.20.193.91:0/4049698237 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5f0003610 con 0x7fb6240b3210 2026-02-12T03:58:46.421 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.414+0000 7f719750a640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-12T03:58:46.421 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.414+0000 7f719750a640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-12T03:58:46.421 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.414+0000 7f719750a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:46.421 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.414+0000 7f719750a640 1 -- 10.20.193.91:0/3447493771 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 12} v 0) -- 0x7f7190135100 con 0x7f71901599b0 2026-02-12T03:58:46.422 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.415+0000 7f66b2c4c640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-12T03:58:46.422 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.415+0000 7f66b2c4c640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-12T03:58:46.422 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.415+0000 7f66b2c4c640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:46.422 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.415+0000 7f66b2c4c640 1 -- 10.20.193.91:0/4196024287 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f66ac0b60e0 con 0x7f66ac0b57a0 2026-02-12T03:58:46.422 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.416+0000 7fd7c97fa640 1 -- 10.20.193.91:0/1283175197 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7fd7d0004070 con 0x7fd7d415d740 2026-02-12T03:58:46.423 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.417+0000 7fd7d8f99640 10 monclient: get_auth_request con 0x7fd7a407a180 auth_method 0 2026-02-12T03:58:46.423 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.417+0000 7fd7c97fa640 10 client.4557.objecter ms_handle_connect 0x7fd7a407a180 2026-02-12T03:58:46.423 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.417+0000 7f66a17fa640 1 -- 10.20.193.91:0/4196024287 <== mon.1 v1:10.20.193.98:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 778662779) 0x7f669c05dcc0 con 0x7f66ac0b57a0 2026-02-12T03:58:46.423 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.417+0000 7f66a17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-12T03:58:46.423 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.417+0000 7f66a17fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:46.424 INFO:teuthology.orchestra.run.trial091.stdout:90194313219 2026-02-12T03:58:46.425 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280518 got 94489280517 for osd.7 2026-02-12T03:58:46.426 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.419+0000 7f66b2c4c640 10 librados: watch_flush enter 2026-02-12T03:58:46.426 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.419+0000 7f66b2c4c640 10 librados: watch_flush exit 2026-02-12T03:58:46.426 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.419+0000 7f66b2c4c640 20 client.4549.objecter shutdown clearing up homeless session... 2026-02-12T03:58:46.426 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.419+0000 7f66b2c4c640 10 client.4549.objecter successfully canceled tick 2026-02-12T03:58:46.426 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.419+0000 7f66b2c4c640 1 -- 10.20.193.91:0/4196024287 >> v1:10.20.193.91:6800/2929217192 conn(0x7f667c079fa0 legacy=0x7f667c09a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.426 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.419+0000 7f66b2c4c640 10 monclient: shutdown 2026-02-12T03:58:46.426 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.419+0000 7f66b2c4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:46.427 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.419+0000 7f66b2c4c640 1 -- 10.20.193.91:0/4196024287 >> v1:10.20.193.98:6789/0 conn(0x7f66ac0b57a0 legacy=0x7f66ac151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.427 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.419+0000 7f66b2c4c640 1 -- 10.20.193.91:0/4196024287 shutdown_connections 2026-02-12T03:58:46.427 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.419+0000 7f66b2c4c640 1 -- 10.20.193.91:0/4196024287 >> 10.20.193.91:0/4196024287 conn(0x7f66ac0559c0 msgr2=0x7f66ac0b8990 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:46.427 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.419+0000 7f66b2c4c640 1 -- 10.20.193.91:0/4196024287 shutdown_connections 2026-02-12T03:58:46.427 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.419+0000 7f66b2c4c640 1 -- 10.20.193.91:0/4196024287 wait complete. 2026-02-12T03:58:46.427 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.419+0000 7f66b2c4c640 1 librados: shutdown 2026-02-12T03:58:46.427 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.420+0000 7fa5c1044640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-12T03:58:46.428 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.420+0000 7fa5c1044640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-12T03:58:46.428 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.420+0000 7fa5c1044640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:46.428 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.420+0000 7fa5c1044640 1 -- 10.20.193.91:0/859043063 --> v1:10.20.193.111:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fa5bc0b60e0 con 0x7fa5bc0b5b70 2026-02-12T03:58:46.428 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.423+0000 7fb60affd640 1 -- 10.20.193.91:0/4049698237 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3842849427 0 0) 0x7fb624132800 con 0x7fb62415e530 2026-02-12T03:58:46.428 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.423+0000 7fb60affd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.428 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.423+0000 7fb60affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.428 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.423+0000 7fb60affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.428 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.423+0000 7fb60affd640 10 monclient(hunting): my global_id is 4584 2026-02-12T03:58:46.428 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.423+0000 7fb60affd640 1 -- 10.20.193.91:0/4049698237 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb624132dc0 con 0x7fb62415e530 2026-02-12T03:58:46.429 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.424+0000 7fd7c97fa640 1 -- 10.20.193.91:0/1283175197 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7fd7d005afe0 con 0x7fd7d415d740 2026-02-12T03:58:46.429 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.424+0000 7fd7c97fa640 10 client.4557.objecter ms_dispatch2 0x7fd7d4000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:46.429 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.424+0000 7fd7c97fa640 3 client.4557.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:46.429 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.424+0000 7fd7c97fa640 3 client.4557.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:46.429 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.424+0000 7fd7c97fa640 20 client.4557.objecter dump_active .. 0 homeless 2026-02-12T03:58:46.430 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.424+0000 7fd7c97fa640 1 -- 10.20.193.91:0/1283175197 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7fd7d40b22d0 con 0x7fd7d415d740 2026-02-12T03:58:46.430 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.424+0000 7fd7c97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.430 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.424+0000 7fd7c97fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:46.430 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.424+0000 7fa6b1ffb640 1 -- 10.20.193.91:0/4031026666 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 676291395 0 0) 0x7fa6c4131860 con 0x7fa6c40b7180 2026-02-12T03:58:46.430 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.424+0000 7fa6b1ffb640 1 -- 10.20.193.91:0/4031026666 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa694003610 con 0x7fa6c40b7180 2026-02-12T03:58:46.430 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.424+0000 7fa6b1ffb640 1 -- 10.20.193.91:0/4031026666 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fa6c0003530 con 0x7fa6c40b7180 2026-02-12T03:58:46.431 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.424+0000 7fa6b1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:46.431 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.424+0000 7fa6b1ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:46.431 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.424+0000 7fa6b1ffb640 10 monclient(hunting): dump: 2026-02-12T03:58:46.431 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.431 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.431 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.431 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.431 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.431 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.431 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.431 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.431 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.431 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.432 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.425+0000 7fd6e57fa640 1 -- 10.20.193.91:0/2036611536 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2673585393 0 0) 0x7fd6f011d360 con 0x7fd6f00b7180 2026-02-12T03:58:46.432 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.425+0000 7fd6e57fa640 1 -- 10.20.193.91:0/2036611536 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd6f011d640 con 0x7fd6f00b7180 2026-02-12T03:58:46.432 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.425+0000 7fd6e57fa640 1 -- 10.20.193.91:0/2036611536 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd6ec003430 con 0x7fd6f00b7180 2026-02-12T03:58:46.432 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.425+0000 7fd6e57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:46.432 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.425+0000 7fd6e57fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:46.432 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.425+0000 7fd6e57fa640 10 monclient(hunting): dump: 2026-02-12T03:58:46.432 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.432 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.432 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.432 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.433 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.433 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.433 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.433 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.433 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.433 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.433 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.425+0000 7fd6e57fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:46.433 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.426+0000 7f1266ffd640 1 -- 10.20.193.91:0/1950003782 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 572102132 0 0) 0x7f128012b680 con 0x7f1280164760 2026-02-12T03:58:46.433 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.426+0000 7f1266ffd640 1 -- 10.20.193.91:0/1950003782 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f128012b960 con 0x7f1280164760 2026-02-12T03:58:46.433 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.426+0000 7f1266ffd640 1 -- 10.20.193.91:0/1950003782 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f1274003310 con 0x7f1280164760 2026-02-12T03:58:46.434 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.426+0000 7f1266ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:46.434 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.426+0000 7f1266ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:46.434 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.426+0000 7f1266ffd640 10 monclient(hunting): dump: 2026-02-12T03:58:46.434 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.434 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.434 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.434 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.434 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.434 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.434 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.434 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.434 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.434 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.434 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.426+0000 7f1266ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:46.435 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.426+0000 7f9222ffd640 1 -- 10.20.193.91:0/598495024 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1498653280 0 0) 0x7f920c003610 con 0x7f923c0b5b70 2026-02-12T03:58:46.435 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.426+0000 7f9222ffd640 1 -- 10.20.193.91:0/598495024 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f923c156a70 con 0x7f923c0b5b70 2026-02-12T03:58:46.435 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.426+0000 7f9222ffd640 1 -- 10.20.193.91:0/598495024 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f9230003350 con 0x7f923c0b5b70 2026-02-12T03:58:46.435 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.426+0000 7f9222ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:46.435 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.426+0000 7f9222ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:46.435 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.426+0000 7f9222ffd640 10 monclient(hunting): dump: 2026-02-12T03:58:46.435 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.435 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.435 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.435 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.436 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.436 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.436 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.436 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.436 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.436 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.436 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.426+0000 7f9222ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:46.437 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.4 2026-02-12T03:58:46.446 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.444+0000 7fafe67fc640 1 -- 10.20.193.91:0/3045807994 <== mon.0 v1:10.20.193.91:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 778662779) 0x7fafec05ecd0 con 0x7faff8161ad0 2026-02-12T03:58:46.446 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.444+0000 7fafe67fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-12T03:58:46.446 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.444+0000 7fafe67fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:46.446 INFO:teuthology.orchestra.run.trial091.stdout:90194313219 2026-02-12T03:58:46.447 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.445+0000 7f717dffb640 1 -- 10.20.193.91:0/3447493771 <== mon.0 v1:10.20.193.91:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 12}]=0 v0) ==== 75+0+12 (unknown 4263375189 0 1257367751) 0x7f718405e3e0 con 0x7f71901599b0 2026-02-12T03:58:46.447 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.445+0000 7f717dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-12T03:58:46.447 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.445+0000 7f717dffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:46.448 INFO:teuthology.orchestra.run.trial091.stdout:90194313220 2026-02-12T03:58:46.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7f8beeffd640 1 -- 10.20.193.91:0/3055226452 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2202047355 0 0) 0x7f8c08137600 con 0x7f8c080b57a0 2026-02-12T03:58:46.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7f8beeffd640 1 -- 10.20.193.91:0/3055226452 >> v1:10.20.193.111:6789/0 conn(0x7f8c080b7180 legacy=0x7f8c081568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7f8beeffd640 1 -- 10.20.193.91:0/3055226452 >> v1:10.20.193.98:6789/0 conn(0x7f8c080b5b70 legacy=0x7f8c08162530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7f8beeffd640 10 monclient: _finish_hunting 0 2026-02-12T03:58:46.450 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7f8beeffd640 1 monclient: found mon.a 2026-02-12T03:58:46.450 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7f8beeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:46.450 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7f8beeffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:46.450 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7f8beeffd640 1 -- 10.20.193.91:0/3055226452 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c081378e0 con 0x7f8c080b57a0 2026-02-12T03:58:46.450 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7f8beeffd640 10 monclient: _finish_auth 0 2026-02-12T03:58:46.450 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7f8beeffd640 10 monclient: _check_auth_tickets 2026-02-12T03:58:46.450 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7f8beeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:46.450 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7f8c10768640 5 monclient: authenticate success, global_id 4569 2026-02-12T03:58:46.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7f8c10768640 10 monclient: _renew_subs 2026-02-12T03:58:46.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7f8c10768640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:46.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7f8c10768640 1 -- 10.20.193.91:0/3055226452 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8c08137bc0 con 0x7f8c080b57a0 2026-02-12T03:58:46.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7f8c10768640 10 client.4569.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:46.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7f8c10768640 10 monclient: _renew_subs 2026-02-12T03:58:46.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7f8c10768640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:46.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7f8c10768640 1 -- 10.20.193.91:0/3055226452 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8c08156fc0 con 0x7f8c080b57a0 2026-02-12T03:58:46.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7f8c10768640 1 librados: init done 2026-02-12T03:58:46.453 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7fa6b1ffb640 1 -- 10.20.193.91:0/4031026666 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 915095953 0 0) 0x7fa694003610 con 0x7fa6c40b7180 2026-02-12T03:58:46.453 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7fa6b1ffb640 1 -- 10.20.193.91:0/4031026666 >> v1:10.20.193.111:6789/0 conn(0x7fa6c40b5b70 legacy=0x7fa6c415cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.453 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7fa6b1ffb640 1 -- 10.20.193.91:0/4031026666 >> v1:10.20.193.98:6789/0 conn(0x7fa6c40b57a0 legacy=0x7fa6c4161fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.454 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7fa6b1ffb640 10 monclient: _finish_hunting 0 2026-02-12T03:58:46.454 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7fa6b1ffb640 1 monclient: found mon.a 2026-02-12T03:58:46.454 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7fa6b1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:46.454 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7fa6b1ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:46.454 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7fa6b1ffb640 1 -- 10.20.193.91:0/4031026666 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6c4131e20 con 0x7fa6c40b7180 2026-02-12T03:58:46.454 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7fa6b1ffb640 10 monclient: _finish_auth 0 2026-02-12T03:58:46.454 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7fa6b1ffb640 10 monclient: _check_auth_tickets 2026-02-12T03:58:46.455 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7fa6b1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:46.455 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7fa6cba60640 5 monclient: authenticate success, global_id 4572 2026-02-12T03:58:46.455 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7fa6cba60640 10 monclient: _renew_subs 2026-02-12T03:58:46.455 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7fa6cba60640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:46.455 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7fa6cba60640 1 -- 10.20.193.91:0/4031026666 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa6c4161ac0 con 0x7fa6c40b7180 2026-02-12T03:58:46.455 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7fa6cba60640 10 client.4572.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:46.455 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7fa6cba60640 10 monclient: _renew_subs 2026-02-12T03:58:46.455 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7fa6cba60640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:46.456 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7fa6cba60640 1 -- 10.20.193.91:0/4031026666 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa6c41628d0 con 0x7fa6c40b7180 2026-02-12T03:58:46.456 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.446+0000 7fa6cba60640 1 librados: init done 2026-02-12T03:58:46.456 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7f1266ffd640 1 -- 10.20.193.91:0/1950003782 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 655130615 0 0) 0x7f128012b960 con 0x7f1280164760 2026-02-12T03:58:46.456 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7f8c10768640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.457 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7f1266ffd640 1 -- 10.20.193.91:0/1950003782 >> v1:10.20.193.111:6789/0 conn(0x7f1280159b70 legacy=0x7f1280133ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.457 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7f1266ffd640 1 -- 10.20.193.91:0/1950003782 >> v1:10.20.193.98:6789/0 conn(0x7f1280166f70 legacy=0x7f1280157390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.457 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7f8c10768640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.457 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7f8c10768640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:46.458 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7f1266ffd640 10 monclient: _finish_hunting 0 2026-02-12T03:58:46.458 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7f1266ffd640 1 monclient: found mon.a 2026-02-12T03:58:46.458 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7f8c10768640 1 -- 10.20.193.91:0/3055226452 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c080b60e0 con 0x7f8c080b57a0 2026-02-12T03:58:46.459 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7f1266ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:46.460 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7f1266ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:46.460 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7f1266ffd640 1 -- 10.20.193.91:0/1950003782 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f128012bc40 con 0x7f1280164760 2026-02-12T03:58:46.460 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7f1266ffd640 10 monclient: _finish_auth 0 2026-02-12T03:58:46.460 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7f1266ffd640 10 monclient: _check_auth_tickets 2026-02-12T03:58:46.460 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7f1266ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:46.460 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7f12887b0640 5 monclient: authenticate success, global_id 4578 2026-02-12T03:58:46.460 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7f12887b0640 10 monclient: _renew_subs 2026-02-12T03:58:46.460 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7f12887b0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:46.461 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7f12887b0640 1 -- 10.20.193.91:0/1950003782 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f128012bf20 con 0x7f1280164760 2026-02-12T03:58:46.461 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7f12887b0640 10 client.4578.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:46.461 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7f12887b0640 10 monclient: _renew_subs 2026-02-12T03:58:46.461 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7f12887b0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:46.461 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7f12887b0640 1 -- 10.20.193.91:0/1950003782 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f12801311a0 con 0x7f1280164760 2026-02-12T03:58:46.461 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7f12887b0640 1 librados: init done 2026-02-12T03:58:46.462 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7fb60affd640 1 -- 10.20.193.91:0/4049698237 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2324998959 0 0) 0x7fb624132dc0 con 0x7fb62415e530 2026-02-12T03:58:46.462 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7fb60affd640 1 -- 10.20.193.91:0/4049698237 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb624132800 con 0x7fb62415e530 2026-02-12T03:58:46.462 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7fb60affd640 1 -- 10.20.193.91:0/4049698237 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fb60c003090 con 0x7fb62415e530 2026-02-12T03:58:46.463 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7fb60affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:46.463 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7fb60affd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:46.463 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7fb60affd640 10 monclient(hunting): dump: 2026-02-12T03:58:46.463 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.463 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.463 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.463 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.463 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.464 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.464 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.464 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.464 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.464 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.464 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7fb60affd640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:46.465 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7fa6cba60640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.465 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7fa6cba60640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.465 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7fa6cba60640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:46.465 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7fa6cba60640 1 -- 10.20.193.91:0/4031026666 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6c40b9c40 con 0x7fa6c40b7180 2026-02-12T03:58:46.467 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7faffffdf640 10 librados: watch_flush enter 2026-02-12T03:58:46.467 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7faffffdf640 10 librados: watch_flush exit 2026-02-12T03:58:46.467 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7faffffdf640 20 client.4515.objecter shutdown clearing up homeless session... 2026-02-12T03:58:46.467 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7faffffdf640 10 client.4515.objecter successfully canceled tick 2026-02-12T03:58:46.467 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7faffffdf640 1 -- 10.20.193.91:0/3045807994 >> v1:10.20.193.91:6800/2929217192 conn(0x7fafc807a160 legacy=0x7fafc809a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.468 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7faffffdf640 10 monclient: shutdown 2026-02-12T03:58:46.468 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7faffffdf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:46.468 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7faffffdf640 1 -- 10.20.193.91:0/3045807994 >> v1:10.20.193.91:6789/0 conn(0x7faff8161ad0 legacy=0x7faff815b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.468 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7faffffdf640 1 -- 10.20.193.91:0/3045807994 shutdown_connections 2026-02-12T03:58:46.468 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7faffffdf640 1 -- 10.20.193.91:0/3045807994 >> 10.20.193.91:0/3045807994 conn(0x7faff80559c0 msgr2=0x7faff815bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:46.468 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.447+0000 7faffffdf640 1 -- 10.20.193.91:0/3045807994 shutdown_connections 2026-02-12T03:58:46.468 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.448+0000 7faffffdf640 1 -- 10.20.193.91:0/3045807994 wait complete. 2026-02-12T03:58:46.468 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.448+0000 7faffffdf640 1 librados: shutdown 2026-02-12T03:58:46.469 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.448+0000 7f12887b0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.469 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.448+0000 7f12887b0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.469 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.448+0000 7f12887b0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:46.469 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.448+0000 7f12887b0640 1 -- 10.20.193.91:0/1950003782 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1280164f90 con 0x7f1280164760 2026-02-12T03:58:46.471 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.448+0000 7f719750a640 10 librados: watch_flush enter 2026-02-12T03:58:46.471 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.448+0000 7f719750a640 10 librados: watch_flush exit 2026-02-12T03:58:46.471 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.448+0000 7f719750a640 20 client.4533.objecter shutdown clearing up homeless session... 2026-02-12T03:58:46.471 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.448+0000 7f719750a640 10 client.4533.objecter successfully canceled tick 2026-02-12T03:58:46.471 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.448+0000 7f719750a640 1 -- 10.20.193.91:0/3447493771 >> v1:10.20.193.91:6800/2929217192 conn(0x7f7160079eb0 legacy=0x7f716009a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.471 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.448+0000 7f719750a640 10 monclient: shutdown 2026-02-12T03:58:46.471 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.448+0000 7f719750a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:46.471 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.448+0000 7f719750a640 1 -- 10.20.193.91:0/3447493771 >> v1:10.20.193.91:6789/0 conn(0x7f71901599b0 legacy=0x7f719011b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.471 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.448+0000 7f719750a640 1 -- 10.20.193.91:0/3447493771 shutdown_connections 2026-02-12T03:58:46.472 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.448+0000 7f719750a640 1 -- 10.20.193.91:0/3447493771 >> 10.20.193.91:0/3447493771 conn(0x7f71900b6560 msgr2=0x7f71901577e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:46.472 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.448+0000 7f719750a640 1 -- 10.20.193.91:0/3447493771 shutdown_connections 2026-02-12T03:58:46.472 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.448+0000 7f719750a640 1 -- 10.20.193.91:0/3447493771 wait complete. 2026-02-12T03:58:46.472 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.448+0000 7f719750a640 1 librados: shutdown 2026-02-12T03:58:46.473 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313220 for osd.12 2026-02-12T03:58:46.473 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.0 2026-02-12T03:58:46.483 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.481+0000 7fb60affd640 1 -- 10.20.193.91:0/4049698237 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2777989312 0 0) 0x7fb624132ae0 con 0x7fb62415e900 2026-02-12T03:58:46.483 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.481+0000 7fb60affd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.483 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.481+0000 7fb60affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.483 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.481+0000 7fb60affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.483 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.481+0000 7fb60affd640 10 monclient(hunting): my global_id is 4579 2026-02-12T03:58:46.483 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.481+0000 7fb60affd640 1 -- 10.20.193.91:0/4049698237 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb624132dc0 con 0x7fb62415e900 2026-02-12T03:58:46.484 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.481+0000 7f9222ffd640 1 -- 10.20.193.91:0/598495024 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2356286578 0 0) 0x7f923c156d50 con 0x7f923c0b57a0 2026-02-12T03:58:46.484 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.481+0000 7f9222ffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.484 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.481+0000 7f9222ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.484 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.481+0000 7f9222ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.484 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.481+0000 7f9222ffd640 10 monclient(hunting): my global_id is 4582 2026-02-12T03:58:46.484 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.481+0000 7f9222ffd640 1 -- 10.20.193.91:0/598495024 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f920c003610 con 0x7f923c0b57a0 2026-02-12T03:58:46.485 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.481+0000 7fd6e57fa640 1 -- 10.20.193.91:0/2036611536 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 147580784 0 0) 0x7fd6c0003610 con 0x7fd6f00b5b70 2026-02-12T03:58:46.485 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.481+0000 7fd6e57fa640 1 -- 10.20.193.91:0/2036611536 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd6f011d360 con 0x7fd6f00b5b70 2026-02-12T03:58:46.485 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.481+0000 7fd6e57fa640 1 -- 10.20.193.91:0/2036611536 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd6d8002fb0 con 0x7fd6f00b5b70 2026-02-12T03:58:46.485 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.481+0000 7fd6e57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:46.485 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.481+0000 7fd6e57fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:46.485 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.481+0000 7fd6e57fa640 10 monclient(hunting): dump: 2026-02-12T03:58:46.485 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.485 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.485 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.486 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.486 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.486 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.486 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.486 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.486 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.486 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.489 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.488+0000 7fb60affd640 1 -- 10.20.193.91:0/4049698237 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 950476907 0 0) 0x7fb624132dc0 con 0x7fb62415e900 2026-02-12T03:58:46.490 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.488+0000 7fb60affd640 1 -- 10.20.193.91:0/4049698237 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb624132ae0 con 0x7fb62415e900 2026-02-12T03:58:46.490 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.488+0000 7fb60affd640 1 -- 10.20.193.91:0/4049698237 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fb614003690 con 0x7fb62415e900 2026-02-12T03:58:46.490 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.488+0000 7fb60affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:46.490 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.488+0000 7fb60affd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:46.490 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.488+0000 7fb60affd640 10 monclient(hunting): dump: 2026-02-12T03:58:46.490 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.490 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.490 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.490 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.490 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.491 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.491 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.491 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.491 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.491 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.491 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.488+0000 7f9222ffd640 1 -- 10.20.193.91:0/598495024 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3743814236 0 0) 0x7f920c003610 con 0x7f923c0b57a0 2026-02-12T03:58:46.491 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.488+0000 7f9222ffd640 1 -- 10.20.193.91:0/598495024 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f923c156d50 con 0x7f923c0b57a0 2026-02-12T03:58:46.491 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.488+0000 7f9222ffd640 1 -- 10.20.193.91:0/598495024 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f922c003120 con 0x7f923c0b57a0 2026-02-12T03:58:46.492 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.488+0000 7f9222ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:46.492 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.488+0000 7f9222ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:46.492 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.488+0000 7f9222ffd640 10 monclient(hunting): dump: 2026-02-12T03:58:46.492 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.492 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.492 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.492 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.492 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.492 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.492 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.492 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.493 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.493 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.494 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.488+0000 7fd6e57fa640 1 -- 10.20.193.91:0/2036611536 <== mon.1 v1:10.20.193.98:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2880203793 0 0) 0x7fd6f011d360 con 0x7fd6f00b5b70 2026-02-12T03:58:46.494 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.488+0000 7fd6e57fa640 1 -- 10.20.193.91:0/2036611536 >> v1:10.20.193.111:6789/0 conn(0x7fd6f00b57a0 legacy=0x7fd6f012e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.494 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.488+0000 7fd6e57fa640 1 -- 10.20.193.91:0/2036611536 >> v1:10.20.193.91:6789/0 conn(0x7fd6f00b7180 legacy=0x7fd6f015cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.494 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.488+0000 7fd6e57fa640 10 monclient: _finish_hunting 0 2026-02-12T03:58:46.494 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.488+0000 7fd6e57fa640 1 monclient: found mon.b 2026-02-12T03:58:46.494 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.488+0000 7fd6e57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:46.494 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.488+0000 7fd6e57fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:46.494 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.488+0000 7fd6e57fa640 1 -- 10.20.193.91:0/2036611536 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f011d920 con 0x7fd6f00b5b70 2026-02-12T03:58:46.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.488+0000 7fd6e57fa640 10 monclient: _finish_auth 0 2026-02-12T03:58:46.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.488+0000 7fd6e57fa640 10 monclient: _check_auth_tickets 2026-02-12T03:58:46.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.488+0000 7fd6e57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:46.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.488+0000 7fd6f70ec640 5 monclient: authenticate success, global_id 4573 2026-02-12T03:58:46.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.488+0000 7fd6f70ec640 10 monclient: _renew_subs 2026-02-12T03:58:46.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.488+0000 7fd6f70ec640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:46.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.488+0000 7fd6f70ec640 1 -- 10.20.193.91:0/2036611536 --> v1:10.20.193.98:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd6f011dc00 con 0x7fd6f00b5b70 2026-02-12T03:58:46.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.488+0000 7fd6f70ec640 10 client.4573.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:46.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.488+0000 7fd6f70ec640 10 monclient: _renew_subs 2026-02-12T03:58:46.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.488+0000 7fd6f70ec640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:46.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.488+0000 7fd6f70ec640 1 -- 10.20.193.91:0/2036611536 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd6f011e830 con 0x7fd6f00b5b70 2026-02-12T03:58:46.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.488+0000 7fd6f70ec640 1 librados: init done 2026-02-12T03:58:46.496 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.489+0000 7fd6f70ec640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.496 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.489+0000 7fd6f70ec640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.496 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.489+0000 7fd6f70ec640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:46.496 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.489+0000 7fd6f70ec640 1 -- 10.20.193.91:0/2036611536 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6f00b60e0 con 0x7fd6f00b5b70 2026-02-12T03:58:46.509 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.507+0000 7fd47effd640 1 -- 10.20.193.91:0/1771820188 <== mon.2 v1:10.20.193.111:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+12 (unknown 2894986287 0 1257367751) 0x7fd48805df70 con 0x7fd4980b7180 2026-02-12T03:58:46.509 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.507+0000 7fd47effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-12T03:58:46.509 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.507+0000 7fd47effd640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:46.509 INFO:teuthology.orchestra.run.trial091.stdout:90194313220 2026-02-12T03:58:46.512 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.510+0000 7fd49ccae640 10 librados: watch_flush enter 2026-02-12T03:58:46.512 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.510+0000 7fd49ccae640 10 librados: watch_flush exit 2026-02-12T03:58:46.512 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.510+0000 7fd49ccae640 20 client.4511.objecter shutdown clearing up homeless session... 2026-02-12T03:58:46.512 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.510+0000 7fd49ccae640 10 client.4511.objecter successfully canceled tick 2026-02-12T03:58:46.512 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.510+0000 7fd49ccae640 1 -- 10.20.193.91:0/1771820188 >> v1:10.20.193.91:6800/2929217192 conn(0x7fd46407a040 legacy=0x7fd46409a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.512 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.510+0000 7fd49ccae640 10 monclient: shutdown 2026-02-12T03:58:46.512 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.510+0000 7fd49ccae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:46.512 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.510+0000 7fd49ccae640 1 -- 10.20.193.91:0/1771820188 >> v1:10.20.193.111:6789/0 conn(0x7fd4980b7180 legacy=0x7fd498142f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.512 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.510+0000 7fd49ccae640 1 -- 10.20.193.91:0/1771820188 shutdown_connections 2026-02-12T03:58:46.513 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.510+0000 7fd49ccae640 1 -- 10.20.193.91:0/1771820188 >> 10.20.193.91:0/1771820188 conn(0x7fd4980559c0 msgr2=0x7fd498153580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:46.513 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.510+0000 7fd49ccae640 1 -- 10.20.193.91:0/1771820188 shutdown_connections 2026-02-12T03:58:46.513 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.510+0000 7fd49ccae640 1 -- 10.20.193.91:0/1771820188 wait complete. 2026-02-12T03:58:46.513 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.510+0000 7fd49ccae640 1 librados: shutdown 2026-02-12T03:58:46.513 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.512+0000 7fb05dffb640 1 -- 10.20.193.91:0/2633229468 <== mon.2 v1:10.20.193.111:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb0600039b0 con 0x7fb0700b57a0 2026-02-12T03:58:46.513 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.512+0000 7fb05dffb640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:46.513 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.512+0000 7fb05dffb640 1 -- 10.20.193.91:0/2633229468 <== mon.2 v1:10.20.193.111:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fb060003c20 con 0x7fb0700b57a0 2026-02-12T03:58:46.513 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.512+0000 7fb05dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.513 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.512+0000 7fb05dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:46.514 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.512+0000 7fb05dffb640 10 monclient: dump: 2026-02-12T03:58:46.514 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.514 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.514 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.514 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.514 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.514 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.514 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.514 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.514 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.514 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.514 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.512+0000 7fb05f7fe640 4 set_mon_vals no callback set 2026-02-12T03:58:46.515 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.512+0000 7fb05dffb640 1 -- 10.20.193.91:0/2633229468 <== mon.2 v1:10.20.193.111:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7fb060003e00 con 0x7fb0700b57a0 2026-02-12T03:58:46.515 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.513+0000 7fb074993640 10 monclient: get_auth_request con 0x7fb04007a180 auth_method 0 2026-02-12T03:58:46.515 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.513+0000 7fb05dffb640 10 client.4517.objecter ms_handle_connect 0x7fb04007a180 2026-02-12T03:58:46.516 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.514+0000 7fb05dffb640 1 -- 10.20.193.91:0/2633229468 <== mon.2 v1:10.20.193.111:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7fb060095b70 con 0x7fb0700b57a0 2026-02-12T03:58:46.516 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.514+0000 7fb05dffb640 10 client.4517.objecter ms_dispatch2 0x7fb070000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:46.516 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.514+0000 7fb05dffb640 3 client.4517.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:46.516 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.514+0000 7fb05dffb640 3 client.4517.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:46.516 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.514+0000 7fb05dffb640 20 client.4517.objecter dump_active .. 0 homeless 2026-02-12T03:58:46.518 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.516+0000 7fb05dffb640 1 -- 10.20.193.91:0/2633229468 <== mon.2 v1:10.20.193.111:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7fb06005f4d0 con 0x7fb0700b57a0 2026-02-12T03:58:46.518 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.516+0000 7fb05dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.518 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.516+0000 7fb05dffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:46.518 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.517+0000 7f6ff24a2640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-12T03:58:46.518 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.517+0000 7f6ff24a2640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-12T03:58:46.518 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.517+0000 7f6ff24a2640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:46.518 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.517+0000 7f6ff24a2640 1 -- 10.20.193.91:0/2303746013 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 15} v 0) -- 0x7f6fec0b60e0 con 0x7f6fec0b7180 2026-02-12T03:58:46.521 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313220 for osd.9 2026-02-12T03:58:46.524 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.522+0000 7fa59b7fe640 1 -- 10.20.193.91:0/859043063 <== mon.2 v1:10.20.193.111:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+12 (unknown 3646472635 0 1257367751) 0x7fa5a405ee80 con 0x7fa5bc0b5b70 2026-02-12T03:58:46.524 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.522+0000 7fa59b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-12T03:58:46.524 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.522+0000 7fa59b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:46.524 INFO:teuthology.orchestra.run.trial091.stdout:90194313220 2026-02-12T03:58:46.524 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.523+0000 7f0ac4dbb640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-12T03:58:46.524 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.523+0000 7f0ac4dbb640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-12T03:58:46.524 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.523+0000 7f0ac4dbb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:46.525 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.523+0000 7f0ac4dbb640 1 -- 10.20.193.91:0/3309826704 --> v1:10.20.193.111:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f0ac01644d0 con 0x7f0ac00b5b70 2026-02-12T03:58:46.526 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.524+0000 7fa5c1044640 10 librados: watch_flush enter 2026-02-12T03:58:46.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.524+0000 7fa5c1044640 10 librados: watch_flush exit 2026-02-12T03:58:46.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.524+0000 7fa5c1044640 20 client.4520.objecter shutdown clearing up homeless session... 2026-02-12T03:58:46.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.524+0000 7fa5c1044640 10 client.4520.objecter successfully canceled tick 2026-02-12T03:58:46.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.525+0000 7fa5c1044640 1 -- 10.20.193.91:0/859043063 >> v1:10.20.193.91:6800/2929217192 conn(0x7fa588079fb0 legacy=0x7fa58809a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.525+0000 7fa5c1044640 10 monclient: shutdown 2026-02-12T03:58:46.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.525+0000 7fa5c1044640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:46.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.525+0000 7fa5c1044640 1 -- 10.20.193.91:0/859043063 >> v1:10.20.193.111:6789/0 conn(0x7fa5bc0b5b70 legacy=0x7fa5bc15cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.525+0000 7fa5c1044640 1 -- 10.20.193.91:0/859043063 shutdown_connections 2026-02-12T03:58:46.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.525+0000 7fa5c1044640 1 -- 10.20.193.91:0/859043063 >> 10.20.193.91:0/859043063 conn(0x7fa5bc0559c0 msgr2=0x7fa5bc0b96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:46.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.525+0000 7fa5c1044640 1 -- 10.20.193.91:0/859043063 shutdown_connections 2026-02-12T03:58:46.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.525+0000 7fa5c1044640 1 -- 10.20.193.91:0/859043063 wait complete. 2026-02-12T03:58:46.527 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.525+0000 7fa5c1044640 1 librados: shutdown 2026-02-12T03:58:46.536 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313220 for osd.10 2026-02-12T03:58:46.541 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.539+0000 7fd7db224640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-12T03:58:46.541 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.539+0000 7fd7db224640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-12T03:58:46.541 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.539+0000 7fd7db224640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:46.541 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.539+0000 7fd7db224640 1 -- 10.20.193.91:0/1283175197 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fd7d40b4f30 con 0x7fd7d415d740 2026-02-12T03:58:46.549 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.548+0000 7f9222ffd640 1 -- 10.20.193.91:0/598495024 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1512233833 0 0) 0x7f923c120070 con 0x7f923c0b7180 2026-02-12T03:58:46.549 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.548+0000 7f9222ffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:46.549 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.548+0000 7f9222ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:46.549 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.548+0000 7f9222ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:46.549 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.548+0000 7f9222ffd640 10 monclient(hunting): my global_id is 4544 2026-02-12T03:58:46.549 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.548+0000 7f9222ffd640 1 -- 10.20.193.91:0/598495024 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f920c003610 con 0x7f923c0b7180 2026-02-12T03:58:46.554 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.553+0000 7fb60affd640 1 -- 10.20.193.91:0/4049698237 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2048341558 0 0) 0x7fb5f0003610 con 0x7fb6240b3210 2026-02-12T03:58:46.554 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.553+0000 7fb60affd640 1 -- 10.20.193.91:0/4049698237 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb624132dc0 con 0x7fb6240b3210 2026-02-12T03:58:46.554 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.553+0000 7fb60affd640 1 -- 10.20.193.91:0/4049698237 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fb618002ed0 con 0x7fb6240b3210 2026-02-12T03:58:46.554 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.553+0000 7fb60affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:46.554 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.553+0000 7fb60affd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:46.554 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.553+0000 7fb60affd640 10 monclient(hunting): dump: 2026-02-12T03:58:46.554 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.554 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.554 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.554 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.554 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.554 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.554 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.554 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.554 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.554 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.555 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.554+0000 7f0aa6ffd640 1 -- 10.20.193.91:0/3309826704 <== mon.2 v1:10.20.193.111:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 1257367751) 0x7f0aa805dcd0 con 0x7f0ac00b5b70 2026-02-12T03:58:46.555 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.554+0000 7f0aa6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-12T03:58:46.555 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.554+0000 7f0aa6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:46.555 INFO:teuthology.orchestra.run.trial091.stdout:90194313220 2026-02-12T03:58:46.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.556+0000 7f0ac4dbb640 10 librados: watch_flush enter 2026-02-12T03:58:46.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.556+0000 7f0ac4dbb640 10 librados: watch_flush exit 2026-02-12T03:58:46.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.556+0000 7f0ac4dbb640 20 client.4523.objecter shutdown clearing up homeless session... 2026-02-12T03:58:46.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.556+0000 7f0ac4dbb640 10 client.4523.objecter successfully canceled tick 2026-02-12T03:58:46.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.556+0000 7f0ac4dbb640 1 -- 10.20.193.91:0/3309826704 >> v1:10.20.193.91:6800/2929217192 conn(0x7f0a8c079fa0 legacy=0x7f0a8c09a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.556+0000 7f0ac4dbb640 10 monclient: shutdown 2026-02-12T03:58:46.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.556+0000 7f0ac4dbb640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:46.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.556+0000 7f0ac4dbb640 1 -- 10.20.193.91:0/3309826704 >> v1:10.20.193.111:6789/0 conn(0x7f0ac00b5b70 legacy=0x7f0ac0133770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.556+0000 7f0ac4dbb640 1 -- 10.20.193.91:0/3309826704 shutdown_connections 2026-02-12T03:58:46.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.556+0000 7f0ac4dbb640 1 -- 10.20.193.91:0/3309826704 >> 10.20.193.91:0/3309826704 conn(0x7f0ac00559c0 msgr2=0x7f0ac0153740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:46.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.556+0000 7f0ac4dbb640 1 -- 10.20.193.91:0/3309826704 shutdown_connections 2026-02-12T03:58:46.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.556+0000 7f0ac4dbb640 1 -- 10.20.193.91:0/3309826704 wait complete. 2026-02-12T03:58:46.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.556+0000 7f0ac4dbb640 1 librados: shutdown 2026-02-12T03:58:46.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313220 for osd.2 2026-02-12T03:58:46.580 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.578+0000 7fb60affd640 1 -- 10.20.193.91:0/4049698237 <== mon.1 v1:10.20.193.98:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3921035241 0 0) 0x7fb624132ae0 con 0x7fb62415e900 2026-02-12T03:58:46.580 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.578+0000 7fb60affd640 1 -- 10.20.193.91:0/4049698237 >> v1:10.20.193.111:6789/0 conn(0x7fb6240b3210 legacy=0x7fb6241f7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.580 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.578+0000 7fb60affd640 1 -- 10.20.193.91:0/4049698237 >> v1:10.20.193.91:6789/0 conn(0x7fb62415e530 legacy=0x7fb6241f8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.580 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.578+0000 7fb60affd640 10 monclient: _finish_hunting 0 2026-02-12T03:58:46.580 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.578+0000 7fb60affd640 1 monclient: found mon.b 2026-02-12T03:58:46.580 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.578+0000 7fb60affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:46.580 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.578+0000 7fb60affd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:46.580 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.578+0000 7fb60affd640 1 -- 10.20.193.91:0/4049698237 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6241330a0 con 0x7fb62415e900 2026-02-12T03:58:46.580 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.578+0000 7fb60affd640 10 monclient: _finish_auth 0 2026-02-12T03:58:46.581 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.578+0000 7fb60affd640 10 monclient: _check_auth_tickets 2026-02-12T03:58:46.581 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.578+0000 7fb60affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:46.581 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.578+0000 7fb628eec640 5 monclient: authenticate success, global_id 4579 2026-02-12T03:58:46.581 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.578+0000 7fb628eec640 10 monclient: _renew_subs 2026-02-12T03:58:46.581 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.578+0000 7fb628eec640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:46.581 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.578+0000 7fb628eec640 1 -- 10.20.193.91:0/4049698237 --> v1:10.20.193.98:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb624133380 con 0x7fb62415e900 2026-02-12T03:58:46.581 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.579+0000 7fb628eec640 10 client.4579.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:46.581 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.579+0000 7fb628eec640 10 monclient: _renew_subs 2026-02-12T03:58:46.581 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.579+0000 7fb628eec640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:46.581 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.579+0000 7fb628eec640 1 -- 10.20.193.91:0/4049698237 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb6241f7d50 con 0x7fb62415e900 2026-02-12T03:58:46.581 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.579+0000 7fb628eec640 1 librados: init done 2026-02-12T03:58:46.581 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.579+0000 7fb628eec640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.581 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.579+0000 7fb628eec640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.581 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.579+0000 7fb628eec640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:46.581 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.579+0000 7fb628eec640 1 -- 10.20.193.91:0/4049698237 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6240b3d10 con 0x7fb62415e900 2026-02-12T03:58:46.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.580+0000 7f9222ffd640 1 -- 10.20.193.91:0/598495024 <== mon.1 v1:10.20.193.98:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2870306885 0 0) 0x7f923c156d50 con 0x7f923c0b57a0 2026-02-12T03:58:46.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.580+0000 7f9222ffd640 1 -- 10.20.193.91:0/598495024 >> v1:10.20.193.111:6789/0 conn(0x7f923c0b7180 legacy=0x7f923c11eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.580+0000 7f9222ffd640 1 -- 10.20.193.91:0/598495024 >> v1:10.20.193.91:6789/0 conn(0x7f923c0b5b70 legacy=0x7f923c120b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.580+0000 7f9222ffd640 10 monclient: _finish_hunting 0 2026-02-12T03:58:46.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.580+0000 7f9222ffd640 1 monclient: found mon.b 2026-02-12T03:58:46.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.580+0000 7f9222ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:46.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.580+0000 7f9222ffd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:46.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.580+0000 7f9222ffd640 1 -- 10.20.193.91:0/598495024 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f923c120350 con 0x7f923c0b57a0 2026-02-12T03:58:46.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.580+0000 7f9222ffd640 10 monclient: _finish_auth 0 2026-02-12T03:58:46.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.580+0000 7f9222ffd640 10 monclient: _check_auth_tickets 2026-02-12T03:58:46.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.580+0000 7f9222ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:46.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.580+0000 7f9244407640 5 monclient: authenticate success, global_id 4582 2026-02-12T03:58:46.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.580+0000 7f9244407640 10 monclient: _renew_subs 2026-02-12T03:58:46.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.580+0000 7f9244407640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:46.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.580+0000 7f9244407640 1 -- 10.20.193.91:0/598495024 --> v1:10.20.193.98:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f923c134180 con 0x7f923c0b57a0 2026-02-12T03:58:46.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.580+0000 7f9244407640 10 client.4582.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:46.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.580+0000 7f9244407640 10 monclient: _renew_subs 2026-02-12T03:58:46.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.580+0000 7f9244407640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:46.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.580+0000 7f9244407640 1 -- 10.20.193.91:0/598495024 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f923c156640 con 0x7f923c0b57a0 2026-02-12T03:58:46.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.580+0000 7f9244407640 1 librados: init done 2026-02-12T03:58:46.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.581+0000 7f9244407640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.581+0000 7f9244407640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.581+0000 7f9244407640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:46.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.581+0000 7f9244407640 1 -- 10.20.193.91:0/598495024 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f923c0b60e0 con 0x7f923c0b57a0 2026-02-12T03:58:46.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.584+0000 7fd6e57fa640 1 -- 10.20.193.91:0/2036611536 <== mon.1 v1:10.20.193.98:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd6d8003700 con 0x7fd6f00b5b70 2026-02-12T03:58:46.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.584+0000 7fd6e57fa640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:46.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.584+0000 7fd6e57fa640 1 -- 10.20.193.91:0/2036611536 <== mon.1 v1:10.20.193.98:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd6d8003a50 con 0x7fd6f00b5b70 2026-02-12T03:58:46.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.584+0000 7fd6e57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.584+0000 7fd6e57fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:46.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.584+0000 7fd6e57fa640 10 monclient: dump: 2026-02-12T03:58:46.586 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.586 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.586 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.586 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.586 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.586 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.586 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.586 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.586 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.586 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.584+0000 7fd6e6ffd640 4 set_mon_vals no callback set 2026-02-12T03:58:46.587 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.585+0000 7fd6e57fa640 1 -- 10.20.193.91:0/2036611536 <== mon.1 v1:10.20.193.98:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7fd6d801cf30 con 0x7fd6f00b5b70 2026-02-12T03:58:46.587 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.586+0000 7fd6f4e61640 10 monclient: get_auth_request con 0x7fd6c007a040 auth_method 0 2026-02-12T03:58:46.587 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.586+0000 7fd6e57fa640 10 client.4573.objecter ms_handle_connect 0x7fd6c007a040 2026-02-12T03:58:46.588 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.587+0000 7fd6e57fa640 1 -- 10.20.193.91:0/2036611536 <== mon.1 v1:10.20.193.98:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7fd6d8094940 con 0x7fd6f00b5b70 2026-02-12T03:58:46.588 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.587+0000 7fd6e57fa640 10 client.4573.objecter ms_dispatch2 0x7fd6f0000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:46.588 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.587+0000 7fd6e57fa640 3 client.4573.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:46.588 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.587+0000 7fd6e57fa640 3 client.4573.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:46.588 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.587+0000 7fd6e57fa640 20 client.4573.objecter dump_active .. 0 homeless 2026-02-12T03:58:46.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.590+0000 7fd6e57fa640 1 -- 10.20.193.91:0/2036611536 <== mon.1 v1:10.20.193.98:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7fd6d805e2a0 con 0x7fd6f00b5b70 2026-02-12T03:58:46.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.590+0000 7fd6e57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.590+0000 7fd6e57fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:46.625 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.623+0000 7fb07741f640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-12T03:58:46.625 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.623+0000 7fb07741f640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-12T03:58:46.625 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.623+0000 7fb07741f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:46.625 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.623+0000 7fb07741f640 1 -- 10.20.193.91:0/2633229468 --> v1:10.20.193.111:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb0700b31e0 con 0x7fb0700b57a0 2026-02-12T03:58:46.627 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.626+0000 7fb05dffb640 1 -- 10.20.193.91:0/2633229468 <== mon.2 v1:10.20.193.111:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 737253363) 0x7fb06005edd0 con 0x7fb0700b57a0 2026-02-12T03:58:46.627 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.626+0000 7fb05dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-12T03:58:46.627 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.626+0000 7fb05dffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:46.627 INFO:teuthology.orchestra.run.trial091.stdout:94489280515 2026-02-12T03:58:46.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.627+0000 7fb07741f640 10 librados: watch_flush enter 2026-02-12T03:58:46.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.627+0000 7fb07741f640 10 librados: watch_flush exit 2026-02-12T03:58:46.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.627+0000 7fb07741f640 20 client.4517.objecter shutdown clearing up homeless session... 2026-02-12T03:58:46.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.627+0000 7fb07741f640 10 client.4517.objecter successfully canceled tick 2026-02-12T03:58:46.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.628+0000 7fb07741f640 1 -- 10.20.193.91:0/2633229468 >> v1:10.20.193.91:6800/2929217192 conn(0x7fb04007a180 legacy=0x7fb04009a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.628+0000 7fb07741f640 10 monclient: shutdown 2026-02-12T03:58:46.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.628+0000 7fb07741f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:46.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.628+0000 7fb07741f640 1 -- 10.20.193.91:0/2633229468 >> v1:10.20.193.111:6789/0 conn(0x7fb0700b57a0 legacy=0x7fb0701363e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.628+0000 7fb07741f640 1 -- 10.20.193.91:0/2633229468 shutdown_connections 2026-02-12T03:58:46.630 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.628+0000 7fb07741f640 1 -- 10.20.193.91:0/2633229468 >> 10.20.193.91:0/2633229468 conn(0x7fb0700559c0 msgr2=0x7fb0700b96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:46.630 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.628+0000 7fb07741f640 1 -- 10.20.193.91:0/2633229468 shutdown_connections 2026-02-12T03:58:46.630 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.628+0000 7fb07741f640 1 -- 10.20.193.91:0/2633229468 wait complete. 2026-02-12T03:58:46.630 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.628+0000 7fb07741f640 1 librados: shutdown 2026-02-12T03:58:46.638 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280515 for osd.1 2026-02-12T03:58:46.680 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.678+0000 7f6fe8ff9640 1 -- 10.20.193.91:0/2303746013 <== mon.1 v1:10.20.193.98:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 15}]=0 v0) ==== 75+0+12 (unknown 2221946896 0 213165853) 0x7f6fe005f880 con 0x7f6fec0b7180 2026-02-12T03:58:46.681 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.678+0000 7f6fe8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-12T03:58:46.681 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.678+0000 7f6fe8ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:46.681 INFO:teuthology.orchestra.run.trial091.stdout:94489280517 2026-02-12T03:58:46.684 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.682+0000 7f6ff24a2640 10 librados: watch_flush enter 2026-02-12T03:58:46.684 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.682+0000 7f6ff24a2640 10 librados: watch_flush exit 2026-02-12T03:58:46.684 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.682+0000 7f6ff24a2640 20 client.4558.objecter shutdown clearing up homeless session... 2026-02-12T03:58:46.684 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.682+0000 7f6ff24a2640 10 client.4558.objecter successfully canceled tick 2026-02-12T03:58:46.685 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.682+0000 7f6ff24a2640 1 -- 10.20.193.91:0/2303746013 >> v1:10.20.193.91:6800/2929217192 conn(0x7f6fb8079ef0 legacy=0x7f6fb809a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.685 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.682+0000 7f6ff24a2640 10 monclient: shutdown 2026-02-12T03:58:46.685 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.682+0000 7f6ff24a2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:46.685 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.682+0000 7f6ff24a2640 1 -- 10.20.193.91:0/2303746013 >> v1:10.20.193.98:6789/0 conn(0x7f6fec0b7180 legacy=0x7f6fec25fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.685 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.682+0000 7f6ff24a2640 1 -- 10.20.193.91:0/2303746013 shutdown_connections 2026-02-12T03:58:46.685 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.682+0000 7f6ff24a2640 1 -- 10.20.193.91:0/2303746013 >> 10.20.193.91:0/2303746013 conn(0x7f6fec0559c0 msgr2=0x7f6fec15cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:46.685 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.682+0000 7f6ff24a2640 1 -- 10.20.193.91:0/2303746013 shutdown_connections 2026-02-12T03:58:46.685 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.682+0000 7f6ff24a2640 1 -- 10.20.193.91:0/2303746013 wait complete. 2026-02-12T03:58:46.685 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.682+0000 7f6ff24a2640 1 librados: shutdown 2026-02-12T03:58:46.686 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.683+0000 7f9222ffd640 1 -- 10.20.193.91:0/598495024 <== mon.1 v1:10.20.193.98:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f922c0036e0 con 0x7f923c0b57a0 2026-02-12T03:58:46.686 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.683+0000 7f9222ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:46.686 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.683+0000 7f9222ffd640 1 -- 10.20.193.91:0/598495024 <== mon.1 v1:10.20.193.98:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f922c003ab0 con 0x7f923c0b57a0 2026-02-12T03:58:46.686 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.683+0000 7f9222ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.687 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.683+0000 7f9222ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:46.687 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.683+0000 7f9240979640 4 set_mon_vals no callback set 2026-02-12T03:58:46.687 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.683+0000 7f9222ffd640 10 monclient: dump: 2026-02-12T03:58:46.687 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.687 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.687 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.687 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.687 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.687 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.687 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.687 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.688 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.688 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.684+0000 7f9222ffd640 1 -- 10.20.193.91:0/598495024 <== mon.1 v1:10.20.193.98:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f922c003c90 con 0x7f923c0b57a0 2026-02-12T03:58:46.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.684+0000 7f924197b640 10 monclient: get_auth_request con 0x7f920c079f90 auth_method 0 2026-02-12T03:58:46.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.684+0000 7f9222ffd640 10 client.4582.objecter ms_handle_connect 0x7f920c079f90 2026-02-12T03:58:46.689 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.685+0000 7f9222ffd640 1 -- 10.20.193.91:0/598495024 <== mon.1 v1:10.20.193.98:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7f922c095c70 con 0x7f923c0b57a0 2026-02-12T03:58:46.689 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.685+0000 7f9222ffd640 10 client.4582.objecter ms_dispatch2 0x7f923c000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:46.689 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.685+0000 7f9222ffd640 3 client.4582.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:46.689 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.685+0000 7f9222ffd640 3 client.4582.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:46.689 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.685+0000 7f9222ffd640 20 client.4582.objecter dump_active .. 0 homeless 2026-02-12T03:58:46.689 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.687+0000 7f9222ffd640 1 -- 10.20.193.91:0/598495024 <== mon.1 v1:10.20.193.98:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f922c05f5d0 con 0x7f923c0b57a0 2026-02-12T03:58:46.690 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.687+0000 7f9222ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.690 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.687+0000 7f9222ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:46.693 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280518 got 94489280517 for osd.15 2026-02-12T03:58:46.706 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.704+0000 7fd6f70ec640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-12T03:58:46.706 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.704+0000 7fd6f70ec640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-12T03:58:46.706 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.704+0000 7fd6f70ec640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:46.706 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.704+0000 7fd6f70ec640 1 -- 10.20.193.91:0/2036611536 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fd6f005d710 con 0x7fd6f00b5b70 2026-02-12T03:58:46.763 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.760+0000 7f8beeffd640 1 -- 10.20.193.91:0/3055226452 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8bf8003230 con 0x7f8c080b57a0 2026-02-12T03:58:46.763 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.760+0000 7f8beeffd640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:46.763 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.760+0000 7f8beeffd640 1 -- 10.20.193.91:0/3055226452 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8bf8003580 con 0x7f8c080b57a0 2026-02-12T03:58:46.763 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.760+0000 7f8beeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.763 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.760+0000 7f8beeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:46.763 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.760+0000 7f8beeffd640 10 monclient: dump: 2026-02-12T03:58:46.763 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.763 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.763 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.764 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.764 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.764 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.764 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.764 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.764 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.764 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.764 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.760+0000 7f8c0ccda640 4 set_mon_vals no callback set 2026-02-12T03:58:46.764 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.761+0000 7f8beeffd640 1 -- 10.20.193.91:0/3055226452 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f8bf8003760 con 0x7f8c080b57a0 2026-02-12T03:58:46.765 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.761+0000 7f8c0dcdc640 10 monclient: get_auth_request con 0x7f8bd807a160 auth_method 0 2026-02-12T03:58:46.765 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.762+0000 7f8beeffd640 10 client.4569.objecter ms_handle_connect 0x7f8bd807a160 2026-02-12T03:58:46.766 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.764+0000 7fa6b1ffb640 1 -- 10.20.193.91:0/4031026666 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa6c0003380 con 0x7fa6c40b7180 2026-02-12T03:58:46.766 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.764+0000 7fa6b1ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:46.766 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.764+0000 7fa6b1ffb640 1 -- 10.20.193.91:0/4031026666 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fa6c0004db0 con 0x7fa6c40b7180 2026-02-12T03:58:46.767 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.764+0000 7fa6b1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.767 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.764+0000 7fa6b1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:46.767 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.764+0000 7fa6b1ffb640 10 monclient: dump: 2026-02-12T03:58:46.767 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.767 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.767 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.767 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.767 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.767 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.767 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.767 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.767 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.768 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.768 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.764+0000 7fa6b37fe640 4 set_mon_vals no callback set 2026-02-12T03:58:46.768 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.765+0000 7fa6b1ffb640 1 -- 10.20.193.91:0/4031026666 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7fa6c001e290 con 0x7fa6c40b7180 2026-02-12T03:58:46.768 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.765+0000 7fa6c97d5640 10 monclient: get_auth_request con 0x7fa694079f50 auth_method 0 2026-02-12T03:58:46.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.765+0000 7fa6b1ffb640 10 client.4572.objecter ms_handle_connect 0x7fa694079f50 2026-02-12T03:58:46.775 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.773+0000 7f8beeffd640 1 -- 10.20.193.91:0/3055226452 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7f8bf8094860 con 0x7f8c080b57a0 2026-02-12T03:58:46.775 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.773+0000 7f8beeffd640 10 client.4569.objecter ms_dispatch2 0x7f8c08000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:46.775 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.773+0000 7f8beeffd640 3 client.4569.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:46.775 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.773+0000 7f8beeffd640 3 client.4569.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:46.775 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.773+0000 7f8beeffd640 20 client.4569.objecter dump_active .. 0 homeless 2026-02-12T03:58:46.775 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.773+0000 7f8beeffd640 1 -- 10.20.193.91:0/3055226452 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f8bf8003580 con 0x7f8c080b57a0 2026-02-12T03:58:46.775 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.773+0000 7f8beeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.775 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.773+0000 7f8beeffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:46.776 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.773+0000 7fd7c97fa640 1 -- 10.20.193.91:0/1283175197 <== mon.0 v1:10.20.193.91:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 1257367751) 0x7fd7d005f750 con 0x7fd7d415d740 2026-02-12T03:58:46.776 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.773+0000 7fd7c97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-12T03:58:46.776 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.773+0000 7fd7c97fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:46.776 INFO:teuthology.orchestra.run.trial091.stdout:90194313220 2026-02-12T03:58:46.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.775+0000 7fa6b1ffb640 1 -- 10.20.193.91:0/4031026666 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7fa6c0095da0 con 0x7fa6c40b7180 2026-02-12T03:58:46.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.775+0000 7fa6b1ffb640 10 client.4572.objecter ms_dispatch2 0x7fa6c4000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:46.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.775+0000 7fa6b1ffb640 3 client.4572.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:46.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.775+0000 7fa6b1ffb640 3 client.4572.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:46.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.775+0000 7fa6b1ffb640 20 client.4572.objecter dump_active .. 0 homeless 2026-02-12T03:58:46.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.775+0000 7fa6b1ffb640 1 -- 10.20.193.91:0/4031026666 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7fa6c40b9c40 con 0x7fa6c40b7180 2026-02-12T03:58:46.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.775+0000 7fa6b1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.775+0000 7fa6b1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:46.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.776+0000 7fd7db224640 10 librados: watch_flush enter 2026-02-12T03:58:46.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.776+0000 7fd7db224640 10 librados: watch_flush exit 2026-02-12T03:58:46.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.776+0000 7fd7db224640 20 client.4557.objecter shutdown clearing up homeless session... 2026-02-12T03:58:46.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.776+0000 7fd7db224640 10 client.4557.objecter successfully canceled tick 2026-02-12T03:58:46.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.776+0000 7fd7db224640 1 -- 10.20.193.91:0/1283175197 >> v1:10.20.193.91:6800/2929217192 conn(0x7fd7a407a180 legacy=0x7fd7a409a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.780 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.776+0000 7fd7db224640 10 monclient: shutdown 2026-02-12T03:58:46.780 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.776+0000 7fd7db224640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:46.780 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.776+0000 7fd7db224640 1 -- 10.20.193.91:0/1283175197 >> v1:10.20.193.91:6789/0 conn(0x7fd7d415d740 legacy=0x7fd7d42030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.780 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.776+0000 7fd7db224640 1 -- 10.20.193.91:0/1283175197 shutdown_connections 2026-02-12T03:58:46.780 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.776+0000 7fd7db224640 1 -- 10.20.193.91:0/1283175197 >> 10.20.193.91:0/1283175197 conn(0x7fd7d40b7580 msgr2=0x7fd7d415af60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:46.780 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.776+0000 7fd7db224640 1 -- 10.20.193.91:0/1283175197 shutdown_connections 2026-02-12T03:58:46.780 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.776+0000 7fd7db224640 1 -- 10.20.193.91:0/1283175197 wait complete. 2026-02-12T03:58:46.780 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.776+0000 7fd7db224640 1 librados: shutdown 2026-02-12T03:58:46.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.780+0000 7f1266ffd640 1 -- 10.20.193.91:0/1950003782 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1274002f70 con 0x7f1280164760 2026-02-12T03:58:46.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.780+0000 7f1266ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:46.783 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.780+0000 7f1266ffd640 1 -- 10.20.193.91:0/1950003782 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f1274003b00 con 0x7f1280164760 2026-02-12T03:58:46.783 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.780+0000 7f1266ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.783 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.780+0000 7f1266ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:46.783 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.780+0000 7f1266ffd640 10 monclient: dump: 2026-02-12T03:58:46.783 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.783 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.783 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.783 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.783 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.783 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.783 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.784 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.784 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.784 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.784 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.780+0000 7f1284d22640 4 set_mon_vals no callback set 2026-02-12T03:58:46.784 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.781+0000 7f1266ffd640 1 -- 10.20.193.91:0/1950003782 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f1274003ce0 con 0x7f1280164760 2026-02-12T03:58:46.785 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.782+0000 7f1286525640 10 monclient: get_auth_request con 0x7f1250079fd0 auth_method 0 2026-02-12T03:58:46.785 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.782+0000 7f1266ffd640 10 client.4578.objecter ms_handle_connect 0x7f1250079fd0 2026-02-12T03:58:46.785 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.782+0000 7fb60affd640 1 -- 10.20.193.91:0/4049698237 <== mon.1 v1:10.20.193.98:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb6140032c0 con 0x7fb62415e900 2026-02-12T03:58:46.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.782+0000 7fb60affd640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:46.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.782+0000 7fb60affd640 1 -- 10.20.193.91:0/4049698237 <== mon.1 v1:10.20.193.98:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fb614003d20 con 0x7fb62415e900 2026-02-12T03:58:46.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.782+0000 7fb60affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:46.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.782+0000 7fb60affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:46.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.782+0000 7fb60affd640 10 monclient: dump: 2026-02-12T03:58:46.786 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:46.786 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:46.786 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.786 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:46.786 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:46.786 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:46.787 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:46.787 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:46.787 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:46.787 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:46.787 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.782+0000 7fb620d72640 4 set_mon_vals no callback set 2026-02-12T03:58:46.787 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.783+0000 7fb60affd640 1 -- 10.20.193.91:0/4049698237 <== mon.1 v1:10.20.193.98:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7fb614003d20 con 0x7fb62415e900 2026-02-12T03:58:46.787 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.783+0000 7fb622575640 10 monclient: get_auth_request con 0x7fb5f007a1e0 auth_method 0 2026-02-12T03:58:46.787 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.784+0000 7fb60affd640 10 client.4579.objecter ms_handle_connect 0x7fb5f007a1e0 2026-02-12T03:58:46.788 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313220 for osd.5 2026-02-12T03:58:46.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.786+0000 7fb60affd640 1 -- 10.20.193.91:0/4049698237 <== mon.1 v1:10.20.193.98:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7fb614095bc0 con 0x7fb62415e900 2026-02-12T03:58:46.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.786+0000 7fb60affd640 10 client.4579.objecter ms_dispatch2 0x7fb624000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:46.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.786+0000 7fb60affd640 3 client.4579.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:46.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.786+0000 7fb60affd640 3 client.4579.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:46.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.786+0000 7fb60affd640 20 client.4579.objecter dump_active .. 0 homeless 2026-02-12T03:58:46.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.787+0000 7fb60affd640 1 -- 10.20.193.91:0/4049698237 <== mon.1 v1:10.20.193.98:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7fb6240b3d10 con 0x7fb62415e900 2026-02-12T03:58:46.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.787+0000 7fb60affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.787+0000 7fb60affd640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:46.792 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.790+0000 7f1266ffd640 1 -- 10.20.193.91:0/1950003782 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7f12740949b0 con 0x7f1280164760 2026-02-12T03:58:46.792 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.790+0000 7f1266ffd640 10 client.4578.objecter ms_dispatch2 0x7f1280000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:46.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.790+0000 7f1266ffd640 3 client.4578.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:46.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.790+0000 7f1266ffd640 3 client.4578.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:46.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.790+0000 7f1266ffd640 20 client.4578.objecter dump_active .. 0 homeless 2026-02-12T03:58:46.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.790+0000 7f1266ffd640 1 -- 10.20.193.91:0/1950003782 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f127405e310 con 0x7f1280164760 2026-02-12T03:58:46.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.790+0000 7f1266ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:46.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.790+0000 7f1266ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:46.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.791+0000 7fd6e57fa640 1 -- 10.20.193.91:0/2036611536 <== mon.1 v1:10.20.193.98:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+12 (unknown 3405404620 0 521551722) 0x7fd6d805dba0 con 0x7fd6f00b5b70 2026-02-12T03:58:46.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.791+0000 7fd6e57fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-12T03:58:46.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.791+0000 7fd6e57fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:46.795 INFO:teuthology.orchestra.run.trial091.stdout:94489280516 2026-02-12T03:58:46.797 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.794+0000 7fd6f70ec640 10 librados: watch_flush enter 2026-02-12T03:58:46.797 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.794+0000 7fd6f70ec640 10 librados: watch_flush exit 2026-02-12T03:58:46.797 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.794+0000 7fd6f70ec640 20 client.4573.objecter shutdown clearing up homeless session... 2026-02-12T03:58:46.797 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.794+0000 7fd6f70ec640 10 client.4573.objecter successfully canceled tick 2026-02-12T03:58:46.797 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.794+0000 7fd6f70ec640 1 -- 10.20.193.91:0/2036611536 >> v1:10.20.193.91:6800/2929217192 conn(0x7fd6c007a040 legacy=0x7fd6c009a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.797 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.794+0000 7fd6f70ec640 10 monclient: shutdown 2026-02-12T03:58:46.797 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.794+0000 7fd6f70ec640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:46.797 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.794+0000 7fd6f70ec640 1 -- 10.20.193.91:0/2036611536 >> v1:10.20.193.98:6789/0 conn(0x7fd6f00b5b70 legacy=0x7fd6f011e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.797 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.794+0000 7fd6f70ec640 1 -- 10.20.193.91:0/2036611536 shutdown_connections 2026-02-12T03:58:46.798 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.794+0000 7fd6f70ec640 1 -- 10.20.193.91:0/2036611536 >> 10.20.193.91:0/2036611536 conn(0x7fd6f00559c0 msgr2=0x7fd6f0135220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:46.798 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.794+0000 7fd6f70ec640 1 -- 10.20.193.91:0/2036611536 shutdown_connections 2026-02-12T03:58:46.798 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.794+0000 7fd6f70ec640 1 -- 10.20.193.91:0/2036611536 wait complete. 2026-02-12T03:58:46.798 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.794+0000 7fd6f70ec640 1 librados: shutdown 2026-02-12T03:58:46.799 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.794+0000 7f9244407640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-12T03:58:46.799 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.795+0000 7f9244407640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-12T03:58:46.799 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.795+0000 7f9244407640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:46.799 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.795+0000 7f9244407640 1 -- 10.20.193.91:0/598495024 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 13} v 0) -- 0x7f923c134f70 con 0x7f923c0b57a0 2026-02-12T03:58:46.799 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.797+0000 7f9222ffd640 1 -- 10.20.193.91:0/598495024 <== mon.1 v1:10.20.193.98:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 13}]=0 v0) ==== 75+0+12 (unknown 3988744482 0 778662779) 0x7f922c05eed0 con 0x7f923c0b57a0 2026-02-12T03:58:46.799 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.797+0000 7f9222ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-12T03:58:46.799 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.797+0000 7f9222ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:46.799 INFO:teuthology.orchestra.run.trial091.stdout:90194313219 2026-02-12T03:58:46.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.799+0000 7f9244407640 10 librados: watch_flush enter 2026-02-12T03:58:46.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.799+0000 7f9244407640 10 librados: watch_flush exit 2026-02-12T03:58:46.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.799+0000 7f9244407640 20 client.4582.objecter shutdown clearing up homeless session... 2026-02-12T03:58:46.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.799+0000 7f9244407640 10 client.4582.objecter successfully canceled tick 2026-02-12T03:58:46.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.799+0000 7f9244407640 1 -- 10.20.193.91:0/598495024 >> v1:10.20.193.91:6800/2929217192 conn(0x7f920c079f90 legacy=0x7f920c09a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.799+0000 7f9244407640 10 monclient: shutdown 2026-02-12T03:58:46.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.799+0000 7f9244407640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:46.803 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.799+0000 7f9244407640 1 -- 10.20.193.91:0/598495024 >> v1:10.20.193.98:6789/0 conn(0x7f923c0b57a0 legacy=0x7f923c133a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.803 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.799+0000 7f9244407640 1 -- 10.20.193.91:0/598495024 shutdown_connections 2026-02-12T03:58:46.803 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.799+0000 7f9244407640 1 -- 10.20.193.91:0/598495024 >> 10.20.193.91:0/598495024 conn(0x7f923c0559c0 msgr2=0x7f923c0b96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:46.803 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.799+0000 7f9244407640 1 -- 10.20.193.91:0/598495024 shutdown_connections 2026-02-12T03:58:46.803 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.799+0000 7f9244407640 1 -- 10.20.193.91:0/598495024 wait complete. 2026-02-12T03:58:46.803 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.800+0000 7f9244407640 1 librados: shutdown 2026-02-12T03:58:46.807 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280516 for osd.11 2026-02-12T03:58:46.812 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313219 for osd.13 2026-02-12T03:58:46.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.885+0000 7f8c10768640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-12T03:58:46.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.885+0000 7f8c10768640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-12T03:58:46.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.885+0000 7f8c10768640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:46.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.885+0000 7f8c10768640 1 -- 10.20.193.91:0/3055226452 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f8c08155e80 con 0x7f8c080b57a0 2026-02-12T03:58:46.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.887+0000 7f8beeffd640 1 -- 10.20.193.91:0/3055226452 <== mon.0 v1:10.20.193.91:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+12 (unknown 3207554136 0 1257367751) 0x7f8bf805e1c0 con 0x7f8c080b57a0 2026-02-12T03:58:46.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.887+0000 7f8beeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 8}] 2026-02-12T03:58:46.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.887+0000 7f8beeffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:46.889 INFO:teuthology.orchestra.run.trial091.stdout:90194313220 2026-02-12T03:58:46.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.889+0000 7fa6cba60640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-12T03:58:46.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.889+0000 7fa6cba60640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-12T03:58:46.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.889+0000 7fa6cba60640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:46.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.889+0000 7fa6cba60640 1 -- 10.20.193.91:0/4031026666 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 14} v 0) -- 0x7fa6c40b60e0 con 0x7fa6c40b7180 2026-02-12T03:58:46.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.890+0000 7f8c10768640 10 librados: watch_flush enter 2026-02-12T03:58:46.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.890+0000 7f8c10768640 10 librados: watch_flush exit 2026-02-12T03:58:46.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.890+0000 7f8c10768640 20 client.4569.objecter shutdown clearing up homeless session... 2026-02-12T03:58:46.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.890+0000 7f8c10768640 10 client.4569.objecter successfully canceled tick 2026-02-12T03:58:46.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.890+0000 7f8c10768640 1 -- 10.20.193.91:0/3055226452 >> v1:10.20.193.91:6800/2929217192 conn(0x7f8bd807a160 legacy=0x7f8bd809a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.890+0000 7f8c10768640 10 monclient: shutdown 2026-02-12T03:58:46.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.890+0000 7f8c10768640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:46.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.890+0000 7f8c10768640 1 -- 10.20.193.91:0/3055226452 >> v1:10.20.193.91:6789/0 conn(0x7f8c080b57a0 legacy=0x7f8c08136df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.890+0000 7f8c10768640 1 -- 10.20.193.91:0/3055226452 shutdown_connections 2026-02-12T03:58:46.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.890+0000 7f8c10768640 1 -- 10.20.193.91:0/3055226452 >> 10.20.193.91:0/3055226452 conn(0x7f8c080559c0 msgr2=0x7f8c0805f700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:46.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.890+0000 7f8c10768640 1 -- 10.20.193.91:0/3055226452 shutdown_connections 2026-02-12T03:58:46.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.890+0000 7f8c10768640 1 -- 10.20.193.91:0/3055226452 wait complete. 2026-02-12T03:58:46.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.890+0000 7f8c10768640 1 librados: shutdown 2026-02-12T03:58:46.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.891+0000 7fa6b1ffb640 1 -- 10.20.193.91:0/4031026666 <== mon.0 v1:10.20.193.91:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 14}]=0 v0) ==== 75+0+12 (unknown 2547163239 0 1257367751) 0x7fa6c005f700 con 0x7fa6c40b7180 2026-02-12T03:58:46.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.891+0000 7fa6b1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 14}] 2026-02-12T03:58:46.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.891+0000 7fa6b1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:46.893 INFO:teuthology.orchestra.run.trial091.stdout:90194313220 2026-02-12T03:58:46.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.894+0000 7fa6cba60640 10 librados: watch_flush enter 2026-02-12T03:58:46.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.894+0000 7fa6cba60640 10 librados: watch_flush exit 2026-02-12T03:58:46.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.894+0000 7fa6cba60640 20 client.4572.objecter shutdown clearing up homeless session... 2026-02-12T03:58:46.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.894+0000 7fa6cba60640 10 client.4572.objecter successfully canceled tick 2026-02-12T03:58:46.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.894+0000 7fa6cba60640 1 -- 10.20.193.91:0/4031026666 >> v1:10.20.193.91:6800/2929217192 conn(0x7fa694079f50 legacy=0x7fa69409a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.894+0000 7fa6cba60640 10 monclient: shutdown 2026-02-12T03:58:46.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.894+0000 7fa6cba60640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:46.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.894+0000 7fa6cba60640 1 -- 10.20.193.91:0/4031026666 >> v1:10.20.193.91:6789/0 conn(0x7fa6c40b7180 legacy=0x7fa6c4130630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.894+0000 7fa6cba60640 1 -- 10.20.193.91:0/4031026666 shutdown_connections 2026-02-12T03:58:46.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.894+0000 7fa6cba60640 1 -- 10.20.193.91:0/4031026666 >> 10.20.193.91:0/4031026666 conn(0x7fa6c40559c0 msgr2=0x7fa6c4057d40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:46.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.894+0000 7fa6cba60640 1 -- 10.20.193.91:0/4031026666 shutdown_connections 2026-02-12T03:58:46.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.894+0000 7fa6cba60640 1 -- 10.20.193.91:0/4031026666 wait complete. 2026-02-12T03:58:46.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.894+0000 7fa6cba60640 1 librados: shutdown 2026-02-12T03:58:46.900 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313220 for osd.8 2026-02-12T03:58:46.900 DEBUG:teuthology.parallel:result is None 2026-02-12T03:58:46.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.899+0000 7fb628eec640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-12T03:58:46.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.899+0000 7fb628eec640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-12T03:58:46.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.899+0000 7fb628eec640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:46.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.899+0000 7fb628eec640 1 -- 10.20.193.91:0/4049698237 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fb624056550 con 0x7fb62415e900 2026-02-12T03:58:46.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.901+0000 7f12887b0640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-12T03:58:46.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.901+0000 7f12887b0640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-12T03:58:46.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.901+0000 7f12887b0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:46.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.901+0000 7f12887b0640 1 -- 10.20.193.91:0/1950003782 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f1280164cb0 con 0x7f1280164760 2026-02-12T03:58:46.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.902+0000 7fb60affd640 1 -- 10.20.193.91:0/4049698237 <== mon.1 v1:10.20.193.98:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 213165853) 0x7fb624056550 con 0x7fb62415e900 2026-02-12T03:58:46.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.902+0000 7fb60affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-12T03:58:46.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.902+0000 7fb60affd640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:46.903 INFO:teuthology.orchestra.run.trial091.stdout:94489280517 2026-02-12T03:58:46.904 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313220 for osd.14 2026-02-12T03:58:46.904 DEBUG:teuthology.parallel:result is None 2026-02-12T03:58:46.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.904+0000 7fb628eec640 10 librados: watch_flush enter 2026-02-12T03:58:46.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.904+0000 7fb628eec640 10 librados: watch_flush exit 2026-02-12T03:58:46.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.904+0000 7fb628eec640 20 client.4579.objecter shutdown clearing up homeless session... 2026-02-12T03:58:46.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.904+0000 7fb628eec640 10 client.4579.objecter successfully canceled tick 2026-02-12T03:58:46.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.904+0000 7fb628eec640 1 -- 10.20.193.91:0/4049698237 >> v1:10.20.193.91:6800/2929217192 conn(0x7fb5f007a1e0 legacy=0x7fb5f009a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.904+0000 7fb628eec640 10 monclient: shutdown 2026-02-12T03:58:46.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.904+0000 7fb628eec640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:46.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.904+0000 7fb628eec640 1 -- 10.20.193.91:0/4049698237 >> v1:10.20.193.98:6789/0 conn(0x7fb62415e900 legacy=0x7fb624137030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.904+0000 7fb628eec640 1 -- 10.20.193.91:0/4049698237 shutdown_connections 2026-02-12T03:58:46.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.904+0000 7fb628eec640 1 -- 10.20.193.91:0/4049698237 >> 10.20.193.91:0/4049698237 conn(0x7fb6240b5310 msgr2=0x7fb6240b3600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:46.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.904+0000 7fb628eec640 1 -- 10.20.193.91:0/4049698237 shutdown_connections 2026-02-12T03:58:46.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.905+0000 7fb628eec640 1 -- 10.20.193.91:0/4049698237 wait complete. 2026-02-12T03:58:46.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.905+0000 7fb628eec640 1 librados: shutdown 2026-02-12T03:58:46.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.905+0000 7f1266ffd640 1 -- 10.20.193.91:0/1950003782 <== mon.0 v1:10.20.193.91:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (unknown 1274345170 0 1257367751) 0x7f127405dc10 con 0x7f1280164760 2026-02-12T03:58:46.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.905+0000 7f1266ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 6}] 2026-02-12T03:58:46.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.905+0000 7f1266ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:46.907 INFO:teuthology.orchestra.run.trial091.stdout:90194313220 2026-02-12T03:58:46.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.907+0000 7f12887b0640 10 librados: watch_flush enter 2026-02-12T03:58:46.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.907+0000 7f12887b0640 10 librados: watch_flush exit 2026-02-12T03:58:46.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.907+0000 7f12887b0640 20 client.4578.objecter shutdown clearing up homeless session... 2026-02-12T03:58:46.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.907+0000 7f12887b0640 10 client.4578.objecter successfully canceled tick 2026-02-12T03:58:46.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.908+0000 7f12887b0640 1 -- 10.20.193.91:0/1950003782 >> v1:10.20.193.91:6800/2929217192 conn(0x7f1250079fd0 legacy=0x7f125009a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.908+0000 7f12887b0640 10 monclient: shutdown 2026-02-12T03:58:46.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.908+0000 7f12887b0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:46.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.908+0000 7f12887b0640 1 -- 10.20.193.91:0/1950003782 >> v1:10.20.193.91:6789/0 conn(0x7f1280164760 legacy=0x7f12801316c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:46.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.908+0000 7f12887b0640 1 -- 10.20.193.91:0/1950003782 shutdown_connections 2026-02-12T03:58:46.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.908+0000 7f12887b0640 1 -- 10.20.193.91:0/1950003782 >> 10.20.193.91:0/1950003782 conn(0x7f12800bab20 msgr2=0x7f1280165790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:46.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.908+0000 7f12887b0640 1 -- 10.20.193.91:0/1950003782 shutdown_connections 2026-02-12T03:58:46.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.908+0000 7f12887b0640 1 -- 10.20.193.91:0/1950003782 wait complete. 2026-02-12T03:58:46.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:46.908+0000 7f12887b0640 1 librados: shutdown 2026-02-12T03:58:46.915 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280517 for osd.3 2026-02-12T03:58:46.915 DEBUG:teuthology.parallel:result is None 2026-02-12T03:58:46.917 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313220 for osd.6 2026-02-12T03:58:46.917 DEBUG:teuthology.parallel:result is None 2026-02-12T03:58:47.426 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2026-02-12T03:58:47.438 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-12T03:58:47.474 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.12 2026-02-12T03:58:47.475 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-12T03:58:47.497 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.495+0000 7f6a17fff640 10 monclient: get_monmap_and_config 2026-02-12T03:58:47.498 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.495+0000 7f6a17fff640 10 monclient: build_initial_monmap 2026-02-12T03:58:47.498 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.495+0000 7f6a17fff640 10 monclient: monmap: 2026-02-12T03:58:47.498 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:47.498 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.498 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:47.495894+0000 2026-02-12T03:58:47.498 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:47.495894+0000 2026-02-12T03:58:47.498 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:47.498 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.498 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:47.499 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:47.499 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:47.499 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.499 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.495+0000 7f6a17fff640 1 Processor -- start 2026-02-12T03:58:47.499 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.495+0000 7f6a17fff640 1 -- start start 2026-02-12T03:58:47.499 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.495+0000 7f6a17fff640 10 monclient: init 2026-02-12T03:58:47.500 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.496+0000 7f6a17fff640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:47.500 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.496+0000 7f6a17fff640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T03:58:47.500 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.496+0000 7f6a17fff640 10 monclient(hunting): picked mon.noname-c con 0x7f6a18164880 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:47.501 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.496+0000 7f6a17fff640 10 monclient(hunting): picked mon.noname-a con 0x7f6a18157bf0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:47.501 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.496+0000 7f6a17fff640 10 monclient(hunting): picked mon.noname-b con 0x7f6a18164c50 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:47.501 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.496+0000 7f6a17fff640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a180b11e0 con 0x7f6a18157bf0 2026-02-12T03:58:47.501 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.496+0000 7f6a17fff640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a180b14c0 con 0x7f6a18164c50 2026-02-12T03:58:47.501 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.496+0000 7f6a17fff640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a180b17a0 con 0x7f6a18164880 2026-02-12T03:58:47.501 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.496+0000 7f6a17fff640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:47.501 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.496+0000 7f6a17fff640 10 monclient(hunting): authenticate will time out at 1130.239457s 2026-02-12T03:58:47.501 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.496+0000 7f6a16ffd640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f6a18164880 0x7f6a181574e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:38156/0 (socket says 10.20.193.91:38156) 2026-02-12T03:58:47.501 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.496+0000 7f6a16ffd640 1 -- 10.20.193.91:0/2408886379 learned_addr learned my addr 10.20.193.91:0/2408886379 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:47.506 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.498+0000 7f6a15ffb640 1 -- 10.20.193.91:0/2408886379 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2908169190 0 0) 0x7f6a180b14c0 con 0x7f6a18164c50 2026-02-12T03:58:47.507 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.498+0000 7f6a15ffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:47.507 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.498+0000 7f6a15ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:47.507 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.498+0000 7f6a15ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:47.507 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.498+0000 7f6a15ffb640 10 monclient(hunting): my global_id is 4585 2026-02-12T03:58:47.507 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.498+0000 7f6a15ffb640 1 -- 10.20.193.91:0/2408886379 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a04003610 con 0x7f6a18164c50 2026-02-12T03:58:47.507 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.498+0000 7f6a15ffb640 1 -- 10.20.193.91:0/2408886379 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1409081126 0 0) 0x7f6a180b17a0 con 0x7f6a18164880 2026-02-12T03:58:47.507 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.498+0000 7f6a15ffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:47.507 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.498+0000 7f6a15ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:47.507 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.498+0000 7f6a15ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:47.507 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.498+0000 7f6a15ffb640 10 monclient(hunting): my global_id is 4547 2026-02-12T03:58:47.508 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.498+0000 7f6a15ffb640 1 -- 10.20.193.91:0/2408886379 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a180b14c0 con 0x7f6a18164880 2026-02-12T03:58:47.508 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.498+0000 7f6a15ffb640 1 -- 10.20.193.91:0/2408886379 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3194272953 0 0) 0x7f6a180b11e0 con 0x7f6a18157bf0 2026-02-12T03:58:47.508 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.498+0000 7f6a15ffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:47.508 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.498+0000 7f6a15ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:47.508 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.498+0000 7f6a15ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:47.508 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.498+0000 7f6a15ffb640 10 monclient(hunting): my global_id is 4587 2026-02-12T03:58:47.508 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.498+0000 7f6a15ffb640 1 -- 10.20.193.91:0/2408886379 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a180b17a0 con 0x7f6a18157bf0 2026-02-12T03:58:47.508 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.499+0000 7f6a15ffb640 1 -- 10.20.193.91:0/2408886379 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1231157090 0 0) 0x7f6a04003610 con 0x7f6a18164c50 2026-02-12T03:58:47.508 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.499+0000 7f6a15ffb640 1 -- 10.20.193.91:0/2408886379 >> v1:10.20.193.111:6789/0 conn(0x7f6a18164880 legacy=0x7f6a181574e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.508 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.499+0000 7f6a15ffb640 1 -- 10.20.193.91:0/2408886379 >> v1:10.20.193.91:6789/0 conn(0x7f6a18157bf0 legacy=0x7f6a180563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.508 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.499+0000 7f6a15ffb640 10 monclient: _finish_hunting 0 2026-02-12T03:58:47.508 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.499+0000 7f6a15ffb640 1 monclient: found mon.noname-b 2026-02-12T03:58:47.509 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.499+0000 7f6a15ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:47.509 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.499+0000 7f6a15ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T03:58:47.509 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.499+0000 7f6a15ffb640 1 -- 10.20.193.91:0/2408886379 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a180b1a80 con 0x7f6a18164c50 2026-02-12T03:58:47.509 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.499+0000 7f6a15ffb640 10 monclient: _finish_auth 0 2026-02-12T03:58:47.509 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.499+0000 7f6a15ffb640 10 monclient: _check_auth_tickets 2026-02-12T03:58:47.509 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.499+0000 7f6a15ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:47.509 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.499+0000 7f6a15ffb640 1 -- 10.20.193.91:0/2408886379 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f6a08003170 con 0x7f6a18164c50 2026-02-12T03:58:47.509 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.499+0000 7f6a15ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:47.509 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.499+0000 7f6a15ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:47.509 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.499+0000 7f6a15ffb640 10 monclient: dump: 2026-02-12T03:58:47.509 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.509 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.510 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.510 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.510 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.510 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.510 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.510 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.510 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.510 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.499+0000 7f6a17fff640 5 monclient: authenticate success, global_id 4585 2026-02-12T03:58:47.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.499+0000 7f6a17fff640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:47.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.500+0000 7f6a15ffb640 1 -- 10.20.193.91:0/2408886379 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6a08003340 con 0x7f6a18164c50 2026-02-12T03:58:47.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.500+0000 7f6a15ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:47.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.500+0000 7f6a15ffb640 1 -- 10.20.193.91:0/2408886379 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f6a08003780 con 0x7f6a18164c50 2026-02-12T03:58:47.511 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.500+0000 7f6a15ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:47.511 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.500+0000 7f6a15ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:47.511 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.500+0000 7f6a15ffb640 10 monclient: dump: 2026-02-12T03:58:47.511 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.511 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.511 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.511 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.511 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.511 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.511 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.511 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.511 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.512 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.512 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.500+0000 7f6a17fff640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:47.512 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.500+0000 7f6a17fff640 4 set_mon_vals no callback set 2026-02-12T03:58:47.512 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.501+0000 7f6a17fff640 10 monclient: shutdown 2026-02-12T03:58:47.512 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.501+0000 7f6a17fff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:47.512 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.501+0000 7f6a17fff640 1 -- 10.20.193.91:0/2408886379 >> v1:10.20.193.98:6789/0 conn(0x7f6a18164c50 legacy=0x7f6a18056ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.512 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.501+0000 7f6a17fff640 1 -- 10.20.193.91:0/2408886379 shutdown_connections 2026-02-12T03:58:47.512 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.501+0000 7f6a17fff640 1 -- 10.20.193.91:0/2408886379 >> 10.20.193.91:0/2408886379 conn(0x7f6a180b2fa0 msgr2=0x7f6a180b33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:47.512 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.501+0000 7f6a17fff640 1 -- 10.20.193.91:0/2408886379 shutdown_connections 2026-02-12T03:58:47.512 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.501+0000 7f6a17fff640 1 -- 10.20.193.91:0/2408886379 wait complete. 2026-02-12T03:58:47.512 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.501+0000 7f6a17fff640 10 monclient: build_initial_monmap 2026-02-12T03:58:47.512 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.501+0000 7f6a17fff640 10 monclient: monmap: 2026-02-12T03:58:47.513 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:47.513 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:47.513 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:47.513 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:47.513 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:47.513 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:47.513 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:47.513 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:47.513 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:47.513 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.513 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.502+0000 7f6a17fff640 1 librados: starting msgr at 2026-02-12T03:58:47.513 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.502+0000 7f6a17fff640 1 librados: starting objecter 2026-02-12T03:58:47.514 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.502+0000 7f6a17fff640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:47.514 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.502+0000 7f6a17fff640 1 Processor -- start 2026-02-12T03:58:47.514 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.502+0000 7f6a17fff640 1 -- start start 2026-02-12T03:58:47.514 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.502+0000 7f6a17fff640 1 librados: setting wanted keys 2026-02-12T03:58:47.514 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.502+0000 7f6a17fff640 1 librados: calling monclient init 2026-02-12T03:58:47.514 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.502+0000 7f6a17fff640 10 monclient: init 2026-02-12T03:58:47.514 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.502+0000 7f6a17fff640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:47.514 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.502+0000 7f6a17fff640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T03:58:47.514 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.502+0000 7f6a17fff640 10 monclient(hunting): picked mon.noname-a con 0x7f6a18157bf0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:47.514 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.502+0000 7f6a17fff640 10 monclient(hunting): picked mon.noname-b con 0x7f6a18164880 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:47.514 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.502+0000 7f6a17fff640 10 monclient(hunting): picked mon.noname-c con 0x7f6a18164c50 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:47.514 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.502+0000 7f6a17fff640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a180592b0 con 0x7f6a18157bf0 2026-02-12T03:58:47.514 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.502+0000 7f6a17fff640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a18137cd0 con 0x7f6a18164880 2026-02-12T03:58:47.515 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.502+0000 7f6a17fff640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a18137fb0 con 0x7f6a18164c50 2026-02-12T03:58:47.515 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.502+0000 7f6a17fff640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:47.515 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.502+0000 7f6a17fff640 10 monclient(hunting): authenticate will time out at 1130.245686s 2026-02-12T03:58:47.515 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.502+0000 7f6a167fc640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f6a18164880 0x7f6a1815a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:48876/0 (socket says 10.20.193.91:48876) 2026-02-12T03:58:47.515 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.503+0000 7f6a16ffd640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f6a18157bf0 0x7f6a18058ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:59688/0 (socket says 10.20.193.91:59688) 2026-02-12T03:58:47.515 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.503+0000 7f6a167fc640 1 -- 10.20.193.91:0/2628226605 learned_addr learned my addr 10.20.193.91:0/2628226605 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:47.515 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.503+0000 7f69f77fe640 10 client.?.objecter ms_handle_connect 0x7f6a18157bf0 2026-02-12T03:58:47.515 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.503+0000 7f69f77fe640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:47.515 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.503+0000 7f69f77fe640 10 client.?.objecter ms_handle_connect 0x7f6a18164c50 2026-02-12T03:58:47.515 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.503+0000 7f69f77fe640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:47.515 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.503+0000 7f69f77fe640 10 client.?.objecter ms_handle_connect 0x7f6a18164880 2026-02-12T03:58:47.515 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.503+0000 7f69f77fe640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:47.516 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.504+0000 7f69f77fe640 1 -- 10.20.193.91:0/2628226605 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1552187164 0 0) 0x7f6a18137fb0 con 0x7f6a18164c50 2026-02-12T03:58:47.516 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.504+0000 7f69f77fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:47.516 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.504+0000 7f69f77fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:47.516 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.504+0000 7f69f77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:47.516 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.504+0000 7f69f77fe640 10 monclient(hunting): my global_id is 4550 2026-02-12T03:58:47.516 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.504+0000 7f69f77fe640 1 -- 10.20.193.91:0/2628226605 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69e4003610 con 0x7f6a18164c50 2026-02-12T03:58:47.516 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.504+0000 7f69f77fe640 1 -- 10.20.193.91:0/2628226605 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1204671954 0 0) 0x7f6a18137cd0 con 0x7f6a18164880 2026-02-12T03:58:47.516 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.504+0000 7f69f77fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:47.516 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.504+0000 7f69f77fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:47.516 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.504+0000 7f69f77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:47.516 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.504+0000 7f69f77fe640 10 monclient(hunting): my global_id is 4588 2026-02-12T03:58:47.516 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.504+0000 7f69f77fe640 1 -- 10.20.193.91:0/2628226605 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a18137fb0 con 0x7f6a18164880 2026-02-12T03:58:47.516 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.504+0000 7f69f77fe640 1 -- 10.20.193.91:0/2628226605 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3091160548 0 0) 0x7f6a180592b0 con 0x7f6a18157bf0 2026-02-12T03:58:47.517 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.504+0000 7f69f77fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:47.517 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.504+0000 7f69f77fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:47.517 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.504+0000 7f69f77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:47.517 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.504+0000 7f69f77fe640 10 monclient(hunting): my global_id is 4590 2026-02-12T03:58:47.517 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.504+0000 7f69f77fe640 1 -- 10.20.193.91:0/2628226605 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a18137cd0 con 0x7f6a18157bf0 2026-02-12T03:58:47.519 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.506+0000 7f69f77fe640 1 -- 10.20.193.91:0/2628226605 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 698111678 0 0) 0x7f69e4003610 con 0x7f6a18164c50 2026-02-12T03:58:47.519 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.506+0000 7f69f77fe640 1 -- 10.20.193.91:0/2628226605 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6a180592b0 con 0x7f6a18164c50 2026-02-12T03:58:47.519 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.506+0000 7f69f77fe640 1 -- 10.20.193.91:0/2628226605 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f6a080034f0 con 0x7f6a18164c50 2026-02-12T03:58:47.519 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.506+0000 7f69f77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:47.520 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.506+0000 7f69f77fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:47.520 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.506+0000 7f69f77fe640 10 monclient(hunting): dump: 2026-02-12T03:58:47.520 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.520 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.520 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.520 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.520 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.520 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.520 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.520 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.520 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.520 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.521 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.506+0000 7f69f77fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:47.521 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.506+0000 7f69f77fe640 1 -- 10.20.193.91:0/2628226605 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3693925383 0 0) 0x7f6a18137cd0 con 0x7f6a18157bf0 2026-02-12T03:58:47.521 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.506+0000 7f69f77fe640 1 -- 10.20.193.91:0/2628226605 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f69e4003610 con 0x7f6a18157bf0 2026-02-12T03:58:47.521 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.506+0000 7f69f77fe640 1 -- 10.20.193.91:0/2628226605 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2730899062 0 0) 0x7f6a18137fb0 con 0x7f6a18164880 2026-02-12T03:58:47.521 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.506+0000 7f69f77fe640 1 -- 10.20.193.91:0/2628226605 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6a18137cd0 con 0x7f6a18164880 2026-02-12T03:58:47.521 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.506+0000 7f69f77fe640 1 -- 10.20.193.91:0/2628226605 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f6a0c0030b0 con 0x7f6a18157bf0 2026-02-12T03:58:47.521 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.506+0000 7f69f77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:47.521 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.506+0000 7f69f77fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:47.521 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.506+0000 7f69f77fe640 10 monclient(hunting): dump: 2026-02-12T03:58:47.521 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.521 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.521 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.522 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.522 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.522 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.522 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.522 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.522 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.522 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.522 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.506+0000 7f69f77fe640 1 -- 10.20.193.91:0/2628226605 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f6a00002fc0 con 0x7f6a18164880 2026-02-12T03:58:47.522 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.506+0000 7f69f77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:47.522 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.506+0000 7f69f77fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:47.522 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.506+0000 7f69f77fe640 10 monclient(hunting): dump: 2026-02-12T03:58:47.522 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.523 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.523 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.523 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.523 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.523 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.523 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.523 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.523 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.523 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.523 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.508+0000 7f69f77fe640 1 -- 10.20.193.91:0/2628226605 <== mon.2 v1:10.20.193.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 365019634 0 0) 0x7f6a180592b0 con 0x7f6a18164c50 2026-02-12T03:58:47.523 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.508+0000 7f69f77fe640 1 -- 10.20.193.91:0/2628226605 >> v1:10.20.193.98:6789/0 conn(0x7f6a18164880 legacy=0x7f6a1815a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.523 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.508+0000 7f69f77fe640 1 -- 10.20.193.91:0/2628226605 >> v1:10.20.193.91:6789/0 conn(0x7f6a18157bf0 legacy=0x7f6a18058ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.523 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.508+0000 7f69f77fe640 10 monclient: _finish_hunting 0 2026-02-12T03:58:47.524 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.508+0000 7f69f77fe640 1 monclient: found mon.c 2026-02-12T03:58:47.524 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.508+0000 7f69f77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:47.524 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.508+0000 7f69f77fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:47.524 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.508+0000 7f69f77fe640 1 -- 10.20.193.91:0/2628226605 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a18138290 con 0x7f6a18164c50 2026-02-12T03:58:47.524 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.508+0000 7f69f77fe640 10 monclient: _finish_auth 0 2026-02-12T03:58:47.524 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.508+0000 7f69f77fe640 10 monclient: _check_auth_tickets 2026-02-12T03:58:47.524 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.508+0000 7f69f77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:47.524 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.508+0000 7f6a17fff640 5 monclient: authenticate success, global_id 4550 2026-02-12T03:58:47.524 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.508+0000 7f6a17fff640 10 monclient: _renew_subs 2026-02-12T03:58:47.524 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.508+0000 7f6a17fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:47.524 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.508+0000 7f6a17fff640 1 -- 10.20.193.91:0/2628226605 --> v1:10.20.193.111:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6a18138570 con 0x7f6a18164c50 2026-02-12T03:58:47.524 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.508+0000 7f6a17fff640 10 client.4550.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:47.525 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.508+0000 7f6a17fff640 10 monclient: _renew_subs 2026-02-12T03:58:47.525 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.508+0000 7f6a17fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:47.525 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.508+0000 7f6a17fff640 1 -- 10.20.193.91:0/2628226605 --> v1:10.20.193.111:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6a1815a870 con 0x7f6a18164c50 2026-02-12T03:58:47.525 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.508+0000 7f6a17fff640 1 librados: init done 2026-02-12T03:58:47.525 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.508+0000 7f6a17fff640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:47.525 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.508+0000 7f6a17fff640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:47.525 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.508+0000 7f6a17fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:47.525 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.508+0000 7f6a17fff640 1 -- 10.20.193.91:0/2628226605 --> v1:10.20.193.111:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a1815aaf0 con 0x7f6a18164c50 2026-02-12T03:58:47.525 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2026-02-12T03:58:47.536 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2026-02-12T03:58:47.538 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.536+0000 7feec8651640 10 monclient: get_monmap_and_config 2026-02-12T03:58:47.539 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.536+0000 7feec8651640 10 monclient: build_initial_monmap 2026-02-12T03:58:47.539 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.536+0000 7feec8651640 10 monclient: monmap: 2026-02-12T03:58:47.539 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:47.539 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.539 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:47.537209+0000 2026-02-12T03:58:47.539 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:47.537209+0000 2026-02-12T03:58:47.539 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:47.539 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.539 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:47.539 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:47.540 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:47.540 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.540 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.537+0000 7feec8651640 1 Processor -- start 2026-02-12T03:58:47.540 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.537+0000 7feec8651640 1 -- start start 2026-02-12T03:58:47.540 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.537+0000 7feec8651640 10 monclient: init 2026-02-12T03:58:47.542 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.537+0000 7feec8651640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:47.542 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.537+0000 7feec8651640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T03:58:47.542 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.537+0000 7feec8651640 10 monclient(hunting): picked mon.noname-c con 0x7feec01599b0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:47.542 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.537+0000 7feec8651640 10 monclient(hunting): picked mon.noname-b con 0x7feec005d180 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:47.542 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.537+0000 7feec8651640 10 monclient(hunting): picked mon.noname-a con 0x7feec0166580 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:47.542 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.537+0000 7feec8651640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feec005c0e0 con 0x7feec0166580 2026-02-12T03:58:47.542 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.537+0000 7feec8651640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feec005c3c0 con 0x7feec005d180 2026-02-12T03:58:47.542 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.537+0000 7feec8651640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feec005c6a0 con 0x7feec01599b0 2026-02-12T03:58:47.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.537+0000 7feec8651640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:47.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.537+0000 7feec8651640 10 monclient(hunting): authenticate will time out at 1130.280903s 2026-02-12T03:58:47.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.538+0000 7feec5bc5640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7feec005d180 0x7feec005d5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:48882/0 (socket says 10.20.193.91:48882) 2026-02-12T03:58:47.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.538+0000 7feec6bc7640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7feec0166580 0x7feec01669a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:59690/0 (socket says 10.20.193.91:59690) 2026-02-12T03:58:47.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.538+0000 7feec5bc5640 1 -- 10.20.193.91:0/1059443531 learned_addr learned my addr 10.20.193.91:0/1059443531 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:47.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.539+0000 7feec53c4640 1 -- 10.20.193.91:0/1059443531 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 758859512 0 0) 0x7feec005c3c0 con 0x7feec005d180 2026-02-12T03:58:47.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.539+0000 7feec53c4640 10 monclient(hunting): _negotiate 2026-02-12T03:58:47.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.539+0000 7feec53c4640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:47.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.539+0000 7feec53c4640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:47.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.539+0000 7feec53c4640 10 monclient(hunting): my global_id is 4591 2026-02-12T03:58:47.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.539+0000 7feec53c4640 1 -- 10.20.193.91:0/1059443531 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feea8003610 con 0x7feec005d180 2026-02-12T03:58:47.543 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.539+0000 7feec53c4640 1 -- 10.20.193.91:0/1059443531 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1525564264 0 0) 0x7feec005c0e0 con 0x7feec0166580 2026-02-12T03:58:47.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.539+0000 7feec53c4640 10 monclient(hunting): _negotiate 2026-02-12T03:58:47.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.539+0000 7feec53c4640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:47.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.539+0000 7feec53c4640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:47.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.539+0000 7feec53c4640 10 monclient(hunting): my global_id is 4593 2026-02-12T03:58:47.544 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.539+0000 7feec53c4640 1 -- 10.20.193.91:0/1059443531 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feec005c3c0 con 0x7feec0166580 2026-02-12T03:58:47.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.541+0000 7feec53c4640 1 -- 10.20.193.91:0/1059443531 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 983580701 0 0) 0x7feea8003610 con 0x7feec005d180 2026-02-12T03:58:47.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.541+0000 7feec53c4640 1 -- 10.20.193.91:0/1059443531 >> v1:10.20.193.111:6789/0 conn(0x7feec01599b0 legacy=0x7feec005b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T03:58:47.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.541+0000 7feec53c4640 1 -- 10.20.193.91:0/1059443531 >> v1:10.20.193.91:6789/0 conn(0x7feec0166580 legacy=0x7feec01669a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.541+0000 7feec53c4640 10 monclient: _finish_hunting 0 2026-02-12T03:58:47.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.541+0000 7feec53c4640 1 monclient: found mon.noname-b 2026-02-12T03:58:47.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.541+0000 7feec53c4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:47.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.541+0000 7feec53c4640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T03:58:47.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.541+0000 7feec53c4640 1 -- 10.20.193.91:0/1059443531 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feec005c980 con 0x7feec005d180 2026-02-12T03:58:47.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.541+0000 7feec53c4640 10 monclient: _finish_auth 0 2026-02-12T03:58:47.549 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.541+0000 7feec53c4640 10 monclient: _check_auth_tickets 2026-02-12T03:58:47.549 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.541+0000 7feec53c4640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:47.549 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.541+0000 7feec53c4640 1 -- 10.20.193.91:0/1059443531 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7feeb4002df0 con 0x7feec005d180 2026-02-12T03:58:47.549 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.541+0000 7feec53c4640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:47.549 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.541+0000 7feec53c4640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:47.549 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.541+0000 7feec53c4640 10 monclient: dump: 2026-02-12T03:58:47.549 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.549 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.549 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.549 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.549 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.549 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.550 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.550 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.550 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.550 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.550 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.541+0000 7feec8651640 5 monclient: authenticate success, global_id 4591 2026-02-12T03:58:47.550 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.541+0000 7feec8651640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:47.550 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.542+0000 7feec53c4640 1 -- 10.20.193.91:0/1059443531 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feeb4003000 con 0x7feec005d180 2026-02-12T03:58:47.550 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.542+0000 7feec53c4640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:47.550 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.542+0000 7feec53c4640 1 -- 10.20.193.91:0/1059443531 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7feeb4003440 con 0x7feec005d180 2026-02-12T03:58:47.550 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.542+0000 7feec8651640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:47.550 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.542+0000 7feec8651640 4 set_mon_vals no callback set 2026-02-12T03:58:47.550 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.542+0000 7feec53c4640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:47.551 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.542+0000 7feec53c4640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:47.551 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.542+0000 7feec53c4640 10 monclient: dump: 2026-02-12T03:58:47.551 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.551 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.551 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.551 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.551 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.551 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.551 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.551 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.551 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.551 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.552 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.542+0000 7feec8651640 10 monclient: shutdown 2026-02-12T03:58:47.552 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.542+0000 7feec8651640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:47.552 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.542+0000 7feec8651640 1 -- 10.20.193.91:0/1059443531 >> v1:10.20.193.98:6789/0 conn(0x7feec005d180 legacy=0x7feec005d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.552 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.542+0000 7feec8651640 1 -- 10.20.193.91:0/1059443531 shutdown_connections 2026-02-12T03:58:47.552 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.542+0000 7feec8651640 1 -- 10.20.193.91:0/1059443531 >> 10.20.193.91:0/1059443531 conn(0x7feec00b6560 msgr2=0x7feec00b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:47.552 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.542+0000 7feec8651640 1 -- 10.20.193.91:0/1059443531 shutdown_connections 2026-02-12T03:58:47.552 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.542+0000 7feec8651640 1 -- 10.20.193.91:0/1059443531 wait complete. 2026-02-12T03:58:47.552 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.542+0000 7feec8651640 10 monclient: build_initial_monmap 2026-02-12T03:58:47.552 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.542+0000 7feec8651640 10 monclient: monmap: 2026-02-12T03:58:47.552 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:47.552 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:47.552 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:47.553 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:47.553 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:47.553 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:47.553 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:47.553 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:47.553 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:47.553 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.553 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.543+0000 7feec8651640 1 librados: starting msgr at 2026-02-12T03:58:47.553 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.543+0000 7feec8651640 1 librados: starting objecter 2026-02-12T03:58:47.553 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.543+0000 7feec8651640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:47.553 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.543+0000 7feec8651640 1 Processor -- start 2026-02-12T03:58:47.553 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.543+0000 7feec8651640 1 -- start start 2026-02-12T03:58:47.553 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.543+0000 7feec8651640 1 librados: setting wanted keys 2026-02-12T03:58:47.554 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.543+0000 7feec8651640 1 librados: calling monclient init 2026-02-12T03:58:47.554 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.543+0000 7feec8651640 10 monclient: init 2026-02-12T03:58:47.554 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.543+0000 7feec8651640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:47.554 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.543+0000 7feec8651640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T03:58:47.554 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.543+0000 7feec8651640 10 monclient(hunting): picked mon.noname-a con 0x7feec005d180 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:47.554 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.543+0000 7feec8651640 10 monclient(hunting): picked mon.noname-c con 0x7feec01599b0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:47.554 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.543+0000 7feec8651640 10 monclient(hunting): picked mon.noname-b con 0x7feec0166580 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:47.554 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.543+0000 7feec8651640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feec011c210 con 0x7feec005d180 2026-02-12T03:58:47.554 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.543+0000 7feec8651640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feec0164770 con 0x7feec0166580 2026-02-12T03:58:47.554 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.543+0000 7feec8651640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feec0164a50 con 0x7feec01599b0 2026-02-12T03:58:47.554 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.543+0000 7feec8651640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:47.554 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.543+0000 7feec8651640 10 monclient(hunting): authenticate will time out at 1130.286619s 2026-02-12T03:58:47.554 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.543+0000 7feec63c6640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7feec005d180 0x7feec0165af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:59692/0 (socket says 10.20.193.91:59692) 2026-02-12T03:58:47.555 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.543+0000 7feec63c6640 1 -- 10.20.193.91:0/2726811216 learned_addr learned my addr 10.20.193.91:0/2726811216 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:47.555 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.544+0000 7feea6ffd640 10 client.?.objecter ms_handle_connect 0x7feec005d180 2026-02-12T03:58:47.555 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.544+0000 7feea6ffd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:47.555 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.544+0000 7feea6ffd640 10 client.?.objecter ms_handle_connect 0x7feec0166580 2026-02-12T03:58:47.555 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.544+0000 7feea6ffd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:47.555 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.545+0000 7feea6ffd640 1 -- 10.20.193.91:0/2726811216 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2415900560 0 0) 0x7feec011c210 con 0x7feec005d180 2026-02-12T03:58:47.555 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.545+0000 7feea6ffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:47.555 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.545+0000 7feea6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:47.555 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.545+0000 7feea6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:47.555 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.545+0000 7feea6ffd640 10 monclient(hunting): my global_id is 4596 2026-02-12T03:58:47.555 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.545+0000 7feea6ffd640 1 -- 10.20.193.91:0/2726811216 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee90003610 con 0x7feec005d180 2026-02-12T03:58:47.555 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.545+0000 7feea6ffd640 1 -- 10.20.193.91:0/2726811216 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3039704132 0 0) 0x7feec0164770 con 0x7feec0166580 2026-02-12T03:58:47.556 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.545+0000 7feea6ffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:47.556 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.545+0000 7feea6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:47.556 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.545+0000 7feea6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:47.556 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.545+0000 7feea6ffd640 10 monclient(hunting): my global_id is 4594 2026-02-12T03:58:47.556 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.545+0000 7feea6ffd640 1 -- 10.20.193.91:0/2726811216 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feec011c210 con 0x7feec0166580 2026-02-12T03:58:47.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.547+0000 7feea6ffd640 1 -- 10.20.193.91:0/2726811216 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 506881262 0 0) 0x7fee90003610 con 0x7feec005d180 2026-02-12T03:58:47.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.547+0000 7feea6ffd640 1 -- 10.20.193.91:0/2726811216 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feec0164770 con 0x7feec005d180 2026-02-12T03:58:47.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.547+0000 7feea6ffd640 1 -- 10.20.193.91:0/2726811216 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7feeb0002fd0 con 0x7feec005d180 2026-02-12T03:58:47.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.547+0000 7feea6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:47.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.547+0000 7feea6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:47.558 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.547+0000 7feea6ffd640 10 monclient(hunting): dump: 2026-02-12T03:58:47.558 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.558 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.558 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.558 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.558 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.558 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.559 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.559 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.559 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.559 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.559 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.547+0000 7feea6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:47.559 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.547+0000 7feea6ffd640 1 -- 10.20.193.91:0/2726811216 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3977892477 0 0) 0x7feec011c210 con 0x7feec0166580 2026-02-12T03:58:47.559 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.547+0000 7feea6ffd640 1 -- 10.20.193.91:0/2726811216 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fee90003610 con 0x7feec0166580 2026-02-12T03:58:47.559 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.547+0000 7feea6ffd640 1 -- 10.20.193.91:0/2726811216 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7feebc003370 con 0x7feec0166580 2026-02-12T03:58:47.559 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.547+0000 7feea6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:47.559 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.547+0000 7feea6ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:47.559 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.547+0000 7feea6ffd640 10 monclient(hunting): dump: 2026-02-12T03:58:47.559 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.559 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.560 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.560 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.560 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.560 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.560 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.560 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.560 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.560 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.560 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.549+0000 7feea6ffd640 1 -- 10.20.193.91:0/2726811216 <== mon.1 v1:10.20.193.98:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1643777907 0 0) 0x7fee90003610 con 0x7feec0166580 2026-02-12T03:58:47.560 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.549+0000 7feea6ffd640 1 -- 10.20.193.91:0/2726811216 >> v1:10.20.193.111:6789/0 conn(0x7feec01599b0 legacy=0x7feec011b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.560 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.549+0000 7feea6ffd640 1 -- 10.20.193.91:0/2726811216 >> v1:10.20.193.91:6789/0 conn(0x7feec005d180 legacy=0x7feec0165af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.560 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.549+0000 7feea6ffd640 10 monclient: _finish_hunting 0 2026-02-12T03:58:47.560 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.549+0000 7feea6ffd640 1 monclient: found mon.b 2026-02-12T03:58:47.560 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.549+0000 7feea6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:47.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.549+0000 7feea6ffd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:47.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.549+0000 7feea6ffd640 1 -- 10.20.193.91:0/2726811216 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feec0164d30 con 0x7feec0166580 2026-02-12T03:58:47.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.549+0000 7feea6ffd640 10 monclient: _finish_auth 0 2026-02-12T03:58:47.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.549+0000 7feea6ffd640 10 monclient: _check_auth_tickets 2026-02-12T03:58:47.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.549+0000 7feea6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:47.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.549+0000 7feec8651640 5 monclient: authenticate success, global_id 4594 2026-02-12T03:58:47.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.549+0000 7feec8651640 10 monclient: _renew_subs 2026-02-12T03:58:47.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.549+0000 7feec8651640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:47.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.549+0000 7feec8651640 1 -- 10.20.193.91:0/2726811216 --> v1:10.20.193.98:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7feec0165010 con 0x7feec0166580 2026-02-12T03:58:47.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.549+0000 7feec8651640 10 client.4594.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:47.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.549+0000 7feec8651640 10 monclient: _renew_subs 2026-02-12T03:58:47.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.549+0000 7feec8651640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:47.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.549+0000 7feec8651640 1 -- 10.20.193.91:0/2726811216 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7feec012b350 con 0x7feec0166580 2026-02-12T03:58:47.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.549+0000 7feec8651640 1 librados: init done 2026-02-12T03:58:47.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.550+0000 7feec8651640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:47.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.550+0000 7feec8651640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:47.561 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.550+0000 7feec8651640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:47.562 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.550+0000 7feec8651640 1 -- 10.20.193.91:0/2726811216 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feec00af920 con 0x7feec0166580 2026-02-12T03:58:47.562 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.557+0000 7feea6ffd640 1 -- 10.20.193.91:0/2726811216 <== mon.1 v1:10.20.193.98:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feebc0038a0 con 0x7feec0166580 2026-02-12T03:58:47.563 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.557+0000 7feea6ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:47.563 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.557+0000 7feea6ffd640 1 -- 10.20.193.91:0/2726811216 <== mon.1 v1:10.20.193.98:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7feebc004df0 con 0x7feec0166580 2026-02-12T03:58:47.563 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.557+0000 7feea6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:47.563 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.557+0000 7feea6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:47.563 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.557+0000 7feec4bc3640 4 set_mon_vals no callback set 2026-02-12T03:58:47.563 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.557+0000 7feea6ffd640 10 monclient: dump: 2026-02-12T03:58:47.563 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.563 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.563 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.563 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.563 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.563 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.563 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.563 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.564 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.564 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.564 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.558+0000 7feea6ffd640 1 -- 10.20.193.91:0/2726811216 <== mon.1 v1:10.20.193.98:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7feebc004fd0 con 0x7feec0166580 2026-02-12T03:58:47.564 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.559+0000 7feec63c6640 10 monclient: get_auth_request con 0x7fee90079ea0 auth_method 0 2026-02-12T03:58:47.564 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.559+0000 7feea6ffd640 10 client.4594.objecter ms_handle_connect 0x7fee90079ea0 2026-02-12T03:58:47.564 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.559+0000 7feea6ffd640 1 -- 10.20.193.91:0/2726811216 <== mon.1 v1:10.20.193.98:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7feebc095dd0 con 0x7feec0166580 2026-02-12T03:58:47.564 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.559+0000 7feea6ffd640 10 client.4594.objecter ms_dispatch2 0x7feec0000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:47.564 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.559+0000 7feea6ffd640 3 client.4594.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:47.564 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.559+0000 7feea6ffd640 3 client.4594.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:47.564 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.559+0000 7feea6ffd640 20 client.4594.objecter dump_active .. 0 homeless 2026-02-12T03:58:47.565 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.564+0000 7fdb6d6c4640 10 monclient: get_monmap_and_config 2026-02-12T03:58:47.566 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.564+0000 7fdb6d6c4640 10 monclient: build_initial_monmap 2026-02-12T03:58:47.566 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.564+0000 7fdb6d6c4640 10 monclient: monmap: 2026-02-12T03:58:47.566 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:47.566 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.566 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:47.564755+0000 2026-02-12T03:58:47.566 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:47.564755+0000 2026-02-12T03:58:47.566 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:47.566 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.566 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:47.566 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:47.566 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:47.566 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.567 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.564+0000 7f4a32dd8640 10 monclient: get_monmap_and_config 2026-02-12T03:58:47.567 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.564+0000 7f4a32dd8640 10 monclient: build_initial_monmap 2026-02-12T03:58:47.567 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.564+0000 7f4a32dd8640 10 monclient: monmap: 2026-02-12T03:58:47.567 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:47.567 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.567 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:47.564938+0000 2026-02-12T03:58:47.567 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:47.564938+0000 2026-02-12T03:58:47.567 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:47.567 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.567 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:47.567 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:47.567 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:47.567 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.568 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.564+0000 7fdb6d6c4640 1 Processor -- start 2026-02-12T03:58:47.568 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.564+0000 7fdb6d6c4640 1 -- start start 2026-02-12T03:58:47.568 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.564+0000 7fdb6d6c4640 10 monclient: init 2026-02-12T03:58:47.568 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.564+0000 7f4a32dd8640 1 Processor -- start 2026-02-12T03:58:47.568 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.565+0000 7f4a32dd8640 1 -- start start 2026-02-12T03:58:47.568 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.565+0000 7f4a32dd8640 10 monclient: init 2026-02-12T03:58:47.569 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.565+0000 7fdb6d6c4640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:47.569 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.565+0000 7fdb6d6c4640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T03:58:47.569 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.565+0000 7fdb6d6c4640 10 monclient(hunting): picked mon.noname-c con 0x7fdb680b57a0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:47.569 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.565+0000 7fdb6d6c4640 10 monclient(hunting): picked mon.noname-a con 0x7fdb680b7180 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:47.569 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.565+0000 7fdb6d6c4640 10 monclient(hunting): picked mon.noname-b con 0x7fdb680b5b70 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:47.570 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.565+0000 7fdb6d6c4640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb68163f30 con 0x7fdb680b7180 2026-02-12T03:58:47.570 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.565+0000 7fdb6d6c4640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb680b63c0 con 0x7fdb680b5b70 2026-02-12T03:58:47.570 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.565+0000 7fdb6d6c4640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb680b66a0 con 0x7fdb680b57a0 2026-02-12T03:58:47.570 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.565+0000 7fdb6d6c4640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:47.570 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.565+0000 7fdb6d6c4640 10 monclient(hunting): authenticate will time out at 1130.308444s 2026-02-12T03:58:47.570 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-12T03:58:47.571 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.565+0000 7f4a32dd8640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:47.571 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.565+0000 7f4a32dd8640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T03:58:47.571 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.565+0000 7f4a32dd8640 10 monclient(hunting): picked mon.noname-b con 0x7f4a2c159b70 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:47.571 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.565+0000 7f4a32dd8640 10 monclient(hunting): picked mon.noname-a con 0x7f4a2c166f70 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:47.571 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.565+0000 7f4a32dd8640 10 monclient(hunting): picked mon.noname-c con 0x7f4a2c164760 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:47.571 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.565+0000 7f4a32dd8640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a2c0b8a20 con 0x7f4a2c166f70 2026-02-12T03:58:47.571 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.565+0000 7f4a32dd8640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a2c0b8cc0 con 0x7f4a2c159b70 2026-02-12T03:58:47.571 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.565+0000 7f4a32dd8640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a2c0b8fa0 con 0x7f4a2c164760 2026-02-12T03:58:47.571 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.565+0000 7f4a32dd8640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:47.572 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.565+0000 7f4a32dd8640 10 monclient(hunting): authenticate will time out at 1130.308819s 2026-02-12T03:58:47.572 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.565+0000 7fdb667fc640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7fdb680b7180 0x7fdb680565b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:59698/0 (socket says 10.20.193.91:59698) 2026-02-12T03:58:47.572 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.565+0000 7fdb667fc640 1 -- 10.20.193.91:0/2720965758 learned_addr learned my addr 10.20.193.91:0/2720965758 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:47.572 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.566+0000 7f4a23fff640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f4a2c166f70 0x7f4a2c0563d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:59706/0 (socket says 10.20.193.91:59706) 2026-02-12T03:58:47.572 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.566+0000 7f4a23fff640 1 -- 10.20.193.91:0/192273423 learned_addr learned my addr 10.20.193.91:0/192273423 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:47.573 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.568+0000 7fdb65ffb640 1 -- 10.20.193.91:0/2720965758 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1519847054 0 0) 0x7fdb68163f30 con 0x7fdb680b7180 2026-02-12T03:58:47.573 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.568+0000 7fdb65ffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:47.573 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.568+0000 7fdb65ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:47.573 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.568+0000 7fdb65ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:47.573 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.568+0000 7fdb65ffb640 10 monclient(hunting): my global_id is 4599 2026-02-12T03:58:47.573 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.568+0000 7fdb65ffb640 1 -- 10.20.193.91:0/2720965758 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb54003610 con 0x7fdb680b7180 2026-02-12T03:58:47.573 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.568+0000 7f4a237fe640 1 -- 10.20.193.91:0/192273423 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2998847605 0 0) 0x7f4a2c0b8a20 con 0x7f4a2c166f70 2026-02-12T03:58:47.573 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.568+0000 7f4a237fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:47.574 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.568+0000 7f4a237fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:47.574 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.568+0000 7f4a237fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:47.574 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.568+0000 7f4a237fe640 10 monclient(hunting): my global_id is 4602 2026-02-12T03:58:47.574 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.568+0000 7f4a237fe640 1 -- 10.20.193.91:0/192273423 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a18003610 con 0x7f4a2c166f70 2026-02-12T03:58:47.574 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.572+0000 7fdb65ffb640 1 -- 10.20.193.91:0/2720965758 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 157734939 0 0) 0x7fdb54003610 con 0x7fdb680b7180 2026-02-12T03:58:47.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.572+0000 7fdb65ffb640 1 -- 10.20.193.91:0/2720965758 >> v1:10.20.193.111:6789/0 conn(0x7fdb680b57a0 legacy=0x7fdb680b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T03:58:47.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.572+0000 7fdb65ffb640 1 -- 10.20.193.91:0/2720965758 >> v1:10.20.193.98:6789/0 conn(0x7fdb680b5b70 legacy=0x7fdb681633b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T03:58:47.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.572+0000 7fdb65ffb640 10 monclient: _finish_hunting 0 2026-02-12T03:58:47.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.572+0000 7fdb65ffb640 1 monclient: found mon.noname-a 2026-02-12T03:58:47.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.572+0000 7fdb65ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:47.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.572+0000 7fdb65ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.91:6789/0 2026-02-12T03:58:47.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.572+0000 7fdb65ffb640 1 -- 10.20.193.91:0/2720965758 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb680b6980 con 0x7fdb680b7180 2026-02-12T03:58:47.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.572+0000 7fdb65ffb640 10 monclient: _finish_auth 0 2026-02-12T03:58:47.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.572+0000 7fdb65ffb640 10 monclient: _check_auth_tickets 2026-02-12T03:58:47.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.572+0000 7fdb65ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:47.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.572+0000 7fdb65ffb640 1 -- 10.20.193.91:0/2720965758 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fdb50002df0 con 0x7fdb680b7180 2026-02-12T03:58:47.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.572+0000 7fdb65ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:47.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.572+0000 7fdb65ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:47.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.572+0000 7fdb65ffb640 10 monclient: dump: 2026-02-12T03:58:47.575 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.575 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.575 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.576 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.576 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.576 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.576 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.576 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.576 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.576 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.576 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.572+0000 7fdb6d6c4640 5 monclient: authenticate success, global_id 4599 2026-02-12T03:58:47.576 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.572+0000 7fdb6d6c4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:47.577 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.572+0000 7f4a237fe640 1 -- 10.20.193.91:0/192273423 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2718837090 0 0) 0x7f4a18003610 con 0x7f4a2c166f70 2026-02-12T03:58:47.577 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.572+0000 7f4a237fe640 1 -- 10.20.193.91:0/192273423 >> v1:10.20.193.111:6789/0 conn(0x7f4a2c164760 legacy=0x7f4a2c056ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T03:58:47.577 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.572+0000 7f4a237fe640 1 -- 10.20.193.91:0/192273423 >> v1:10.20.193.98:6789/0 conn(0x7f4a2c159b70 legacy=0x7f4a2c166860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T03:58:47.577 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.572+0000 7f4a237fe640 10 monclient: _finish_hunting 0 2026-02-12T03:58:47.577 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.572+0000 7f4a237fe640 1 monclient: found mon.noname-a 2026-02-12T03:58:47.577 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.572+0000 7f4a237fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:47.577 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.572+0000 7f4a237fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.91:6789/0 2026-02-12T03:58:47.577 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.572+0000 7f4a237fe640 1 -- 10.20.193.91:0/192273423 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a2c0b9280 con 0x7f4a2c166f70 2026-02-12T03:58:47.577 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.572+0000 7f4a237fe640 10 monclient: _finish_auth 0 2026-02-12T03:58:47.577 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.572+0000 7f4a237fe640 10 monclient: _check_auth_tickets 2026-02-12T03:58:47.577 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.572+0000 7f4a237fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:47.577 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.572+0000 7f4a237fe640 1 -- 10.20.193.91:0/192273423 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f4a14002df0 con 0x7f4a2c166f70 2026-02-12T03:58:47.577 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.572+0000 7f4a32dd8640 5 monclient: authenticate success, global_id 4602 2026-02-12T03:58:47.578 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.572+0000 7f4a237fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:47.578 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.572+0000 7f4a237fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:47.578 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.572+0000 7f4a237fe640 10 monclient: dump: 2026-02-12T03:58:47.578 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.578 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.578 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.578 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.578 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.578 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.578 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.578 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.578 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.578 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.578 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.572+0000 7f4a32dd8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:47.579 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.574+0000 7f4a237fe640 1 -- 10.20.193.91:0/192273423 <== mon.0 v1:10.20.193.91:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4a14003000 con 0x7f4a2c166f70 2026-02-12T03:58:47.579 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.574+0000 7f4a237fe640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:47.579 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.574+0000 7f4a32dd8640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:47.579 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.574+0000 7f4a32dd8640 4 set_mon_vals no callback set 2026-02-12T03:58:47.580 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.574+0000 7fdb65ffb640 1 -- 10.20.193.91:0/2720965758 <== mon.0 v1:10.20.193.91:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdb50003000 con 0x7fdb680b7180 2026-02-12T03:58:47.580 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.574+0000 7fdb65ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:47.580 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.574+0000 7fdb65ffb640 1 -- 10.20.193.91:0/2720965758 <== mon.0 v1:10.20.193.91:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fdb50003440 con 0x7fdb680b7180 2026-02-12T03:58:47.580 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.574+0000 7fdb65ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:47.580 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.574+0000 7fdb65ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:47.580 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.574+0000 7fdb65ffb640 10 monclient: dump: 2026-02-12T03:58:47.580 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.580 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.580 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.580 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.580 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.581 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.581 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.581 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.581 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.581 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.581 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.574+0000 7fdb6d6c4640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:47.581 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.574+0000 7fdb6d6c4640 4 set_mon_vals no callback set 2026-02-12T03:58:47.581 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.574+0000 7f4a237fe640 1 -- 10.20.193.91:0/192273423 <== mon.0 v1:10.20.193.91:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f4a14003440 con 0x7f4a2c166f70 2026-02-12T03:58:47.581 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.574+0000 7f4a237fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:47.581 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.574+0000 7f4a237fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:47.581 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.574+0000 7f4a237fe640 10 monclient: dump: 2026-02-12T03:58:47.581 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.582 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.582 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.582 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.582 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.582 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.582 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.582 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.582 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.582 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.574+0000 7f4a32dd8640 10 monclient: shutdown 2026-02-12T03:58:47.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.574+0000 7f4a32dd8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:47.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.574+0000 7f4a32dd8640 1 -- 10.20.193.91:0/192273423 >> v1:10.20.193.91:6789/0 conn(0x7f4a2c166f70 legacy=0x7f4a2c0563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.574+0000 7fdb6d6c4640 10 monclient: shutdown 2026-02-12T03:58:47.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.574+0000 7fdb6d6c4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:47.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.574+0000 7fdb6d6c4640 1 -- 10.20.193.91:0/2720965758 >> v1:10.20.193.91:6789/0 conn(0x7fdb680b7180 legacy=0x7fdb680565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.574+0000 7f4a32dd8640 1 -- 10.20.193.91:0/192273423 shutdown_connections 2026-02-12T03:58:47.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.574+0000 7f4a32dd8640 1 -- 10.20.193.91:0/192273423 >> 10.20.193.91:0/192273423 conn(0x7f4a2c0bab20 msgr2=0x7f4a2c0baf20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:47.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.574+0000 7fdb6d6c4640 1 -- 10.20.193.91:0/2720965758 shutdown_connections 2026-02-12T03:58:47.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.574+0000 7fdb6d6c4640 1 -- 10.20.193.91:0/2720965758 >> 10.20.193.91:0/2720965758 conn(0x7fdb680559c0 msgr2=0x7fdb68055dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:47.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.574+0000 7fdb6d6c4640 1 -- 10.20.193.91:0/2720965758 shutdown_connections 2026-02-12T03:58:47.584 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.574+0000 7f4a32dd8640 1 -- 10.20.193.91:0/192273423 shutdown_connections 2026-02-12T03:58:47.584 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.574+0000 7fdb6d6c4640 1 -- 10.20.193.91:0/2720965758 wait complete. 2026-02-12T03:58:47.584 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.574+0000 7f4a32dd8640 1 -- 10.20.193.91:0/192273423 wait complete. 2026-02-12T03:58:47.584 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.575+0000 7fdb6d6c4640 10 monclient: build_initial_monmap 2026-02-12T03:58:47.584 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.575+0000 7fdb6d6c4640 10 monclient: monmap: 2026-02-12T03:58:47.584 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:47.584 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:47.585 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:47.585 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:47.585 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:47.585 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:47.585 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:47.585 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:47.585 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:47.585 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.585 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.575+0000 7f4a32dd8640 10 monclient: build_initial_monmap 2026-02-12T03:58:47.585 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.575+0000 7f4a32dd8640 10 monclient: monmap: 2026-02-12T03:58:47.585 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:47.585 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:47.585 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:47.585 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:47.585 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:47.586 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:47.586 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:47.586 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:47.586 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:47.586 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.575+0000 7fdb6d6c4640 1 librados: starting msgr at 2026-02-12T03:58:47.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.575+0000 7fdb6d6c4640 1 librados: starting objecter 2026-02-12T03:58:47.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.575+0000 7fdb6d6c4640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:47.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.575+0000 7fdb6d6c4640 1 Processor -- start 2026-02-12T03:58:47.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.575+0000 7f4a32dd8640 1 librados: starting msgr at 2026-02-12T03:58:47.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.575+0000 7f4a32dd8640 1 librados: starting objecter 2026-02-12T03:58:47.587 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.575+0000 7fdb6d6c4640 1 -- start start 2026-02-12T03:58:47.587 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.575+0000 7fdb6d6c4640 1 librados: setting wanted keys 2026-02-12T03:58:47.587 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.575+0000 7fdb6d6c4640 1 librados: calling monclient init 2026-02-12T03:58:47.587 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.575+0000 7fdb6d6c4640 10 monclient: init 2026-02-12T03:58:47.587 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.575+0000 7f4a32dd8640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:47.587 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.575+0000 7f4a32dd8640 1 Processor -- start 2026-02-12T03:58:47.587 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.575+0000 7f4a32dd8640 1 -- start start 2026-02-12T03:58:47.587 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.575+0000 7f4a32dd8640 1 librados: setting wanted keys 2026-02-12T03:58:47.587 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.575+0000 7f4a32dd8640 1 librados: calling monclient init 2026-02-12T03:58:47.587 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.575+0000 7f4a32dd8640 10 monclient: init 2026-02-12T03:58:47.588 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.575+0000 7fdb6d6c4640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:47.588 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.575+0000 7fdb6d6c4640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T03:58:47.588 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.575+0000 7fdb6d6c4640 10 monclient(hunting): picked mon.noname-a con 0x7fdb680b57a0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:47.588 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.575+0000 7fdb6d6c4640 10 monclient(hunting): picked mon.noname-b con 0x7fdb680b5b70 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:47.588 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.575+0000 7fdb6d6c4640 10 monclient(hunting): picked mon.noname-c con 0x7fdb680b7180 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:47.588 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.575+0000 7fdb6d6c4640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb68154aa0 con 0x7fdb680b57a0 2026-02-12T03:58:47.588 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.575+0000 7fdb6d6c4640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb68154d80 con 0x7fdb680b5b70 2026-02-12T03:58:47.588 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.575+0000 7fdb6d6c4640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb68155060 con 0x7fdb680b7180 2026-02-12T03:58:47.588 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.575+0000 7fdb6d6c4640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:47.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.575+0000 7fdb6d6c4640 10 monclient(hunting): authenticate will time out at 1130.318967s 2026-02-12T03:58:47.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.576+0000 7f4a32dd8640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:47.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.576+0000 7f4a32dd8640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T03:58:47.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.576+0000 7f4a32dd8640 10 monclient(hunting): picked mon.noname-c con 0x7f4a2c159b70 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:47.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.576+0000 7f4a32dd8640 10 monclient(hunting): picked mon.noname-b con 0x7f4a2c164760 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:47.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.576+0000 7f4a32dd8640 10 monclient(hunting): picked mon.noname-a con 0x7f4a2c166f70 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:47.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.576+0000 7f4a32dd8640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a2c144240 con 0x7f4a2c166f70 2026-02-12T03:58:47.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.576+0000 7f4a32dd8640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a2c139040 con 0x7f4a2c164760 2026-02-12T03:58:47.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.576+0000 7f4a32dd8640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a2c1351c0 con 0x7f4a2c159b70 2026-02-12T03:58:47.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.576+0000 7f4a32dd8640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:47.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.576+0000 7f4a32dd8640 10 monclient(hunting): authenticate will time out at 1130.319090s 2026-02-12T03:58:47.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.576+0000 7fdb66ffd640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7fdb680b57a0 0x7fdb68156920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:59722/0 (socket says 10.20.193.91:59722) 2026-02-12T03:58:47.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.576+0000 7fdb66ffd640 1 -- 10.20.193.91:0/4125666078 learned_addr learned my addr 10.20.193.91:0/4125666078 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:47.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.576+0000 7f4a3134e640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f4a2c166f70 0x7f4a2c145730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:59734/0 (socket says 10.20.193.91:59734) 2026-02-12T03:58:47.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.576+0000 7f4a3134e640 1 -- 10.20.193.91:0/385266500 learned_addr learned my addr 10.20.193.91:0/385266500 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:47.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.576+0000 7fdb477fe640 10 client.?.objecter ms_handle_connect 0x7fdb680b57a0 2026-02-12T03:58:47.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.576+0000 7fdb477fe640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:47.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.576+0000 7f4a217fa640 10 client.?.objecter ms_handle_connect 0x7f4a2c166f70 2026-02-12T03:58:47.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.576+0000 7f4a217fa640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:47.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.577+0000 7fdb477fe640 1 -- 10.20.193.91:0/4125666078 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1535547568 0 0) 0x7fdb68154aa0 con 0x7fdb680b57a0 2026-02-12T03:58:47.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.577+0000 7fdb477fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:47.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.577+0000 7fdb477fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:47.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.577+0000 7fdb477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:47.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.577+0000 7fdb477fe640 10 monclient(hunting): my global_id is 4605 2026-02-12T03:58:47.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.577+0000 7fdb477fe640 1 -- 10.20.193.91:0/4125666078 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb34003610 con 0x7fdb680b57a0 2026-02-12T03:58:47.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.578+0000 7f4a217fa640 1 -- 10.20.193.91:0/385266500 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1560604464 0 0) 0x7f4a2c144240 con 0x7f4a2c166f70 2026-02-12T03:58:47.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.578+0000 7f4a217fa640 10 monclient(hunting): _negotiate 2026-02-12T03:58:47.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.578+0000 7f4a217fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:47.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.578+0000 7f4a217fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:47.592 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.578+0000 7f4a217fa640 10 monclient(hunting): my global_id is 4608 2026-02-12T03:58:47.592 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.578+0000 7f4a217fa640 1 -- 10.20.193.91:0/385266500 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49fc003610 con 0x7f4a2c166f70 2026-02-12T03:58:47.592 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.583+0000 7fdb477fe640 1 -- 10.20.193.91:0/4125666078 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1761579275 0 0) 0x7fdb34003610 con 0x7fdb680b57a0 2026-02-12T03:58:47.592 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.583+0000 7fdb477fe640 1 -- 10.20.193.91:0/4125666078 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdb68154aa0 con 0x7fdb680b57a0 2026-02-12T03:58:47.592 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.583+0000 7fdb477fe640 1 -- 10.20.193.91:0/4125666078 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fdb5c002f30 con 0x7fdb680b57a0 2026-02-12T03:58:47.592 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.583+0000 7fdb477fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:47.592 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.583+0000 7fdb477fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:47.592 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.583+0000 7fdb477fe640 10 monclient(hunting): dump: 2026-02-12T03:58:47.592 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.592 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.592 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.592 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.592 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.592 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.592 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.593 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.593 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.593 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.593 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.583+0000 7fdb477fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:47.593 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.583+0000 7f4a217fa640 1 -- 10.20.193.91:0/385266500 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2680808231 0 0) 0x7f49fc003610 con 0x7f4a2c166f70 2026-02-12T03:58:47.593 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.583+0000 7f4a217fa640 1 -- 10.20.193.91:0/385266500 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4a2c144240 con 0x7f4a2c166f70 2026-02-12T03:58:47.593 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.583+0000 7f4a217fa640 1 -- 10.20.193.91:0/385266500 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f4a280032d0 con 0x7f4a2c166f70 2026-02-12T03:58:47.593 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.583+0000 7f4a217fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:47.594 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.583+0000 7f4a217fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:47.594 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.583+0000 7f4a217fa640 10 monclient(hunting): dump: 2026-02-12T03:58:47.594 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.594 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.594 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.594 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.594 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.594 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.594 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.594 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.594 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.594 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.594 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.583+0000 7f4a217fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:47.594 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.587+0000 7f4a217fa640 1 -- 10.20.193.91:0/385266500 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 180745948 0 0) 0x7f4a2c144240 con 0x7f4a2c166f70 2026-02-12T03:58:47.594 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.587+0000 7f4a217fa640 1 -- 10.20.193.91:0/385266500 >> v1:10.20.193.111:6789/0 conn(0x7f4a2c159b70 legacy=0x7f4a2c1462d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.594 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.587+0000 7f4a217fa640 1 -- 10.20.193.91:0/385266500 >> v1:10.20.193.98:6789/0 conn(0x7f4a2c164760 legacy=0x7f4a2c138930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.594 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7f4a217fa640 10 monclient: _finish_hunting 0 2026-02-12T03:58:47.594 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7f4a217fa640 1 monclient: found mon.a 2026-02-12T03:58:47.594 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7f4a217fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:47.594 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7f4a217fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:47.594 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7f4a217fa640 1 -- 10.20.193.91:0/385266500 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a2c1354a0 con 0x7f4a2c166f70 2026-02-12T03:58:47.594 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7f4a217fa640 10 monclient: _finish_auth 0 2026-02-12T03:58:47.594 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7f4a217fa640 10 monclient: _check_auth_tickets 2026-02-12T03:58:47.594 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7f4a217fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:47.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7f4a32dd8640 5 monclient: authenticate success, global_id 4608 2026-02-12T03:58:47.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7f4a32dd8640 10 monclient: _renew_subs 2026-02-12T03:58:47.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7f4a32dd8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:47.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7f4a32dd8640 1 -- 10.20.193.91:0/385266500 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4a2c135780 con 0x7f4a2c166f70 2026-02-12T03:58:47.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7f4a32dd8640 10 client.4608.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:47.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7f4a32dd8640 10 monclient: _renew_subs 2026-02-12T03:58:47.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7f4a32dd8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:47.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7f4a32dd8640 1 -- 10.20.193.91:0/385266500 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4a2c1609a0 con 0x7f4a2c166f70 2026-02-12T03:58:47.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7f4a32dd8640 1 librados: init done 2026-02-12T03:58:47.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7fdb477fe640 1 -- 10.20.193.91:0/4125666078 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2391771425 0 0) 0x7fdb68154aa0 con 0x7fdb680b57a0 2026-02-12T03:58:47.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7fdb477fe640 1 -- 10.20.193.91:0/4125666078 >> v1:10.20.193.111:6789/0 conn(0x7fdb680b7180 legacy=0x7fdb68152a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7fdb477fe640 1 -- 10.20.193.91:0/4125666078 >> v1:10.20.193.98:6789/0 conn(0x7fdb680b5b70 legacy=0x7fdb681fc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7fdb477fe640 10 monclient: _finish_hunting 0 2026-02-12T03:58:47.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7fdb477fe640 1 monclient: found mon.a 2026-02-12T03:58:47.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7fdb477fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:47.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7fdb477fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:47.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7fdb477fe640 1 -- 10.20.193.91:0/4125666078 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb68155340 con 0x7fdb680b57a0 2026-02-12T03:58:47.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7fdb477fe640 10 monclient: _finish_auth 0 2026-02-12T03:58:47.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7fdb477fe640 10 monclient: _check_auth_tickets 2026-02-12T03:58:47.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7fdb477fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:47.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7fdb6d6c4640 5 monclient: authenticate success, global_id 4605 2026-02-12T03:58:47.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7fdb6d6c4640 10 monclient: _renew_subs 2026-02-12T03:58:47.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7fdb6d6c4640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:47.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7fdb6d6c4640 1 -- 10.20.193.91:0/4125666078 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdb68155620 con 0x7fdb680b57a0 2026-02-12T03:58:47.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7fdb6d6c4640 10 client.4605.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:47.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7fdb6d6c4640 10 monclient: _renew_subs 2026-02-12T03:58:47.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7fdb6d6c4640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:47.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7fdb6d6c4640 1 -- 10.20.193.91:0/4125666078 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fdb681fcc10 con 0x7fdb680b57a0 2026-02-12T03:58:47.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7fdb6d6c4640 1 librados: init done 2026-02-12T03:58:47.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7f4a32dd8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:47.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7f4a32dd8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:47.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7f4a32dd8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:47.597 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7fdb6d6c4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:47.597 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7fdb6d6c4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:47.597 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7fdb6d6c4640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:47.597 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7f4a32dd8640 1 -- 10.20.193.91:0/385266500 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a2c135b70 con 0x7f4a2c166f70 2026-02-12T03:58:47.597 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.588+0000 7fdb6d6c4640 1 -- 10.20.193.91:0/4125666078 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb680b60e0 con 0x7fdb680b57a0 2026-02-12T03:58:47.598 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.593+0000 7f5879763640 10 monclient: get_monmap_and_config 2026-02-12T03:58:47.598 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.593+0000 7f5879763640 10 monclient: build_initial_monmap 2026-02-12T03:58:47.598 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.593+0000 7f5879763640 10 monclient: monmap: 2026-02-12T03:58:47.598 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:47.598 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.598 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:47.593698+0000 2026-02-12T03:58:47.598 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:47.593698+0000 2026-02-12T03:58:47.599 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:47.599 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.599 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:47.599 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:47.599 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:47.599 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.599 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.593+0000 7f5879763640 1 Processor -- start 2026-02-12T03:58:47.599 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.593+0000 7f5879763640 1 -- start start 2026-02-12T03:58:47.599 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.593+0000 7f5879763640 10 monclient: init 2026-02-12T03:58:47.599 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.594+0000 7f5879763640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:47.599 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.594+0000 7f5879763640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T03:58:47.599 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.594+0000 7f5879763640 10 monclient(hunting): picked mon.noname-c con 0x7f58741575d0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:47.599 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.594+0000 7f5879763640 10 monclient(hunting): picked mon.noname-a con 0x7f5874163310 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:47.599 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.594+0000 7f5879763640 10 monclient(hunting): picked mon.noname-b con 0x7f58740560d0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:47.599 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.594+0000 7f5879763640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58740b20b0 con 0x7f5874163310 2026-02-12T03:58:47.599 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.594+0000 7f5879763640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58740b2390 con 0x7f58740560d0 2026-02-12T03:58:47.599 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.594+0000 7f5879763640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58740b2670 con 0x7f58741575d0 2026-02-12T03:58:47.599 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.594+0000 7f5879763640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:47.599 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.594+0000 7f5879763640 10 monclient(hunting): authenticate will time out at 1130.337106s 2026-02-12T03:58:47.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.606+0000 7f69f77fe640 1 -- 10.20.193.91:0/2628226605 <== mon.2 v1:10.20.193.111:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6a080032f0 con 0x7f6a18164c50 2026-02-12T03:58:47.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.606+0000 7f69f77fe640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:47.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.606+0000 7f69f77fe640 1 -- 10.20.193.91:0/2628226605 <== mon.2 v1:10.20.193.111:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f6a08003ce0 con 0x7f6a18164c50 2026-02-12T03:58:47.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.606+0000 7f69f77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:47.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.606+0000 7f69f77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:47.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.606+0000 7f69f77fe640 10 monclient: dump: 2026-02-12T03:58:47.608 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.608 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.608 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.608 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.608 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.608 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.608 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.608 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.608 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.608 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.606+0000 7f6a157fa640 4 set_mon_vals no callback set 2026-02-12T03:58:47.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.607+0000 7f3ca00e5640 10 monclient: get_monmap_and_config 2026-02-12T03:58:47.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.607+0000 7f3ca00e5640 10 monclient: build_initial_monmap 2026-02-12T03:58:47.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.607+0000 7f3ca00e5640 10 monclient: monmap: 2026-02-12T03:58:47.609 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:47.609 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.609 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:47.607719+0000 2026-02-12T03:58:47.609 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:47.607719+0000 2026-02-12T03:58:47.609 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:47.609 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.609 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:47.609 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:47.609 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:47.609 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.607+0000 7f69f77fe640 1 -- 10.20.193.91:0/2628226605 <== mon.2 v1:10.20.193.111:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f6a0801d1c0 con 0x7f6a18164c50 2026-02-12T03:58:47.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.607+0000 7f3ca00e5640 1 Processor -- start 2026-02-12T03:58:47.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.607+0000 7f3ca00e5640 1 -- start start 2026-02-12T03:58:47.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.607+0000 7f3ca00e5640 10 monclient: init 2026-02-12T03:58:47.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.608+0000 7f6a16ffd640 10 monclient: get_auth_request con 0x7f69e407a0b0 auth_method 0 2026-02-12T03:58:47.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.608+0000 7f69f77fe640 10 client.4550.objecter ms_handle_connect 0x7f69e407a0b0 2026-02-12T03:58:47.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.608+0000 7f3ca00e5640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:47.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.608+0000 7f3ca00e5640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T03:58:47.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.608+0000 7f3ca00e5640 10 monclient(hunting): picked mon.noname-a con 0x7f3c981575d0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:47.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.608+0000 7f3ca00e5640 10 monclient(hunting): picked mon.noname-c con 0x7f3c98163310 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:47.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.608+0000 7f3ca00e5640 10 monclient(hunting): picked mon.noname-b con 0x7f3c980560d0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:47.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.608+0000 7f3ca00e5640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c980b20b0 con 0x7f3c981575d0 2026-02-12T03:58:47.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.608+0000 7f3ca00e5640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c980b2390 con 0x7f3c980560d0 2026-02-12T03:58:47.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.608+0000 7f3ca00e5640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c980b2670 con 0x7f3c98163310 2026-02-12T03:58:47.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.608+0000 7f3ca00e5640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:47.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.608+0000 7f3ca00e5640 10 monclient(hunting): authenticate will time out at 1130.351377s 2026-02-12T03:58:47.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.609+0000 7f69f77fe640 1 -- 10.20.193.91:0/2628226605 <== mon.2 v1:10.20.193.111:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7f6a08094c90 con 0x7f6a18164c50 2026-02-12T03:58:47.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.609+0000 7f69f77fe640 10 client.4550.objecter ms_dispatch2 0x7f6a18000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:47.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.609+0000 7f69f77fe640 3 client.4550.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:47.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.609+0000 7f69f77fe640 3 client.4550.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:47.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.609+0000 7f69f77fe640 20 client.4550.objecter dump_active .. 0 homeless 2026-02-12T03:58:47.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.610+0000 7f69f77fe640 1 -- 10.20.193.91:0/2628226605 <== mon.2 v1:10.20.193.111:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f6a0805e5f0 con 0x7f6a18164c50 2026-02-12T03:58:47.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.610+0000 7f69f77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:47.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.610+0000 7f69f77fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:47.615 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.613+0000 7f3c9d659640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f3c98163310 0x7f3c980559c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:38254/0 (socket says 10.20.193.91:38254) 2026-02-12T03:58:47.615 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.613+0000 7f3c9d659640 1 -- 10.20.193.91:0/1864430990 learned_addr learned my addr 10.20.193.91:0/1864430990 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:47.616 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.614+0000 7f5872ffd640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f58741575d0 0x7f5874162c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:38240/0 (socket says 10.20.193.91:38240) 2026-02-12T03:58:47.616 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.614+0000 7f5872ffd640 1 -- 10.20.193.91:0/145289838 learned_addr learned my addr 10.20.193.91:0/145289838 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:47.618 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.616+0000 7f3c9ce58640 1 -- 10.20.193.91:0/1864430990 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2694642784 0 0) 0x7f3c980b2670 con 0x7f3c98163310 2026-02-12T03:58:47.618 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.616+0000 7f3c9ce58640 10 monclient(hunting): _negotiate 2026-02-12T03:58:47.618 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.616+0000 7f3c9ce58640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:47.618 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.616+0000 7f3c9ce58640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:47.618 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.616+0000 7f3c9ce58640 10 monclient(hunting): my global_id is 4553 2026-02-12T03:58:47.618 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.616+0000 7f3c9ce58640 1 -- 10.20.193.91:0/1864430990 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c80003610 con 0x7f3c98163310 2026-02-12T03:58:47.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.618+0000 7f5871ffb640 1 -- 10.20.193.91:0/145289838 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3337131244 0 0) 0x7f58740b2670 con 0x7f58741575d0 2026-02-12T03:58:47.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.618+0000 7f5871ffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:47.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.618+0000 7f5871ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:47.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.618+0000 7f5871ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:47.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.618+0000 7f5871ffb640 10 monclient(hunting): my global_id is 4556 2026-02-12T03:58:47.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.618+0000 7f5871ffb640 1 -- 10.20.193.91:0/145289838 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5860003610 con 0x7f58741575d0 2026-02-12T03:58:47.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.619+0000 7f3c9ce58640 1 -- 10.20.193.91:0/1864430990 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 495163190 0 0) 0x7f3c80003610 con 0x7f3c98163310 2026-02-12T03:58:47.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.619+0000 7f3c9ce58640 1 -- 10.20.193.91:0/1864430990 >> v1:10.20.193.98:6789/0 conn(0x7f3c980560d0 legacy=0x7f3c981c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T03:58:47.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.619+0000 7f3c9ce58640 1 -- 10.20.193.91:0/1864430990 >> v1:10.20.193.91:6789/0 conn(0x7f3c981575d0 legacy=0x7f3c98162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T03:58:47.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.619+0000 7f3c9ce58640 10 monclient: _finish_hunting 0 2026-02-12T03:58:47.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.619+0000 7f3c9ce58640 1 monclient: found mon.noname-c 2026-02-12T03:58:47.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.619+0000 7f3c9ce58640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:47.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.619+0000 7f3c9ce58640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.111:6789/0 2026-02-12T03:58:47.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.619+0000 7f3c9ce58640 1 -- 10.20.193.91:0/1864430990 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c98162400 con 0x7f3c98163310 2026-02-12T03:58:47.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.619+0000 7f3c9ce58640 10 monclient: _finish_auth 0 2026-02-12T03:58:47.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.619+0000 7f3c9ce58640 10 monclient: _check_auth_tickets 2026-02-12T03:58:47.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.619+0000 7f3c9ce58640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:47.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.619+0000 7f3c9ce58640 1 -- 10.20.193.91:0/1864430990 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f3c8c002df0 con 0x7f3c98163310 2026-02-12T03:58:47.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.619+0000 7f3c9ce58640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:47.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.619+0000 7f3c9ce58640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:47.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.619+0000 7f3c9ce58640 10 monclient: dump: 2026-02-12T03:58:47.622 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.622 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.622 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.622 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.622 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.622 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.622 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.622 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.622 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.622 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.619+0000 7f3ca00e5640 5 monclient: authenticate success, global_id 4553 2026-02-12T03:58:47.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.619+0000 7f3ca00e5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:47.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.621+0000 7f5871ffb640 1 -- 10.20.193.91:0/145289838 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1186319559 0 0) 0x7f5860003610 con 0x7f58741575d0 2026-02-12T03:58:47.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.621+0000 7f5871ffb640 1 -- 10.20.193.91:0/145289838 >> v1:10.20.193.98:6789/0 conn(0x7f58740560d0 legacy=0x7f58741c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T03:58:47.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.621+0000 7f5871ffb640 1 -- 10.20.193.91:0/145289838 >> v1:10.20.193.91:6789/0 conn(0x7f5874163310 legacy=0x7f58740559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T03:58:47.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.621+0000 7f5871ffb640 10 monclient: _finish_hunting 0 2026-02-12T03:58:47.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.621+0000 7f5871ffb640 1 monclient: found mon.noname-c 2026-02-12T03:58:47.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.621+0000 7f5871ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:47.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.621+0000 7f5871ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.111:6789/0 2026-02-12T03:58:47.624 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.621+0000 7f5871ffb640 1 -- 10.20.193.91:0/145289838 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5874162400 con 0x7f58741575d0 2026-02-12T03:58:47.624 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.621+0000 7f5871ffb640 10 monclient: _finish_auth 0 2026-02-12T03:58:47.624 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.621+0000 7f5871ffb640 10 monclient: _check_auth_tickets 2026-02-12T03:58:47.624 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.621+0000 7f5871ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:47.624 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.621+0000 7f5871ffb640 1 -- 10.20.193.91:0/145289838 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f5868002df0 con 0x7f58741575d0 2026-02-12T03:58:47.624 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.621+0000 7f5871ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:47.624 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.621+0000 7f5871ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:47.624 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.621+0000 7f5871ffb640 10 monclient: dump: 2026-02-12T03:58:47.624 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.624 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.624 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.624 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.624 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.624 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.624 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.624 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.624 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.624 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.625 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.621+0000 7f5879763640 5 monclient: authenticate success, global_id 4556 2026-02-12T03:58:47.625 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.621+0000 7f5879763640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:47.625 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.622+0000 7f3c9ce58640 1 -- 10.20.193.91:0/1864430990 <== mon.2 v1:10.20.193.111:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3c8c003000 con 0x7f3c98163310 2026-02-12T03:58:47.625 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.622+0000 7f3c9ce58640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:47.626 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.622+0000 7f3ca00e5640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:47.626 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.622+0000 7f3ca00e5640 4 set_mon_vals no callback set 2026-02-12T03:58:47.626 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.622+0000 7f3c9ce58640 1 -- 10.20.193.91:0/1864430990 <== mon.2 v1:10.20.193.111:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f3c8c003440 con 0x7f3c98163310 2026-02-12T03:58:47.626 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.622+0000 7f3c9ce58640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:47.626 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.622+0000 7f3c9ce58640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:47.626 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.622+0000 7f3c9ce58640 10 monclient: dump: 2026-02-12T03:58:47.626 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.626 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.626 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.626 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.626 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.626 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.626 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.626 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.626 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.626 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.626 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.622+0000 7f3ca00e5640 10 monclient: shutdown 2026-02-12T03:58:47.626 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.622+0000 7f3ca00e5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:47.627 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.622+0000 7f3ca00e5640 1 -- 10.20.193.91:0/1864430990 >> v1:10.20.193.111:6789/0 conn(0x7f3c98163310 legacy=0x7f3c980559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.627 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.622+0000 7f3ca00e5640 1 -- 10.20.193.91:0/1864430990 shutdown_connections 2026-02-12T03:58:47.627 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.622+0000 7f3ca00e5640 1 -- 10.20.193.91:0/1864430990 >> 10.20.193.91:0/1864430990 conn(0x7f3c980b6560 msgr2=0x7f3c980b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:47.627 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.622+0000 7f3ca00e5640 1 -- 10.20.193.91:0/1864430990 shutdown_connections 2026-02-12T03:58:47.627 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.622+0000 7f3ca00e5640 1 -- 10.20.193.91:0/1864430990 wait complete. 2026-02-12T03:58:47.627 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.623+0000 7f5871ffb640 1 -- 10.20.193.91:0/145289838 <== mon.2 v1:10.20.193.111:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5868003000 con 0x7f58741575d0 2026-02-12T03:58:47.627 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.623+0000 7f5871ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:47.627 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.623+0000 7f5871ffb640 1 -- 10.20.193.91:0/145289838 <== mon.2 v1:10.20.193.111:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f5868003440 con 0x7f58741575d0 2026-02-12T03:58:47.627 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.623+0000 7f5879763640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:47.628 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.623+0000 7f5879763640 4 set_mon_vals no callback set 2026-02-12T03:58:47.628 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.623+0000 7f5871ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:47.628 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.623+0000 7f5871ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:47.628 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.623+0000 7f5871ffb640 10 monclient: dump: 2026-02-12T03:58:47.628 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.628 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.628 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.628 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.628 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.628 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.628 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.628 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.628 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.628 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.628 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.623+0000 7f5879763640 10 monclient: shutdown 2026-02-12T03:58:47.628 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.623+0000 7f5879763640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:47.628 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.623+0000 7f5879763640 1 -- 10.20.193.91:0/145289838 >> v1:10.20.193.111:6789/0 conn(0x7f58741575d0 legacy=0x7f5874162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.628 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.623+0000 7f5879763640 1 -- 10.20.193.91:0/145289838 shutdown_connections 2026-02-12T03:58:47.628 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.623+0000 7f5879763640 1 -- 10.20.193.91:0/145289838 >> 10.20.193.91:0/145289838 conn(0x7f58740b6560 msgr2=0x7f58740b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:47.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.623+0000 7f5879763640 1 -- 10.20.193.91:0/145289838 shutdown_connections 2026-02-12T03:58:47.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.623+0000 7f5879763640 1 -- 10.20.193.91:0/145289838 wait complete. 2026-02-12T03:58:47.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.623+0000 7f3ca00e5640 10 monclient: build_initial_monmap 2026-02-12T03:58:47.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.623+0000 7f3ca00e5640 10 monclient: monmap: 2026-02-12T03:58:47.629 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:47.629 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:47.629 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:47.629 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:47.629 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:47.630 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:47.630 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:47.630 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:47.630 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:47.630 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.630 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.623+0000 7f3ca00e5640 1 librados: starting msgr at 2026-02-12T03:58:47.630 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.623+0000 7f3ca00e5640 1 librados: starting objecter 2026-02-12T03:58:47.630 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.623+0000 7f3ca00e5640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:47.630 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.623+0000 7f3ca00e5640 1 Processor -- start 2026-02-12T03:58:47.630 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.623+0000 7f3ca00e5640 1 -- start start 2026-02-12T03:58:47.630 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.623+0000 7f3ca00e5640 1 librados: setting wanted keys 2026-02-12T03:58:47.630 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.623+0000 7f3ca00e5640 1 librados: calling monclient init 2026-02-12T03:58:47.630 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.623+0000 7f3ca00e5640 10 monclient: init 2026-02-12T03:58:47.631 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.623+0000 7f5879763640 10 monclient: build_initial_monmap 2026-02-12T03:58:47.631 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.623+0000 7f5879763640 10 monclient: monmap: 2026-02-12T03:58:47.631 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:47.631 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:47.631 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:47.631 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:47.631 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:47.631 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:47.631 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:47.631 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:47.631 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:47.631 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.631 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.623+0000 7f5879763640 1 librados: starting msgr at 2026-02-12T03:58:47.631 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.623+0000 7f5879763640 1 librados: starting objecter 2026-02-12T03:58:47.631 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.623+0000 7f5879763640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:47.631 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.623+0000 7f5879763640 1 Processor -- start 2026-02-12T03:58:47.631 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.623+0000 7f5879763640 1 -- start start 2026-02-12T03:58:47.632 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.623+0000 7f5879763640 1 librados: setting wanted keys 2026-02-12T03:58:47.632 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.623+0000 7f5879763640 1 librados: calling monclient init 2026-02-12T03:58:47.632 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.623+0000 7f5879763640 10 monclient: init 2026-02-12T03:58:47.632 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.624+0000 7f3ca00e5640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:47.632 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.624+0000 7f3ca00e5640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T03:58:47.632 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.624+0000 7f3ca00e5640 10 monclient(hunting): picked mon.noname-c con 0x7f3c980560d0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:47.632 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.624+0000 7f3ca00e5640 10 monclient(hunting): picked mon.noname-a con 0x7f3c981575d0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:47.632 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.624+0000 7f3ca00e5640 10 monclient(hunting): picked mon.noname-b con 0x7f3c98163310 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:47.632 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.624+0000 7f3ca00e5640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c980ad900 con 0x7f3c981575d0 2026-02-12T03:58:47.633 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.624+0000 7f3ca00e5640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c980b0510 con 0x7f3c98163310 2026-02-12T03:58:47.633 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.624+0000 7f3ca00e5640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c980adba0 con 0x7f3c980560d0 2026-02-12T03:58:47.633 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.624+0000 7f3ca00e5640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:47.633 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.624+0000 7f3ca00e5640 10 monclient(hunting): authenticate will time out at 1130.367150s 2026-02-12T03:58:47.633 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.624+0000 7f5879763640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:47.633 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.624+0000 7f5879763640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T03:58:47.633 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.624+0000 7f5879763640 10 monclient(hunting): picked mon.noname-c con 0x7f58740560d0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:47.633 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.624+0000 7f5879763640 10 monclient(hunting): picked mon.noname-b con 0x7f58741575d0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:47.634 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.624+0000 7f5879763640 10 monclient(hunting): picked mon.noname-a con 0x7f5874163310 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:47.634 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.624+0000 7f5879763640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58740ae6b0 con 0x7f5874163310 2026-02-12T03:58:47.634 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.624+0000 7f5879763640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5874057950 con 0x7f58741575d0 2026-02-12T03:58:47.634 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.624+0000 7f5879763640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5874057c30 con 0x7f58740560d0 2026-02-12T03:58:47.634 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.624+0000 7f5879763640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:47.634 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.624+0000 7f5879763640 10 monclient(hunting): authenticate will time out at 1130.367418s 2026-02-12T03:58:47.634 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.624+0000 7f3c9de5a640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f3c980560d0 0x7f3c980aec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:38264/0 (socket says 10.20.193.91:38264) 2026-02-12T03:58:47.634 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.624+0000 7f3c9de5a640 1 -- 10.20.193.91:0/3002491663 learned_addr learned my addr 10.20.193.91:0/3002491663 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:47.634 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.624+0000 7f5872ffd640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f58740560d0 0x7f5874151cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:38274/0 (socket says 10.20.193.91:38274) 2026-02-12T03:58:47.634 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.624+0000 7f5872ffd640 1 -- 10.20.193.91:0/2261743271 learned_addr learned my addr 10.20.193.91:0/2261743271 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:47.634 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.624+0000 7f3c867fc640 10 client.?.objecter ms_handle_connect 0x7f3c980560d0 2026-02-12T03:58:47.635 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.624+0000 7f3c867fc640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:47.635 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.625+0000 7f58537fe640 10 client.?.objecter ms_handle_connect 0x7f58740560d0 2026-02-12T03:58:47.635 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.625+0000 7f58537fe640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:47.635 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.626+0000 7f3c867fc640 1 -- 10.20.193.91:0/3002491663 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2698902830 0 0) 0x7f3c980adba0 con 0x7f3c980560d0 2026-02-12T03:58:47.635 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.626+0000 7f3c867fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:47.635 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.626+0000 7f3c867fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:47.635 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.626+0000 7f3c867fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:47.635 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.626+0000 7f3c867fc640 10 monclient(hunting): my global_id is 4559 2026-02-12T03:58:47.635 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.626+0000 7f3c867fc640 1 -- 10.20.193.91:0/3002491663 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c68003610 con 0x7f3c980560d0 2026-02-12T03:58:47.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.626+0000 7f58537fe640 1 -- 10.20.193.91:0/2261743271 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2781960011 0 0) 0x7f5874057c30 con 0x7f58740560d0 2026-02-12T03:58:47.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.626+0000 7f58537fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:47.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.626+0000 7f58537fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:47.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.626+0000 7f58537fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:47.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.626+0000 7f58537fe640 10 monclient(hunting): my global_id is 4562 2026-02-12T03:58:47.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.626+0000 7f58537fe640 1 -- 10.20.193.91:0/2261743271 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5840003610 con 0x7f58740560d0 2026-02-12T03:58:47.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.631+0000 7f3c867fc640 1 -- 10.20.193.91:0/3002491663 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1640332189 0 0) 0x7f3c68003610 con 0x7f3c980560d0 2026-02-12T03:58:47.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.631+0000 7f3c867fc640 1 -- 10.20.193.91:0/3002491663 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3c980adba0 con 0x7f3c980560d0 2026-02-12T03:58:47.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.631+0000 7f3c867fc640 1 -- 10.20.193.91:0/3002491663 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f3c88002fd0 con 0x7f3c980560d0 2026-02-12T03:58:47.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.631+0000 7f3c867fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:47.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.631+0000 7f3c867fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:47.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.631+0000 7f3c867fc640 10 monclient(hunting): dump: 2026-02-12T03:58:47.636 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.636 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.637 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.637 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.637 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.637 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.637 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.637 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.637 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.637 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.637 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.631+0000 7f3c867fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:47.637 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.631+0000 7f58537fe640 1 -- 10.20.193.91:0/2261743271 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3628199423 0 0) 0x7f5840003610 con 0x7f58740560d0 2026-02-12T03:58:47.637 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.631+0000 7f58537fe640 1 -- 10.20.193.91:0/2261743271 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5874057c30 con 0x7f58740560d0 2026-02-12T03:58:47.637 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.631+0000 7f58537fe640 1 -- 10.20.193.91:0/2261743271 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f5868003350 con 0x7f58740560d0 2026-02-12T03:58:47.637 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.631+0000 7f58537fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:47.637 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.631+0000 7f58537fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:47.637 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.631+0000 7f58537fe640 10 monclient(hunting): dump: 2026-02-12T03:58:47.637 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.638 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.638 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.638 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.638 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.638 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.638 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.638 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.638 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.638 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.638 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.631+0000 7f58537fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:47.638 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.634+0000 7f3c867fc640 1 -- 10.20.193.91:0/3002491663 <== mon.2 v1:10.20.193.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3068290790 0 0) 0x7f3c980adba0 con 0x7f3c980560d0 2026-02-12T03:58:47.638 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.634+0000 7f3c867fc640 1 -- 10.20.193.91:0/3002491663 >> v1:10.20.193.98:6789/0 conn(0x7f3c98163310 legacy=0x7f3c98137310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.638 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.634+0000 7f3c867fc640 1 -- 10.20.193.91:0/3002491663 >> v1:10.20.193.91:6789/0 conn(0x7f3c981575d0 legacy=0x7f3c980afe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.638 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f3c867fc640 10 monclient: _finish_hunting 0 2026-02-12T03:58:47.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f3c867fc640 1 monclient: found mon.c 2026-02-12T03:58:47.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f3c867fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:47.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f3c867fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:47.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f3c867fc640 1 -- 10.20.193.91:0/3002491663 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c980ade80 con 0x7f3c980560d0 2026-02-12T03:58:47.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f3c867fc640 10 monclient: _finish_auth 0 2026-02-12T03:58:47.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f3c867fc640 10 monclient: _check_auth_tickets 2026-02-12T03:58:47.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f3c867fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:47.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f3ca00e5640 5 monclient: authenticate success, global_id 4559 2026-02-12T03:58:47.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f3ca00e5640 10 monclient: _renew_subs 2026-02-12T03:58:47.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f3ca00e5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:47.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f3ca00e5640 1 -- 10.20.193.91:0/3002491663 --> v1:10.20.193.111:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3c980ae160 con 0x7f3c980560d0 2026-02-12T03:58:47.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f58537fe640 1 -- 10.20.193.91:0/2261743271 <== mon.2 v1:10.20.193.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3418351721 0 0) 0x7f5874057c30 con 0x7f58740560d0 2026-02-12T03:58:47.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f58537fe640 1 -- 10.20.193.91:0/2261743271 >> v1:10.20.193.98:6789/0 conn(0x7f58741575d0 legacy=0x7f5874058710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f58537fe640 1 -- 10.20.193.91:0/2261743271 >> v1:10.20.193.91:6789/0 conn(0x7f5874163310 legacy=0x7f58741fbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f58537fe640 10 monclient: _finish_hunting 0 2026-02-12T03:58:47.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f58537fe640 1 monclient: found mon.c 2026-02-12T03:58:47.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f58537fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:47.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f58537fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:47.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f3ca00e5640 10 client.4559.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:47.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f3ca00e5640 10 monclient: _renew_subs 2026-02-12T03:58:47.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f3ca00e5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:47.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f3ca00e5640 1 -- 10.20.193.91:0/3002491663 --> v1:10.20.193.111:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3c980ae720 con 0x7f3c980560d0 2026-02-12T03:58:47.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f3ca00e5640 1 librados: init done 2026-02-12T03:58:47.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f58537fe640 1 -- 10.20.193.91:0/2261743271 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5874057f10 con 0x7f58740560d0 2026-02-12T03:58:47.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f58537fe640 10 monclient: _finish_auth 0 2026-02-12T03:58:47.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f58537fe640 10 monclient: _check_auth_tickets 2026-02-12T03:58:47.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f58537fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:47.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f5879763640 5 monclient: authenticate success, global_id 4562 2026-02-12T03:58:47.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f5879763640 10 monclient: _renew_subs 2026-02-12T03:58:47.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f5879763640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:47.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f5879763640 1 -- 10.20.193.91:0/2261743271 --> v1:10.20.193.111:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f58741fcce0 con 0x7f58740560d0 2026-02-12T03:58:47.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f5879763640 10 client.4562.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:47.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f5879763640 10 monclient: _renew_subs 2026-02-12T03:58:47.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f5879763640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:47.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f5879763640 1 -- 10.20.193.91:0/2261743271 --> v1:10.20.193.111:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5874058e20 con 0x7f58740560d0 2026-02-12T03:58:47.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f5879763640 1 librados: init done 2026-02-12T03:58:47.641 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-12T03:58:47.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f3ca00e5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:47.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f3ca00e5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:47.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f3ca00e5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:47.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f3ca00e5640 1 -- 10.20.193.91:0/3002491663 --> v1:10.20.193.111:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c980b7290 con 0x7f3c980560d0 2026-02-12T03:58:47.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f5879763640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:47.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f5879763640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:47.642 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f5879763640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:47.642 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.635+0000 7f5879763640 1 -- 10.20.193.91:0/2261743271 --> v1:10.20.193.111:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58740b7290 con 0x7f58740560d0 2026-02-12T03:58:47.645 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.644+0000 7fbef2f41640 10 monclient: get_monmap_and_config 2026-02-12T03:58:47.645 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.644+0000 7fbef2f41640 10 monclient: build_initial_monmap 2026-02-12T03:58:47.645 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.644+0000 7fbef2f41640 10 monclient: monmap: 2026-02-12T03:58:47.645 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:47.646 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.646 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:47.644750+0000 2026-02-12T03:58:47.646 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:47.644750+0000 2026-02-12T03:58:47.646 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:47.646 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.646 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:47.646 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:47.646 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:47.646 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.646 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.644+0000 7fbef2f41640 1 Processor -- start 2026-02-12T03:58:47.647 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.644+0000 7fbef2f41640 1 -- start start 2026-02-12T03:58:47.647 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.644+0000 7fbef2f41640 10 monclient: init 2026-02-12T03:58:47.647 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.645+0000 7fbef2f41640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:47.647 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.645+0000 7fbef2f41640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T03:58:47.647 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.645+0000 7fbef2f41640 10 monclient(hunting): picked mon.noname-c con 0x7fbeec1575d0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:47.647 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.645+0000 7fbef2f41640 10 monclient(hunting): picked mon.noname-b con 0x7fbeec163310 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:47.647 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.645+0000 7fbef2f41640 10 monclient(hunting): picked mon.noname-a con 0x7fbeec0560d0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:47.647 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.645+0000 7fbef2f41640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbeec0b20b0 con 0x7fbeec0560d0 2026-02-12T03:58:47.647 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.645+0000 7fbef2f41640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbeec0b2390 con 0x7fbeec163310 2026-02-12T03:58:47.647 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.645+0000 7fbef2f41640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbeec0b2670 con 0x7fbeec1575d0 2026-02-12T03:58:47.647 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.645+0000 7fbef2f41640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:47.647 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.645+0000 7fbef2f41640 10 monclient(hunting): authenticate will time out at 1130.388185s 2026-02-12T03:58:47.649 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.648+0000 7feea6ffd640 1 -- 10.20.193.91:0/2726811216 <== mon.1 v1:10.20.193.98:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7feebc05f730 con 0x7feec0166580 2026-02-12T03:58:47.649 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.648+0000 7feea6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:47.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.648+0000 7feea6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:47.652 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.651+0000 7fbee3fff640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7fbeec163310 0x7fbeec0559c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:48952/0 (socket says 10.20.193.91:48952) 2026-02-12T03:58:47.652 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.651+0000 7fbee3fff640 1 -- 10.20.193.91:0/3768987229 learned_addr learned my addr 10.20.193.91:0/3768987229 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:47.656 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.655+0000 7fbee37fe640 1 -- 10.20.193.91:0/3768987229 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 255409093 0 0) 0x7fbeec0b2390 con 0x7fbeec163310 2026-02-12T03:58:47.657 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.655+0000 7fbee37fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:47.657 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.655+0000 7fbee37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:47.657 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.655+0000 7fbee37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:47.657 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.655+0000 7fbee37fe640 10 monclient(hunting): my global_id is 4597 2026-02-12T03:58:47.657 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.655+0000 7fbee37fe640 1 -- 10.20.193.91:0/3768987229 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbed8003610 con 0x7fbeec163310 2026-02-12T03:58:47.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.657+0000 7fbee37fe640 1 -- 10.20.193.91:0/3768987229 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1862585076 0 0) 0x7fbed8003610 con 0x7fbeec163310 2026-02-12T03:58:47.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.657+0000 7fbee37fe640 1 -- 10.20.193.91:0/3768987229 >> v1:10.20.193.111:6789/0 conn(0x7fbeec1575d0 legacy=0x7fbeec162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T03:58:47.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.657+0000 7fbee37fe640 1 -- 10.20.193.91:0/3768987229 >> v1:10.20.193.91:6789/0 conn(0x7fbeec0560d0 legacy=0x7fbeec1c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T03:58:47.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.657+0000 7fbee37fe640 10 monclient: _finish_hunting 0 2026-02-12T03:58:47.659 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.657+0000 7fbee37fe640 1 monclient: found mon.noname-b 2026-02-12T03:58:47.659 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.657+0000 7fbee37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:47.659 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.657+0000 7fbee37fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T03:58:47.659 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.657+0000 7fbee37fe640 1 -- 10.20.193.91:0/3768987229 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeec162400 con 0x7fbeec163310 2026-02-12T03:58:47.659 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.657+0000 7fbee37fe640 10 monclient: _finish_auth 0 2026-02-12T03:58:47.659 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.657+0000 7fbee37fe640 10 monclient: _check_auth_tickets 2026-02-12T03:58:47.659 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.657+0000 7fbee37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:47.659 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.657+0000 7fbee37fe640 1 -- 10.20.193.91:0/3768987229 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fbed4002df0 con 0x7fbeec163310 2026-02-12T03:58:47.659 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.657+0000 7fbee37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:47.659 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.657+0000 7fbee37fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:47.659 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.657+0000 7fbee37fe640 10 monclient: dump: 2026-02-12T03:58:47.659 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.659 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.659 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.659 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.659 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.659 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.659 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.659 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.659 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.659 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.659 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.657+0000 7fbef2f41640 5 monclient: authenticate success, global_id 4597 2026-02-12T03:58:47.659 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.657+0000 7fbef2f41640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:47.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.657+0000 7fbee37fe640 1 -- 10.20.193.91:0/3768987229 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbed4003000 con 0x7fbeec163310 2026-02-12T03:58:47.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.657+0000 7fbee37fe640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:47.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.657+0000 7fbee37fe640 1 -- 10.20.193.91:0/3768987229 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fbed4003440 con 0x7fbeec163310 2026-02-12T03:58:47.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.657+0000 7fbef2f41640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:47.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.657+0000 7fbef2f41640 4 set_mon_vals no callback set 2026-02-12T03:58:47.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.657+0000 7fbee37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:47.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.657+0000 7fbee37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:47.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.657+0000 7fbee37fe640 10 monclient: dump: 2026-02-12T03:58:47.660 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.661 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.661 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.661 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.661 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.661 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.661 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.661 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.661 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.661 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.661 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.658+0000 7fbef2f41640 10 monclient: shutdown 2026-02-12T03:58:47.661 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.658+0000 7fbef2f41640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:47.661 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.658+0000 7fbef2f41640 1 -- 10.20.193.91:0/3768987229 >> v1:10.20.193.98:6789/0 conn(0x7fbeec163310 legacy=0x7fbeec0559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.661 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.658+0000 7fbef2f41640 1 -- 10.20.193.91:0/3768987229 shutdown_connections 2026-02-12T03:58:47.661 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.658+0000 7fbef2f41640 1 -- 10.20.193.91:0/3768987229 >> 10.20.193.91:0/3768987229 conn(0x7fbeec0b6560 msgr2=0x7fbeec0b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:47.661 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.658+0000 7fbef2f41640 1 -- 10.20.193.91:0/3768987229 shutdown_connections 2026-02-12T03:58:47.661 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.658+0000 7fbef2f41640 1 -- 10.20.193.91:0/3768987229 wait complete. 2026-02-12T03:58:47.661 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.658+0000 7fbef2f41640 10 monclient: build_initial_monmap 2026-02-12T03:58:47.661 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.658+0000 7fbef2f41640 10 monclient: monmap: 2026-02-12T03:58:47.661 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:47.661 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:47.661 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:47.661 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:47.661 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:47.661 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:47.661 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:47.661 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:47.662 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:47.662 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.658+0000 7fbef2f41640 1 librados: starting msgr at 2026-02-12T03:58:47.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.658+0000 7fbef2f41640 1 librados: starting objecter 2026-02-12T03:58:47.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.658+0000 7fbef2f41640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:47.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.658+0000 7fbef2f41640 1 Processor -- start 2026-02-12T03:58:47.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.658+0000 7fbef2f41640 1 -- start start 2026-02-12T03:58:47.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.658+0000 7fbef2f41640 1 librados: setting wanted keys 2026-02-12T03:58:47.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.658+0000 7fbef2f41640 1 librados: calling monclient init 2026-02-12T03:58:47.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.658+0000 7fbef2f41640 10 monclient: init 2026-02-12T03:58:47.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.659+0000 7fbef2f41640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:47.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.659+0000 7fbef2f41640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T03:58:47.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.659+0000 7fbef2f41640 10 monclient(hunting): picked mon.noname-b con 0x7fbeec0560d0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:47.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.659+0000 7fbef2f41640 10 monclient(hunting): picked mon.noname-a con 0x7fbeec1575d0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:47.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.659+0000 7fbef2f41640 10 monclient(hunting): picked mon.noname-c con 0x7fbeec163310 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:47.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.659+0000 7fbef2f41640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbeec1427e0 con 0x7fbeec1575d0 2026-02-12T03:58:47.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.659+0000 7fbef2f41640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbeec1604f0 con 0x7fbeec0560d0 2026-02-12T03:58:47.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.659+0000 7fbef2f41640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbeec141f40 con 0x7fbeec163310 2026-02-12T03:58:47.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.659+0000 7fbef2f41640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:47.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.659+0000 7fbef2f41640 10 monclient(hunting): authenticate will time out at 1130.402349s 2026-02-12T03:58:47.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.659+0000 7fbef0cb6640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7fbeec0560d0 0x7fbeec15fde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:48956/0 (socket says 10.20.193.91:48956) 2026-02-12T03:58:47.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.659+0000 7fbef0cb6640 1 -- 10.20.193.91:0/2112863097 learned_addr learned my addr 10.20.193.91:0/2112863097 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:47.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.659+0000 7fbee17fa640 10 client.?.objecter ms_handle_connect 0x7fbeec0560d0 2026-02-12T03:58:47.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.659+0000 7fbee17fa640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:47.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.660+0000 7fbee17fa640 1 -- 10.20.193.91:0/2112863097 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 187220066 0 0) 0x7fbeec1604f0 con 0x7fbeec0560d0 2026-02-12T03:58:47.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.660+0000 7fbee17fa640 10 monclient(hunting): _negotiate 2026-02-12T03:58:47.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.660+0000 7fbee17fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:47.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.660+0000 7fbee17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:47.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.660+0000 7fbee17fa640 10 monclient(hunting): my global_id is 4600 2026-02-12T03:58:47.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.660+0000 7fbee17fa640 1 -- 10.20.193.91:0/2112863097 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbebc003610 con 0x7fbeec0560d0 2026-02-12T03:58:47.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.663+0000 7fbee17fa640 1 -- 10.20.193.91:0/2112863097 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3725017915 0 0) 0x7fbebc003610 con 0x7fbeec0560d0 2026-02-12T03:58:47.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.663+0000 7fbee17fa640 1 -- 10.20.193.91:0/2112863097 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbeec1604f0 con 0x7fbeec0560d0 2026-02-12T03:58:47.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.663+0000 7fbee17fa640 1 -- 10.20.193.91:0/2112863097 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fbedc002fd0 con 0x7fbeec0560d0 2026-02-12T03:58:47.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.663+0000 7fbee17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:47.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.663+0000 7fbee17fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:47.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.663+0000 7fbee17fa640 10 monclient(hunting): dump: 2026-02-12T03:58:47.665 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.665 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.665 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.665 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.665 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.665 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.665 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.665 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.665 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.665 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.663+0000 7fbee17fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:47.666 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.664+0000 7fbee17fa640 1 -- 10.20.193.91:0/2112863097 <== mon.1 v1:10.20.193.98:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1150475569 0 0) 0x7fbeec1604f0 con 0x7fbeec0560d0 2026-02-12T03:58:47.666 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.664+0000 7fbee17fa640 1 -- 10.20.193.91:0/2112863097 >> v1:10.20.193.111:6789/0 conn(0x7fbeec163310 legacy=0x7fbeec145080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.666 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.664+0000 7fbee17fa640 1 -- 10.20.193.91:0/2112863097 >> v1:10.20.193.91:6789/0 conn(0x7fbeec1575d0 legacy=0x7fbeec15a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.666 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.664+0000 7fbee17fa640 10 monclient: _finish_hunting 0 2026-02-12T03:58:47.666 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.664+0000 7fbee17fa640 1 monclient: found mon.b 2026-02-12T03:58:47.666 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.664+0000 7fbee17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:47.666 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.664+0000 7fbee17fa640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:47.667 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.664+0000 7fbee17fa640 1 -- 10.20.193.91:0/2112863097 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeec142220 con 0x7fbeec0560d0 2026-02-12T03:58:47.667 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.664+0000 7fbee17fa640 10 monclient: _finish_auth 0 2026-02-12T03:58:47.667 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.664+0000 7fbee17fa640 10 monclient: _check_auth_tickets 2026-02-12T03:58:47.667 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.664+0000 7fbee17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:47.667 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.664+0000 7fbef2f41640 5 monclient: authenticate success, global_id 4600 2026-02-12T03:58:47.667 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.664+0000 7fbef2f41640 10 monclient: _renew_subs 2026-02-12T03:58:47.667 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.664+0000 7fbef2f41640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:47.667 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.664+0000 7fbef2f41640 1 -- 10.20.193.91:0/2112863097 --> v1:10.20.193.98:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbeec142500 con 0x7fbeec0560d0 2026-02-12T03:58:47.667 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.664+0000 7fbef2f41640 10 client.4600.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:47.667 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.664+0000 7fbef2f41640 10 monclient: _renew_subs 2026-02-12T03:58:47.667 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.664+0000 7fbef2f41640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:47.667 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.664+0000 7fbef2f41640 1 -- 10.20.193.91:0/2112863097 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fbeec159b60 con 0x7fbeec0560d0 2026-02-12T03:58:47.667 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.665+0000 7fbef2f41640 1 librados: init done 2026-02-12T03:58:47.667 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.665+0000 7fbef2f41640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:47.667 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.665+0000 7fbef2f41640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:47.667 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.665+0000 7fbef2f41640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:47.667 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.665+0000 7fbef2f41640 1 -- 10.20.193.91:0/2112863097 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbeec0b7290 con 0x7fbeec0560d0 2026-02-12T03:58:47.694 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.15 2026-02-12T03:58:47.708 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.706+0000 7f8c0f670640 10 monclient: get_monmap_and_config 2026-02-12T03:58:47.708 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.706+0000 7f8c0f670640 10 monclient: build_initial_monmap 2026-02-12T03:58:47.708 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.706+0000 7f8c0f670640 10 monclient: monmap: 2026-02-12T03:58:47.708 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:47.708 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.708 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:47.706959+0000 2026-02-12T03:58:47.708 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:47.706959+0000 2026-02-12T03:58:47.708 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:47.708 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.708 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:47.708 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:47.708 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:47.709 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.709 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.706+0000 7f8c0f670640 1 Processor -- start 2026-02-12T03:58:47.710 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.706+0000 7f8c0f670640 1 -- start start 2026-02-12T03:58:47.710 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.706+0000 7f8c0f670640 10 monclient: init 2026-02-12T03:58:47.710 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.707+0000 7f8c0f670640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:47.710 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.707+0000 7f8c0f670640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T03:58:47.710 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.707+0000 7f8c0f670640 10 monclient(hunting): picked mon.noname-a con 0x7f8c081575d0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:47.710 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.707+0000 7f8c0f670640 10 monclient(hunting): picked mon.noname-b con 0x7f8c08163310 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:47.710 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.707+0000 7f8c0f670640 10 monclient(hunting): picked mon.noname-c con 0x7f8c080560d0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:47.710 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.707+0000 7f8c0f670640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c080b20b0 con 0x7f8c081575d0 2026-02-12T03:58:47.710 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.707+0000 7f8c0f670640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c080b2390 con 0x7f8c08163310 2026-02-12T03:58:47.710 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.707+0000 7f8c0f670640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c080b2670 con 0x7f8c080560d0 2026-02-12T03:58:47.710 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.707+0000 7f8c0f670640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:47.710 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.707+0000 7f8c0f670640 10 monclient(hunting): authenticate will time out at 1130.450473s 2026-02-12T03:58:47.720 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.718+0000 7f6a17fff640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-12T03:58:47.720 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.718+0000 7f6a17fff640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-12T03:58:47.720 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.718+0000 7f6a17fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:47.720 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.718+0000 7f6a17fff640 1 -- 10.20.193.91:0/2628226605 --> v1:10.20.193.111:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f6a1805d710 con 0x7f6a18164c50 2026-02-12T03:58:47.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.756+0000 7feec8651640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-12T03:58:47.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.756+0000 7feec8651640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-12T03:58:47.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.756+0000 7feec8651640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:47.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.756+0000 7feec8651640 1 -- 10.20.193.91:0/2726811216 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7feec00af640 con 0x7feec0166580 2026-02-12T03:58:47.760 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.757+0000 7f14550ed640 10 monclient: get_monmap_and_config 2026-02-12T03:58:47.760 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.757+0000 7f14550ed640 10 monclient: build_initial_monmap 2026-02-12T03:58:47.760 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.757+0000 7f14550ed640 10 monclient: monmap: 2026-02-12T03:58:47.760 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:47.760 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.760 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:47.757770+0000 2026-02-12T03:58:47.760 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:47.757770+0000 2026-02-12T03:58:47.760 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:47.761 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.761 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:47.761 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:47.761 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:47.761 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.761 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.757+0000 7f14550ed640 1 Processor -- start 2026-02-12T03:58:47.761 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.757+0000 7f14550ed640 1 -- start start 2026-02-12T03:58:47.761 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.757+0000 7f14550ed640 10 monclient: init 2026-02-12T03:58:47.761 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.758+0000 7f14550ed640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:47.761 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.758+0000 7f14550ed640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T03:58:47.761 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.758+0000 7f14550ed640 10 monclient(hunting): picked mon.noname-c con 0x7f14500afe70 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:47.761 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.758+0000 7f14550ed640 10 monclient(hunting): picked mon.noname-a con 0x7f145015f310 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:47.761 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.758+0000 7f14550ed640 10 monclient(hunting): picked mon.noname-b con 0x7f14501639c0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:47.761 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.758+0000 7f14550ed640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1450162bb0 con 0x7f145015f310 2026-02-12T03:58:47.762 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.758+0000 7f14550ed640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1450162e90 con 0x7f14501639c0 2026-02-12T03:58:47.762 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.758+0000 7f14550ed640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f145015de40 con 0x7f14500afe70 2026-02-12T03:58:47.762 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.758+0000 7f14550ed640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:47.762 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.758+0000 7f14550ed640 10 monclient(hunting): authenticate will time out at 1130.501187s 2026-02-12T03:58:47.762 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.760+0000 7fbee17fa640 1 -- 10.20.193.91:0/2112863097 <== mon.1 v1:10.20.193.98:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbedc0049f0 con 0x7fbeec0560d0 2026-02-12T03:58:47.763 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.760+0000 7fbee17fa640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:47.763 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.760+0000 7fbee17fa640 1 -- 10.20.193.91:0/2112863097 <== mon.1 v1:10.20.193.98:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fbedc004ba0 con 0x7fbeec0560d0 2026-02-12T03:58:47.763 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.760+0000 7fbee17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:47.763 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.760+0000 7fbee17fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:47.763 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.760+0000 7fbee2ffd640 4 set_mon_vals no callback set 2026-02-12T03:58:47.763 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.760+0000 7fbee17fa640 10 monclient: dump: 2026-02-12T03:58:47.763 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.763 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.763 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.763 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.763 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.763 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.764 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.764 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.764 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.764 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.764 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.761+0000 7fbee17fa640 1 -- 10.20.193.91:0/2112863097 <== mon.1 v1:10.20.193.98:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7fbedc01e080 con 0x7fbeec0560d0 2026-02-12T03:58:47.764 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.761+0000 7fbee3fff640 10 monclient: get_auth_request con 0x7fbebc079f30 auth_method 0 2026-02-12T03:58:47.764 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.762+0000 7fbee17fa640 10 client.4600.objecter ms_handle_connect 0x7fbebc079f30 2026-02-12T03:58:47.765 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.763+0000 7fbee17fa640 1 -- 10.20.193.91:0/2112863097 <== mon.1 v1:10.20.193.98:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7fbedc095ce0 con 0x7fbeec0560d0 2026-02-12T03:58:47.765 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.763+0000 7fbee17fa640 10 client.4600.objecter ms_dispatch2 0x7fbeec000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:47.765 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.763+0000 7fbee17fa640 3 client.4600.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:47.765 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.763+0000 7fbee17fa640 3 client.4600.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:47.765 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.763+0000 7fbee17fa640 20 client.4600.objecter dump_active .. 0 homeless 2026-02-12T03:58:47.767 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.765+0000 7fbee17fa640 1 -- 10.20.193.91:0/2112863097 <== mon.1 v1:10.20.193.98:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7fbedc05f640 con 0x7fbeec0560d0 2026-02-12T03:58:47.767 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.765+0000 7fbee17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:47.767 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.765+0000 7fbee17fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:47.767 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.765+0000 7f8c0cbe4640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f8c08163310 0x7f8c080559c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:48962/0 (socket says 10.20.193.91:48962) 2026-02-12T03:58:47.767 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.765+0000 7f8c0cbe4640 1 -- 10.20.193.91:0/589050308 learned_addr learned my addr 10.20.193.91:0/589050308 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:47.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.767+0000 7f144f577640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f14501639c0 0x7f1450161b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:48976/0 (socket says 10.20.193.91:48976) 2026-02-12T03:58:47.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.767+0000 7f144f577640 1 -- 10.20.193.91:0/640003439 learned_addr learned my addr 10.20.193.91:0/640003439 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:47.771 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.769+0000 7f8bf7fff640 1 -- 10.20.193.91:0/589050308 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1038529520 0 0) 0x7f8c080b2390 con 0x7f8c08163310 2026-02-12T03:58:47.771 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.769+0000 7f8bf7fff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:47.771 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.769+0000 7f8bf7fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:47.771 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.769+0000 7f8bf7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:47.772 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.769+0000 7f8bf7fff640 10 monclient(hunting): my global_id is 4603 2026-02-12T03:58:47.772 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.769+0000 7f8bf7fff640 1 -- 10.20.193.91:0/589050308 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bf0003610 con 0x7f8c08163310 2026-02-12T03:58:47.772 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.770+0000 7feea6ffd640 1 -- 10.20.193.91:0/2726811216 <== mon.1 v1:10.20.193.98:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 1257367751) 0x7feebc05f030 con 0x7feec0166580 2026-02-12T03:58:47.772 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.770+0000 7feea6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-12T03:58:47.772 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.770+0000 7feea6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:47.772 INFO:teuthology.orchestra.run.trial091.stdout:90194313220 2026-02-12T03:58:47.773 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.771+0000 7f144dd74640 1 -- 10.20.193.91:0/640003439 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3657876414 0 0) 0x7f1450162e90 con 0x7f14501639c0 2026-02-12T03:58:47.773 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.771+0000 7f144dd74640 10 monclient(hunting): _negotiate 2026-02-12T03:58:47.773 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.771+0000 7f144dd74640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:47.773 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.771+0000 7f144dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:47.773 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.771+0000 7f144dd74640 10 monclient(hunting): my global_id is 4606 2026-02-12T03:58:47.773 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.771+0000 7f144dd74640 1 -- 10.20.193.91:0/640003439 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f143c003610 con 0x7f14501639c0 2026-02-12T03:58:47.774 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.772+0000 7feec8651640 10 librados: watch_flush enter 2026-02-12T03:58:47.774 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.772+0000 7feec8651640 10 librados: watch_flush exit 2026-02-12T03:58:47.774 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.772+0000 7feec8651640 20 client.4594.objecter shutdown clearing up homeless session... 2026-02-12T03:58:47.774 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.772+0000 7feec8651640 10 client.4594.objecter successfully canceled tick 2026-02-12T03:58:47.775 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.772+0000 7f8bf7fff640 1 -- 10.20.193.91:0/589050308 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1289305588 0 0) 0x7f8bf0003610 con 0x7f8c08163310 2026-02-12T03:58:47.775 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.772+0000 7f8bf7fff640 1 -- 10.20.193.91:0/589050308 >> v1:10.20.193.111:6789/0 conn(0x7f8c080560d0 legacy=0x7f8c081c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T03:58:47.775 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.772+0000 7f8bf7fff640 1 -- 10.20.193.91:0/589050308 >> v1:10.20.193.91:6789/0 conn(0x7f8c081575d0 legacy=0x7f8c08162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T03:58:47.775 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.772+0000 7f8bf7fff640 10 monclient: _finish_hunting 0 2026-02-12T03:58:47.775 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.772+0000 7f8bf7fff640 1 monclient: found mon.noname-b 2026-02-12T03:58:47.775 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.772+0000 7f8bf7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:47.776 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.772+0000 7f8bf7fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T03:58:47.776 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.772+0000 7f8bf7fff640 1 -- 10.20.193.91:0/589050308 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c08162400 con 0x7f8c08163310 2026-02-12T03:58:47.776 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.772+0000 7f8bf7fff640 10 monclient: _finish_auth 0 2026-02-12T03:58:47.776 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.772+0000 7f8bf7fff640 10 monclient: _check_auth_tickets 2026-02-12T03:58:47.776 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.772+0000 7f8bf7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:47.776 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.772+0000 7feec8651640 1 -- 10.20.193.91:0/2726811216 >> v1:10.20.193.91:6800/2929217192 conn(0x7fee90079ea0 legacy=0x7fee9009a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.776 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.772+0000 7feec8651640 10 monclient: shutdown 2026-02-12T03:58:47.776 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.772+0000 7feec8651640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:47.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.772+0000 7f8bf7fff640 1 -- 10.20.193.91:0/589050308 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8bfc002df0 con 0x7f8c08163310 2026-02-12T03:58:47.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.772+0000 7f8bf7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:47.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.772+0000 7f8bf7fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:47.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.772+0000 7f8bf7fff640 10 monclient: dump: 2026-02-12T03:58:47.777 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.777 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.777 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.777 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.778 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.778 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.778 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.778 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.778 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.778 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.772+0000 7f8c0f670640 5 monclient: authenticate success, global_id 4603 2026-02-12T03:58:47.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.772+0000 7f8c0f670640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:47.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.772+0000 7feec8651640 1 -- 10.20.193.91:0/2726811216 >> v1:10.20.193.98:6789/0 conn(0x7feec0166580 legacy=0x7feec0137c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.772+0000 7feec8651640 1 -- 10.20.193.91:0/2726811216 shutdown_connections 2026-02-12T03:58:47.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.772+0000 7feec8651640 1 -- 10.20.193.91:0/2726811216 >> 10.20.193.91:0/2726811216 conn(0x7feec00b6560 msgr2=0x7feec0134ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:47.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.772+0000 7feec8651640 1 -- 10.20.193.91:0/2726811216 shutdown_connections 2026-02-12T03:58:47.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.772+0000 7feec8651640 1 -- 10.20.193.91:0/2726811216 wait complete. 2026-02-12T03:58:47.780 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.772+0000 7feec8651640 1 librados: shutdown 2026-02-12T03:58:47.780 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.775+0000 7f144dd74640 1 -- 10.20.193.91:0/640003439 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4141715435 0 0) 0x7f143c003610 con 0x7f14501639c0 2026-02-12T03:58:47.780 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.775+0000 7f144dd74640 1 -- 10.20.193.91:0/640003439 >> v1:10.20.193.111:6789/0 conn(0x7f14500afe70 legacy=0x7f145015ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T03:58:47.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.775+0000 7f144dd74640 1 -- 10.20.193.91:0/640003439 >> v1:10.20.193.91:6789/0 conn(0x7f145015f310 legacy=0x7f14501632b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T03:58:47.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.775+0000 7f144dd74640 10 monclient: _finish_hunting 0 2026-02-12T03:58:47.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.775+0000 7f144dd74640 1 monclient: found mon.noname-b 2026-02-12T03:58:47.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.775+0000 7f144dd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:47.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.775+0000 7f144dd74640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T03:58:47.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.775+0000 7f144dd74640 1 -- 10.20.193.91:0/640003439 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f145015e120 con 0x7f14501639c0 2026-02-12T03:58:47.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.775+0000 7f144dd74640 10 monclient: _finish_auth 0 2026-02-12T03:58:47.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.775+0000 7f144dd74640 10 monclient: _check_auth_tickets 2026-02-12T03:58:47.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.775+0000 7f144dd74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:47.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.775+0000 7f144dd74640 1 -- 10.20.193.91:0/640003439 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f1440003170 con 0x7f14501639c0 2026-02-12T03:58:47.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.775+0000 7f144dd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:47.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.775+0000 7f144dd74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:47.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.775+0000 7f144dd74640 10 monclient: dump: 2026-02-12T03:58:47.782 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.782 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.782 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.782 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.782 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.782 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.782 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.782 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.782 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.782 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.775+0000 7f14550ed640 5 monclient: authenticate success, global_id 4606 2026-02-12T03:58:47.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.775+0000 7f14550ed640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:47.784 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.775+0000 7f8bf7fff640 1 -- 10.20.193.91:0/589050308 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8bfc003000 con 0x7f8c08163310 2026-02-12T03:58:47.784 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.775+0000 7f8bf7fff640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:47.784 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.775+0000 7f8bf7fff640 1 -- 10.20.193.91:0/589050308 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8bfc003440 con 0x7f8c08163310 2026-02-12T03:58:47.784 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.775+0000 7f8c0f670640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:47.784 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.775+0000 7f8c0f670640 4 set_mon_vals no callback set 2026-02-12T03:58:47.784 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.775+0000 7f8bf7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:47.784 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.775+0000 7f8bf7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:47.784 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.775+0000 7f8bf7fff640 10 monclient: dump: 2026-02-12T03:58:47.784 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.784 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.785 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.785 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.785 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.785 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.785 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.785 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.785 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.785 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.785 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.775+0000 7f8c0f670640 10 monclient: shutdown 2026-02-12T03:58:47.785 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.775+0000 7f8c0f670640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:47.785 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.775+0000 7f8c0f670640 1 -- 10.20.193.91:0/589050308 >> v1:10.20.193.98:6789/0 conn(0x7f8c08163310 legacy=0x7f8c080559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.785 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.775+0000 7f8c0f670640 1 -- 10.20.193.91:0/589050308 shutdown_connections 2026-02-12T03:58:47.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.775+0000 7f8c0f670640 1 -- 10.20.193.91:0/589050308 >> 10.20.193.91:0/589050308 conn(0x7f8c080b6560 msgr2=0x7f8c080b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:47.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.775+0000 7f8c0f670640 1 -- 10.20.193.91:0/589050308 shutdown_connections 2026-02-12T03:58:47.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.775+0000 7f8c0f670640 1 -- 10.20.193.91:0/589050308 wait complete. 2026-02-12T03:58:47.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.776+0000 7f8c0f670640 10 monclient: build_initial_monmap 2026-02-12T03:58:47.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.776+0000 7f8c0f670640 10 monclient: monmap: 2026-02-12T03:58:47.786 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:47.786 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:47.786 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:47.786 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:47.786 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:47.786 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:47.786 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:47.786 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:47.787 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:47.787 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.787 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.776+0000 7f144dd74640 1 -- 10.20.193.91:0/640003439 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1440003380 con 0x7f14501639c0 2026-02-12T03:58:47.787 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.776+0000 7f144dd74640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:47.787 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.776+0000 7f144dd74640 1 -- 10.20.193.91:0/640003439 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f14400037c0 con 0x7f14501639c0 2026-02-12T03:58:47.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.776+0000 7f144dd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:47.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.776+0000 7f144dd74640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:47.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.776+0000 7f144dd74640 10 monclient: dump: 2026-02-12T03:58:47.788 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.788 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.788 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.788 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.788 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.788 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.788 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.788 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.788 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.789 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.776+0000 7f14550ed640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:47.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.776+0000 7f14550ed640 4 set_mon_vals no callback set 2026-02-12T03:58:47.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.776+0000 7f8c0f670640 1 librados: starting msgr at 2026-02-12T03:58:47.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.776+0000 7f8c0f670640 1 librados: starting objecter 2026-02-12T03:58:47.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.776+0000 7f8c0f670640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:47.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.776+0000 7f8c0f670640 1 Processor -- start 2026-02-12T03:58:47.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.776+0000 7f8c0f670640 1 -- start start 2026-02-12T03:58:47.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.776+0000 7f8c0f670640 1 librados: setting wanted keys 2026-02-12T03:58:47.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.776+0000 7f8c0f670640 1 librados: calling monclient init 2026-02-12T03:58:47.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.776+0000 7f8c0f670640 10 monclient: init 2026-02-12T03:58:47.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.776+0000 7f14550ed640 10 monclient: shutdown 2026-02-12T03:58:47.791 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.776+0000 7f14550ed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:47.791 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.776+0000 7f14550ed640 1 -- 10.20.193.91:0/640003439 >> v1:10.20.193.98:6789/0 conn(0x7f14501639c0 legacy=0x7f1450161b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.791 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.776+0000 7f14550ed640 1 -- 10.20.193.91:0/640003439 shutdown_connections 2026-02-12T03:58:47.791 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.776+0000 7f14550ed640 1 -- 10.20.193.91:0/640003439 >> 10.20.193.91:0/640003439 conn(0x7f14500b6560 msgr2=0x7f14500b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:47.791 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.776+0000 7f14550ed640 1 -- 10.20.193.91:0/640003439 shutdown_connections 2026-02-12T03:58:47.791 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.776+0000 7f14550ed640 1 -- 10.20.193.91:0/640003439 wait complete. 2026-02-12T03:58:47.792 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.777+0000 7f8c0f670640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:47.792 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.777+0000 7f8c0f670640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T03:58:47.792 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.777+0000 7f8c0f670640 10 monclient(hunting): picked mon.noname-a con 0x7f8c080560d0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:47.792 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.777+0000 7f8c0f670640 10 monclient(hunting): picked mon.noname-c con 0x7f8c081575d0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:47.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.777+0000 7f8c0f670640 10 monclient(hunting): picked mon.noname-b con 0x7f8c08163310 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:47.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.777+0000 7f8c0f670640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c080ae9f0 con 0x7f8c080560d0 2026-02-12T03:58:47.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.777+0000 7f8c0f670640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c080aecd0 con 0x7f8c08163310 2026-02-12T03:58:47.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.777+0000 7f8c0f670640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c080aefb0 con 0x7f8c081575d0 2026-02-12T03:58:47.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.777+0000 7f8c0f670640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:47.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.777+0000 7f8c0f670640 10 monclient(hunting): authenticate will time out at 1130.520161s 2026-02-12T03:58:47.793 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-12T03:58:47.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.777+0000 7f14550ed640 10 monclient: build_initial_monmap 2026-02-12T03:58:47.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.777+0000 7f14550ed640 10 monclient: monmap: 2026-02-12T03:58:47.794 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:47.795 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:47.795 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:47.795 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:47.795 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:47.795 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:47.795 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:47.795 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:47.795 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:47.795 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.777+0000 7f14550ed640 1 librados: starting msgr at 2026-02-12T03:58:47.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.777+0000 7f14550ed640 1 librados: starting objecter 2026-02-12T03:58:47.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.777+0000 7f14550ed640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:47.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.777+0000 7f14550ed640 1 Processor -- start 2026-02-12T03:58:47.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.777+0000 7f14550ed640 1 -- start start 2026-02-12T03:58:47.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.777+0000 7f14550ed640 1 librados: setting wanted keys 2026-02-12T03:58:47.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.777+0000 7f14550ed640 1 librados: calling monclient init 2026-02-12T03:58:47.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.777+0000 7f14550ed640 10 monclient: init 2026-02-12T03:58:47.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.777+0000 7f8c0dbe6640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f8c08163310 0x7f8c081fe240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:48986/0 (socket says 10.20.193.91:48986) 2026-02-12T03:58:47.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.777+0000 7f8c0dbe6640 1 -- 10.20.193.91:0/2072269458 learned_addr learned my addr 10.20.193.91:0/2072269458 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:47.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.777+0000 7f8bf5ffb640 10 client.?.objecter ms_handle_connect 0x7f8c08163310 2026-02-12T03:58:47.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.777+0000 7f8bf5ffb640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:47.797 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.777+0000 7f14550ed640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:47.797 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.777+0000 7f14550ed640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T03:58:47.797 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.777+0000 7f14550ed640 10 monclient(hunting): picked mon.noname-a con 0x7f14500afe70 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:47.797 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.777+0000 7f14550ed640 10 monclient(hunting): picked mon.noname-c con 0x7f145015f310 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:47.797 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.777+0000 7f14550ed640 10 monclient(hunting): picked mon.noname-b con 0x7f14501639c0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:47.797 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.777+0000 7f14550ed640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14500b2a20 con 0x7f14500afe70 2026-02-12T03:58:47.797 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.777+0000 7f14550ed640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14501faf00 con 0x7f14501639c0 2026-02-12T03:58:47.797 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.778+0000 7f14550ed640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14501fb1e0 con 0x7f145015f310 2026-02-12T03:58:47.798 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.778+0000 7f14550ed640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:47.798 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.778+0000 7f14550ed640 10 monclient(hunting): authenticate will time out at 1130.521010s 2026-02-12T03:58:47.798 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.779+0000 7f8bf5ffb640 1 -- 10.20.193.91:0/2072269458 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4143069188 0 0) 0x7f8c080aecd0 con 0x7f8c08163310 2026-02-12T03:58:47.798 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.779+0000 7f8bf5ffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:47.798 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.779+0000 7f8bf5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:47.798 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.779+0000 7f8bf5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:47.798 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.779+0000 7f8bf5ffb640 10 monclient(hunting): my global_id is 4609 2026-02-12T03:58:47.798 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.779+0000 7f8bf5ffb640 1 -- 10.20.193.91:0/2072269458 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bd8003610 con 0x7f8c08163310 2026-02-12T03:58:47.799 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.779+0000 7f144f577640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f14501639c0 0x7f1450155a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:48996/0 (socket says 10.20.193.91:48996) 2026-02-12T03:58:47.799 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.779+0000 7f144f577640 1 -- 10.20.193.91:0/2867776790 learned_addr learned my addr 10.20.193.91:0/2867776790 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:47.799 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.779+0000 7f142f7fe640 10 client.?.objecter ms_handle_connect 0x7f14501639c0 2026-02-12T03:58:47.799 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.779+0000 7f142f7fe640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:47.799 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.781+0000 7fdb477fe640 1 -- 10.20.193.91:0/4125666078 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdb5c004950 con 0x7fdb680b57a0 2026-02-12T03:58:47.799 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.781+0000 7fdb477fe640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:47.799 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.781+0000 7fdb657fa640 4 set_mon_vals no callback set 2026-02-12T03:58:47.800 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313220 for osd.4 2026-02-12T03:58:47.801 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.783+0000 7f142f7fe640 1 -- 10.20.193.91:0/2867776790 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2503127816 0 0) 0x7f14501faf00 con 0x7f14501639c0 2026-02-12T03:58:47.801 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.783+0000 7f142f7fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:47.801 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.783+0000 7f142f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:47.801 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.783+0000 7f142f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:47.801 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.783+0000 7f142f7fe640 10 monclient(hunting): my global_id is 4612 2026-02-12T03:58:47.801 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.783+0000 7f142f7fe640 1 -- 10.20.193.91:0/2867776790 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f141c003610 con 0x7f14501639c0 2026-02-12T03:58:47.801 DEBUG:teuthology.parallel:result is None 2026-02-12T03:58:47.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.783+0000 7f8bf5ffb640 1 -- 10.20.193.91:0/2072269458 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4058345258 0 0) 0x7f8bd8003610 con 0x7f8c08163310 2026-02-12T03:58:47.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.783+0000 7f8bf5ffb640 1 -- 10.20.193.91:0/2072269458 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8c080aecd0 con 0x7f8c08163310 2026-02-12T03:58:47.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.783+0000 7f8bf5ffb640 1 -- 10.20.193.91:0/2072269458 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8c040032d0 con 0x7f8c08163310 2026-02-12T03:58:47.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.783+0000 7f8bf5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:47.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.783+0000 7f8bf5ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:47.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.783+0000 7f8bf5ffb640 10 monclient(hunting): dump: 2026-02-12T03:58:47.802 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.802 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.802 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.802 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.802 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.802 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.802 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.803 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.803 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.803 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.803 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.783+0000 7f8bf5ffb640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:47.803 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.785+0000 7fdb477fe640 1 -- 10.20.193.91:0/4125666078 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fdb5c004b00 con 0x7fdb680b57a0 2026-02-12T03:58:47.803 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.785+0000 7fdb477fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:47.803 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.785+0000 7fdb477fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:47.803 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.785+0000 7fdb477fe640 10 monclient: dump: 2026-02-12T03:58:47.803 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.803 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.804 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.804 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.804 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.804 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.804 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.804 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.804 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.804 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.804 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.786+0000 7fdb477fe640 1 -- 10.20.193.91:0/4125666078 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7fdb5c01e020 con 0x7fdb680b57a0 2026-02-12T03:58:47.804 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.786+0000 7fdb667fc640 10 monclient: get_auth_request con 0x7fdb34079d40 auth_method 0 2026-02-12T03:58:47.804 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.786+0000 7fdb477fe640 10 client.4605.objecter ms_handle_connect 0x7fdb34079d40 2026-02-12T03:58:47.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.787+0000 7f8bf5ffb640 1 -- 10.20.193.91:0/2072269458 <== mon.1 v1:10.20.193.98:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2354794015 0 0) 0x7f8c080aecd0 con 0x7f8c08163310 2026-02-12T03:58:47.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.787+0000 7f8bf5ffb640 1 -- 10.20.193.91:0/2072269458 >> v1:10.20.193.111:6789/0 conn(0x7f8c081575d0 legacy=0x7f8c081fc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.787+0000 7f8bf5ffb640 1 -- 10.20.193.91:0/2072269458 >> v1:10.20.193.91:6789/0 conn(0x7f8c080560d0 legacy=0x7f8c08153900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.787+0000 7f8bf5ffb640 10 monclient: _finish_hunting 0 2026-02-12T03:58:47.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.787+0000 7f8bf5ffb640 1 monclient: found mon.b 2026-02-12T03:58:47.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.787+0000 7f8bf5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:47.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.787+0000 7f8bf5ffb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:47.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.787+0000 7f8bf5ffb640 1 -- 10.20.193.91:0/2072269458 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c080af290 con 0x7f8c08163310 2026-02-12T03:58:47.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.787+0000 7f8bf5ffb640 10 monclient: _finish_auth 0 2026-02-12T03:58:47.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.787+0000 7f8bf5ffb640 10 monclient: _check_auth_tickets 2026-02-12T03:58:47.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.787+0000 7f8bf5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:47.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.787+0000 7f8c0f670640 5 monclient: authenticate success, global_id 4609 2026-02-12T03:58:47.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.787+0000 7f8c0f670640 10 monclient: _renew_subs 2026-02-12T03:58:47.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.787+0000 7f8c0f670640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:47.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.787+0000 7f8c0f670640 1 -- 10.20.193.91:0/2072269458 --> v1:10.20.193.98:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8c080af570 con 0x7f8c08163310 2026-02-12T03:58:47.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.787+0000 7f8c0f670640 10 client.4609.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:47.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.787+0000 7f8c0f670640 10 monclient: _renew_subs 2026-02-12T03:58:47.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.787+0000 7f8c0f670640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:47.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.787+0000 7f8c0f670640 1 -- 10.20.193.91:0/2072269458 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8c08154480 con 0x7f8c08163310 2026-02-12T03:58:47.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.787+0000 7f8c0f670640 1 librados: init done 2026-02-12T03:58:47.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.787+0000 7f142f7fe640 1 -- 10.20.193.91:0/2867776790 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 352714300 0 0) 0x7f141c003610 con 0x7f14501639c0 2026-02-12T03:58:47.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.787+0000 7f142f7fe640 1 -- 10.20.193.91:0/2867776790 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f14501faf00 con 0x7f14501639c0 2026-02-12T03:58:47.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.787+0000 7f142f7fe640 1 -- 10.20.193.91:0/2867776790 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f14400036d0 con 0x7f14501639c0 2026-02-12T03:58:47.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.787+0000 7f142f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:47.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.787+0000 7f142f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:47.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.787+0000 7f142f7fe640 10 monclient(hunting): dump: 2026-02-12T03:58:47.807 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.807 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.807 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.807 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.807 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.807 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.807 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.807 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.807 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.807 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.787+0000 7f142f7fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:47.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.788+0000 7f8c0f670640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:47.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.788+0000 7f8c0f670640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:47.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.788+0000 7f8c0f670640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:47.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.788+0000 7f8c0f670640 1 -- 10.20.193.91:0/2072269458 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c0805a0b0 con 0x7f8c08163310 2026-02-12T03:58:47.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.789+0000 7f4a217fa640 1 -- 10.20.193.91:0/385266500 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4a28003950 con 0x7f4a2c166f70 2026-02-12T03:58:47.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.789+0000 7f4a217fa640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:47.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.789+0000 7f4a217fa640 1 -- 10.20.193.91:0/385266500 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f4a28004f10 con 0x7f4a2c166f70 2026-02-12T03:58:47.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.789+0000 7f4a217fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:47.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.789+0000 7f4a217fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:47.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.789+0000 7f4a217fa640 10 monclient: dump: 2026-02-12T03:58:47.809 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.809 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.809 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.809 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.809 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.809 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.809 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.809 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.809 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.809 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.789+0000 7f4a22ffd640 4 set_mon_vals no callback set 2026-02-12T03:58:47.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.790+0000 7f4a217fa640 1 -- 10.20.193.91:0/385266500 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f4a2801e3f0 con 0x7f4a2c166f70 2026-02-12T03:58:47.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.790+0000 7f4a30b4d640 10 monclient: get_auth_request con 0x7f49fc079f30 auth_method 0 2026-02-12T03:58:47.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.790+0000 7f4a217fa640 10 client.4608.objecter ms_handle_connect 0x7f49fc079f30 2026-02-12T03:58:47.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.795+0000 7fdb477fe640 1 -- 10.20.193.91:0/4125666078 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7fdb5c095c70 con 0x7fdb680b57a0 2026-02-12T03:58:47.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.795+0000 7fdb477fe640 10 client.4605.objecter ms_dispatch2 0x7fdb68000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:47.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.795+0000 7fdb477fe640 3 client.4605.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:47.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.795+0000 7fdb477fe640 3 client.4605.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:47.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.795+0000 7fdb477fe640 20 client.4605.objecter dump_active .. 0 homeless 2026-02-12T03:58:47.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.795+0000 7fdb477fe640 1 -- 10.20.193.91:0/4125666078 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7fdb5c05f5d0 con 0x7fdb680b57a0 2026-02-12T03:58:47.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.795+0000 7fdb477fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:47.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.795+0000 7fdb477fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:47.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.797+0000 7f4a217fa640 1 -- 10.20.193.91:0/385266500 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7f4a28095fb0 con 0x7f4a2c166f70 2026-02-12T03:58:47.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.797+0000 7f4a217fa640 10 client.4608.objecter ms_dispatch2 0x7f4a2c000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:47.811 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.797+0000 7f4a217fa640 3 client.4608.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:47.811 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.797+0000 7f4a217fa640 3 client.4608.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:47.811 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.797+0000 7f4a217fa640 20 client.4608.objecter dump_active .. 0 homeless 2026-02-12T03:58:47.811 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.797+0000 7f4a217fa640 1 -- 10.20.193.91:0/385266500 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f4a2805f910 con 0x7f4a2c166f70 2026-02-12T03:58:47.811 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.797+0000 7f4a217fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:47.811 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.797+0000 7f4a217fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:47.811 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.808+0000 7f142f7fe640 10 client.?.objecter ms_handle_connect 0x7f14500afe70 2026-02-12T03:58:47.811 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.808+0000 7f142f7fe640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:47.812 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2026-02-12T03:58:47.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.810+0000 7f142f7fe640 1 -- 10.20.193.91:0/2867776790 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2967424860 0 0) 0x7f14500b2a20 con 0x7f14500afe70 2026-02-12T03:58:47.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.810+0000 7f142f7fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:47.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.810+0000 7f142f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:47.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.810+0000 7f142f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:47.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.810+0000 7f142f7fe640 10 monclient(hunting): my global_id is 4611 2026-02-12T03:58:47.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.810+0000 7f142f7fe640 1 -- 10.20.193.91:0/2867776790 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f141c003610 con 0x7f14500afe70 2026-02-12T03:58:47.813 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.13 2026-02-12T03:58:47.814 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.813+0000 7f142f7fe640 1 -- 10.20.193.91:0/2867776790 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 176451504 0 0) 0x7f141c003610 con 0x7f14500afe70 2026-02-12T03:58:47.814 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.813+0000 7f142f7fe640 1 -- 10.20.193.91:0/2867776790 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f14500b2a20 con 0x7f14500afe70 2026-02-12T03:58:47.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.813+0000 7f142f7fe640 1 -- 10.20.193.91:0/2867776790 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f1444002ea0 con 0x7f14500afe70 2026-02-12T03:58:47.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.813+0000 7f142f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:47.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.813+0000 7f142f7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:47.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.813+0000 7f142f7fe640 10 monclient(hunting): dump: 2026-02-12T03:58:47.815 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.815 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.815 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.815 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.815 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.815 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.815 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.815 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.815 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.815 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.817 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.815+0000 7f142f7fe640 1 -- 10.20.193.91:0/2867776790 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3560814985 0 0) 0x7f14500b2a20 con 0x7f14500afe70 2026-02-12T03:58:47.817 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.815+0000 7f142f7fe640 1 -- 10.20.193.91:0/2867776790 >> v1:10.20.193.111:6789/0 conn(0x7f145015f310 legacy=0x7f145015b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.815+0000 7f142f7fe640 1 -- 10.20.193.91:0/2867776790 >> v1:10.20.193.98:6789/0 conn(0x7f14501639c0 legacy=0x7f1450155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.815+0000 7f142f7fe640 10 monclient: _finish_hunting 0 2026-02-12T03:58:47.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.815+0000 7f142f7fe640 1 monclient: found mon.a 2026-02-12T03:58:47.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.815+0000 7f142f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:47.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.815+0000 7f142f7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:47.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.815+0000 7f142f7fe640 1 -- 10.20.193.91:0/2867776790 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14501fb4c0 con 0x7f14500afe70 2026-02-12T03:58:47.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.815+0000 7f142f7fe640 10 monclient: _finish_auth 0 2026-02-12T03:58:47.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.815+0000 7f142f7fe640 10 monclient: _check_auth_tickets 2026-02-12T03:58:47.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.815+0000 7f142f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:47.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.815+0000 7f14550ed640 5 monclient: authenticate success, global_id 4611 2026-02-12T03:58:47.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.815+0000 7f14550ed640 10 monclient: _renew_subs 2026-02-12T03:58:47.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.815+0000 7f14550ed640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:47.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.815+0000 7f14550ed640 1 -- 10.20.193.91:0/2867776790 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f14501fb7a0 con 0x7f14500afe70 2026-02-12T03:58:47.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.815+0000 7f14550ed640 10 client.4611.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:47.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.815+0000 7f14550ed640 10 monclient: _renew_subs 2026-02-12T03:58:47.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.815+0000 7f14550ed640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:47.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.815+0000 7f14550ed640 1 -- 10.20.193.91:0/2867776790 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f145015c080 con 0x7f14500afe70 2026-02-12T03:58:47.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.815+0000 7f14550ed640 1 librados: init done 2026-02-12T03:58:47.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.815+0000 7f14550ed640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:47.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.815+0000 7f14550ed640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:47.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.815+0000 7f14550ed640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:47.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.815+0000 7f14550ed640 1 -- 10.20.193.91:0/2867776790 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14500b6e80 con 0x7f14500afe70 2026-02-12T03:58:47.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.823+0000 7f3c867fc640 1 -- 10.20.193.91:0/3002491663 <== mon.2 v1:10.20.193.111:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3c880049f0 con 0x7f3c980560d0 2026-02-12T03:58:47.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.823+0000 7f3c867fc640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:47.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.823+0000 7f3c867fc640 1 -- 10.20.193.91:0/3002491663 <== mon.2 v1:10.20.193.111:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f3c88004ba0 con 0x7f3c980560d0 2026-02-12T03:58:47.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.823+0000 7f3c867fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:47.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.823+0000 7f3c867fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:47.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.823+0000 7f3c867fc640 10 monclient: dump: 2026-02-12T03:58:47.825 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.825 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.825 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.825 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.825 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.825 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.825 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.825 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.825 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.825 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.825 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.823+0000 7f3c87fff640 4 set_mon_vals no callback set 2026-02-12T03:58:47.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.823+0000 7f3c867fc640 1 -- 10.20.193.91:0/3002491663 <== mon.2 v1:10.20.193.111:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f3c8801e080 con 0x7f3c980560d0 2026-02-12T03:58:47.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.824+0000 7f142f7fe640 1 -- 10.20.193.91:0/2867776790 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f14440034b0 con 0x7f14500afe70 2026-02-12T03:58:47.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.824+0000 7f142f7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:47.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.824+0000 7f142f7fe640 1 -- 10.20.193.91:0/2867776790 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f1444003800 con 0x7f14500afe70 2026-02-12T03:58:47.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.824+0000 7f142f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:47.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.824+0000 7f142f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:47.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.824+0000 7f142f7fe640 10 monclient: dump: 2026-02-12T03:58:47.826 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.826 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.826 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.826 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.826 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.826 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.826 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.826 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.827 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.827 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.827 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.824+0000 7f144d573640 4 set_mon_vals no callback set 2026-02-12T03:58:47.827 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.824+0000 7f3c9d659640 10 monclient: get_auth_request con 0x7f3c68079ea0 auth_method 0 2026-02-12T03:58:47.827 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.824+0000 7f3c867fc640 10 client.4559.objecter ms_handle_connect 0x7f3c68079ea0 2026-02-12T03:58:47.827 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.824+0000 7f142f7fe640 1 -- 10.20.193.91:0/2867776790 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f144401cce0 con 0x7f14500afe70 2026-02-12T03:58:47.827 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.825+0000 7f144e575640 10 monclient: get_auth_request con 0x7f141c079fe0 auth_method 0 2026-02-12T03:58:47.827 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.825+0000 7f142f7fe640 10 client.4611.objecter ms_handle_connect 0x7f141c079fe0 2026-02-12T03:58:47.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.825+0000 7f3c867fc640 1 -- 10.20.193.91:0/3002491663 <== mon.2 v1:10.20.193.111:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7f3c88095cd0 con 0x7f3c980560d0 2026-02-12T03:58:47.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.825+0000 7f3c867fc640 10 client.4559.objecter ms_dispatch2 0x7f3c98000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:47.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.825+0000 7f3c867fc640 3 client.4559.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:47.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.825+0000 7f3c867fc640 3 client.4559.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:47.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.825+0000 7f3c867fc640 20 client.4559.objecter dump_active .. 0 homeless 2026-02-12T03:58:47.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.826+0000 7f142f7fe640 1 -- 10.20.193.91:0/2867776790 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7f1444094890 con 0x7f14500afe70 2026-02-12T03:58:47.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.826+0000 7f142f7fe640 10 client.4611.objecter ms_dispatch2 0x7f1450000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:47.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.826+0000 7f142f7fe640 3 client.4611.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:47.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.826+0000 7f142f7fe640 3 client.4611.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:47.828 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.826+0000 7f142f7fe640 20 client.4611.objecter dump_active .. 0 homeless 2026-02-12T03:58:47.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.829+0000 7f58537fe640 1 -- 10.20.193.91:0/2261743271 <== mon.2 v1:10.20.193.111:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5868002f80 con 0x7f58740560d0 2026-02-12T03:58:47.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.829+0000 7f58537fe640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:47.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.829+0000 7f58537fe640 1 -- 10.20.193.91:0/2261743271 <== mon.2 v1:10.20.193.111:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f5868004e80 con 0x7f58740560d0 2026-02-12T03:58:47.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.829+0000 7f58537fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:47.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.829+0000 7f58537fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:47.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.829+0000 7f58537fe640 10 monclient: dump: 2026-02-12T03:58:47.831 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.831 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.831 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.831 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.831 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.831 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.831 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.831 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.831 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.831 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.831 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.829+0000 7f58717fa640 4 set_mon_vals no callback set 2026-02-12T03:58:47.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.830+0000 7f58537fe640 1 -- 10.20.193.91:0/2261743271 <== mon.2 v1:10.20.193.111:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f586801e360 con 0x7f58740560d0 2026-02-12T03:58:47.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.830+0000 7f58727fc640 10 monclient: get_auth_request con 0x7f5840079d80 auth_method 0 2026-02-12T03:58:47.832 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.831+0000 7f58537fe640 10 client.4562.objecter ms_handle_connect 0x7f5840079d80 2026-02-12T03:58:47.834 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.833+0000 7f58537fe640 1 -- 10.20.193.91:0/2261743271 <== mon.2 v1:10.20.193.111:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7f5868095e60 con 0x7f58740560d0 2026-02-12T03:58:47.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.833+0000 7f58537fe640 10 client.4562.objecter ms_dispatch2 0x7f5874000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:47.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.833+0000 7f58537fe640 3 client.4562.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:47.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.833+0000 7f58537fe640 3 client.4562.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:47.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.833+0000 7f58537fe640 20 client.4562.objecter dump_active .. 0 homeless 2026-02-12T03:58:47.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.833+0000 7f3c867fc640 1 -- 10.20.193.91:0/3002491663 <== mon.2 v1:10.20.193.111:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f3c8805f630 con 0x7f3c980560d0 2026-02-12T03:58:47.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.833+0000 7f3c867fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:47.835 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.833+0000 7f3c867fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:47.836 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.834+0000 7f58537fe640 1 -- 10.20.193.91:0/2261743271 <== mon.2 v1:10.20.193.111:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f586805f7c0 con 0x7f58740560d0 2026-02-12T03:58:47.836 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.834+0000 7f58537fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:47.836 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.834+0000 7f58537fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:47.844 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.842+0000 7f69f77fe640 1 -- 10.20.193.91:0/2628226605 <== mon.2 v1:10.20.193.111:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (unknown 1482059429 0 3956125152) 0x7f6a0805def0 con 0x7f6a18164c50 2026-02-12T03:58:47.844 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.842+0000 7f69f77fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 7}] 2026-02-12T03:58:47.844 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.842+0000 7f69f77fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:47.844 INFO:teuthology.orchestra.run.trial091.stdout:94489280518 2026-02-12T03:58:47.847 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.845+0000 7f6a17fff640 10 librados: watch_flush enter 2026-02-12T03:58:47.848 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.845+0000 7f6a17fff640 10 librados: watch_flush exit 2026-02-12T03:58:47.848 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.845+0000 7f6a17fff640 20 client.4550.objecter shutdown clearing up homeless session... 2026-02-12T03:58:47.848 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.845+0000 7f6a17fff640 10 client.4550.objecter successfully canceled tick 2026-02-12T03:58:47.848 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.845+0000 7f6a17fff640 1 -- 10.20.193.91:0/2628226605 >> v1:10.20.193.91:6800/2929217192 conn(0x7f69e407a0b0 legacy=0x7f69e409a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.848 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.845+0000 7f6a17fff640 10 monclient: shutdown 2026-02-12T03:58:47.848 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.845+0000 7f6a17fff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:47.848 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.845+0000 7f6a17fff640 1 -- 10.20.193.91:0/2628226605 >> v1:10.20.193.111:6789/0 conn(0x7f6a18164c50 legacy=0x7f6a18158440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.848 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.846+0000 7f6a17fff640 1 -- 10.20.193.91:0/2628226605 shutdown_connections 2026-02-12T03:58:47.848 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.846+0000 7f6a17fff640 1 -- 10.20.193.91:0/2628226605 >> 10.20.193.91:0/2628226605 conn(0x7f6a180b2fa0 msgr2=0x7f6a180b3370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:47.848 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.846+0000 7f6a17fff640 1 -- 10.20.193.91:0/2628226605 shutdown_connections 2026-02-12T03:58:47.848 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.846+0000 7f6a17fff640 1 -- 10.20.193.91:0/2628226605 wait complete. 2026-02-12T03:58:47.848 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.846+0000 7f6a17fff640 1 librados: shutdown 2026-02-12T03:58:47.858 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280518 got 94489280518 for osd.7 2026-02-12T03:58:47.858 DEBUG:teuthology.parallel:result is None 2026-02-12T03:58:47.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.877+0000 7f9f19345640 10 monclient: get_monmap_and_config 2026-02-12T03:58:47.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.877+0000 7f9f19345640 10 monclient: build_initial_monmap 2026-02-12T03:58:47.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.877+0000 7f9f19345640 10 monclient: monmap: 2026-02-12T03:58:47.879 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:47.879 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.880 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:47.878092+0000 2026-02-12T03:58:47.880 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:47.878092+0000 2026-02-12T03:58:47.880 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:47.880 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.880 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:47.880 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:47.880 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:47.880 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.877+0000 7f9f19345640 1 Processor -- start 2026-02-12T03:58:47.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.878+0000 7f9f19345640 1 -- start start 2026-02-12T03:58:47.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.878+0000 7f9f19345640 10 monclient: init 2026-02-12T03:58:47.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.878+0000 7f9f19345640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:47.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.878+0000 7f9f19345640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T03:58:47.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.878+0000 7f9f19345640 10 monclient(hunting): picked mon.noname-a con 0x7f9f140afe70 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:47.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.878+0000 7f9f19345640 10 monclient(hunting): picked mon.noname-b con 0x7f9f1415f310 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:47.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.878+0000 7f9f19345640 10 monclient(hunting): picked mon.noname-c con 0x7f9f141639c0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:47.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.878+0000 7f9f19345640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f14162bb0 con 0x7f9f140afe70 2026-02-12T03:58:47.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.878+0000 7f9f19345640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f14162e90 con 0x7f9f1415f310 2026-02-12T03:58:47.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.878+0000 7f9f19345640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f1415de40 con 0x7f9f141639c0 2026-02-12T03:58:47.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.878+0000 7f9f19345640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:47.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.878+0000 7f9f19345640 10 monclient(hunting): authenticate will time out at 1130.621720s 2026-02-12T03:58:47.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.879+0000 7f9f137fe640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f9f141639c0 0x7f9f14161b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:38334/0 (socket says 10.20.193.91:38334) 2026-02-12T03:58:47.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.879+0000 7f9f137fe640 1 -- 10.20.193.91:0/4115083222 learned_addr learned my addr 10.20.193.91:0/4115083222 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:47.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.880+0000 7f9f11ffb640 1 -- 10.20.193.91:0/4115083222 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 958928828 0 0) 0x7f9f1415de40 con 0x7f9f141639c0 2026-02-12T03:58:47.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.880+0000 7f9f11ffb640 10 monclient(hunting): _negotiate 2026-02-12T03:58:47.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.880+0000 7f9f11ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:47.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.880+0000 7f9f11ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:47.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.880+0000 7f9f11ffb640 10 monclient(hunting): my global_id is 4565 2026-02-12T03:58:47.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.880+0000 7f9f11ffb640 1 -- 10.20.193.91:0/4115083222 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f00003610 con 0x7f9f141639c0 2026-02-12T03:58:47.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.882+0000 7f9f11ffb640 1 -- 10.20.193.91:0/4115083222 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1632318293 0 0) 0x7f9f00003610 con 0x7f9f141639c0 2026-02-12T03:58:47.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.882+0000 7f9f11ffb640 1 -- 10.20.193.91:0/4115083222 >> v1:10.20.193.98:6789/0 conn(0x7f9f1415f310 legacy=0x7f9f141632b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T03:58:47.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.882+0000 7f9f11ffb640 1 -- 10.20.193.91:0/4115083222 >> v1:10.20.193.91:6789/0 conn(0x7f9f140afe70 legacy=0x7f9f1415ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T03:58:47.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.882+0000 7f9f11ffb640 10 monclient: _finish_hunting 0 2026-02-12T03:58:47.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.882+0000 7f9f11ffb640 1 monclient: found mon.noname-c 2026-02-12T03:58:47.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.882+0000 7f9f11ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:47.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.882+0000 7f9f11ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.111:6789/0 2026-02-12T03:58:47.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.882+0000 7f9f11ffb640 1 -- 10.20.193.91:0/4115083222 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f1415e120 con 0x7f9f141639c0 2026-02-12T03:58:47.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.882+0000 7f9f11ffb640 10 monclient: _finish_auth 0 2026-02-12T03:58:47.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.882+0000 7f9f11ffb640 10 monclient: _check_auth_tickets 2026-02-12T03:58:47.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.882+0000 7f9f11ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:47.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.882+0000 7f9f11ffb640 1 -- 10.20.193.91:0/4115083222 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f9f04003170 con 0x7f9f141639c0 2026-02-12T03:58:47.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.882+0000 7f9f11ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:47.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.882+0000 7f9f11ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:47.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.882+0000 7f9f11ffb640 10 monclient: dump: 2026-02-12T03:58:47.885 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.885 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.885 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.885 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.885 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.885 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.886 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.886 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.886 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.886 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.882+0000 7f9f19345640 5 monclient: authenticate success, global_id 4565 2026-02-12T03:58:47.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.882+0000 7f9f19345640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:47.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.882+0000 7f1b79038640 10 monclient: get_monmap_and_config 2026-02-12T03:58:47.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.882+0000 7f1b79038640 10 monclient: build_initial_monmap 2026-02-12T03:58:47.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.882+0000 7f1b79038640 10 monclient: monmap: 2026-02-12T03:58:47.887 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:47.887 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.887 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:47.883093+0000 2026-02-12T03:58:47.887 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:47.883093+0000 2026-02-12T03:58:47.887 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:47.887 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.887 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:47.887 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:47.887 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:47.887 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.882+0000 7f9f2cc81640 10 monclient: get_monmap_and_config 2026-02-12T03:58:47.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.882+0000 7f9f2cc81640 10 monclient: build_initial_monmap 2026-02-12T03:58:47.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.882+0000 7f9f2cc81640 10 monclient: monmap: 2026-02-12T03:58:47.888 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:47.888 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.888 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:47.883167+0000 2026-02-12T03:58:47.888 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:47.883167+0000 2026-02-12T03:58:47.888 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:47.888 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.888 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:47.888 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:47.889 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:47.889 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.882+0000 7f1b79038640 1 Processor -- start 2026-02-12T03:58:47.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f1b79038640 1 -- start start 2026-02-12T03:58:47.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f1b79038640 10 monclient: init 2026-02-12T03:58:47.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f9f11ffb640 1 -- 10.20.193.91:0/4115083222 <== mon.2 v1:10.20.193.111:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9f04003380 con 0x7f9f141639c0 2026-02-12T03:58:47.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f9f11ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:47.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7fbef2f41640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-12T03:58:47.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f9f11ffb640 1 -- 10.20.193.91:0/4115083222 <== mon.2 v1:10.20.193.111:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f9f040037c0 con 0x7f9f141639c0 2026-02-12T03:58:47.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f9f11ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:47.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f9f11ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:47.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7fbef2f41640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-12T03:58:47.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7fbef2f41640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:47.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f9f11ffb640 10 monclient: dump: 2026-02-12T03:58:47.891 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.891 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.891 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.891 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.892 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.892 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.892 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.892 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.892 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.892 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f9f19345640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:47.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f9f19345640 4 set_mon_vals no callback set 2026-02-12T03:58:47.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f9f2cc81640 1 Processor -- start 2026-02-12T03:58:47.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7fbef2f41640 1 -- 10.20.193.91:0/2112863097 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fbeec0b1310 con 0x7fbeec0560d0 2026-02-12T03:58:47.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f9f2cc81640 1 -- start start 2026-02-12T03:58:47.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f9f2cc81640 10 monclient: init 2026-02-12T03:58:47.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f1b79038640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:47.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f1b79038640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T03:58:47.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f1b79038640 10 monclient(hunting): picked mon.noname-a con 0x7f1b740afe70 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:47.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f1b79038640 10 monclient(hunting): picked mon.noname-c con 0x7f1b7415f310 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:47.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f1b79038640 10 monclient(hunting): picked mon.noname-b con 0x7f1b741639c0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:47.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f1b79038640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b74162bb0 con 0x7f1b740afe70 2026-02-12T03:58:47.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f1b79038640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b74162e90 con 0x7f1b741639c0 2026-02-12T03:58:47.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f1b79038640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b7415de40 con 0x7f1b7415f310 2026-02-12T03:58:47.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f1b79038640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:47.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f1b79038640 10 monclient(hunting): authenticate will time out at 1130.626593s 2026-02-12T03:58:47.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f9f19345640 10 monclient: shutdown 2026-02-12T03:58:47.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f9f19345640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:47.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f9f19345640 1 -- 10.20.193.91:0/4115083222 >> v1:10.20.193.111:6789/0 conn(0x7f9f141639c0 legacy=0x7f9f14161b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f9f19345640 1 -- 10.20.193.91:0/4115083222 shutdown_connections 2026-02-12T03:58:47.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f9f19345640 1 -- 10.20.193.91:0/4115083222 >> 10.20.193.91:0/4115083222 conn(0x7f9f140b6560 msgr2=0x7f9f140b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:47.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f9f2cc81640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:47.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f9f2cc81640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T03:58:47.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f9f2cc81640 10 monclient(hunting): picked mon.noname-a con 0x7f9f280afe70 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:47.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f9f19345640 1 -- 10.20.193.91:0/4115083222 shutdown_connections 2026-02-12T03:58:47.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f9f2cc81640 10 monclient(hunting): picked mon.noname-b con 0x7f9f2815f310 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:47.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f9f2cc81640 10 monclient(hunting): picked mon.noname-c con 0x7f9f281639c0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:47.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f9f19345640 1 -- 10.20.193.91:0/4115083222 wait complete. 2026-02-12T03:58:47.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f9f2cc81640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f28162bb0 con 0x7f9f280afe70 2026-02-12T03:58:47.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f9f2cc81640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f28162e90 con 0x7f9f2815f310 2026-02-12T03:58:47.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f9f2cc81640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f2815de40 con 0x7f9f281639c0 2026-02-12T03:58:47.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f9f2cc81640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:47.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f9f2cc81640 10 monclient(hunting): authenticate will time out at 1130.626790s 2026-02-12T03:58:47.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f8bf5ffb640 1 -- 10.20.193.91:0/2072269458 <== mon.1 v1:10.20.193.98:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8c04003950 con 0x7f8c08163310 2026-02-12T03:58:47.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f8bf5ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:47.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f8bf5ffb640 1 -- 10.20.193.91:0/2072269458 <== mon.1 v1:10.20.193.98:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8c04004f10 con 0x7f8c08163310 2026-02-12T03:58:47.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f8bf5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:47.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f8bf5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:47.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f8bf5ffb640 10 monclient: dump: 2026-02-12T03:58:47.899 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.899 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.900 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.900 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.900 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.900 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.900 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.900 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.900 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.900 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f8bf77fe640 4 set_mon_vals no callback set 2026-02-12T03:58:47.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f1b72575640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f1b7415f310 0x7f1b741632b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:38342/0 (socket says 10.20.193.91:38342) 2026-02-12T03:58:47.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.883+0000 7f1b72575640 1 -- 10.20.193.91:0/2814263020 learned_addr learned my addr 10.20.193.91:0/2814263020 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:47.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.884+0000 7f9f19345640 10 monclient: build_initial_monmap 2026-02-12T03:58:47.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.884+0000 7f9f19345640 10 monclient: monmap: 2026-02-12T03:58:47.901 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:47.901 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:47.901 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:47.901 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:47.901 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:47.901 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:47.901 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:47.901 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:47.902 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:47.902 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.884+0000 7f9f26d76640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f9f281639c0 0x7f9f28161b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:38358/0 (socket says 10.20.193.91:38358) 2026-02-12T03:58:47.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.884+0000 7f9f26d76640 1 -- 10.20.193.91:0/1467656006 learned_addr learned my addr 10.20.193.91:0/1467656006 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:47.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.884+0000 7f9f19345640 1 librados: starting msgr at 2026-02-12T03:58:47.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.884+0000 7f9f19345640 1 librados: starting objecter 2026-02-12T03:58:47.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.884+0000 7f9f19345640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:47.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.884+0000 7f9f19345640 1 Processor -- start 2026-02-12T03:58:47.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.884+0000 7f9f19345640 1 -- start start 2026-02-12T03:58:47.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.884+0000 7f9f19345640 1 librados: setting wanted keys 2026-02-12T03:58:47.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.884+0000 7f9f19345640 1 librados: calling monclient init 2026-02-12T03:58:47.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.884+0000 7f9f19345640 10 monclient: init 2026-02-12T03:58:47.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.884+0000 7f8bf5ffb640 1 -- 10.20.193.91:0/2072269458 <== mon.1 v1:10.20.193.98:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f8c0401e3f0 con 0x7f8c08163310 2026-02-12T03:58:47.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.885+0000 7f9f19345640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:47.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.885+0000 7f9f19345640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T03:58:47.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.885+0000 7f9f19345640 10 monclient(hunting): picked mon.noname-a con 0x7f9f140afe70 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:47.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.885+0000 7f9f19345640 10 monclient(hunting): picked mon.noname-c con 0x7f9f1415f310 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:47.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.885+0000 7f9f19345640 10 monclient(hunting): picked mon.noname-b con 0x7f9f141639c0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:47.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.885+0000 7f9f19345640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f14160740 con 0x7f9f140afe70 2026-02-12T03:58:47.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.885+0000 7f9f19345640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f14157f70 con 0x7f9f141639c0 2026-02-12T03:58:47.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.885+0000 7f9f19345640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f141353f0 con 0x7f9f1415f310 2026-02-12T03:58:47.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.885+0000 7f9f19345640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:47.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.885+0000 7f9f19345640 10 monclient(hunting): authenticate will time out at 1130.628440s 2026-02-12T03:58:47.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.885+0000 7f8c0d3e5640 10 monclient: get_auth_request con 0x7f8bd8079f30 auth_method 0 2026-02-12T03:58:47.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.885+0000 7f8bf5ffb640 10 client.4609.objecter ms_handle_connect 0x7f8bd8079f30 2026-02-12T03:58:47.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.885+0000 7f1b71d74640 1 -- 10.20.193.91:0/2814263020 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 658139488 0 0) 0x7f1b7415de40 con 0x7f1b7415f310 2026-02-12T03:58:47.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.885+0000 7f1b71d74640 10 monclient(hunting): _negotiate 2026-02-12T03:58:47.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.885+0000 7f1b71d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:47.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.885+0000 7f1b71d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:47.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.885+0000 7f1b71d74640 10 monclient(hunting): my global_id is 4568 2026-02-12T03:58:47.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.885+0000 7f1b71d74640 1 -- 10.20.193.91:0/2814263020 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b600058a0 con 0x7f1b7415f310 2026-02-12T03:58:47.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.886+0000 7f8bf5ffb640 1 -- 10.20.193.91:0/2072269458 <== mon.1 v1:10.20.193.98:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7f8c04095f20 con 0x7f8c08163310 2026-02-12T03:58:47.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.886+0000 7f8bf5ffb640 10 client.4609.objecter ms_dispatch2 0x7f8c08000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:47.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.886+0000 7f8bf5ffb640 3 client.4609.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:47.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.886+0000 7f8bf5ffb640 3 client.4609.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:47.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.886+0000 7f8bf5ffb640 20 client.4609.objecter dump_active .. 0 homeless 2026-02-12T03:58:47.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.888+0000 7f8bf5ffb640 1 -- 10.20.193.91:0/2072269458 <== mon.1 v1:10.20.193.98:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f8c040cfc30 con 0x7f8c08163310 2026-02-12T03:58:47.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.888+0000 7f8bf5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:47.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.888+0000 7f8bf5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:47.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.888+0000 7f1b71d74640 1 -- 10.20.193.91:0/2814263020 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1956760467 0 0) 0x7f1b600058a0 con 0x7f1b7415f310 2026-02-12T03:58:47.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.888+0000 7f1b71d74640 1 -- 10.20.193.91:0/2814263020 >> v1:10.20.193.98:6789/0 conn(0x7f1b741639c0 legacy=0x7f1b74161b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T03:58:47.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.888+0000 7f1b71d74640 1 -- 10.20.193.91:0/2814263020 >> v1:10.20.193.91:6789/0 conn(0x7f1b740afe70 legacy=0x7f1b7415ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T03:58:47.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.888+0000 7f1b71d74640 10 monclient: _finish_hunting 0 2026-02-12T03:58:47.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.888+0000 7f1b71d74640 1 monclient: found mon.noname-c 2026-02-12T03:58:47.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.888+0000 7f1b71d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:47.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.888+0000 7f1b71d74640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.111:6789/0 2026-02-12T03:58:47.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.888+0000 7f1b71d74640 1 -- 10.20.193.91:0/2814263020 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b7415e120 con 0x7f1b7415f310 2026-02-12T03:58:47.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.888+0000 7f1b71d74640 10 monclient: _finish_auth 0 2026-02-12T03:58:47.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.888+0000 7f1b71d74640 10 monclient: _check_auth_tickets 2026-02-12T03:58:47.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.888+0000 7f1b71d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:47.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.888+0000 7f1b71d74640 1 -- 10.20.193.91:0/2814263020 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f1b5c002df0 con 0x7f1b7415f310 2026-02-12T03:58:47.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.888+0000 7f1b71d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:47.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.888+0000 7f1b71d74640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:47.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.888+0000 7f1b71d74640 10 monclient: dump: 2026-02-12T03:58:47.908 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.908 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.908 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.908 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.908 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.908 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.908 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.908 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.908 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.908 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.888+0000 7f1b79038640 5 monclient: authenticate success, global_id 4568 2026-02-12T03:58:47.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.888+0000 7f1b79038640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:47.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.888+0000 7f9f25573640 1 -- 10.20.193.91:0/1467656006 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2345012548 0 0) 0x7f9f2815de40 con 0x7f9f281639c0 2026-02-12T03:58:47.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.888+0000 7f9f25573640 10 monclient(hunting): _negotiate 2026-02-12T03:58:47.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.888+0000 7f9f25573640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:47.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.888+0000 7f9f25573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:47.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.888+0000 7f9f25573640 10 monclient(hunting): my global_id is 4571 2026-02-12T03:58:47.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.888+0000 7f9f25573640 1 -- 10.20.193.91:0/1467656006 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f140058a0 con 0x7f9f281639c0 2026-02-12T03:58:47.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.888+0000 7f9f127fc640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f9f1415f310 0x7f9f14154830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:38374/0 (socket says 10.20.193.91:38374) 2026-02-12T03:58:47.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.888+0000 7f9f127fc640 1 -- 10.20.193.91:0/3761149215 learned_addr learned my addr 10.20.193.91:0/3761149215 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:47.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.889+0000 7f9ef37fe640 10 client.?.objecter ms_handle_connect 0x7f9f1415f310 2026-02-12T03:58:47.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.889+0000 7f9ef37fe640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:47.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.890+0000 7f1b71d74640 1 -- 10.20.193.91:0/2814263020 <== mon.2 v1:10.20.193.111:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1b5c003000 con 0x7f1b7415f310 2026-02-12T03:58:47.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.890+0000 7f1b71d74640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:47.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.890+0000 7f1b71d74640 1 -- 10.20.193.91:0/2814263020 <== mon.2 v1:10.20.193.111:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f1b5c003440 con 0x7f1b7415f310 2026-02-12T03:58:47.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.890+0000 7f1b71d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:47.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.890+0000 7f1b71d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:47.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.890+0000 7f1b71d74640 10 monclient: dump: 2026-02-12T03:58:47.911 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.911 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.911 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.911 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.911 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.911 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.911 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.911 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.911 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.911 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.890+0000 7f1b79038640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:47.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.890+0000 7f1b79038640 4 set_mon_vals no callback set 2026-02-12T03:58:47.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.891+0000 7f1b79038640 10 monclient: shutdown 2026-02-12T03:58:47.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.891+0000 7f1b79038640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:47.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.891+0000 7f1b79038640 1 -- 10.20.193.91:0/2814263020 >> v1:10.20.193.111:6789/0 conn(0x7f1b7415f310 legacy=0x7f1b741632b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.891+0000 7f1b79038640 1 -- 10.20.193.91:0/2814263020 shutdown_connections 2026-02-12T03:58:47.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.891+0000 7f1b79038640 1 -- 10.20.193.91:0/2814263020 >> 10.20.193.91:0/2814263020 conn(0x7f1b740b6560 msgr2=0x7f1b740b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:47.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.891+0000 7f1b79038640 1 -- 10.20.193.91:0/2814263020 shutdown_connections 2026-02-12T03:58:47.912 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.891+0000 7f9f25573640 1 -- 10.20.193.91:0/1467656006 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4165081905 0 0) 0x7f9f140058a0 con 0x7f9f281639c0 2026-02-12T03:58:47.912 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.891+0000 7f9f25573640 1 -- 10.20.193.91:0/1467656006 >> v1:10.20.193.98:6789/0 conn(0x7f9f2815f310 legacy=0x7f9f281632b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T03:58:47.912 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.891+0000 7f9f25573640 1 -- 10.20.193.91:0/1467656006 >> v1:10.20.193.91:6789/0 conn(0x7f9f280afe70 legacy=0x7f9f2815ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T03:58:47.912 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.891+0000 7f9f25573640 10 monclient: _finish_hunting 0 2026-02-12T03:58:47.912 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.891+0000 7f1b79038640 1 -- 10.20.193.91:0/2814263020 wait complete. 2026-02-12T03:58:47.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.891+0000 7f9f25573640 1 monclient: found mon.noname-c 2026-02-12T03:58:47.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.891+0000 7f9f25573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:47.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.891+0000 7f9f25573640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.111:6789/0 2026-02-12T03:58:47.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.891+0000 7f9f25573640 1 -- 10.20.193.91:0/1467656006 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f2815e120 con 0x7f9f281639c0 2026-02-12T03:58:47.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.891+0000 7f9f25573640 10 monclient: _finish_auth 0 2026-02-12T03:58:47.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.891+0000 7f9f25573640 10 monclient: _check_auth_tickets 2026-02-12T03:58:47.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.891+0000 7f9f25573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:47.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.891+0000 7f9f25573640 1 -- 10.20.193.91:0/1467656006 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f9f18003170 con 0x7f9f281639c0 2026-02-12T03:58:47.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.891+0000 7f9f25573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:47.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.891+0000 7f9f25573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:47.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.891+0000 7f9f25573640 10 monclient: dump: 2026-02-12T03:58:47.913 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.913 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.913 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.913 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.913 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.914 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.914 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.914 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.914 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.914 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.914 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.891+0000 7f9f2cc81640 5 monclient: authenticate success, global_id 4571 2026-02-12T03:58:47.914 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.891+0000 7f9f2cc81640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:47.914 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.891+0000 7f1b79038640 10 monclient: build_initial_monmap 2026-02-12T03:58:47.914 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.891+0000 7f1b79038640 10 monclient: monmap: 2026-02-12T03:58:47.914 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:47.915 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:47.915 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:47.915 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:47.915 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:47.915 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:47.915 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:47.915 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:47.915 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:47.915 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.891+0000 7f1b79038640 1 librados: starting msgr at 2026-02-12T03:58:47.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.891+0000 7f1b79038640 1 librados: starting objecter 2026-02-12T03:58:47.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.891+0000 7f1b79038640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:47.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.891+0000 7f1b79038640 1 Processor -- start 2026-02-12T03:58:47.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.891+0000 7f1b79038640 1 -- start start 2026-02-12T03:58:47.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.891+0000 7f1b79038640 1 librados: setting wanted keys 2026-02-12T03:58:47.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.891+0000 7f1b79038640 1 librados: calling monclient init 2026-02-12T03:58:47.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.891+0000 7f1b79038640 10 monclient: init 2026-02-12T03:58:47.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.892+0000 7f9ef37fe640 1 -- 10.20.193.91:0/3761149215 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2895266052 0 0) 0x7f9f141353f0 con 0x7f9f1415f310 2026-02-12T03:58:47.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.892+0000 7f9ef37fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:47.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.892+0000 7f9ef37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:47.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.892+0000 7f9ef37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:47.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.892+0000 7f9ef37fe640 10 monclient(hunting): my global_id is 4574 2026-02-12T03:58:47.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.892+0000 7f9ef37fe640 1 -- 10.20.193.91:0/3761149215 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ee0003610 con 0x7f9f1415f310 2026-02-12T03:58:47.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.892+0000 7f1b79038640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:47.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.892+0000 7f1b79038640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T03:58:47.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.892+0000 7f1b79038640 10 monclient(hunting): picked mon.noname-c con 0x7f1b740afe70 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:47.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.892+0000 7f1b79038640 10 monclient(hunting): picked mon.noname-a con 0x7f1b7415f310 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:47.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.892+0000 7f1b79038640 10 monclient(hunting): picked mon.noname-b con 0x7f1b741639c0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:47.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.892+0000 7f1b79038640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b741fedd0 con 0x7f1b7415f310 2026-02-12T03:58:47.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.892+0000 7f1b79038640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b741fc350 con 0x7f1b741639c0 2026-02-12T03:58:47.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.892+0000 7f1b79038640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b741fc630 con 0x7f1b740afe70 2026-02-12T03:58:47.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.892+0000 7f1b79038640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:47.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.892+0000 7f1b79038640 10 monclient(hunting): authenticate will time out at 1130.635479s 2026-02-12T03:58:47.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.895+0000 7f9ef37fe640 10 client.?.objecter ms_handle_connect 0x7f9f141639c0 2026-02-12T03:58:47.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.895+0000 7f9ef37fe640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:47.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.895+0000 7f9f25573640 1 -- 10.20.193.91:0/1467656006 <== mon.2 v1:10.20.193.111:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9f18003380 con 0x7f9f281639c0 2026-02-12T03:58:47.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.895+0000 7f9f25573640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:47.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.895+0000 7f9f25573640 1 -- 10.20.193.91:0/1467656006 <== mon.2 v1:10.20.193.111:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f9f180037c0 con 0x7f9f281639c0 2026-02-12T03:58:47.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.895+0000 7f9f25573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:47.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.895+0000 7f9f25573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:47.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.895+0000 7f9f25573640 10 monclient: dump: 2026-02-12T03:58:47.918 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.918 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.918 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.918 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.918 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.918 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.918 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.918 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.918 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.918 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.895+0000 7f9f2cc81640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:47.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.895+0000 7f9f2cc81640 4 set_mon_vals no callback set 2026-02-12T03:58:47.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.895+0000 7f1b72d76640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f1b740afe70 0x7f1b741fe6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:38378/0 (socket says 10.20.193.91:38378) 2026-02-12T03:58:47.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.895+0000 7f1b72d76640 1 -- 10.20.193.91:0/934231211 learned_addr learned my addr 10.20.193.91:0/934231211 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:47.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.895+0000 7f9f2cc81640 10 monclient: shutdown 2026-02-12T03:58:47.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.895+0000 7f9f2cc81640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:47.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.895+0000 7f9f2cc81640 1 -- 10.20.193.91:0/1467656006 >> v1:10.20.193.111:6789/0 conn(0x7f9f281639c0 legacy=0x7f9f28161b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.895+0000 7f9f2cc81640 1 -- 10.20.193.91:0/1467656006 shutdown_connections 2026-02-12T03:58:47.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.895+0000 7f9f2cc81640 1 -- 10.20.193.91:0/1467656006 >> 10.20.193.91:0/1467656006 conn(0x7f9f280b6560 msgr2=0x7f9f280b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:47.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.895+0000 7f9f2cc81640 1 -- 10.20.193.91:0/1467656006 shutdown_connections 2026-02-12T03:58:47.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.896+0000 7f9f2cc81640 1 -- 10.20.193.91:0/1467656006 wait complete. 2026-02-12T03:58:47.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.896+0000 7f1b537fe640 10 client.?.objecter ms_handle_connect 0x7f1b740afe70 2026-02-12T03:58:47.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.896+0000 7f1b537fe640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:47.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.896+0000 7f9ef37fe640 1 -- 10.20.193.91:0/3761149215 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2745531990 0 0) 0x7f9ee0003610 con 0x7f9f1415f310 2026-02-12T03:58:47.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.896+0000 7f9ef37fe640 1 -- 10.20.193.91:0/3761149215 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9f141353f0 con 0x7f9f1415f310 2026-02-12T03:58:47.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.896+0000 7f9ef37fe640 1 -- 10.20.193.91:0/3761149215 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f9efc002fd0 con 0x7f9f1415f310 2026-02-12T03:58:47.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.896+0000 7f9ef37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:47.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.896+0000 7f9ef37fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:58:47.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.896+0000 7f9ef37fe640 10 monclient(hunting): dump: 2026-02-12T03:58:47.920 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.920 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.920 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.920 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.920 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.920 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.920 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.920 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.920 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.920 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.896+0000 7f9ef37fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:47.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.896+0000 7f9f2cc81640 10 monclient: build_initial_monmap 2026-02-12T03:58:47.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.896+0000 7f9f2cc81640 10 monclient: monmap: 2026-02-12T03:58:47.920 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:47.920 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:47.920 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:47.921 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:47.921 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:47.921 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:47.921 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:47.921 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:47.921 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:47.921 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.896+0000 7fbee17fa640 1 -- 10.20.193.91:0/2112863097 <== mon.1 v1:10.20.193.98:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 1498640560) 0x7fbedc05ef40 con 0x7fbeec0560d0 2026-02-12T03:58:47.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.896+0000 7fbee17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-12T03:58:47.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.896+0000 7fbee17fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:47.921 INFO:teuthology.orchestra.run.trial091.stdout:90194313221 2026-02-12T03:58:47.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.896+0000 7f9f2cc81640 1 librados: starting msgr at 2026-02-12T03:58:47.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.896+0000 7f9f2cc81640 1 librados: starting objecter 2026-02-12T03:58:47.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.896+0000 7f9f2cc81640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:47.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.896+0000 7f9f2cc81640 1 Processor -- start 2026-02-12T03:58:47.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.896+0000 7f9f2cc81640 1 -- start start 2026-02-12T03:58:47.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.896+0000 7f9f2cc81640 1 librados: setting wanted keys 2026-02-12T03:58:47.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.896+0000 7f9f2cc81640 1 librados: calling monclient init 2026-02-12T03:58:47.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.896+0000 7f9f2cc81640 10 monclient: init 2026-02-12T03:58:47.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.897+0000 7f9f2cc81640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:47.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.897+0000 7f9f2cc81640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T03:58:47.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.897+0000 7f9f2cc81640 10 monclient(hunting): picked mon.noname-c con 0x7f9f280afe70 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:47.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.897+0000 7f9f2cc81640 10 monclient(hunting): picked mon.noname-b con 0x7f9f2815f310 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:47.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.897+0000 7f9f2cc81640 10 monclient(hunting): picked mon.noname-a con 0x7f9f281639c0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:47.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.897+0000 7f9f2cc81640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f281fa5f0 con 0x7f9f281639c0 2026-02-12T03:58:47.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.897+0000 7f9f2cc81640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f28133f00 con 0x7f9f2815f310 2026-02-12T03:58:47.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.897+0000 7f9f2cc81640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f281341e0 con 0x7f9f280afe70 2026-02-12T03:58:47.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.897+0000 7f9f2cc81640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:47.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.897+0000 7f9f2cc81640 10 monclient(hunting): authenticate will time out at 1130.640279s 2026-02-12T03:58:47.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.897+0000 7f9ef37fe640 1 -- 10.20.193.91:0/3761149215 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 352746751 0 0) 0x7f9f14157f70 con 0x7f9f141639c0 2026-02-12T03:58:47.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.897+0000 7f9ef37fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:47.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.897+0000 7f9ef37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:47.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.897+0000 7f9ef37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:47.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.897+0000 7f9ef37fe640 10 monclient(hunting): my global_id is 4615 2026-02-12T03:58:47.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.897+0000 7f9ef37fe640 1 -- 10.20.193.91:0/3761149215 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ee0003610 con 0x7f9f141639c0 2026-02-12T03:58:47.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.897+0000 7f9f25d74640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f9f2815f310 0x7f9f2805b730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:49046/0 (socket says 10.20.193.91:49046) 2026-02-12T03:58:47.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.897+0000 7f9f25d74640 1 -- 10.20.193.91:0/4237945326 learned_addr learned my addr 10.20.193.91:0/4237945326 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:47.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.898+0000 7f1b537fe640 10 client.?.objecter ms_handle_connect 0x7f1b741639c0 2026-02-12T03:58:47.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.898+0000 7f1b537fe640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:47.924 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7fbef2f41640 10 librados: watch_flush enter 2026-02-12T03:58:47.924 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7fbef2f41640 10 librados: watch_flush exit 2026-02-12T03:58:47.924 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7fbef2f41640 20 client.4600.objecter shutdown clearing up homeless session... 2026-02-12T03:58:47.924 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7fbef2f41640 10 client.4600.objecter successfully canceled tick 2026-02-12T03:58:47.924 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7fbef2f41640 1 -- 10.20.193.91:0/2112863097 >> v1:10.20.193.91:6800/2929217192 conn(0x7fbebc079f30 legacy=0x7fbebc09a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.924 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7fbef2f41640 10 monclient: shutdown 2026-02-12T03:58:47.924 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7fbef2f41640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:47.924 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7fbef2f41640 1 -- 10.20.193.91:0/2112863097 >> v1:10.20.193.98:6789/0 conn(0x7fbeec0560d0 legacy=0x7fbeec15fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.924 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7fbef2f41640 1 -- 10.20.193.91:0/2112863097 shutdown_connections 2026-02-12T03:58:47.924 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7fbef2f41640 1 -- 10.20.193.91:0/2112863097 >> 10.20.193.91:0/2112863097 conn(0x7fbeec0b6560 msgr2=0x7fbeec0b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:47.924 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7fbef2f41640 1 -- 10.20.193.91:0/2112863097 shutdown_connections 2026-02-12T03:58:47.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7fbef2f41640 1 -- 10.20.193.91:0/2112863097 wait complete. 2026-02-12T03:58:47.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7fbef2f41640 1 librados: shutdown 2026-02-12T03:58:47.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7f9ef37fe640 1 -- 10.20.193.91:0/3761149215 <== mon.2 v1:10.20.193.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3923581518 0 0) 0x7f9f141353f0 con 0x7f9f1415f310 2026-02-12T03:58:47.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7f9ef37fe640 1 -- 10.20.193.91:0/3761149215 >> v1:10.20.193.98:6789/0 conn(0x7f9f141639c0 legacy=0x7f9f1405c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7f9ef37fe640 1 -- 10.20.193.91:0/3761149215 >> v1:10.20.193.91:6789/0 conn(0x7f9f140afe70 legacy=0x7f9f14157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7f9ef37fe640 10 monclient: _finish_hunting 0 2026-02-12T03:58:47.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7f9ef37fe640 1 monclient: found mon.c 2026-02-12T03:58:47.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7f9ef37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:47.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7f9ef37fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:47.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7f9ef37fe640 1 -- 10.20.193.91:0/3761149215 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f141356d0 con 0x7f9f1415f310 2026-02-12T03:58:47.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7f9ef37fe640 10 monclient: _finish_auth 0 2026-02-12T03:58:47.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7f9ef37fe640 10 monclient: _check_auth_tickets 2026-02-12T03:58:47.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7f9ef37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:47.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7f9f19345640 5 monclient: authenticate success, global_id 4574 2026-02-12T03:58:47.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7f9f19345640 10 monclient: _renew_subs 2026-02-12T03:58:47.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7f9f19345640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:47.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7f9f19345640 1 -- 10.20.193.91:0/3761149215 --> v1:10.20.193.111:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9f141359b0 con 0x7f9f1415f310 2026-02-12T03:58:47.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7f1b537fe640 1 -- 10.20.193.91:0/934231211 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 635486865 0 0) 0x7f1b741fc630 con 0x7f1b740afe70 2026-02-12T03:58:47.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7f1b537fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:47.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7f1b537fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:47.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7f1b537fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:47.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7f1b537fe640 10 monclient(hunting): my global_id is 4577 2026-02-12T03:58:47.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7f1b537fe640 1 -- 10.20.193.91:0/934231211 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b40003610 con 0x7f1b740afe70 2026-02-12T03:58:47.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7f9f19345640 10 client.4574.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:47.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7f9f19345640 10 monclient: _renew_subs 2026-02-12T03:58:47.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7f9f19345640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:47.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7f9f19345640 1 -- 10.20.193.91:0/3761149215 --> v1:10.20.193.111:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9f1405d1a0 con 0x7f9f1415f310 2026-02-12T03:58:47.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.899+0000 7f9f19345640 1 librados: init done 2026-02-12T03:58:47.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.900+0000 7f9f19345640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:47.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.900+0000 7f9f19345640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:47.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.900+0000 7f9f19345640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:47.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.900+0000 7f9f19345640 1 -- 10.20.193.91:0/3761149215 --> v1:10.20.193.111:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f140b6b40 con 0x7f9f1415f310 2026-02-12T03:58:47.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.901+0000 7f9f0effd640 10 client.?.objecter ms_handle_connect 0x7f9f2815f310 2026-02-12T03:58:47.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.901+0000 7f9f0effd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:47.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.903+0000 7f1b537fe640 1 -- 10.20.193.91:0/934231211 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1479622194 0 0) 0x7f1b741fc350 con 0x7f1b741639c0 2026-02-12T03:58:47.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.903+0000 7f1b537fe640 10 monclient(hunting): _negotiate 2026-02-12T03:58:47.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.903+0000 7f1b537fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:47.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.903+0000 7f1b537fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:47.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.903+0000 7f1b537fe640 10 monclient(hunting): my global_id is 4618 2026-02-12T03:58:47.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.903+0000 7f1b537fe640 1 -- 10.20.193.91:0/934231211 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b741fc630 con 0x7f1b741639c0 2026-02-12T03:58:47.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.906+0000 7f9f0effd640 1 -- 10.20.193.91:0/4237945326 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1092137345 0 0) 0x7f9f28133f00 con 0x7f9f2815f310 2026-02-12T03:58:47.928 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.906+0000 7f9f0effd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:47.928 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.906+0000 7f9f0effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:47.928 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.906+0000 7f9f0effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:47.928 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.906+0000 7f9f0effd640 10 monclient(hunting): my global_id is 4621 2026-02-12T03:58:47.928 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.906+0000 7f9f0effd640 1 -- 10.20.193.91:0/4237945326 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ef4003610 con 0x7f9f2815f310 2026-02-12T03:58:47.928 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.906+0000 7f1b537fe640 1 -- 10.20.193.91:0/934231211 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3872717238 0 0) 0x7f1b741fc630 con 0x7f1b741639c0 2026-02-12T03:58:47.928 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.906+0000 7f1b537fe640 1 -- 10.20.193.91:0/934231211 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1b741fc350 con 0x7f1b741639c0 2026-02-12T03:58:47.928 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.908+0000 7f9f0effd640 10 client.?.objecter ms_handle_connect 0x7f9f280afe70 2026-02-12T03:58:47.928 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.908+0000 7f9f0effd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:47.928 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.908+0000 7f1b537fe640 1 -- 10.20.193.91:0/934231211 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f1b640033f0 con 0x7f1b741639c0 2026-02-12T03:58:47.928 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.908+0000 7f1b537fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:47.928 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.908+0000 7f1b537fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:47.928 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.908+0000 7f1b537fe640 10 monclient(hunting): dump: 2026-02-12T03:58:47.928 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.928 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.928 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.929 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.929 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.929 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.929 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.929 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.929 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.929 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.929 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.908+0000 7f1b537fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:47.929 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313221 for osd.2 2026-02-12T03:58:47.930 DEBUG:teuthology.parallel:result is None 2026-02-12T03:58:47.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.911+0000 7f1b537fe640 1 -- 10.20.193.91:0/934231211 <== mon.1 v1:10.20.193.98:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3499479494 0 0) 0x7f1b741fc350 con 0x7f1b741639c0 2026-02-12T03:58:47.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.911+0000 7f1b537fe640 1 -- 10.20.193.91:0/934231211 >> v1:10.20.193.111:6789/0 conn(0x7f1b740afe70 legacy=0x7f1b741fe6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.911+0000 7f1b537fe640 1 -- 10.20.193.91:0/934231211 >> v1:10.20.193.91:6789/0 conn(0x7f1b7415f310 legacy=0x7f1b741fd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.911+0000 7f1b537fe640 10 monclient: _finish_hunting 0 2026-02-12T03:58:47.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.911+0000 7f1b537fe640 1 monclient: found mon.b 2026-02-12T03:58:47.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.911+0000 7f1b537fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:47.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.911+0000 7f1b537fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:47.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.911+0000 7f1b537fe640 1 -- 10.20.193.91:0/934231211 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b741fc910 con 0x7f1b741639c0 2026-02-12T03:58:47.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.911+0000 7f1b537fe640 10 monclient: _finish_auth 0 2026-02-12T03:58:47.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.911+0000 7f1b537fe640 10 monclient: _check_auth_tickets 2026-02-12T03:58:47.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.911+0000 7f1b537fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:47.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.911+0000 7f1b79038640 5 monclient: authenticate success, global_id 4618 2026-02-12T03:58:47.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.911+0000 7f1b79038640 10 monclient: _renew_subs 2026-02-12T03:58:47.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.911+0000 7f1b79038640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:47.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.911+0000 7f1b79038640 1 -- 10.20.193.91:0/934231211 --> v1:10.20.193.98:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1b741fcbf0 con 0x7f1b741639c0 2026-02-12T03:58:47.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.911+0000 7f1b79038640 10 client.4618.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:47.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.911+0000 7f1b79038640 10 monclient: _renew_subs 2026-02-12T03:58:47.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.911+0000 7f1b79038640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:47.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.911+0000 7f1b79038640 1 -- 10.20.193.91:0/934231211 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1b741fd1b0 con 0x7f1b741639c0 2026-02-12T03:58:47.931 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.911+0000 7f1b79038640 1 librados: init done 2026-02-12T03:58:47.931 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.911+0000 7f9f0effd640 1 -- 10.20.193.91:0/4237945326 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1495776198 0 0) 0x7f9ef4003610 con 0x7f9f2815f310 2026-02-12T03:58:47.931 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.911+0000 7f9f0effd640 1 -- 10.20.193.91:0/4237945326 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9f28133f00 con 0x7f9f2815f310 2026-02-12T03:58:47.931 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.911+0000 7f9f0effd640 1 -- 10.20.193.91:0/4237945326 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f9f100040d0 con 0x7f9f2815f310 2026-02-12T03:58:47.931 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.911+0000 7f9f0effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:47.931 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.911+0000 7f9f0effd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:47.931 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.911+0000 7f9f0effd640 10 monclient(hunting): dump: 2026-02-12T03:58:47.931 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.931 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.931 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.931 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.931 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.931 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.931 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.931 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.931 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.931 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.931 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.911+0000 7f9f0effd640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:47.932 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.912+0000 7f1b79038640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:47.932 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.912+0000 7f1b79038640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:47.932 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.912+0000 7f1b79038640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:47.932 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.912+0000 7f1b79038640 1 -- 10.20.193.91:0/934231211 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b74164070 con 0x7f1b741639c0 2026-02-12T03:58:47.932 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.915+0000 7fdb6d6c4640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-12T03:58:47.932 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.915+0000 7fdb6d6c4640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-12T03:58:47.932 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.915+0000 7fdb6d6c4640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:47.932 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.915+0000 7fdb6d6c4640 1 -- 10.20.193.91:0/4125666078 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fdb680b9510 con 0x7fdb680b57a0 2026-02-12T03:58:47.932 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.921+0000 7f4a32dd8640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-12T03:58:47.932 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.921+0000 7f4a32dd8640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-12T03:58:47.932 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.921+0000 7f4a32dd8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:47.932 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.921+0000 7f4a32dd8640 1 -- 10.20.193.91:0/385266500 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 12} v 0) -- 0x7f4a2c15d8a0 con 0x7f4a2c166f70 2026-02-12T03:58:47.933 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.931+0000 7f142f7fe640 1 -- 10.20.193.91:0/2867776790 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f144405e1f0 con 0x7f14500afe70 2026-02-12T03:58:47.933 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.931+0000 7f142f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:47.933 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.931+0000 7f142f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:47.951 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.949+0000 7f3ca00e5640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-12T03:58:47.951 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.949+0000 7f3ca00e5640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-12T03:58:47.951 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.949+0000 7f3ca00e5640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:47.951 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.950+0000 7f3ca00e5640 1 -- 10.20.193.91:0/3002491663 --> v1:10.20.193.111:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f3c9815fd00 con 0x7f3c980560d0 2026-02-12T03:58:47.952 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.951+0000 7f5879763640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-12T03:58:47.952 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.951+0000 7f5879763640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-12T03:58:47.952 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.951+0000 7f5879763640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:47.952 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.951+0000 7f5879763640 1 -- 10.20.193.91:0/2261743271 --> v1:10.20.193.111:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f58741555e0 con 0x7f58740560d0 2026-02-12T03:58:47.961 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.959+0000 7fdb477fe640 1 -- 10.20.193.91:0/4125666078 <== mon.0 v1:10.20.193.91:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 1257367751) 0x7fdb5c05eed0 con 0x7fdb680b57a0 2026-02-12T03:58:47.961 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.959+0000 7fdb477fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-12T03:58:47.961 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.959+0000 7fdb477fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:47.962 INFO:teuthology.orchestra.run.trial091.stdout:90194313220 2026-02-12T03:58:47.964 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.962+0000 7fdb6d6c4640 10 librados: watch_flush enter 2026-02-12T03:58:47.964 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.962+0000 7fdb6d6c4640 10 librados: watch_flush exit 2026-02-12T03:58:47.964 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.962+0000 7fdb6d6c4640 20 client.4605.objecter shutdown clearing up homeless session... 2026-02-12T03:58:47.964 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.962+0000 7fdb6d6c4640 10 client.4605.objecter successfully canceled tick 2026-02-12T03:58:47.964 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.962+0000 7fdb6d6c4640 1 -- 10.20.193.91:0/4125666078 >> v1:10.20.193.91:6800/2929217192 conn(0x7fdb34079d40 legacy=0x7fdb3409a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.964 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.962+0000 7fdb6d6c4640 10 monclient: shutdown 2026-02-12T03:58:47.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.962+0000 7fdb6d6c4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:47.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.962+0000 7fdb6d6c4640 1 -- 10.20.193.91:0/4125666078 >> v1:10.20.193.91:6789/0 conn(0x7fdb680b57a0 legacy=0x7fdb68156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.962+0000 7fdb6d6c4640 1 -- 10.20.193.91:0/4125666078 shutdown_connections 2026-02-12T03:58:47.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.962+0000 7fdb6d6c4640 1 -- 10.20.193.91:0/4125666078 >> 10.20.193.91:0/4125666078 conn(0x7fdb680559c0 msgr2=0x7fdb6815b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:47.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.962+0000 7fdb6d6c4640 1 -- 10.20.193.91:0/4125666078 shutdown_connections 2026-02-12T03:58:47.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.962+0000 7fdb6d6c4640 1 -- 10.20.193.91:0/4125666078 wait complete. 2026-02-12T03:58:47.965 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.962+0000 7fdb6d6c4640 1 librados: shutdown 2026-02-12T03:58:47.971 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.969+0000 7f9f0effd640 10 client.?.objecter ms_handle_connect 0x7f9f281639c0 2026-02-12T03:58:47.971 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.969+0000 7f9f0effd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:47.972 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.971+0000 7f4a217fa640 1 -- 10.20.193.91:0/385266500 <== mon.0 v1:10.20.193.91:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 12}]=0 v0) ==== 75+0+12 (unknown 4263375189 0 1498640560) 0x7f4a2c15d8a0 con 0x7f4a2c166f70 2026-02-12T03:58:47.973 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.971+0000 7f4a217fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 12}] 2026-02-12T03:58:47.973 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.971+0000 7f4a217fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:47.973 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313220 for osd.0 2026-02-12T03:58:47.974 INFO:teuthology.orchestra.run.trial091.stdout:90194313221 2026-02-12T03:58:47.974 DEBUG:teuthology.parallel:result is None 2026-02-12T03:58:47.974 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.973+0000 7f9f0effd640 1 -- 10.20.193.91:0/4237945326 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3289306957 0 0) 0x7f9f281fa5f0 con 0x7f9f281639c0 2026-02-12T03:58:47.975 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.973+0000 7f9f0effd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:47.975 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.973+0000 7f9f0effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:47.975 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.973+0000 7f9f0effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:47.975 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.973+0000 7f9f0effd640 10 monclient(hunting): my global_id is 4614 2026-02-12T03:58:47.975 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.973+0000 7f9f0effd640 1 -- 10.20.193.91:0/4237945326 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ef4003610 con 0x7f9f281639c0 2026-02-12T03:58:47.976 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.974+0000 7f4a32dd8640 10 librados: watch_flush enter 2026-02-12T03:58:47.992 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.974+0000 7f4a32dd8640 10 librados: watch_flush exit 2026-02-12T03:58:47.992 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.974+0000 7f4a32dd8640 20 client.4608.objecter shutdown clearing up homeless session... 2026-02-12T03:58:47.993 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.974+0000 7f4a32dd8640 10 client.4608.objecter successfully canceled tick 2026-02-12T03:58:47.993 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.974+0000 7f4a32dd8640 1 -- 10.20.193.91:0/385266500 >> v1:10.20.193.91:6800/2929217192 conn(0x7f49fc079f30 legacy=0x7f49fc09a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.993 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.974+0000 7f4a32dd8640 10 monclient: shutdown 2026-02-12T03:58:47.993 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.974+0000 7f4a32dd8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:47.993 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.974+0000 7f4a32dd8640 1 -- 10.20.193.91:0/385266500 >> v1:10.20.193.91:6789/0 conn(0x7f4a2c166f70 legacy=0x7f4a2c145730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.993 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.974+0000 7f4a32dd8640 1 -- 10.20.193.91:0/385266500 shutdown_connections 2026-02-12T03:58:47.993 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.974+0000 7f4a32dd8640 1 -- 10.20.193.91:0/385266500 >> 10.20.193.91:0/385266500 conn(0x7f4a2c0bab20 msgr2=0x7f4a2c1666f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:47.993 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.974+0000 7f4a32dd8640 1 -- 10.20.193.91:0/385266500 shutdown_connections 2026-02-12T03:58:47.993 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.974+0000 7f4a32dd8640 1 -- 10.20.193.91:0/385266500 wait complete. 2026-02-12T03:58:47.993 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.974+0000 7f4a32dd8640 1 librados: shutdown 2026-02-12T03:58:47.995 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.978+0000 7f9f0effd640 1 -- 10.20.193.91:0/4237945326 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 302488985 0 0) 0x7f9ef4003610 con 0x7f9f281639c0 2026-02-12T03:58:47.995 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.978+0000 7f9f0effd640 1 -- 10.20.193.91:0/4237945326 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9f281fa5f0 con 0x7f9f281639c0 2026-02-12T03:58:47.995 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.978+0000 7f9f0effd640 1 -- 10.20.193.91:0/4237945326 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f9f180036d0 con 0x7f9f281639c0 2026-02-12T03:58:47.995 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.978+0000 7f9f0effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:47.996 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.978+0000 7f9f0effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:47.996 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.978+0000 7f9f0effd640 10 monclient(hunting): dump: 2026-02-12T03:58:47.996 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:47.996 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:47.996 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.996 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:47.996 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:47.996 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:47.996 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:47.996 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:47.997 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:47.997 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:47.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.980+0000 7f9f0effd640 1 -- 10.20.193.91:0/4237945326 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1145919002 0 0) 0x7f9f281fa5f0 con 0x7f9f281639c0 2026-02-12T03:58:47.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.980+0000 7f9f0effd640 1 -- 10.20.193.91:0/4237945326 >> v1:10.20.193.111:6789/0 conn(0x7f9f280afe70 legacy=0x7f9f2805c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.980+0000 7f9f0effd640 1 -- 10.20.193.91:0/4237945326 >> v1:10.20.193.98:6789/0 conn(0x7f9f2815f310 legacy=0x7f9f2805b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:47.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.980+0000 7f9f0effd640 10 monclient: _finish_hunting 0 2026-02-12T03:58:47.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.980+0000 7f9f0effd640 1 monclient: found mon.a 2026-02-12T03:58:47.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.980+0000 7f9f0effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:47.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.980+0000 7f9f0effd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:47.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.980+0000 7f9f0effd640 1 -- 10.20.193.91:0/4237945326 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f281344c0 con 0x7f9f281639c0 2026-02-12T03:58:47.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.980+0000 7f9f0effd640 10 monclient: _finish_auth 0 2026-02-12T03:58:47.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.980+0000 7f9f0effd640 10 monclient: _check_auth_tickets 2026-02-12T03:58:47.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.980+0000 7f9f0effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:47.998 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.980+0000 7f9f2cc81640 5 monclient: authenticate success, global_id 4614 2026-02-12T03:58:47.998 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.980+0000 7f9f2cc81640 10 monclient: _renew_subs 2026-02-12T03:58:47.998 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.980+0000 7f9f2cc81640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:47.998 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.980+0000 7f9f2cc81640 1 -- 10.20.193.91:0/4237945326 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9f281347a0 con 0x7f9f281639c0 2026-02-12T03:58:47.998 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.980+0000 7f9f2cc81640 10 client.4614.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:47.998 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.980+0000 7f9f2cc81640 10 monclient: _renew_subs 2026-02-12T03:58:47.998 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.980+0000 7f9f2cc81640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:47.998 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.980+0000 7f9f2cc81640 1 -- 10.20.193.91:0/4237945326 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9f28134d60 con 0x7f9f281639c0 2026-02-12T03:58:47.998 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.980+0000 7f9f2cc81640 1 librados: init done 2026-02-12T03:58:47.998 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.980+0000 7f9f2cc81640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:47.998 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.980+0000 7f9f2cc81640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:47.998 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.980+0000 7f9f2cc81640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:47.998 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:47.980+0000 7f9f2cc81640 1 -- 10.20.193.91:0/4237945326 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f28161120 con 0x7f9f281639c0 2026-02-12T03:58:47.999 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313221 for osd.12 2026-02-12T03:58:48.000 DEBUG:teuthology.parallel:result is None 2026-02-12T03:58:48.003 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.001+0000 7f8c0f670640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-12T03:58:48.003 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.001+0000 7f8c0f670640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-12T03:58:48.003 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.001+0000 7f8c0f670640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:48.003 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.001+0000 7f8c0f670640 1 -- 10.20.193.91:0/2072269458 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f8c080b7290 con 0x7f8c08163310 2026-02-12T03:58:48.008 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.006+0000 7f1b537fe640 1 -- 10.20.193.91:0/934231211 <== mon.1 v1:10.20.193.98:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1b64003970 con 0x7f1b741639c0 2026-02-12T03:58:48.008 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.006+0000 7f1b537fe640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:48.008 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.006+0000 7f1b537fe640 1 -- 10.20.193.91:0/934231211 <== mon.1 v1:10.20.193.98:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f1b64003cc0 con 0x7f1b741639c0 2026-02-12T03:58:48.008 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.006+0000 7f1b537fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:48.008 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.006+0000 7f1b537fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:48.008 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.006+0000 7f1b71573640 4 set_mon_vals no callback set 2026-02-12T03:58:48.008 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.006+0000 7f1b537fe640 10 monclient: dump: 2026-02-12T03:58:48.009 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:48.009 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:48.009 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.009 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.009 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:48.009 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:48.009 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:48.009 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:48.009 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:48.009 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:48.010 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.007+0000 7f1b537fe640 1 -- 10.20.193.91:0/934231211 <== mon.1 v1:10.20.193.98:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f1b6401d1a0 con 0x7f1b741639c0 2026-02-12T03:58:48.010 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.007+0000 7f1b72d76640 10 monclient: get_auth_request con 0x7f1b40079ef0 auth_method 0 2026-02-12T03:58:48.010 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.007+0000 7f1b537fe640 10 client.4618.objecter ms_handle_connect 0x7f1b40079ef0 2026-02-12T03:58:48.010 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.008+0000 7f1b537fe640 1 -- 10.20.193.91:0/934231211 <== mon.1 v1:10.20.193.98:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7f1b64094cf0 con 0x7f1b741639c0 2026-02-12T03:58:48.010 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.008+0000 7f1b537fe640 10 client.4618.objecter ms_dispatch2 0x7f1b74000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:48.010 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.008+0000 7f1b537fe640 3 client.4618.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:48.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.008+0000 7f1b537fe640 3 client.4618.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:48.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.008+0000 7f1b537fe640 20 client.4618.objecter dump_active .. 0 homeless 2026-02-12T03:58:48.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.008+0000 7f9ef37fe640 1 -- 10.20.193.91:0/3761149215 <== mon.2 v1:10.20.193.111:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9efc0049f0 con 0x7f9f1415f310 2026-02-12T03:58:48.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.008+0000 7f9ef37fe640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:48.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.008+0000 7f9ef37fe640 1 -- 10.20.193.91:0/3761149215 <== mon.2 v1:10.20.193.111:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f9efc004ba0 con 0x7f9f1415f310 2026-02-12T03:58:48.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.008+0000 7f9ef37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:48.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.008+0000 7f9ef37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:48.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.008+0000 7f9ef37fe640 10 monclient: dump: 2026-02-12T03:58:48.012 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:48.012 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:48.012 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.012 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.012 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:48.012 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:48.012 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:48.012 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:48.012 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:48.012 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:48.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.008+0000 7f9f117fa640 4 set_mon_vals no callback set 2026-02-12T03:58:48.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.009+0000 7f9ef37fe640 1 -- 10.20.193.91:0/3761149215 <== mon.2 v1:10.20.193.111:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f9efc01e080 con 0x7f9f1415f310 2026-02-12T03:58:48.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.009+0000 7f9f12ffd640 10 monclient: get_auth_request con 0x7f9ee0079f10 auth_method 0 2026-02-12T03:58:48.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.009+0000 7f9ef37fe640 10 client.4574.objecter ms_handle_connect 0x7f9ee0079f10 2026-02-12T03:58:48.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.009+0000 7f1b537fe640 1 -- 10.20.193.91:0/934231211 <== mon.1 v1:10.20.193.98:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f1b6405e650 con 0x7f1b741639c0 2026-02-12T03:58:48.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.009+0000 7f1b537fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:48.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.009+0000 7f1b537fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:48.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.011+0000 7f9ef37fe640 1 -- 10.20.193.91:0/3761149215 <== mon.2 v1:10.20.193.111:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7f9efc095cb0 con 0x7f9f1415f310 2026-02-12T03:58:48.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.011+0000 7f9ef37fe640 10 client.4574.objecter ms_dispatch2 0x7f9f14000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:48.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.011+0000 7f9ef37fe640 3 client.4574.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:48.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.011+0000 7f9ef37fe640 3 client.4574.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:48.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.011+0000 7f9ef37fe640 20 client.4574.objecter dump_active .. 0 homeless 2026-02-12T03:58:48.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.014+0000 7f8bf5ffb640 1 -- 10.20.193.91:0/2072269458 <== mon.1 v1:10.20.193.98:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 521551722) 0x7f8c08154480 con 0x7f8c08163310 2026-02-12T03:58:48.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.014+0000 7f8bf5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-12T03:58:48.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.014+0000 7f8bf5ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:48.016 INFO:teuthology.orchestra.run.trial091.stdout:94489280516 2026-02-12T03:58:48.017 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.015+0000 7f58537fe640 1 -- 10.20.193.91:0/2261743271 <== mon.2 v1:10.20.193.111:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+12 (unknown 2894986287 0 1498640560) 0x7f586805f0c0 con 0x7f58740560d0 2026-02-12T03:58:48.017 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.015+0000 7f58537fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 9}] 2026-02-12T03:58:48.017 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.015+0000 7f58537fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:48.017 INFO:teuthology.orchestra.run.trial091.stdout:90194313221 2026-02-12T03:58:48.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.015+0000 7f9ef37fe640 1 -- 10.20.193.91:0/3761149215 <== mon.2 v1:10.20.193.111:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f9efc05f610 con 0x7f9f1415f310 2026-02-12T03:58:48.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.015+0000 7f9ef37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:48.018 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.015+0000 7f9ef37fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:48.019 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.017+0000 7f8c0f670640 10 librados: watch_flush enter 2026-02-12T03:58:48.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.017+0000 7f8c0f670640 10 librados: watch_flush exit 2026-02-12T03:58:48.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.017+0000 7f8c0f670640 20 client.4609.objecter shutdown clearing up homeless session... 2026-02-12T03:58:48.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.017+0000 7f8c0f670640 10 client.4609.objecter successfully canceled tick 2026-02-12T03:58:48.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.017+0000 7f8c0f670640 1 -- 10.20.193.91:0/2072269458 >> v1:10.20.193.91:6800/2929217192 conn(0x7f8bd8079f30 legacy=0x7f8bd809a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:48.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.017+0000 7f8c0f670640 10 monclient: shutdown 2026-02-12T03:58:48.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.017+0000 7f8c0f670640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:48.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.017+0000 7f8c0f670640 1 -- 10.20.193.91:0/2072269458 >> v1:10.20.193.98:6789/0 conn(0x7f8c08163310 legacy=0x7f8c081fe240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:48.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.017+0000 7f8c0f670640 1 -- 10.20.193.91:0/2072269458 shutdown_connections 2026-02-12T03:58:48.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.017+0000 7f8c0f670640 1 -- 10.20.193.91:0/2072269458 >> 10.20.193.91:0/2072269458 conn(0x7f8c080b6560 msgr2=0x7f8c08154df0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:48.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.017+0000 7f8c0f670640 1 -- 10.20.193.91:0/2072269458 shutdown_connections 2026-02-12T03:58:48.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.017+0000 7f8c0f670640 1 -- 10.20.193.91:0/2072269458 wait complete. 2026-02-12T03:58:48.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.017+0000 7f8c0f670640 1 librados: shutdown 2026-02-12T03:58:48.021 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.018+0000 7f5879763640 10 librados: watch_flush enter 2026-02-12T03:58:48.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.018+0000 7f5879763640 10 librados: watch_flush exit 2026-02-12T03:58:48.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.018+0000 7f5879763640 20 client.4562.objecter shutdown clearing up homeless session... 2026-02-12T03:58:48.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.018+0000 7f5879763640 10 client.4562.objecter successfully canceled tick 2026-02-12T03:58:48.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.018+0000 7f5879763640 1 -- 10.20.193.91:0/2261743271 >> v1:10.20.193.91:6800/2929217192 conn(0x7f5840079d80 legacy=0x7f584009a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:48.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.018+0000 7f5879763640 10 monclient: shutdown 2026-02-12T03:58:48.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.018+0000 7f5879763640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:48.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.018+0000 7f5879763640 1 -- 10.20.193.91:0/2261743271 >> v1:10.20.193.111:6789/0 conn(0x7f58740560d0 legacy=0x7f5874151cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:48.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.018+0000 7f5879763640 1 -- 10.20.193.91:0/2261743271 shutdown_connections 2026-02-12T03:58:48.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.018+0000 7f5879763640 1 -- 10.20.193.91:0/2261743271 >> 10.20.193.91:0/2261743271 conn(0x7f58740b6560 msgr2=0x7f58741637a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:48.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.018+0000 7f5879763640 1 -- 10.20.193.91:0/2261743271 shutdown_connections 2026-02-12T03:58:48.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.018+0000 7f5879763640 1 -- 10.20.193.91:0/2261743271 wait complete. 2026-02-12T03:58:48.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.018+0000 7f5879763640 1 librados: shutdown 2026-02-12T03:58:48.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.022+0000 7f3c867fc640 1 -- 10.20.193.91:0/3002491663 <== mon.2 v1:10.20.193.111:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+12 (unknown 3646472635 0 1498640560) 0x7f3c8805ef30 con 0x7f3c980560d0 2026-02-12T03:58:48.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.022+0000 7f3c867fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 10}] 2026-02-12T03:58:48.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.022+0000 7f3c867fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:48.024 INFO:teuthology.orchestra.run.trial091.stdout:90194313221 2026-02-12T03:58:48.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.025+0000 7f3ca00e5640 10 librados: watch_flush enter 2026-02-12T03:58:48.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.025+0000 7f3ca00e5640 10 librados: watch_flush exit 2026-02-12T03:58:48.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.025+0000 7f3ca00e5640 20 client.4559.objecter shutdown clearing up homeless session... 2026-02-12T03:58:48.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.025+0000 7f3ca00e5640 10 client.4559.objecter successfully canceled tick 2026-02-12T03:58:48.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.025+0000 7f3ca00e5640 1 -- 10.20.193.91:0/3002491663 >> v1:10.20.193.91:6800/2929217192 conn(0x7f3c68079ea0 legacy=0x7f3c6809a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:48.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.025+0000 7f3ca00e5640 10 monclient: shutdown 2026-02-12T03:58:48.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.025+0000 7f3ca00e5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:48.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.025+0000 7f3ca00e5640 1 -- 10.20.193.91:0/3002491663 >> v1:10.20.193.111:6789/0 conn(0x7f3c980560d0 legacy=0x7f3c980aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:48.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.025+0000 7f3ca00e5640 1 -- 10.20.193.91:0/3002491663 shutdown_connections 2026-02-12T03:58:48.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.025+0000 7f3ca00e5640 1 -- 10.20.193.91:0/3002491663 >> 10.20.193.91:0/3002491663 conn(0x7f3c980b6560 msgr2=0x7f3c98160220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:48.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.025+0000 7f3ca00e5640 1 -- 10.20.193.91:0/3002491663 shutdown_connections 2026-02-12T03:58:48.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.025+0000 7f3ca00e5640 1 -- 10.20.193.91:0/3002491663 wait complete. 2026-02-12T03:58:48.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.025+0000 7f3ca00e5640 1 librados: shutdown 2026-02-12T03:58:48.030 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280516 got 94489280516 for osd.1 2026-02-12T03:58:48.030 DEBUG:teuthology.parallel:result is None 2026-02-12T03:58:48.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313221 for osd.9 2026-02-12T03:58:48.031 DEBUG:teuthology.parallel:result is None 2026-02-12T03:58:48.036 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313221 for osd.10 2026-02-12T03:58:48.036 DEBUG:teuthology.parallel:result is None 2026-02-12T03:58:48.046 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.044+0000 7f14550ed640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-12T03:58:48.046 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.044+0000 7f14550ed640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-12T03:58:48.046 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.044+0000 7f14550ed640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:48.046 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.044+0000 7f14550ed640 1 -- 10.20.193.91:0/2867776790 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 15} v 0) -- 0x7f145005a0f0 con 0x7f14500afe70 2026-02-12T03:58:48.081 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.079+0000 7f9f0effd640 1 -- 10.20.193.91:0/4237945326 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9f18003870 con 0x7f9f281639c0 2026-02-12T03:58:48.081 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.079+0000 7f9f0effd640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:48.081 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.079+0000 7f9f0effd640 1 -- 10.20.193.91:0/4237945326 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f9f18005060 con 0x7f9f281639c0 2026-02-12T03:58:48.081 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.079+0000 7f9f0effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:48.081 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.079+0000 7f9f0effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:48.081 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.079+0000 7f9f24d72640 4 set_mon_vals no callback set 2026-02-12T03:58:48.082 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.079+0000 7f9f0effd640 10 monclient: dump: 2026-02-12T03:58:48.082 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:48.082 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:48.082 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.082 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.082 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:48.082 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:48.082 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:48.082 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:48.082 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:48.082 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:48.083 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.079+0000 7f9f0effd640 1 -- 10.20.193.91:0/4237945326 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f9f1801e540 con 0x7f9f281639c0 2026-02-12T03:58:48.083 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.080+0000 7f9f26575640 10 monclient: get_auth_request con 0x7f9ef407a010 auth_method 0 2026-02-12T03:58:48.083 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.080+0000 7f9f0effd640 10 client.4614.objecter ms_handle_connect 0x7f9ef407a010 2026-02-12T03:58:48.084 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.082+0000 7f9f0effd640 1 -- 10.20.193.91:0/4237945326 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(28..28 src has 1..28) ==== 8169+0+0 (unknown 3713564641 0 0) 0x7f9f18095da0 con 0x7f9f281639c0 2026-02-12T03:58:48.085 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.082+0000 7f9f0effd640 10 client.4614.objecter ms_dispatch2 0x7f9f28000b90 osd_map(28..28 src has 1..28) 2026-02-12T03:58:48.085 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.082+0000 7f9f0effd640 3 client.4614.objecter handle_osd_map got epochs [28,28] > 0 2026-02-12T03:58:48.085 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.082+0000 7f9f0effd640 3 client.4614.objecter handle_osd_map decoding full epoch 28 2026-02-12T03:58:48.085 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.083+0000 7f9f0effd640 20 client.4614.objecter dump_active .. 0 homeless 2026-02-12T03:58:48.085 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.083+0000 7f9f0effd640 1 -- 10.20.193.91:0/4237945326 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f9f1805f700 con 0x7f9f281639c0 2026-02-12T03:58:48.085 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.083+0000 7f9f0effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:48.085 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.083+0000 7f9f0effd640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:48.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.089+0000 7f142f7fe640 1 -- 10.20.193.91:0/2867776790 <== mon.0 v1:10.20.193.91:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 15}]=0 v0) ==== 75+0+12 (unknown 2221946896 0 3956125152) 0x7f144405daf0 con 0x7f14500afe70 2026-02-12T03:58:48.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.089+0000 7f142f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 15}] 2026-02-12T03:58:48.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.089+0000 7f142f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:48.091 INFO:teuthology.orchestra.run.trial091.stdout:94489280518 2026-02-12T03:58:48.094 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.091+0000 7f14550ed640 10 librados: watch_flush enter 2026-02-12T03:58:48.094 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.091+0000 7f14550ed640 10 librados: watch_flush exit 2026-02-12T03:58:48.094 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.091+0000 7f14550ed640 20 client.4611.objecter shutdown clearing up homeless session... 2026-02-12T03:58:48.094 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.091+0000 7f14550ed640 10 client.4611.objecter successfully canceled tick 2026-02-12T03:58:48.094 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.092+0000 7f14550ed640 1 -- 10.20.193.91:0/2867776790 >> v1:10.20.193.91:6800/2929217192 conn(0x7f141c079fe0 legacy=0x7f141c09a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:48.094 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.092+0000 7f14550ed640 10 monclient: shutdown 2026-02-12T03:58:48.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.092+0000 7f14550ed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:48.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.092+0000 7f14550ed640 1 -- 10.20.193.91:0/2867776790 >> v1:10.20.193.91:6789/0 conn(0x7f14500afe70 legacy=0x7f14500b2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:48.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.092+0000 7f14550ed640 1 -- 10.20.193.91:0/2867776790 shutdown_connections 2026-02-12T03:58:48.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.092+0000 7f14550ed640 1 -- 10.20.193.91:0/2867776790 >> 10.20.193.91:0/2867776790 conn(0x7f14500b6560 msgr2=0x7f145015d900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:48.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.092+0000 7f14550ed640 1 -- 10.20.193.91:0/2867776790 shutdown_connections 2026-02-12T03:58:48.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.092+0000 7f14550ed640 1 -- 10.20.193.91:0/2867776790 wait complete. 2026-02-12T03:58:48.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.092+0000 7f14550ed640 1 librados: shutdown 2026-02-12T03:58:48.104 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280518 got 94489280518 for osd.15 2026-02-12T03:58:48.104 DEBUG:teuthology.parallel:result is None 2026-02-12T03:58:48.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.120+0000 7f1b79038640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-12T03:58:48.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.120+0000 7f1b79038640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-12T03:58:48.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.120+0000 7f1b79038640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T03:58:48.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.120+0000 7f1b79038640 1 -- 10.20.193.91:0/934231211 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 13} v 0) -- 0x7f1b7405a0f0 con 0x7f1b741639c0 2026-02-12T03:58:48.125 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.123+0000 7f9f19345640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-12T03:58:48.125 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.123+0000 7f9f19345640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-12T03:58:48.126 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.123+0000 7f9f19345640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:48.126 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.123+0000 7f9f19345640 1 -- 10.20.193.91:0/3761149215 --> v1:10.20.193.111:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f9f141635c0 con 0x7f9f1415f310 2026-02-12T03:58:48.129 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.127+0000 7f1b537fe640 1 -- 10.20.193.91:0/934231211 <== mon.1 v1:10.20.193.98:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 13}]=0 v0) ==== 75+0+12 (unknown 3988744482 0 1257367751) 0x7f1b6405df50 con 0x7f1b741639c0 2026-02-12T03:58:48.129 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.127+0000 7f1b537fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 13}] 2026-02-12T03:58:48.129 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.127+0000 7f1b537fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:48.130 INFO:teuthology.orchestra.run.trial091.stdout:90194313220 2026-02-12T03:58:48.131 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.130+0000 7f9ef37fe640 1 -- 10.20.193.91:0/3761149215 <== mon.2 v1:10.20.193.111:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 1498640560) 0x7f9efc05ef10 con 0x7f9f1415f310 2026-02-12T03:58:48.132 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.130+0000 7f9ef37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-12T03:58:48.132 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.130+0000 7f9ef37fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:48.132 INFO:teuthology.orchestra.run.trial091.stdout:90194313221 2026-02-12T03:58:48.133 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.130+0000 7f1b79038640 10 librados: watch_flush enter 2026-02-12T03:58:48.133 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.130+0000 7f1b79038640 10 librados: watch_flush exit 2026-02-12T03:58:48.134 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.130+0000 7f1b79038640 20 client.4618.objecter shutdown clearing up homeless session... 2026-02-12T03:58:48.134 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.130+0000 7f1b79038640 10 client.4618.objecter successfully canceled tick 2026-02-12T03:58:48.134 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.130+0000 7f1b79038640 1 -- 10.20.193.91:0/934231211 >> v1:10.20.193.91:6800/2929217192 conn(0x7f1b40079ef0 legacy=0x7f1b4009a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:48.134 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.130+0000 7f1b79038640 10 monclient: shutdown 2026-02-12T03:58:48.134 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.130+0000 7f1b79038640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:48.134 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.130+0000 7f1b79038640 1 -- 10.20.193.91:0/934231211 >> v1:10.20.193.98:6789/0 conn(0x7f1b741639c0 legacy=0x7f1b74154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:48.134 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.130+0000 7f1b79038640 1 -- 10.20.193.91:0/934231211 shutdown_connections 2026-02-12T03:58:48.134 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.130+0000 7f1b79038640 1 -- 10.20.193.91:0/934231211 >> 10.20.193.91:0/934231211 conn(0x7f1b740b6560 msgr2=0x7f1b741561c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:48.134 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.130+0000 7f1b79038640 1 -- 10.20.193.91:0/934231211 shutdown_connections 2026-02-12T03:58:48.134 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.130+0000 7f1b79038640 1 -- 10.20.193.91:0/934231211 wait complete. 2026-02-12T03:58:48.135 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.130+0000 7f1b79038640 1 librados: shutdown 2026-02-12T03:58:48.136 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.132+0000 7f9f19345640 10 librados: watch_flush enter 2026-02-12T03:58:48.136 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.132+0000 7f9f19345640 10 librados: watch_flush exit 2026-02-12T03:58:48.136 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.132+0000 7f9f19345640 20 client.4574.objecter shutdown clearing up homeless session... 2026-02-12T03:58:48.136 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.132+0000 7f9f19345640 10 client.4574.objecter successfully canceled tick 2026-02-12T03:58:48.136 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.132+0000 7f9f19345640 1 -- 10.20.193.91:0/3761149215 >> v1:10.20.193.91:6800/2929217192 conn(0x7f9ee0079f10 legacy=0x7f9ee009a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:48.137 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.132+0000 7f9f19345640 10 monclient: shutdown 2026-02-12T03:58:48.137 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.132+0000 7f9f19345640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:48.137 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.132+0000 7f9f19345640 1 -- 10.20.193.91:0/3761149215 >> v1:10.20.193.111:6789/0 conn(0x7f9f1415f310 legacy=0x7f9f14154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:48.137 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.132+0000 7f9f19345640 1 -- 10.20.193.91:0/3761149215 shutdown_connections 2026-02-12T03:58:48.137 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.132+0000 7f9f19345640 1 -- 10.20.193.91:0/3761149215 >> 10.20.193.91:0/3761149215 conn(0x7f9f140b6560 msgr2=0x7f9f140af1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:48.137 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.133+0000 7f9f19345640 1 -- 10.20.193.91:0/3761149215 shutdown_connections 2026-02-12T03:58:48.137 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.133+0000 7f9f19345640 1 -- 10.20.193.91:0/3761149215 wait complete. 2026-02-12T03:58:48.137 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.133+0000 7f9f19345640 1 librados: shutdown 2026-02-12T03:58:48.141 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313220 got 90194313220 for osd.13 2026-02-12T03:58:48.142 DEBUG:teuthology.parallel:result is None 2026-02-12T03:58:48.143 INFO:tasks.ceph.ceph_manager.ceph:need seq 90194313221 got 90194313221 for osd.5 2026-02-12T03:58:48.143 DEBUG:teuthology.parallel:result is None 2026-02-12T03:58:48.203 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.201+0000 7f9f2cc81640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-12T03:58:48.203 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.201+0000 7f9f2cc81640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-12T03:58:48.204 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.201+0000 7f9f2cc81640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:48.204 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.201+0000 7f9f2cc81640 1 -- 10.20.193.91:0/4237945326 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f9f28136ea0 con 0x7f9f281639c0 2026-02-12T03:58:48.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.205+0000 7f9f0effd640 1 -- 10.20.193.91:0/4237945326 <== mon.0 v1:10.20.193.91:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+12 (unknown 3405404620 0 213165853) 0x7f9f1805f000 con 0x7f9f281639c0 2026-02-12T03:58:48.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.205+0000 7f9f0effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 11}] 2026-02-12T03:58:48.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.205+0000 7f9f0effd640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:48.207 INFO:teuthology.orchestra.run.trial091.stdout:94489280517 2026-02-12T03:58:48.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.207+0000 7f9f2cc81640 10 librados: watch_flush enter 2026-02-12T03:58:48.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.207+0000 7f9f2cc81640 10 librados: watch_flush exit 2026-02-12T03:58:48.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.207+0000 7f9f2cc81640 20 client.4614.objecter shutdown clearing up homeless session... 2026-02-12T03:58:48.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.207+0000 7f9f2cc81640 10 client.4614.objecter successfully canceled tick 2026-02-12T03:58:48.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.207+0000 7f9f2cc81640 1 -- 10.20.193.91:0/4237945326 >> v1:10.20.193.91:6800/2929217192 conn(0x7f9ef407a010 legacy=0x7f9ef409a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:48.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.207+0000 7f9f2cc81640 10 monclient: shutdown 2026-02-12T03:58:48.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.207+0000 7f9f2cc81640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:48.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.207+0000 7f9f2cc81640 1 -- 10.20.193.91:0/4237945326 >> v1:10.20.193.91:6789/0 conn(0x7f9f281639c0 legacy=0x7f9f281f9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:48.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.207+0000 7f9f2cc81640 1 -- 10.20.193.91:0/4237945326 shutdown_connections 2026-02-12T03:58:48.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.207+0000 7f9f2cc81640 1 -- 10.20.193.91:0/4237945326 >> 10.20.193.91:0/4237945326 conn(0x7f9f280b6560 msgr2=0x7f9f28155d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:48.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.207+0000 7f9f2cc81640 1 -- 10.20.193.91:0/4237945326 shutdown_connections 2026-02-12T03:58:48.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.207+0000 7f9f2cc81640 1 -- 10.20.193.91:0/4237945326 wait complete. 2026-02-12T03:58:48.211 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.207+0000 7f9f2cc81640 1 librados: shutdown 2026-02-12T03:58:48.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 94489280517 got 94489280517 for osd.11 2026-02-12T03:58:48.218 DEBUG:teuthology.parallel:result is None 2026-02-12T03:58:48.219 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-12T03:58:48.219 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T03:58:48.289 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.285+0000 7f12a481d640 10 monclient: get_monmap_and_config 2026-02-12T03:58:48.289 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.285+0000 7f12a481d640 10 monclient: build_initial_monmap 2026-02-12T03:58:48.289 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.285+0000 7f12a481d640 10 monclient: monmap: 2026-02-12T03:58:48.290 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:48.290 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:48.290 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:48.286342+0000 2026-02-12T03:58:48.290 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:48.286342+0000 2026-02-12T03:58:48.290 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:48.290 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:48.290 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:48.290 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:48.290 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:48.290 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:48.290 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.286+0000 7f12a481d640 1 Processor -- start 2026-02-12T03:58:48.290 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.286+0000 7f12a481d640 1 -- start start 2026-02-12T03:58:48.291 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.286+0000 7f12a481d640 10 monclient: init 2026-02-12T03:58:48.291 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.286+0000 7f12a481d640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:48.291 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.286+0000 7f12a481d640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T03:58:48.291 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.286+0000 7f12a481d640 10 monclient(hunting): picked mon.noname-a con 0x7f129c1575d0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:48.291 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.286+0000 7f12a481d640 10 monclient(hunting): picked mon.noname-c con 0x7f129c163310 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:48.291 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.286+0000 7f12a481d640 10 monclient(hunting): picked mon.noname-b con 0x7f129c0560d0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:48.291 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.286+0000 7f12a481d640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f129c0b20b0 con 0x7f129c1575d0 2026-02-12T03:58:48.291 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.286+0000 7f12a481d640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f129c0b2390 con 0x7f129c0560d0 2026-02-12T03:58:48.291 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.286+0000 7f12a481d640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f129c0b2670 con 0x7f129c163310 2026-02-12T03:58:48.291 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.286+0000 7f12a481d640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:48.291 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.286+0000 7f12a481d640 10 monclient(hunting): authenticate will time out at 1131.029893s 2026-02-12T03:58:48.292 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.287+0000 7f12a2592640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f129c1575d0 0x7f129c162c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:59886/0 (socket says 10.20.193.91:59886) 2026-02-12T03:58:48.292 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.287+0000 7f12a2592640 1 -- 10.20.193.91:0/4274909960 learned_addr learned my addr 10.20.193.91:0/4274909960 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:48.296 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.288+0000 7f12a1590640 1 -- 10.20.193.91:0/4274909960 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4208722206 0 0) 0x7f129c0b20b0 con 0x7f129c1575d0 2026-02-12T03:58:48.296 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.288+0000 7f12a1590640 10 monclient(hunting): _negotiate 2026-02-12T03:58:48.296 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.288+0000 7f12a1590640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:48.296 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.288+0000 7f12a1590640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:48.297 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.288+0000 7f12a1590640 10 monclient(hunting): my global_id is 4617 2026-02-12T03:58:48.297 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.288+0000 7f12a1590640 1 -- 10.20.193.91:0/4274909960 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f128c003610 con 0x7f129c1575d0 2026-02-12T03:58:48.297 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.288+0000 7f12a1590640 1 -- 10.20.193.91:0/4274909960 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3432345980 0 0) 0x7f129c0b2390 con 0x7f129c0560d0 2026-02-12T03:58:48.297 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.288+0000 7f12a1590640 10 monclient(hunting): _negotiate 2026-02-12T03:58:48.297 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.288+0000 7f12a1590640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:48.297 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.288+0000 7f12a1590640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:48.297 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.288+0000 7f12a1590640 10 monclient(hunting): my global_id is 4624 2026-02-12T03:58:48.297 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.288+0000 7f12a1590640 1 -- 10.20.193.91:0/4274909960 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f129c0b20b0 con 0x7f129c0560d0 2026-02-12T03:58:48.297 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.289+0000 7f12a1590640 1 -- 10.20.193.91:0/4274909960 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2107879014 0 0) 0x7f129c0b2670 con 0x7f129c163310 2026-02-12T03:58:48.297 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.289+0000 7f12a1590640 10 monclient(hunting): _negotiate 2026-02-12T03:58:48.297 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.289+0000 7f12a1590640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:48.297 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.289+0000 7f12a1590640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:48.298 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.289+0000 7f12a1590640 10 monclient(hunting): my global_id is 4580 2026-02-12T03:58:48.298 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.289+0000 7f12a1590640 1 -- 10.20.193.91:0/4274909960 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f129c0b2390 con 0x7f129c163310 2026-02-12T03:58:48.298 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.290+0000 7f12a1590640 1 -- 10.20.193.91:0/4274909960 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4012163296 0 0) 0x7f129c0b20b0 con 0x7f129c0560d0 2026-02-12T03:58:48.298 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.290+0000 7f12a1590640 1 -- 10.20.193.91:0/4274909960 >> v1:10.20.193.111:6789/0 conn(0x7f129c163310 legacy=0x7f129c0559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:48.298 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.290+0000 7f12a1590640 1 -- 10.20.193.91:0/4274909960 >> v1:10.20.193.91:6789/0 conn(0x7f129c1575d0 legacy=0x7f129c162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:48.298 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.290+0000 7f12a1590640 10 monclient: _finish_hunting 0 2026-02-12T03:58:48.298 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.290+0000 7f12a1590640 1 monclient: found mon.noname-b 2026-02-12T03:58:48.298 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.290+0000 7f12a1590640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:48.298 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.290+0000 7f12a1590640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T03:58:48.298 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.290+0000 7f12a1590640 1 -- 10.20.193.91:0/4274909960 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f129c162400 con 0x7f129c0560d0 2026-02-12T03:58:48.298 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.290+0000 7f12a1590640 10 monclient: _finish_auth 0 2026-02-12T03:58:48.298 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.290+0000 7f12a1590640 10 monclient: _check_auth_tickets 2026-02-12T03:58:48.299 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.290+0000 7f12a1590640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:48.299 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.290+0000 7f12a1590640 1 -- 10.20.193.91:0/4274909960 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f1290003170 con 0x7f129c0560d0 2026-02-12T03:58:48.299 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.290+0000 7f12a481d640 5 monclient: authenticate success, global_id 4624 2026-02-12T03:58:48.299 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.290+0000 7f12a481d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:48.299 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.290+0000 7f12a1590640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:48.299 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.290+0000 7f12a1590640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:48.299 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.290+0000 7f12a1590640 10 monclient: dump: 2026-02-12T03:58:48.299 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:48.299 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:48.299 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.299 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.299 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:48.300 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:48.300 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:48.300 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:48.300 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:48.300 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:48.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.290+0000 7f12a481d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:48.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.291+0000 7f12a1590640 1 -- 10.20.193.91:0/4274909960 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1290003340 con 0x7f129c0560d0 2026-02-12T03:58:48.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.291+0000 7f12a1590640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:48.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.291+0000 7f12a1590640 1 -- 10.20.193.91:0/4274909960 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f1290003780 con 0x7f129c0560d0 2026-02-12T03:58:48.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.291+0000 7f12a1590640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:48.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.291+0000 7f12a1590640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:48.300 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.291+0000 7f12a1590640 10 monclient: dump: 2026-02-12T03:58:48.301 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:48.301 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:48.301 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.301 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.301 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:48.301 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:48.301 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:48.301 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:48.301 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:48.301 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:48.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.291+0000 7f12a481d640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:48.301 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.291+0000 7f12a481d640 4 set_mon_vals no callback set 2026-02-12T03:58:48.302 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.292+0000 7f12a481d640 10 monclient: shutdown 2026-02-12T03:58:48.302 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.292+0000 7f12a481d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:48.302 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.292+0000 7f12a481d640 1 -- 10.20.193.91:0/4274909960 >> v1:10.20.193.98:6789/0 conn(0x7f129c0560d0 legacy=0x7f129c1c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:48.302 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.292+0000 7f12a481d640 1 -- 10.20.193.91:0/4274909960 shutdown_connections 2026-02-12T03:58:48.302 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.292+0000 7f12a481d640 1 -- 10.20.193.91:0/4274909960 >> 10.20.193.91:0/4274909960 conn(0x7f129c0b6560 msgr2=0x7f129c0b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:48.302 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.292+0000 7f12a481d640 1 -- 10.20.193.91:0/4274909960 shutdown_connections 2026-02-12T03:58:48.302 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.292+0000 7f12a481d640 1 -- 10.20.193.91:0/4274909960 wait complete. 2026-02-12T03:58:48.302 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.292+0000 7f12a481d640 10 monclient: build_initial_monmap 2026-02-12T03:58:48.302 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.292+0000 7f12a481d640 10 monclient: monmap: 2026-02-12T03:58:48.302 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:48.302 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:48.302 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:48.303 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:48.303 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:48.303 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:48.303 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:48.303 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:48.303 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:48.303 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:48.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.292+0000 7f12a481d640 1 librados: starting msgr at 2026-02-12T03:58:48.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.293+0000 7f12a481d640 1 librados: starting objecter 2026-02-12T03:58:48.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.293+0000 7f12a481d640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:48.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.293+0000 7f12a481d640 1 Processor -- start 2026-02-12T03:58:48.303 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.293+0000 7f12a481d640 1 -- start start 2026-02-12T03:58:48.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.293+0000 7f12a481d640 1 librados: setting wanted keys 2026-02-12T03:58:48.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.293+0000 7f12a481d640 1 librados: calling monclient init 2026-02-12T03:58:48.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.293+0000 7f12a481d640 10 monclient: init 2026-02-12T03:58:48.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.293+0000 7f12a481d640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:48.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.293+0000 7f12a481d640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T03:58:48.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.293+0000 7f12a481d640 10 monclient(hunting): picked mon.noname-a con 0x7f129c0560d0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:48.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.293+0000 7f12a481d640 10 monclient(hunting): picked mon.noname-b con 0x7f129c1575d0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:48.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.293+0000 7f12a481d640 10 monclient(hunting): picked mon.noname-c con 0x7f129c163310 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:48.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.293+0000 7f12a481d640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f129c11d510 con 0x7f129c0560d0 2026-02-12T03:58:48.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.293+0000 7f12a481d640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f129c05d230 con 0x7f129c1575d0 2026-02-12T03:58:48.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.293+0000 7f12a481d640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f129c05d510 con 0x7f129c163310 2026-02-12T03:58:48.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.293+0000 7f12a481d640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:48.305 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.293+0000 7f12a481d640 10 monclient(hunting): authenticate will time out at 1131.036551s 2026-02-12T03:58:48.305 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.293+0000 7f12a2592640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f129c0560d0 0x7f129c160330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:59898/0 (socket says 10.20.193.91:59898) 2026-02-12T03:58:48.305 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.293+0000 7f12a2592640 1 -- 10.20.193.91:0/108858163 learned_addr learned my addr 10.20.193.91:0/108858163 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:48.305 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.294+0000 7f1286ffd640 10 client.?.objecter ms_handle_connect 0x7f129c0560d0 2026-02-12T03:58:48.305 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.294+0000 7f1286ffd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:48.305 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.294+0000 7f1286ffd640 10 client.?.objecter ms_handle_connect 0x7f129c163310 2026-02-12T03:58:48.305 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.294+0000 7f1286ffd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:48.305 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.294+0000 7f1286ffd640 10 client.?.objecter ms_handle_connect 0x7f129c1575d0 2026-02-12T03:58:48.305 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.294+0000 7f1286ffd640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:48.308 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.295+0000 7f1286ffd640 1 -- 10.20.193.91:0/108858163 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 139154512 0 0) 0x7f129c11d510 con 0x7f129c0560d0 2026-02-12T03:58:48.308 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.295+0000 7f1286ffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:48.309 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.295+0000 7f1286ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:48.309 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.295+0000 7f1286ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:48.309 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.295+0000 7f1286ffd640 10 monclient(hunting): my global_id is 4620 2026-02-12T03:58:48.309 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.295+0000 7f1286ffd640 1 -- 10.20.193.91:0/108858163 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f126c003610 con 0x7f129c0560d0 2026-02-12T03:58:48.309 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.295+0000 7f1286ffd640 1 -- 10.20.193.91:0/108858163 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3077929558 0 0) 0x7f129c05d510 con 0x7f129c163310 2026-02-12T03:58:48.309 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.295+0000 7f1286ffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:48.309 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.295+0000 7f1286ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:48.309 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.295+0000 7f1286ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:48.309 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.295+0000 7f1286ffd640 10 monclient(hunting): my global_id is 4583 2026-02-12T03:58:48.309 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.295+0000 7f1286ffd640 1 -- 10.20.193.91:0/108858163 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f129c11d510 con 0x7f129c163310 2026-02-12T03:58:48.309 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.295+0000 7f1286ffd640 1 -- 10.20.193.91:0/108858163 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 249814222 0 0) 0x7f129c05d230 con 0x7f129c1575d0 2026-02-12T03:58:48.310 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.295+0000 7f1286ffd640 10 monclient(hunting): _negotiate 2026-02-12T03:58:48.310 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.295+0000 7f1286ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:48.310 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.295+0000 7f1286ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:48.310 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.295+0000 7f1286ffd640 10 monclient(hunting): my global_id is 4627 2026-02-12T03:58:48.310 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.295+0000 7f1286ffd640 1 -- 10.20.193.91:0/108858163 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f129c05d510 con 0x7f129c1575d0 2026-02-12T03:58:48.310 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.297+0000 7f1286ffd640 1 -- 10.20.193.91:0/108858163 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2018351181 0 0) 0x7f126c003610 con 0x7f129c0560d0 2026-02-12T03:58:48.310 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.297+0000 7f1286ffd640 1 -- 10.20.193.91:0/108858163 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f129c05d230 con 0x7f129c0560d0 2026-02-12T03:58:48.310 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.297+0000 7f1286ffd640 1 -- 10.20.193.91:0/108858163 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f12940030b0 con 0x7f129c0560d0 2026-02-12T03:58:48.311 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.297+0000 7f1286ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:48.311 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.297+0000 7f1286ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:48.311 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.297+0000 7f1286ffd640 10 monclient(hunting): dump: 2026-02-12T03:58:48.311 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:48.311 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:48.311 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.311 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.311 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:48.311 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:48.312 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:48.312 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:48.312 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:48.312 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:48.312 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.297+0000 7f1286ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:48.312 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.298+0000 7f1286ffd640 1 -- 10.20.193.91:0/108858163 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2806868942 0 0) 0x7f129c11d510 con 0x7f129c163310 2026-02-12T03:58:48.312 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.298+0000 7f1286ffd640 1 -- 10.20.193.91:0/108858163 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f126c003610 con 0x7f129c163310 2026-02-12T03:58:48.312 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.298+0000 7f1286ffd640 1 -- 10.20.193.91:0/108858163 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f1290003690 con 0x7f129c163310 2026-02-12T03:58:48.312 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.298+0000 7f1286ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:48.312 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.298+0000 7f1286ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:48.312 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.298+0000 7f1286ffd640 10 monclient(hunting): dump: 2026-02-12T03:58:48.313 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:48.313 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:48.313 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.313 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.313 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:48.313 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:48.313 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:48.313 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:48.313 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:48.313 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:48.313 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.298+0000 7f1286ffd640 1 -- 10.20.193.91:0/108858163 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1766347265 0 0) 0x7f129c05d510 con 0x7f129c1575d0 2026-02-12T03:58:48.313 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.298+0000 7f1286ffd640 1 -- 10.20.193.91:0/108858163 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f129c11d510 con 0x7f129c1575d0 2026-02-12T03:58:48.314 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.298+0000 7f1286ffd640 1 -- 10.20.193.91:0/108858163 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f1288002f30 con 0x7f129c1575d0 2026-02-12T03:58:48.314 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.298+0000 7f1286ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:48.314 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.298+0000 7f1286ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:48.314 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.298+0000 7f1286ffd640 10 monclient(hunting): dump: 2026-02-12T03:58:48.314 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:48.314 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:48.314 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.314 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.314 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:48.314 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:48.314 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:48.314 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:48.315 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:48.315 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:48.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.299+0000 7f1286ffd640 1 -- 10.20.193.91:0/108858163 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3073446061 0 0) 0x7f129c05d230 con 0x7f129c0560d0 2026-02-12T03:58:48.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.299+0000 7f1286ffd640 1 -- 10.20.193.91:0/108858163 >> v1:10.20.193.111:6789/0 conn(0x7f129c163310 legacy=0x7f129c11ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:48.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.299+0000 7f1286ffd640 1 -- 10.20.193.91:0/108858163 >> v1:10.20.193.98:6789/0 conn(0x7f129c1575d0 legacy=0x7f129c0b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:48.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.299+0000 7f1286ffd640 10 monclient: _finish_hunting 0 2026-02-12T03:58:48.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.299+0000 7f1286ffd640 1 monclient: found mon.a 2026-02-12T03:58:48.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.299+0000 7f1286ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:48.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.299+0000 7f1286ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:48.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.299+0000 7f1286ffd640 1 -- 10.20.193.91:0/108858163 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f129c142d90 con 0x7f129c0560d0 2026-02-12T03:58:48.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.299+0000 7f1286ffd640 10 monclient: _finish_auth 0 2026-02-12T03:58:48.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.299+0000 7f1286ffd640 10 monclient: _check_auth_tickets 2026-02-12T03:58:48.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.299+0000 7f1286ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:48.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.299+0000 7f12a481d640 5 monclient: authenticate success, global_id 4620 2026-02-12T03:58:48.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.299+0000 7f12a481d640 10 monclient: _renew_subs 2026-02-12T03:58:48.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.299+0000 7f12a481d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:48.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.299+0000 7f12a481d640 1 -- 10.20.193.91:0/108858163 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f129c143070 con 0x7f129c0560d0 2026-02-12T03:58:48.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.299+0000 7f12a481d640 10 client.4620.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:48.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.299+0000 7f12a481d640 10 monclient: _renew_subs 2026-02-12T03:58:48.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.299+0000 7f12a481d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:48.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.299+0000 7f12a481d640 1 -- 10.20.193.91:0/108858163 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f129c143870 con 0x7f129c0560d0 2026-02-12T03:58:48.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.299+0000 7f12a481d640 1 librados: init done 2026-02-12T03:58:48.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.299+0000 7f12a481d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:48.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.299+0000 7f12a481d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:48.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.299+0000 7f12a481d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:48.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.299+0000 7f12a481d640 1 -- 10.20.193.91:0/108858163 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f129c143b50 con 0x7f129c0560d0 2026-02-12T03:58:48.395 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.393+0000 7f1286ffd640 1 -- 10.20.193.91:0/108858163 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f12940048d0 con 0x7f129c0560d0 2026-02-12T03:58:48.396 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.393+0000 7f1286ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:48.396 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.393+0000 7f1286ffd640 1 -- 10.20.193.91:0/108858163 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f1294004c20 con 0x7f129c0560d0 2026-02-12T03:58:48.396 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.393+0000 7f1286ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:48.396 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.393+0000 7f1286ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:48.396 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.393+0000 7f12a0d8f640 4 set_mon_vals no callback set 2026-02-12T03:58:48.396 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.393+0000 7f1286ffd640 10 monclient: dump: 2026-02-12T03:58:48.396 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:48.396 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:48.397 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.397 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.397 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:48.397 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:48.397 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:48.397 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:48.397 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:48.397 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:48.397 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.394+0000 7f1286ffd640 1 -- 10.20.193.91:0/108858163 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f129401e100 con 0x7f129c0560d0 2026-02-12T03:58:48.398 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.394+0000 7f12a1d91640 10 monclient: get_auth_request con 0x7f126c07a040 auth_method 0 2026-02-12T03:58:48.398 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.394+0000 7f1286ffd640 10 client.4620.objecter ms_handle_connect 0x7f126c07a040 2026-02-12T03:58:48.399 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.396+0000 7f1286ffd640 1 -- 10.20.193.91:0/108858163 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8141+0+0 (unknown 1201408556 0 0) 0x7f1294095b60 con 0x7f129c0560d0 2026-02-12T03:58:48.399 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.396+0000 7f1286ffd640 10 client.4620.objecter ms_dispatch2 0x7f129c000b90 osd_map(29..29 src has 1..29) 2026-02-12T03:58:48.399 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.396+0000 7f1286ffd640 3 client.4620.objecter handle_osd_map got epochs [29,29] > 0 2026-02-12T03:58:48.399 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.396+0000 7f1286ffd640 3 client.4620.objecter handle_osd_map decoding full epoch 29 2026-02-12T03:58:48.399 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.396+0000 7f1286ffd640 20 client.4620.objecter dump_active .. 0 homeless 2026-02-12T03:58:48.399 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.396+0000 7f1286ffd640 1 -- 10.20.193.91:0/108858163 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f129405f4c0 con 0x7f129c0560d0 2026-02-12T03:58:48.399 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.396+0000 7f1286ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:48.399 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.396+0000 7f1286ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:48.502 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.500+0000 7f12a481d640 1 -- 10.20.193.91:0/108858163 --> v1:10.20.193.91:6800/2929217192 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f129c05cfe0 con 0x7f126c07a040 2026-02-12T03:58:48.503 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.501+0000 7f1286ffd640 1 -- 10.20.193.91:0/108858163 <== mgr.4113 v1:10.20.193.91:6800/2929217192 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+43115 (unknown 2965378022 0 66459569) 0x7f129c05cfe0 con 0x7f126c07a040 2026-02-12T03:58:48.504 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:58:48.505 INFO:teuthology.orchestra.run.trial091.stderr:dumped all 2026-02-12T03:58:48.506 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.502+0000 7f12a481d640 10 librados: watch_flush enter 2026-02-12T03:58:48.506 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.502+0000 7f12a481d640 10 librados: watch_flush exit 2026-02-12T03:58:48.506 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.502+0000 7f12a481d640 20 client.4620.objecter shutdown clearing up homeless session... 2026-02-12T03:58:48.506 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.502+0000 7f12a481d640 10 client.4620.objecter successfully canceled tick 2026-02-12T03:58:48.506 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.502+0000 7f12a481d640 1 -- 10.20.193.91:0/108858163 >> v1:10.20.193.91:6800/2929217192 conn(0x7f126c07a040 legacy=0x7f126c09a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:48.506 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.502+0000 7f12a481d640 10 monclient: shutdown 2026-02-12T03:58:48.506 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.502+0000 7f12a481d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:48.506 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.502+0000 7f12a481d640 1 -- 10.20.193.91:0/108858163 >> v1:10.20.193.91:6789/0 conn(0x7f129c0560d0 legacy=0x7f129c160330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:48.506 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.502+0000 7f12a481d640 1 -- 10.20.193.91:0/108858163 shutdown_connections 2026-02-12T03:58:48.506 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.502+0000 7f12a481d640 1 -- 10.20.193.91:0/108858163 >> 10.20.193.91:0/108858163 conn(0x7f129c0b6560 msgr2=0x7f129c0559c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:48.507 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.503+0000 7f12a481d640 1 -- 10.20.193.91:0/108858163 shutdown_connections 2026-02-12T03:58:48.507 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.503+0000 7f12a481d640 1 -- 10.20.193.91:0/108858163 wait complete. 2026-02-12T03:58:48.507 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.503+0000 7f12a481d640 1 librados: shutdown 2026-02-12T03:58:48.513 INFO:teuthology.orchestra.run.trial091.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2026-02-12T03:58:48.100302+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":12,"kb":1509949440,"kb_used":435152,"kb_used_data":3792,"kb_used_omap":118,"kb_used_meta":430985,"kb_avail":1509514288,"statfs":{"total":1546188226560,"available":1545742630912,"internally_reserved":0,"allocated":3883008,"data_stored":2823606,"data_compressed":280112,"data_compressed_allocated":720896,"data_compressed_original":2072240,"omap_allocated":120899,"internal_metadata":441329597},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":131107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":18,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.081904"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-12T03:58:44.071250+0000","last_change":"2026-02-12T03:58:44.073484+0000","last_active":"2026-02-12T03:58:44.071250+0000","last_peered":"2026-02-12T03:58:44.071250+0000","last_clean":"2026-02-12T03:58:44.071250+0000","last_became_active":"2026-02-12T03:58:42.327696+0000","last_became_peered":"2026-02-12T03:58:42.327696+0000","last_unstale":"2026-02-12T03:58:44.071250+0000","last_undegraded":"2026-02-12T03:58:44.071250+0000","last_fullsized":"2026-02-12T03:58:44.071250+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T07:45:24.713381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.065547275000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,14],"acting":[8,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-12T03:58:44.164407+0000","last_change":"2026-02-12T03:58:44.186869+0000","last_active":"2026-02-12T03:58:44.164407+0000","last_peered":"2026-02-12T03:58:44.164407+0000","last_clean":"2026-02-12T03:58:44.164407+0000","last_became_active":"2026-02-12T03:58:41.959956+0000","last_became_peered":"2026-02-12T03:58:41.959956+0000","last_unstale":"2026-02-12T03:58:44.164407+0000","last_undegraded":"2026-02-12T03:58:44.164407+0000","last_fullsized":"2026-02-12T03:58:44.164407+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T10:02:09.820740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032971485000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,15],"acting":[10,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-12T03:58:44.387094+0000","last_change":"2026-02-12T03:58:44.393932+0000","last_active":"2026-02-12T03:58:44.387094+0000","last_peered":"2026-02-12T03:58:44.387094+0000","last_clean":"2026-02-12T03:58:44.387094+0000","last_became_active":"2026-02-12T03:58:42.477478+0000","last_became_peered":"2026-02-12T03:58:42.477478+0000","last_unstale":"2026-02-12T03:58:44.387094+0000","last_undegraded":"2026-02-12T03:58:44.387094+0000","last_fullsized":"2026-02-12T03:58:44.387094+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:13:02.779200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.042443649,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-12T03:58:44.363916+0000","last_change":"2026-02-12T03:58:44.390979+0000","last_active":"2026-02-12T03:58:44.363916+0000","last_peered":"2026-02-12T03:58:44.363916+0000","last_clean":"2026-02-12T03:58:44.363916+0000","last_became_active":"2026-02-12T03:58:42.128705+0000","last_became_peered":"2026-02-12T03:58:42.128705+0000","last_unstale":"2026-02-12T03:58:44.363916+0000","last_undegraded":"2026-02-12T03:58:44.363916+0000","last_fullsized":"2026-02-12T03:58:44.363916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T04:06:44.956414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.043458169999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"28'2","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-12T03:58:44.064995+0000","last_change":"2026-02-12T03:58:44.064995+0000","last_active":"2026-02-12T03:58:44.064995+0000","last_peered":"2026-02-12T03:58:44.064995+0000","last_clean":"2026-02-12T03:58:44.064995+0000","last_became_active":"2026-02-12T03:58:42.443435+0000","last_became_peered":"2026-02-12T03:58:42.443435+0000","last_unstale":"2026-02-12T03:58:44.064995+0000","last_undegraded":"2026-02-12T03:58:44.064995+0000","last_fullsized":"2026-02-12T03:58:44.064995+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T11:15:40.933288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.069533228000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-12T03:58:44.000544+0000","last_change":"2026-02-12T03:58:44.019395+0000","last_active":"2026-02-12T03:58:44.000544+0000","last_peered":"2026-02-12T03:58:44.000544+0000","last_clean":"2026-02-12T03:58:44.000544+0000","last_became_active":"2026-02-12T03:58:42.143466+0000","last_became_peered":"2026-02-12T03:58:42.143466+0000","last_unstale":"2026-02-12T03:58:44.000544+0000","last_undegraded":"2026-02-12T03:58:44.000544+0000","last_fullsized":"2026-02-12T03:58:44.000544+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T08:05:12.033817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030228985,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-12T03:58:43.989822+0000","last_change":"2026-02-12T03:58:44.008038+0000","last_active":"2026-02-12T03:58:43.989822+0000","last_peered":"2026-02-12T03:58:43.989822+0000","last_clean":"2026-02-12T03:58:43.989822+0000","last_became_active":"2026-02-12T03:58:42.530615+0000","last_became_peered":"2026-02-12T03:58:42.530615+0000","last_unstale":"2026-02-12T03:58:43.989822+0000","last_undegraded":"2026-02-12T03:58:43.989822+0000","last_fullsized":"2026-02-12T03:58:43.989822+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T12:12:39.355846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030042276999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"26'1","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-12T03:58:44.036323+0000","last_change":"2026-02-12T03:58:44.065350+0000","last_active":"2026-02-12T03:58:44.036323+0000","last_peered":"2026-02-12T03:58:44.036323+0000","last_clean":"2026-02-12T03:58:44.036323+0000","last_became_active":"2026-02-12T03:58:42.128882+0000","last_became_peered":"2026-02-12T03:58:42.128882+0000","last_unstale":"2026-02-12T03:58:44.036323+0000","last_undegraded":"2026-02-12T03:58:44.036323+0000","last_fullsized":"2026-02-12T03:58:44.036323+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T08:20:23.062411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058002405,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6],"acting":[8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"24'32","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-12T03:58:44.338015+0000","last_change":"2026-02-12T03:58:33.836000+0000","last_active":"2026-02-12T03:58:44.338015+0000","last_peered":"2026-02-12T03:58:44.338015+0000","last_clean":"2026-02-12T03:58:44.338015+0000","last_became_active":"2026-02-12T03:58:33.819911+0000","last_became_peered":"2026-02-12T03:58:33.819911+0000","last_unstale":"2026-02-12T03:58:44.338015+0000","last_undegraded":"2026-02-12T03:58:44.338015+0000","last_fullsized":"2026-02-12T03:58:44.338015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:32.372907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:32.372907+0000","last_clean_scrub_stamp":"2026-02-12T03:58:32.372907+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T08:01:25.009200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,15],"acting":[2,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":918560,"data_compressed":2320,"data_compressed_allocated":65536,"data_compressed_original":917504,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":22,"seq":94489280517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":236,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":241664,"data_stored":119082,"data_compressed":17362,"data_compressed_allocated":40960,"data_compressed_original":72171,"omap_allocated":7476,"internal_metadata":27583180},"hb_peers":[0,1,2,3,4,6,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":232,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":237568,"data_stored":119063,"data_compressed":17362,"data_compressed_allocated":40960,"data_compressed_original":72171,"omap_allocated":8124,"internal_metadata":27582532},"hb_peers":[0,2,3,4,6,7,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280518,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":268,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":274432,"data_stored":578343,"data_compressed":18522,"data_compressed_allocated":73728,"data_compressed_original":530923,"omap_allocated":8124,"internal_metadata":27582532},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":232,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":237568,"data_stored":119063,"data_compressed":17362,"data_compressed_allocated":40960,"data_compressed_original":72171,"omap_allocated":6825,"internal_metadata":27583831},"hb_peers":[1,2,4,5,6,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27192,"kb_used_data":232,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":237568,"data_stored":119063,"data_compressed":17362,"data_compressed_allocated":40960,"data_compressed_original":72171,"omap_allocated":6825,"internal_metadata":27583831},"hb_peers":[0,1,2,3,4,5,6,8,10,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":21,"seq":90194313221,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":232,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":237568,"data_stored":119063,"data_compressed":17362,"data_compressed_allocated":40960,"data_compressed_original":72171,"omap_allocated":8773,"internal_metadata":27581883},"hb_peers":[1,3,4,5,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313222,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":268,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":274432,"data_stored":578343,"data_compressed":18522,"data_compressed_allocated":73728,"data_compressed_original":530923,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,3,4,5,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":232,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":237568,"data_stored":119063,"data_compressed":17362,"data_compressed_allocated":40960,"data_compressed_original":72171,"omap_allocated":6825,"internal_metadata":27583831},"hb_peers":[0,1,2,3,5,7,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313222,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27192,"kb_used_data":232,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":237568,"data_stored":119063,"data_compressed":17362,"data_compressed_allocated":40960,"data_compressed_original":72171,"omap_allocated":6825,"internal_metadata":27583831},"hb_peers":[0,2,3,4,6,7,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313221,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":236,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":241664,"data_stored":119082,"data_compressed":17362,"data_compressed_allocated":40960,"data_compressed_original":72171,"omap_allocated":8124,"internal_metadata":27582532},"hb_peers":[0,1,2,3,4,5,6,7,9,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313222,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":232,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":237568,"data_stored":119063,"data_compressed":17362,"data_compressed_allocated":40960,"data_compressed_original":72171,"omap_allocated":8780,"internal_metadata":27581876},"hb_peers":[1,2,3,4,5,6,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":21,"seq":90194313222,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":232,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":237568,"data_stored":119063,"data_compressed":17362,"data_compressed_allocated":40960,"data_compressed_original":72171,"omap_allocated":6830,"internal_metadata":27583826},"hb_peers":[0,1,2,3,4,5,6,7,9,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313222,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27192,"kb_used_data":232,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":237568,"data_stored":119063,"data_compressed":17362,"data_compressed_allocated":40960,"data_compressed_original":72171,"omap_allocated":6825,"internal_metadata":27583831},"hb_peers":[0,1,2,4,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":232,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":237568,"data_stored":119063,"data_compressed":17362,"data_compressed_allocated":40960,"data_compressed_original":72171,"omap_allocated":6825,"internal_metadata":27583831},"hb_peers":[0,1,3,5,6,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":232,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":237568,"data_stored":119063,"data_compressed":17362,"data_compressed_allocated":40960,"data_compressed_original":72171,"omap_allocated":7473,"internal_metadata":27583183},"hb_peers":[0,1,2,4,5,6,7,9,10,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280518,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27192,"kb_used_data":232,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":237568,"data_stored":119063,"data_compressed":17362,"data_compressed_allocated":40960,"data_compressed_original":72171,"omap_allocated":7470,"internal_metadata":27583186},"hb_peers":[0,2,3,4,5,6,8,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":459280,"data_compressed":1160,"data_compressed_allocated":32768,"data_compressed_original":458752,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":459280,"data_compressed":1160,"data_compressed_allocated":32768,"data_compressed_original":458752,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T03:58:48.515 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T03:58:48.584 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.582+0000 7f271de2b640 10 monclient: get_monmap_and_config 2026-02-12T03:58:48.584 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.582+0000 7f271de2b640 10 monclient: build_initial_monmap 2026-02-12T03:58:48.584 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.582+0000 7f271de2b640 10 monclient: monmap: 2026-02-12T03:58:48.584 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:48.585 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:48.585 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:48.582672+0000 2026-02-12T03:58:48.585 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:48.582672+0000 2026-02-12T03:58:48.585 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:48.585 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:48.585 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:48.585 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:48.585 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:48.585 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:48.585 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.582+0000 7f271de2b640 1 Processor -- start 2026-02-12T03:58:48.585 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.582+0000 7f271de2b640 1 -- start start 2026-02-12T03:58:48.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.582+0000 7f271de2b640 10 monclient: init 2026-02-12T03:58:48.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.583+0000 7f271de2b640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:48.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.583+0000 7f271de2b640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T03:58:48.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.583+0000 7f271de2b640 10 monclient(hunting): picked mon.noname-a con 0x7f27181575d0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:48.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.583+0000 7f271de2b640 10 monclient(hunting): picked mon.noname-c con 0x7f2718163310 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:48.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.583+0000 7f271de2b640 10 monclient(hunting): picked mon.noname-b con 0x7f27180560d0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:48.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.583+0000 7f271de2b640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27180b20b0 con 0x7f27181575d0 2026-02-12T03:58:48.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.583+0000 7f271de2b640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27180b2390 con 0x7f27180560d0 2026-02-12T03:58:48.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.583+0000 7f271de2b640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27180b2670 con 0x7f2718163310 2026-02-12T03:58:48.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.583+0000 7f271de2b640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:48.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.583+0000 7f271de2b640 10 monclient(hunting): authenticate will time out at 1131.326096s 2026-02-12T03:58:48.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.583+0000 7f27177fe640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f27181575d0 0x7f2718162c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:59900/0 (socket says 10.20.193.91:59900) 2026-02-12T03:58:48.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.583+0000 7f27177fe640 1 -- 10.20.193.91:0/2254220560 learned_addr learned my addr 10.20.193.91:0/2254220560 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:48.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.584+0000 7f27167fc640 1 -- 10.20.193.91:0/2254220560 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 440799420 0 0) 0x7f27180b2390 con 0x7f27180560d0 2026-02-12T03:58:48.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.584+0000 7f27167fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:48.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.584+0000 7f27167fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:48.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.584+0000 7f27167fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:48.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.584+0000 7f27167fc640 10 monclient(hunting): my global_id is 4630 2026-02-12T03:58:48.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.584+0000 7f27167fc640 1 -- 10.20.193.91:0/2254220560 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26fc003610 con 0x7f27180560d0 2026-02-12T03:58:48.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.585+0000 7f27167fc640 1 -- 10.20.193.91:0/2254220560 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3179921171 0 0) 0x7f27180b2670 con 0x7f2718163310 2026-02-12T03:58:48.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.585+0000 7f27167fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:48.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.585+0000 7f27167fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:48.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.585+0000 7f27167fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:48.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.585+0000 7f27167fc640 10 monclient(hunting): my global_id is 4586 2026-02-12T03:58:48.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.585+0000 7f27167fc640 1 -- 10.20.193.91:0/2254220560 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27180b2390 con 0x7f2718163310 2026-02-12T03:58:48.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.585+0000 7f27167fc640 1 -- 10.20.193.91:0/2254220560 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 288120759 0 0) 0x7f27180b20b0 con 0x7f27181575d0 2026-02-12T03:58:48.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.585+0000 7f27167fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:48.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.585+0000 7f27167fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:48.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.585+0000 7f27167fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:48.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.585+0000 7f27167fc640 10 monclient(hunting): my global_id is 4623 2026-02-12T03:58:48.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.585+0000 7f27167fc640 1 -- 10.20.193.91:0/2254220560 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27180b2670 con 0x7f27181575d0 2026-02-12T03:58:48.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.586+0000 7f27167fc640 1 -- 10.20.193.91:0/2254220560 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 41573835 0 0) 0x7f26fc003610 con 0x7f27180560d0 2026-02-12T03:58:48.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.586+0000 7f27167fc640 1 -- 10.20.193.91:0/2254220560 >> v1:10.20.193.111:6789/0 conn(0x7f2718163310 legacy=0x7f27180559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:48.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.586+0000 7f27167fc640 1 -- 10.20.193.91:0/2254220560 >> v1:10.20.193.91:6789/0 conn(0x7f27181575d0 legacy=0x7f2718162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:48.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.586+0000 7f27167fc640 10 monclient: _finish_hunting 0 2026-02-12T03:58:48.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.586+0000 7f27167fc640 1 monclient: found mon.noname-b 2026-02-12T03:58:48.592 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.586+0000 7f27167fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:48.592 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.586+0000 7f27167fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T03:58:48.592 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.586+0000 7f27167fc640 1 -- 10.20.193.91:0/2254220560 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2718162400 con 0x7f27180560d0 2026-02-12T03:58:48.592 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.586+0000 7f27167fc640 10 monclient: _finish_auth 0 2026-02-12T03:58:48.592 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.586+0000 7f27167fc640 10 monclient: _check_auth_tickets 2026-02-12T03:58:48.592 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.586+0000 7f27167fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:48.592 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.586+0000 7f27167fc640 1 -- 10.20.193.91:0/2254220560 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f270c003170 con 0x7f27180560d0 2026-02-12T03:58:48.592 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.586+0000 7f27167fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:48.592 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.586+0000 7f27167fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:48.592 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.586+0000 7f27167fc640 10 monclient: dump: 2026-02-12T03:58:48.592 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:48.592 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:48.593 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.593 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.593 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:48.593 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:48.593 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:48.593 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:48.593 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:48.593 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:48.593 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.586+0000 7f271de2b640 5 monclient: authenticate success, global_id 4630 2026-02-12T03:58:48.593 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.586+0000 7f271de2b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:48.599 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.587+0000 7f27167fc640 1 -- 10.20.193.91:0/2254220560 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f270c003340 con 0x7f27180560d0 2026-02-12T03:58:48.599 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.587+0000 7f27167fc640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:48.600 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.587+0000 7f27167fc640 1 -- 10.20.193.91:0/2254220560 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f270c003780 con 0x7f27180560d0 2026-02-12T03:58:48.600 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.587+0000 7f27167fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:48.600 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.587+0000 7f27167fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:48.600 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.587+0000 7f27167fc640 10 monclient: dump: 2026-02-12T03:58:48.600 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:48.600 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:48.600 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.600 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.600 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:48.600 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:48.600 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:48.601 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:48.601 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:48.601 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:48.601 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.587+0000 7f271de2b640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:48.601 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.587+0000 7f271de2b640 4 set_mon_vals no callback set 2026-02-12T03:58:48.601 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.587+0000 7f271de2b640 10 monclient: shutdown 2026-02-12T03:58:48.601 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.587+0000 7f271de2b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:48.601 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.587+0000 7f271de2b640 1 -- 10.20.193.91:0/2254220560 >> v1:10.20.193.98:6789/0 conn(0x7f27180560d0 legacy=0x7f27181c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:48.601 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.587+0000 7f271de2b640 1 -- 10.20.193.91:0/2254220560 shutdown_connections 2026-02-12T03:58:48.601 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.587+0000 7f271de2b640 1 -- 10.20.193.91:0/2254220560 >> 10.20.193.91:0/2254220560 conn(0x7f27180b6560 msgr2=0x7f27180b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:48.601 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.587+0000 7f271de2b640 1 -- 10.20.193.91:0/2254220560 shutdown_connections 2026-02-12T03:58:48.602 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.587+0000 7f271de2b640 1 -- 10.20.193.91:0/2254220560 wait complete. 2026-02-12T03:58:48.602 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.588+0000 7f271de2b640 10 monclient: build_initial_monmap 2026-02-12T03:58:48.602 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.588+0000 7f271de2b640 10 monclient: monmap: 2026-02-12T03:58:48.602 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:48.602 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:48.602 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:48.602 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:48.602 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:48.602 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:48.602 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:48.602 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:48.602 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:48.603 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:48.603 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.588+0000 7f271de2b640 1 librados: starting msgr at 2026-02-12T03:58:48.603 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.588+0000 7f271de2b640 1 librados: starting objecter 2026-02-12T03:58:48.603 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.588+0000 7f271de2b640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:48.603 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.588+0000 7f271de2b640 1 Processor -- start 2026-02-12T03:58:48.603 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.588+0000 7f271de2b640 1 -- start start 2026-02-12T03:58:48.603 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.588+0000 7f271de2b640 1 librados: setting wanted keys 2026-02-12T03:58:48.603 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.588+0000 7f271de2b640 1 librados: calling monclient init 2026-02-12T03:58:48.603 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.588+0000 7f271de2b640 10 monclient: init 2026-02-12T03:58:48.604 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.589+0000 7f271de2b640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:48.604 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.589+0000 7f271de2b640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T03:58:48.604 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.589+0000 7f271de2b640 10 monclient(hunting): picked mon.noname-a con 0x7f27180560d0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:48.604 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.589+0000 7f271de2b640 10 monclient(hunting): picked mon.noname-b con 0x7f27181575d0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:48.604 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.589+0000 7f271de2b640 10 monclient(hunting): picked mon.noname-c con 0x7f2718163310 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:48.604 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.589+0000 7f271de2b640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2718145240 con 0x7f27180560d0 2026-02-12T03:58:48.604 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.589+0000 7f271de2b640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27181429d0 con 0x7f27181575d0 2026-02-12T03:58:48.604 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.589+0000 7f271de2b640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2718142cb0 con 0x7f2718163310 2026-02-12T03:58:48.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.589+0000 7f271de2b640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:48.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.589+0000 7f271de2b640 10 monclient(hunting): authenticate will time out at 1131.332075s 2026-02-12T03:58:48.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.589+0000 7f27177fe640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f27180560d0 0x7f2718144b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:59908/0 (socket says 10.20.193.91:59908) 2026-02-12T03:58:48.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.589+0000 7f27177fe640 1 -- 10.20.193.91:0/1672227658 learned_addr learned my addr 10.20.193.91:0/1672227658 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:48.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.589+0000 7f26f3fff640 10 client.?.objecter ms_handle_connect 0x7f2718163310 2026-02-12T03:58:48.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.589+0000 7f26f3fff640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:48.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.589+0000 7f26f3fff640 10 client.?.objecter ms_handle_connect 0x7f27180560d0 2026-02-12T03:58:48.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.589+0000 7f26f3fff640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:48.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.589+0000 7f26f3fff640 10 client.?.objecter ms_handle_connect 0x7f27181575d0 2026-02-12T03:58:48.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.589+0000 7f26f3fff640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:48.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.590+0000 7f26f3fff640 1 -- 10.20.193.91:0/1672227658 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2943962984 0 0) 0x7f2718145240 con 0x7f27180560d0 2026-02-12T03:58:48.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.590+0000 7f26f3fff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:48.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.590+0000 7f26f3fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:48.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.590+0000 7f26f3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:48.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.590+0000 7f26f3fff640 10 monclient(hunting): my global_id is 4626 2026-02-12T03:58:48.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.590+0000 7f26f3fff640 1 -- 10.20.193.91:0/1672227658 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26e8003610 con 0x7f27180560d0 2026-02-12T03:58:48.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.590+0000 7f26f3fff640 1 -- 10.20.193.91:0/1672227658 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2692211184 0 0) 0x7f27181429d0 con 0x7f27181575d0 2026-02-12T03:58:48.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.590+0000 7f26f3fff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:48.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.590+0000 7f26f3fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:48.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.590+0000 7f26f3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:48.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.590+0000 7f26f3fff640 10 monclient(hunting): my global_id is 4633 2026-02-12T03:58:48.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.590+0000 7f26f3fff640 1 -- 10.20.193.91:0/1672227658 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2718145240 con 0x7f27181575d0 2026-02-12T03:58:48.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.590+0000 7f26f3fff640 1 -- 10.20.193.91:0/1672227658 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2692279846 0 0) 0x7f2718142cb0 con 0x7f2718163310 2026-02-12T03:58:48.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.590+0000 7f26f3fff640 10 monclient(hunting): _negotiate 2026-02-12T03:58:48.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.590+0000 7f26f3fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:48.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.590+0000 7f26f3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:48.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.590+0000 7f26f3fff640 10 monclient(hunting): my global_id is 4589 2026-02-12T03:58:48.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.590+0000 7f26f3fff640 1 -- 10.20.193.91:0/1672227658 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27181429d0 con 0x7f2718163310 2026-02-12T03:58:48.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.592+0000 7f26f3fff640 1 -- 10.20.193.91:0/1672227658 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2351354170 0 0) 0x7f26e8003610 con 0x7f27180560d0 2026-02-12T03:58:48.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.592+0000 7f26f3fff640 1 -- 10.20.193.91:0/1672227658 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2718142cb0 con 0x7f27180560d0 2026-02-12T03:58:48.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.592+0000 7f26f3fff640 1 -- 10.20.193.91:0/1672227658 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f2704003060 con 0x7f27180560d0 2026-02-12T03:58:48.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.592+0000 7f26f3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:48.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.593+0000 7f26f3fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:48.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.593+0000 7f26f3fff640 10 monclient(hunting): dump: 2026-02-12T03:58:48.607 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:48.608 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:48.608 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.608 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.608 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:48.608 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:48.608 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:48.608 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:48.608 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:48.608 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:48.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.593+0000 7f26f3fff640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:48.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.593+0000 7f26f3fff640 1 -- 10.20.193.91:0/1672227658 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2955403862 0 0) 0x7f2718145240 con 0x7f27181575d0 2026-02-12T03:58:48.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.593+0000 7f26f3fff640 1 -- 10.20.193.91:0/1672227658 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f26e8003610 con 0x7f27181575d0 2026-02-12T03:58:48.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.593+0000 7f26f3fff640 1 -- 10.20.193.91:0/1672227658 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f27080030c0 con 0x7f27181575d0 2026-02-12T03:58:48.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.593+0000 7f26f3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:48.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.593+0000 7f26f3fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:48.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.593+0000 7f26f3fff640 10 monclient(hunting): dump: 2026-02-12T03:58:48.609 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:48.609 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:48.609 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.609 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.609 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:48.609 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:48.609 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:48.609 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:48.610 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:48.610 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:48.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.593+0000 7f26f3fff640 1 -- 10.20.193.91:0/1672227658 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3688824945 0 0) 0x7f27181429d0 con 0x7f2718163310 2026-02-12T03:58:48.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.593+0000 7f26f3fff640 1 -- 10.20.193.91:0/1672227658 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2718145240 con 0x7f2718163310 2026-02-12T03:58:48.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.593+0000 7f26f3fff640 1 -- 10.20.193.91:0/1672227658 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f270c0034f0 con 0x7f2718163310 2026-02-12T03:58:48.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.593+0000 7f26f3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:48.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.593+0000 7f26f3fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:48.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.593+0000 7f26f3fff640 10 monclient(hunting): dump: 2026-02-12T03:58:48.610 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:48.610 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:48.610 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.610 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.611 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:48.611 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:48.611 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:48.611 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:48.611 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:48.611 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:48.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.594+0000 7f26f3fff640 1 -- 10.20.193.91:0/1672227658 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3678250456 0 0) 0x7f2718142cb0 con 0x7f27180560d0 2026-02-12T03:58:48.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.594+0000 7f26f3fff640 1 -- 10.20.193.91:0/1672227658 >> v1:10.20.193.111:6789/0 conn(0x7f2718163310 legacy=0x7f2718155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:48.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.594+0000 7f26f3fff640 1 -- 10.20.193.91:0/1672227658 >> v1:10.20.193.98:6789/0 conn(0x7f27181575d0 legacy=0x7f2718143a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:48.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.594+0000 7f26f3fff640 10 monclient: _finish_hunting 0 2026-02-12T03:58:48.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.594+0000 7f26f3fff640 1 monclient: found mon.a 2026-02-12T03:58:48.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.594+0000 7f26f3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:48.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.594+0000 7f26f3fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:48.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.594+0000 7f26f3fff640 1 -- 10.20.193.91:0/1672227658 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2718142f90 con 0x7f27180560d0 2026-02-12T03:58:48.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.594+0000 7f26f3fff640 10 monclient: _finish_auth 0 2026-02-12T03:58:48.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.594+0000 7f26f3fff640 10 monclient: _check_auth_tickets 2026-02-12T03:58:48.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.594+0000 7f26f3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:48.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.594+0000 7f271de2b640 5 monclient: authenticate success, global_id 4626 2026-02-12T03:58:48.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.594+0000 7f271de2b640 10 monclient: _renew_subs 2026-02-12T03:58:48.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.594+0000 7f271de2b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:48.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.594+0000 7f271de2b640 1 -- 10.20.193.91:0/1672227658 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2718143270 con 0x7f27180560d0 2026-02-12T03:58:48.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.594+0000 7f271de2b640 10 client.4626.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:48.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.594+0000 7f271de2b640 10 monclient: _renew_subs 2026-02-12T03:58:48.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.594+0000 7f271de2b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:48.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.594+0000 7f271de2b640 1 -- 10.20.193.91:0/1672227658 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f27181455c0 con 0x7f27180560d0 2026-02-12T03:58:48.613 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.594+0000 7f271de2b640 1 librados: init done 2026-02-12T03:58:48.613 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.595+0000 7f271de2b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:48.613 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.595+0000 7f271de2b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:48.613 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.595+0000 7f271de2b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T03:58:48.613 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.595+0000 7f271de2b640 1 -- 10.20.193.91:0/1672227658 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f271805a0b0 con 0x7f27180560d0 2026-02-12T03:58:48.691 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.689+0000 7f26f3fff640 1 -- 10.20.193.91:0/1672227658 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2704003200 con 0x7f27180560d0 2026-02-12T03:58:48.691 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.689+0000 7f26f3fff640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:48.691 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.689+0000 7f26f3fff640 1 -- 10.20.193.91:0/1672227658 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f2704004af0 con 0x7f27180560d0 2026-02-12T03:58:48.691 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.689+0000 7f26f3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:48.692 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.689+0000 7f26f3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:58:48.692 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.689+0000 7f2715ffb640 4 set_mon_vals no callback set 2026-02-12T03:58:48.692 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.689+0000 7f26f3fff640 10 monclient: dump: 2026-02-12T03:58:48.692 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:48.692 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:48.692 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.692 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.692 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:48.692 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:48.692 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:48.692 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:48.693 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:48.693 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:48.693 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.689+0000 7f26f3fff640 1 -- 10.20.193.91:0/1672227658 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f2704004af0 con 0x7f27180560d0 2026-02-12T03:58:48.694 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.690+0000 7f2716ffd640 10 monclient: get_auth_request con 0x7f26e8079ff0 auth_method 0 2026-02-12T03:58:48.694 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.690+0000 7f26f3fff640 10 client.4626.objecter ms_handle_connect 0x7f26e8079ff0 2026-02-12T03:58:48.695 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.692+0000 7f26f3fff640 1 -- 10.20.193.91:0/1672227658 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8141+0+0 (unknown 1201408556 0 0) 0x7f2704095ae0 con 0x7f27180560d0 2026-02-12T03:58:48.695 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.692+0000 7f26f3fff640 10 client.4626.objecter ms_dispatch2 0x7f2718000b90 osd_map(29..29 src has 1..29) 2026-02-12T03:58:48.695 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.692+0000 7f26f3fff640 3 client.4626.objecter handle_osd_map got epochs [29,29] > 0 2026-02-12T03:58:48.695 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.692+0000 7f26f3fff640 3 client.4626.objecter handle_osd_map decoding full epoch 29 2026-02-12T03:58:48.695 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.692+0000 7f26f3fff640 20 client.4626.objecter dump_active .. 0 homeless 2026-02-12T03:58:48.695 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.692+0000 7f26f3fff640 1 -- 10.20.193.91:0/1672227658 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f270405f440 con 0x7f27180560d0 2026-02-12T03:58:48.695 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.692+0000 7f26f3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:48.695 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.692+0000 7f26f3fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:48.798 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.796+0000 7f271de2b640 1 -- 10.20.193.91:0/1672227658 --> v1:10.20.193.91:6800/2929217192 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f27180b7290 con 0x7f26e8079ff0 2026-02-12T03:58:48.799 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.796+0000 7f26f3fff640 1 -- 10.20.193.91:0/1672227658 <== mgr.4113 v1:10.20.193.91:6800/2929217192 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+43115 (unknown 2965378022 0 66459569) 0x7f27180b7290 con 0x7f26e8079ff0 2026-02-12T03:58:48.799 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:58:48.801 INFO:teuthology.orchestra.run.trial091.stderr:dumped all 2026-02-12T03:58:48.801 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.797+0000 7f271de2b640 10 librados: watch_flush enter 2026-02-12T03:58:48.801 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.797+0000 7f271de2b640 10 librados: watch_flush exit 2026-02-12T03:58:48.801 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.797+0000 7f271de2b640 20 client.4626.objecter shutdown clearing up homeless session... 2026-02-12T03:58:48.801 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.797+0000 7f271de2b640 10 client.4626.objecter successfully canceled tick 2026-02-12T03:58:48.801 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.797+0000 7f271de2b640 1 -- 10.20.193.91:0/1672227658 >> v1:10.20.193.91:6800/2929217192 conn(0x7f26e8079ff0 legacy=0x7f26e809a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:48.801 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.797+0000 7f271de2b640 10 monclient: shutdown 2026-02-12T03:58:48.801 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.797+0000 7f271de2b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:48.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.797+0000 7f271de2b640 1 -- 10.20.193.91:0/1672227658 >> v1:10.20.193.91:6789/0 conn(0x7f27180560d0 legacy=0x7f2718144b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:48.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.797+0000 7f271de2b640 1 -- 10.20.193.91:0/1672227658 shutdown_connections 2026-02-12T03:58:48.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.797+0000 7f271de2b640 1 -- 10.20.193.91:0/1672227658 >> 10.20.193.91:0/1672227658 conn(0x7f27180b6560 msgr2=0x7f27181642f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:48.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.797+0000 7f271de2b640 1 -- 10.20.193.91:0/1672227658 shutdown_connections 2026-02-12T03:58:48.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.797+0000 7f271de2b640 1 -- 10.20.193.91:0/1672227658 wait complete. 2026-02-12T03:58:48.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.797+0000 7f271de2b640 1 librados: shutdown 2026-02-12T03:58:48.808 INFO:teuthology.orchestra.run.trial091.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2026-02-12T03:58:48.100302+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459299,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":59,"num_write_kb":586,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":12,"kb":1509949440,"kb_used":435152,"kb_used_data":3792,"kb_used_omap":118,"kb_used_meta":430985,"kb_avail":1509514288,"statfs":{"total":1546188226560,"available":1545742630912,"internally_reserved":0,"allocated":3883008,"data_stored":2823606,"data_compressed":280112,"data_compressed_allocated":720896,"data_compressed_original":2072240,"omap_allocated":120899,"internal_metadata":441329597},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":131107,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":18,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.081904"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-12T03:58:44.071250+0000","last_change":"2026-02-12T03:58:44.073484+0000","last_active":"2026-02-12T03:58:44.071250+0000","last_peered":"2026-02-12T03:58:44.071250+0000","last_clean":"2026-02-12T03:58:44.071250+0000","last_became_active":"2026-02-12T03:58:42.327696+0000","last_became_peered":"2026-02-12T03:58:42.327696+0000","last_unstale":"2026-02-12T03:58:44.071250+0000","last_undegraded":"2026-02-12T03:58:44.071250+0000","last_fullsized":"2026-02-12T03:58:44.071250+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T07:45:24.713381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.065547275000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,14],"acting":[8,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-12T03:58:44.164407+0000","last_change":"2026-02-12T03:58:44.186869+0000","last_active":"2026-02-12T03:58:44.164407+0000","last_peered":"2026-02-12T03:58:44.164407+0000","last_clean":"2026-02-12T03:58:44.164407+0000","last_became_active":"2026-02-12T03:58:41.959956+0000","last_became_peered":"2026-02-12T03:58:41.959956+0000","last_unstale":"2026-02-12T03:58:44.164407+0000","last_undegraded":"2026-02-12T03:58:44.164407+0000","last_fullsized":"2026-02-12T03:58:44.164407+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T10:02:09.820740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032971485000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,15],"acting":[10,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-12T03:58:44.387094+0000","last_change":"2026-02-12T03:58:44.393932+0000","last_active":"2026-02-12T03:58:44.387094+0000","last_peered":"2026-02-12T03:58:44.387094+0000","last_clean":"2026-02-12T03:58:44.387094+0000","last_became_active":"2026-02-12T03:58:42.477478+0000","last_became_peered":"2026-02-12T03:58:42.477478+0000","last_unstale":"2026-02-12T03:58:44.387094+0000","last_undegraded":"2026-02-12T03:58:44.387094+0000","last_fullsized":"2026-02-12T03:58:44.387094+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:13:02.779200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.042443649,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-12T03:58:44.363916+0000","last_change":"2026-02-12T03:58:44.390979+0000","last_active":"2026-02-12T03:58:44.363916+0000","last_peered":"2026-02-12T03:58:44.363916+0000","last_clean":"2026-02-12T03:58:44.363916+0000","last_became_active":"2026-02-12T03:58:42.128705+0000","last_became_peered":"2026-02-12T03:58:42.128705+0000","last_unstale":"2026-02-12T03:58:44.363916+0000","last_undegraded":"2026-02-12T03:58:44.363916+0000","last_fullsized":"2026-02-12T03:58:44.363916+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T04:06:44.956414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.043458169999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"28'2","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-12T03:58:44.064995+0000","last_change":"2026-02-12T03:58:44.064995+0000","last_active":"2026-02-12T03:58:44.064995+0000","last_peered":"2026-02-12T03:58:44.064995+0000","last_clean":"2026-02-12T03:58:44.064995+0000","last_became_active":"2026-02-12T03:58:42.443435+0000","last_became_peered":"2026-02-12T03:58:42.443435+0000","last_unstale":"2026-02-12T03:58:44.064995+0000","last_undegraded":"2026-02-12T03:58:44.064995+0000","last_fullsized":"2026-02-12T03:58:44.064995+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T11:15:40.933288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.069533228000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-12T03:58:44.000544+0000","last_change":"2026-02-12T03:58:44.019395+0000","last_active":"2026-02-12T03:58:44.000544+0000","last_peered":"2026-02-12T03:58:44.000544+0000","last_clean":"2026-02-12T03:58:44.000544+0000","last_became_active":"2026-02-12T03:58:42.143466+0000","last_became_peered":"2026-02-12T03:58:42.143466+0000","last_unstale":"2026-02-12T03:58:44.000544+0000","last_undegraded":"2026-02-12T03:58:44.000544+0000","last_fullsized":"2026-02-12T03:58:44.000544+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T08:05:12.033817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030228985,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-12T03:58:43.989822+0000","last_change":"2026-02-12T03:58:44.008038+0000","last_active":"2026-02-12T03:58:43.989822+0000","last_peered":"2026-02-12T03:58:43.989822+0000","last_clean":"2026-02-12T03:58:43.989822+0000","last_became_active":"2026-02-12T03:58:42.530615+0000","last_became_peered":"2026-02-12T03:58:42.530615+0000","last_unstale":"2026-02-12T03:58:43.989822+0000","last_undegraded":"2026-02-12T03:58:43.989822+0000","last_fullsized":"2026-02-12T03:58:43.989822+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T12:12:39.355846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030042276999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"26'1","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-12T03:58:44.036323+0000","last_change":"2026-02-12T03:58:44.065350+0000","last_active":"2026-02-12T03:58:44.036323+0000","last_peered":"2026-02-12T03:58:44.036323+0000","last_clean":"2026-02-12T03:58:44.036323+0000","last_became_active":"2026-02-12T03:58:42.128882+0000","last_became_peered":"2026-02-12T03:58:42.128882+0000","last_unstale":"2026-02-12T03:58:44.036323+0000","last_undegraded":"2026-02-12T03:58:44.036323+0000","last_fullsized":"2026-02-12T03:58:44.036323+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T08:20:23.062411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058002405,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6],"acting":[8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"24'32","reported_seq":65,"reported_epoch":28,"state":"active+clean","last_fresh":"2026-02-12T03:58:44.338015+0000","last_change":"2026-02-12T03:58:33.836000+0000","last_active":"2026-02-12T03:58:44.338015+0000","last_peered":"2026-02-12T03:58:44.338015+0000","last_clean":"2026-02-12T03:58:44.338015+0000","last_became_active":"2026-02-12T03:58:33.819911+0000","last_became_peered":"2026-02-12T03:58:33.819911+0000","last_unstale":"2026-02-12T03:58:44.338015+0000","last_undegraded":"2026-02-12T03:58:44.338015+0000","last_fullsized":"2026-02-12T03:58:44.338015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:32.372907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:32.372907+0000","last_clean_scrub_stamp":"2026-02-12T03:58:32.372907+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T08:01:25.009200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,15],"acting":[2,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":918560,"data_compressed":2320,"data_compressed_allocated":65536,"data_compressed_original":917504,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":22,"seq":94489280517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":236,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":241664,"data_stored":119082,"data_compressed":17362,"data_compressed_allocated":40960,"data_compressed_original":72171,"omap_allocated":7476,"internal_metadata":27583180},"hb_peers":[0,1,2,3,4,6,8,9,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280516,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":232,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":237568,"data_stored":119063,"data_compressed":17362,"data_compressed_allocated":40960,"data_compressed_original":72171,"omap_allocated":8124,"internal_metadata":27582532},"hb_peers":[0,2,3,4,6,7,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280518,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":268,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":274432,"data_stored":578343,"data_compressed":18522,"data_compressed_allocated":73728,"data_compressed_original":530923,"omap_allocated":8124,"internal_metadata":27582532},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":232,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":237568,"data_stored":119063,"data_compressed":17362,"data_compressed_allocated":40960,"data_compressed_original":72171,"omap_allocated":6825,"internal_metadata":27583831},"hb_peers":[1,2,4,5,6,7,8,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313221,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27192,"kb_used_data":232,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":237568,"data_stored":119063,"data_compressed":17362,"data_compressed_allocated":40960,"data_compressed_original":72171,"omap_allocated":6825,"internal_metadata":27583831},"hb_peers":[0,1,2,3,4,5,6,8,10,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":21,"seq":90194313221,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":232,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":237568,"data_stored":119063,"data_compressed":17362,"data_compressed_allocated":40960,"data_compressed_original":72171,"omap_allocated":8773,"internal_metadata":27581883},"hb_peers":[1,3,4,5,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313222,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":268,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":274432,"data_stored":578343,"data_compressed":18522,"data_compressed_allocated":73728,"data_compressed_original":530923,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,3,4,5,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":232,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":237568,"data_stored":119063,"data_compressed":17362,"data_compressed_allocated":40960,"data_compressed_original":72171,"omap_allocated":6825,"internal_metadata":27583831},"hb_peers":[0,1,2,3,5,7,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313222,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27192,"kb_used_data":232,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":237568,"data_stored":119063,"data_compressed":17362,"data_compressed_allocated":40960,"data_compressed_original":72171,"omap_allocated":6825,"internal_metadata":27583831},"hb_peers":[0,2,3,4,6,7,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313221,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":236,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":241664,"data_stored":119082,"data_compressed":17362,"data_compressed_allocated":40960,"data_compressed_original":72171,"omap_allocated":8124,"internal_metadata":27582532},"hb_peers":[0,1,2,3,4,5,6,7,9,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313222,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":232,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":237568,"data_stored":119063,"data_compressed":17362,"data_compressed_allocated":40960,"data_compressed_original":72171,"omap_allocated":8780,"internal_metadata":27581876},"hb_peers":[1,2,3,4,5,6,8,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":21,"seq":90194313222,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":232,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":237568,"data_stored":119063,"data_compressed":17362,"data_compressed_allocated":40960,"data_compressed_original":72171,"omap_allocated":6830,"internal_metadata":27583826},"hb_peers":[0,1,2,3,4,5,6,7,9,11,12,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313222,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27192,"kb_used_data":232,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":237568,"data_stored":119063,"data_compressed":17362,"data_compressed_allocated":40960,"data_compressed_original":72171,"omap_allocated":6825,"internal_metadata":27583831},"hb_peers":[0,1,2,4,7,8,9,10,11,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":21,"seq":90194313221,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":232,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":237568,"data_stored":119063,"data_compressed":17362,"data_compressed_allocated":40960,"data_compressed_original":72171,"omap_allocated":6825,"internal_metadata":27583831},"hb_peers":[0,1,3,5,6,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280517,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":232,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":237568,"data_stored":119063,"data_compressed":17362,"data_compressed_allocated":40960,"data_compressed_original":72171,"omap_allocated":7473,"internal_metadata":27583183},"hb_peers":[0,1,2,4,5,6,7,9,10,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280518,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27192,"kb_used_data":232,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":237568,"data_stored":119063,"data_compressed":17362,"data_compressed_allocated":40960,"data_compressed_original":72171,"omap_allocated":7470,"internal_metadata":27583186},"hb_peers":[0,2,3,4,5,6,8,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":459280,"data_compressed":1160,"data_compressed_allocated":32768,"data_compressed_original":458752,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":459280,"data_compressed":1160,"data_compressed_allocated":32768,"data_compressed_original":458752,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T03:58:48.810 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-12T03:58:48.810 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-12T03:58:48.810 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-12T03:58:48.811 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-12T03:58:48.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.877+0000 7fb1d4001640 10 monclient: get_monmap_and_config 2026-02-12T03:58:48.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.877+0000 7fb1d4001640 10 monclient: build_initial_monmap 2026-02-12T03:58:48.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.877+0000 7fb1d4001640 10 monclient: monmap: 2026-02-12T03:58:48.880 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:48.880 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:48.880 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:58:48.878140+0000 2026-02-12T03:58:48.880 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:58:48.878140+0000 2026-02-12T03:58:48.880 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:48.880 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:48.881 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:48.881 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:48.881 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:48.881 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:48.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.877+0000 7fb1d4001640 1 Processor -- start 2026-02-12T03:58:48.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.878+0000 7fb1d4001640 1 -- start start 2026-02-12T03:58:48.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.878+0000 7fb1d4001640 10 monclient: init 2026-02-12T03:58:48.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.878+0000 7fb1d4001640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:48.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.878+0000 7fb1d4001640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T03:58:48.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.878+0000 7fb1d4001640 10 monclient(hunting): picked mon.noname-a con 0x7fb1cc1575d0 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:48.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.878+0000 7fb1d4001640 10 monclient(hunting): picked mon.noname-b con 0x7fb1cc163310 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:48.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.878+0000 7fb1d4001640 10 monclient(hunting): picked mon.noname-c con 0x7fb1cc0560d0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:48.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.878+0000 7fb1d4001640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1cc0b20b0 con 0x7fb1cc1575d0 2026-02-12T03:58:48.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.878+0000 7fb1d4001640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1cc0b2390 con 0x7fb1cc163310 2026-02-12T03:58:48.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.878+0000 7fb1d4001640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1cc0b2670 con 0x7fb1cc0560d0 2026-02-12T03:58:48.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.878+0000 7fb1d4001640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:48.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.878+0000 7fb1d4001640 10 monclient(hunting): authenticate will time out at 1131.621599s 2026-02-12T03:58:48.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.878+0000 7fb1d2577640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7fb1cc0560d0 0x7fb1cc1c56f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:38448/0 (socket says 10.20.193.91:38448) 2026-02-12T03:58:48.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.878+0000 7fb1d2577640 1 -- 10.20.193.91:0/2564896844 learned_addr learned my addr 10.20.193.91:0/2564896844 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:48.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.880+0000 7fb1d0d74640 1 -- 10.20.193.91:0/2564896844 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4160905327 0 0) 0x7fb1cc0b2390 con 0x7fb1cc163310 2026-02-12T03:58:48.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.880+0000 7fb1d0d74640 10 monclient(hunting): _negotiate 2026-02-12T03:58:48.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.880+0000 7fb1d0d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:48.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.880+0000 7fb1d0d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:48.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.880+0000 7fb1d0d74640 10 monclient(hunting): my global_id is 4636 2026-02-12T03:58:48.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.880+0000 7fb1d0d74640 1 -- 10.20.193.91:0/2564896844 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1b4003610 con 0x7fb1cc163310 2026-02-12T03:58:48.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.880+0000 7fb1d0d74640 1 -- 10.20.193.91:0/2564896844 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1860082203 0 0) 0x7fb1cc0b20b0 con 0x7fb1cc1575d0 2026-02-12T03:58:48.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.880+0000 7fb1d0d74640 10 monclient(hunting): _negotiate 2026-02-12T03:58:48.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.880+0000 7fb1d0d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:48.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.880+0000 7fb1d0d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:48.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.880+0000 7fb1d0d74640 10 monclient(hunting): my global_id is 4629 2026-02-12T03:58:48.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.880+0000 7fb1d0d74640 1 -- 10.20.193.91:0/2564896844 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1cc0b2390 con 0x7fb1cc1575d0 2026-02-12T03:58:48.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.880+0000 7fb1d0d74640 1 -- 10.20.193.91:0/2564896844 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1324690014 0 0) 0x7fb1cc0b2670 con 0x7fb1cc0560d0 2026-02-12T03:58:48.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.880+0000 7fb1d0d74640 10 monclient(hunting): _negotiate 2026-02-12T03:58:48.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.880+0000 7fb1d0d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:48.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.880+0000 7fb1d0d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:48.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.880+0000 7fb1d0d74640 10 monclient(hunting): my global_id is 4592 2026-02-12T03:58:48.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.880+0000 7fb1d0d74640 1 -- 10.20.193.91:0/2564896844 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1cc0b20b0 con 0x7fb1cc0560d0 2026-02-12T03:58:48.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.882+0000 7fb1d0d74640 1 -- 10.20.193.91:0/2564896844 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2364456521 0 0) 0x7fb1b4003610 con 0x7fb1cc163310 2026-02-12T03:58:48.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.882+0000 7fb1d0d74640 1 -- 10.20.193.91:0/2564896844 >> v1:10.20.193.111:6789/0 conn(0x7fb1cc0560d0 legacy=0x7fb1cc1c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:48.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.882+0000 7fb1d0d74640 1 -- 10.20.193.91:0/2564896844 >> v1:10.20.193.91:6789/0 conn(0x7fb1cc1575d0 legacy=0x7fb1cc162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:48.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.882+0000 7fb1d0d74640 10 monclient: _finish_hunting 0 2026-02-12T03:58:48.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.882+0000 7fb1d0d74640 1 monclient: found mon.noname-b 2026-02-12T03:58:48.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.882+0000 7fb1d0d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:48.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.882+0000 7fb1d0d74640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T03:58:48.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.882+0000 7fb1d0d74640 1 -- 10.20.193.91:0/2564896844 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1cc162400 con 0x7fb1cc163310 2026-02-12T03:58:48.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.882+0000 7fb1d0d74640 10 monclient: _finish_auth 0 2026-02-12T03:58:48.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.882+0000 7fb1d0d74640 10 monclient: _check_auth_tickets 2026-02-12T03:58:48.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.882+0000 7fb1d0d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:48.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.882+0000 7fb1d0d74640 1 -- 10.20.193.91:0/2564896844 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fb1c0002df0 con 0x7fb1cc163310 2026-02-12T03:58:48.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.882+0000 7fb1d0d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:48.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.882+0000 7fb1d0d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T03:58:48.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.882+0000 7fb1d0d74640 10 monclient: dump: 2026-02-12T03:58:48.889 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:48.889 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:48.890 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.890 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.890 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:48.890 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:48.890 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:48.890 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:48.890 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:48.890 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:48.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.882+0000 7fb1d4001640 5 monclient: authenticate success, global_id 4636 2026-02-12T03:58:48.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.882+0000 7fb1d4001640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:58:48.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.882+0000 7fb1d0d74640 1 -- 10.20.193.91:0/2564896844 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb1c0002fc0 con 0x7fb1cc163310 2026-02-12T03:58:48.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.882+0000 7fb1d0d74640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:48.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.882+0000 7fb1d0d74640 1 -- 10.20.193.91:0/2564896844 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fb1c0003400 con 0x7fb1cc163310 2026-02-12T03:58:48.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.882+0000 7fb1d0d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:48.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.882+0000 7fb1d0d74640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:48.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.882+0000 7fb1d0d74640 10 monclient: dump: 2026-02-12T03:58:48.891 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:48.891 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:48.891 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.891 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.891 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:48.891 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:48.892 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:48.892 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:48.892 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:48.892 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:48.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.882+0000 7fb1d4001640 10 monclient: get_monmap_and_config success 2026-02-12T03:58:48.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.882+0000 7fb1d4001640 4 set_mon_vals no callback set 2026-02-12T03:58:48.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.883+0000 7fb1d4001640 10 monclient: shutdown 2026-02-12T03:58:48.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.883+0000 7fb1d4001640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:48.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.883+0000 7fb1d4001640 1 -- 10.20.193.91:0/2564896844 >> v1:10.20.193.98:6789/0 conn(0x7fb1cc163310 legacy=0x7fb1cc0559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:48.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.883+0000 7fb1d4001640 1 -- 10.20.193.91:0/2564896844 shutdown_connections 2026-02-12T03:58:48.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.883+0000 7fb1d4001640 1 -- 10.20.193.91:0/2564896844 >> 10.20.193.91:0/2564896844 conn(0x7fb1cc0b6560 msgr2=0x7fb1cc0b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:48.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.883+0000 7fb1d4001640 1 -- 10.20.193.91:0/2564896844 shutdown_connections 2026-02-12T03:58:48.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.883+0000 7fb1d4001640 1 -- 10.20.193.91:0/2564896844 wait complete. 2026-02-12T03:58:48.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.883+0000 7fb1d4001640 10 monclient: build_initial_monmap 2026-02-12T03:58:48.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.883+0000 7fb1d4001640 10 monclient: monmap: 2026-02-12T03:58:48.893 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T03:58:48.893 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:58:48.893 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T03:58:48.893 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T03:58:48.893 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T03:58:48.893 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T03:58:48.893 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:58:48.893 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:58:48.893 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:58:48.894 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:48.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.884+0000 7fb1d4001640 1 librados: starting msgr at 2026-02-12T03:58:48.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.884+0000 7fb1d4001640 1 librados: starting objecter 2026-02-12T03:58:48.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.884+0000 7fb1d4001640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:58:48.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.884+0000 7fb1d4001640 1 Processor -- start 2026-02-12T03:58:48.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.884+0000 7fb1d4001640 1 -- start start 2026-02-12T03:58:48.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.884+0000 7fb1d4001640 1 librados: setting wanted keys 2026-02-12T03:58:48.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.884+0000 7fb1d4001640 1 librados: calling monclient init 2026-02-12T03:58:48.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.884+0000 7fb1d4001640 10 monclient: init 2026-02-12T03:58:48.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.884+0000 7fb1d4001640 10 monclient: _reopen_session rank -1 2026-02-12T03:58:48.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.884+0000 7fb1d4001640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T03:58:48.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.884+0000 7fb1d4001640 10 monclient(hunting): picked mon.noname-c con 0x7fb1cc0560d0 addr v1:10.20.193.111:6789/0 2026-02-12T03:58:48.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.884+0000 7fb1d4001640 10 monclient(hunting): picked mon.noname-b con 0x7fb1cc1575d0 addr v1:10.20.193.98:6789/0 2026-02-12T03:58:48.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.884+0000 7fb1d4001640 10 monclient(hunting): picked mon.noname-a con 0x7fb1cc163310 addr v1:10.20.193.91:6789/0 2026-02-12T03:58:48.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.884+0000 7fb1d4001640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1cc146e80 con 0x7fb1cc163310 2026-02-12T03:58:48.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.884+0000 7fb1d4001640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1cc141020 con 0x7fb1cc1575d0 2026-02-12T03:58:48.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.884+0000 7fb1d4001640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1cc141300 con 0x7fb1cc0560d0 2026-02-12T03:58:48.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.884+0000 7fb1d4001640 10 monclient(hunting): _renew_subs 2026-02-12T03:58:48.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.884+0000 7fb1d4001640 10 monclient(hunting): authenticate will time out at 1131.627516s 2026-02-12T03:58:48.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.884+0000 7fb1d2577640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7fb1cc163310 0x7fb1cc129ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:59930/0 (socket says 10.20.193.91:59930) 2026-02-12T03:58:48.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.884+0000 7fb1d2577640 1 -- 10.20.193.91:0/1351130931 learned_addr learned my addr 10.20.193.91:0/1351130931 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T03:58:48.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.884+0000 7fb1ba7fc640 10 client.?.objecter ms_handle_connect 0x7fb1cc163310 2026-02-12T03:58:48.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.885+0000 7fb1ba7fc640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:48.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.885+0000 7fb1ba7fc640 10 client.?.objecter ms_handle_connect 0x7fb1cc1575d0 2026-02-12T03:58:48.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.885+0000 7fb1ba7fc640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:48.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.885+0000 7fb1ba7fc640 10 client.?.objecter ms_handle_connect 0x7fb1cc0560d0 2026-02-12T03:58:48.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.885+0000 7fb1ba7fc640 10 client.?.objecter resend_mon_ops 2026-02-12T03:58:48.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.885+0000 7fb1ba7fc640 1 -- 10.20.193.91:0/1351130931 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1255655573 0 0) 0x7fb1cc146e80 con 0x7fb1cc163310 2026-02-12T03:58:48.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.885+0000 7fb1ba7fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:48.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.885+0000 7fb1ba7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:48.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.885+0000 7fb1ba7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:48.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.885+0000 7fb1ba7fc640 10 monclient(hunting): my global_id is 4632 2026-02-12T03:58:48.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.885+0000 7fb1ba7fc640 1 -- 10.20.193.91:0/1351130931 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb19c003610 con 0x7fb1cc163310 2026-02-12T03:58:48.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.885+0000 7fb1ba7fc640 1 -- 10.20.193.91:0/1351130931 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2799561626 0 0) 0x7fb1cc141020 con 0x7fb1cc1575d0 2026-02-12T03:58:48.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.885+0000 7fb1ba7fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:48.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.885+0000 7fb1ba7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:48.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.885+0000 7fb1ba7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:48.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.885+0000 7fb1ba7fc640 10 monclient(hunting): my global_id is 4639 2026-02-12T03:58:48.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.885+0000 7fb1ba7fc640 1 -- 10.20.193.91:0/1351130931 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1cc146e80 con 0x7fb1cc1575d0 2026-02-12T03:58:48.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.886+0000 7fb1ba7fc640 1 -- 10.20.193.91:0/1351130931 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1437957056 0 0) 0x7fb1cc141300 con 0x7fb1cc0560d0 2026-02-12T03:58:48.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.886+0000 7fb1ba7fc640 10 monclient(hunting): _negotiate 2026-02-12T03:58:48.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.886+0000 7fb1ba7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:58:48.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.886+0000 7fb1ba7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:58:48.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.886+0000 7fb1ba7fc640 10 monclient(hunting): my global_id is 4595 2026-02-12T03:58:48.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.886+0000 7fb1ba7fc640 1 -- 10.20.193.91:0/1351130931 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1cc141020 con 0x7fb1cc0560d0 2026-02-12T03:58:48.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.888+0000 7fb1ba7fc640 1 -- 10.20.193.91:0/1351130931 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2537654970 0 0) 0x7fb19c003610 con 0x7fb1cc163310 2026-02-12T03:58:48.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.888+0000 7fb1ba7fc640 1 -- 10.20.193.91:0/1351130931 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb1cc141300 con 0x7fb1cc163310 2026-02-12T03:58:48.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.888+0000 7fb1ba7fc640 1 -- 10.20.193.91:0/1351130931 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fb1c8003410 con 0x7fb1cc163310 2026-02-12T03:58:48.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.888+0000 7fb1ba7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:48.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.888+0000 7fb1ba7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:58:48.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.888+0000 7fb1ba7fc640 10 monclient(hunting): dump: 2026-02-12T03:58:48.903 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:48.903 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:48.903 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.903 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.903 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:48.903 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:48.903 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:48.903 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:48.903 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:48.903 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:48.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.888+0000 7fb1ba7fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:58:48.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.888+0000 7fb1ba7fc640 1 -- 10.20.193.91:0/1351130931 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2071595397 0 0) 0x7fb1cc141020 con 0x7fb1cc0560d0 2026-02-12T03:58:48.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.888+0000 7fb1ba7fc640 1 -- 10.20.193.91:0/1351130931 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb19c003610 con 0x7fb1cc0560d0 2026-02-12T03:58:48.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.888+0000 7fb1ba7fc640 1 -- 10.20.193.91:0/1351130931 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fb1bc003070 con 0x7fb1cc0560d0 2026-02-12T03:58:48.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.888+0000 7fb1ba7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:48.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.888+0000 7fb1ba7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:48.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.888+0000 7fb1ba7fc640 10 monclient(hunting): dump: 2026-02-12T03:58:48.904 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:48.904 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:48.904 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.904 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.904 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:48.904 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:48.904 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:48.905 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:48.905 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:48.905 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:48.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.888+0000 7fb1ba7fc640 1 -- 10.20.193.91:0/1351130931 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2966858593 0 0) 0x7fb1cc146e80 con 0x7fb1cc1575d0 2026-02-12T03:58:48.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.888+0000 7fb1ba7fc640 1 -- 10.20.193.91:0/1351130931 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb1cc141020 con 0x7fb1cc1575d0 2026-02-12T03:58:48.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.888+0000 7fb1ba7fc640 1 -- 10.20.193.91:0/1351130931 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fb1c0003310 con 0x7fb1cc1575d0 2026-02-12T03:58:48.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.888+0000 7fb1ba7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:58:48.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.888+0000 7fb1ba7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T03:58:48.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.888+0000 7fb1ba7fc640 10 monclient(hunting): dump: 2026-02-12T03:58:48.905 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:48.905 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:48.905 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.906 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.906 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:48.906 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:48.906 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:48.906 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:48.906 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:48.906 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:48.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.890+0000 7fb1ba7fc640 1 -- 10.20.193.91:0/1351130931 <== mon.2 v1:10.20.193.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1786524203 0 0) 0x7fb19c003610 con 0x7fb1cc0560d0 2026-02-12T03:58:48.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.890+0000 7fb1ba7fc640 1 -- 10.20.193.91:0/1351130931 >> v1:10.20.193.98:6789/0 conn(0x7fb1cc1575d0 legacy=0x7fb1cc1423a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:48.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.890+0000 7fb1ba7fc640 1 -- 10.20.193.91:0/1351130931 >> v1:10.20.193.91:6789/0 conn(0x7fb1cc163310 legacy=0x7fb1cc129ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:48.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.890+0000 7fb1ba7fc640 10 monclient: _finish_hunting 0 2026-02-12T03:58:48.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.890+0000 7fb1ba7fc640 1 monclient: found mon.c 2026-02-12T03:58:48.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.890+0000 7fb1ba7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:58:48.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.890+0000 7fb1ba7fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:48.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.890+0000 7fb1ba7fc640 1 -- 10.20.193.91:0/1351130931 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1cc1415e0 con 0x7fb1cc0560d0 2026-02-12T03:58:48.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.890+0000 7fb1ba7fc640 10 monclient: _finish_auth 0 2026-02-12T03:58:48.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.890+0000 7fb1ba7fc640 10 monclient: _check_auth_tickets 2026-02-12T03:58:48.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.890+0000 7fb1ba7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:58:48.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.890+0000 7fb1d4001640 5 monclient: authenticate success, global_id 4595 2026-02-12T03:58:48.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.890+0000 7fb1d4001640 10 monclient: _renew_subs 2026-02-12T03:58:48.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.890+0000 7fb1d4001640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:48.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.890+0000 7fb1d4001640 1 -- 10.20.193.91:0/1351130931 --> v1:10.20.193.111:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb1cc1418c0 con 0x7fb1cc0560d0 2026-02-12T03:58:48.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.890+0000 7fb1d4001640 10 client.4595.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:58:48.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.890+0000 7fb1d4001640 10 monclient: _renew_subs 2026-02-12T03:58:48.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.890+0000 7fb1d4001640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:48.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.890+0000 7fb1d4001640 1 -- 10.20.193.91:0/1351130931 --> v1:10.20.193.111:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb1cc141e80 con 0x7fb1cc0560d0 2026-02-12T03:58:48.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.890+0000 7fb1d4001640 1 librados: init done 2026-02-12T03:58:48.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.890+0000 7fb1d4001640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:48.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.890+0000 7fb1d4001640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:48.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.890+0000 7fb1d4001640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:48.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.890+0000 7fb1d4001640 1 -- 10.20.193.91:0/1351130931 --> v1:10.20.193.111:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1cc0b7290 con 0x7fb1cc0560d0 2026-02-12T03:58:48.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.898+0000 7fb1ba7fc640 1 -- 10.20.193.91:0/1351130931 <== mon.2 v1:10.20.193.111:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb1bc0034c0 con 0x7fb1cc0560d0 2026-02-12T03:58:48.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.898+0000 7fb1ba7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T03:58:48.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.898+0000 7fb1ba7fc640 1 -- 10.20.193.91:0/1351130931 <== mon.2 v1:10.20.193.111:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fb1bc0038d0 con 0x7fb1cc0560d0 2026-02-12T03:58:48.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.898+0000 7fb1ba7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:58:48.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.898+0000 7fb1ba7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:58:48.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.898+0000 7fb1bbfff640 4 set_mon_vals no callback set 2026-02-12T03:58:48.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.898+0000 7fb1ba7fc640 10 monclient: dump: 2026-02-12T03:58:48.910 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T03:58:48.910 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:58:48.910 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.911 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:58:48.911 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T03:58:48.911 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T03:58:48.911 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:58:48.911 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:58:48.911 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:58:48.911 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T03:58:48.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.899+0000 7fb1ba7fc640 1 -- 10.20.193.91:0/1351130931 <== mon.2 v1:10.20.193.111:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7fb1bc003ab0 con 0x7fb1cc0560d0 2026-02-12T03:58:48.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.899+0000 7fb1d1575640 10 monclient: get_auth_request con 0x7fb19c07a020 auth_method 0 2026-02-12T03:58:48.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.899+0000 7fb1ba7fc640 10 client.4595.objecter ms_handle_connect 0x7fb19c07a020 2026-02-12T03:58:48.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.900+0000 7fb1ba7fc640 1 -- 10.20.193.91:0/1351130931 <== mon.2 v1:10.20.193.111:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8141+0+0 (unknown 1201408556 0 0) 0x7fb1bc059a30 con 0x7fb1cc0560d0 2026-02-12T03:58:48.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.900+0000 7fb1ba7fc640 10 client.4595.objecter ms_dispatch2 0x7fb1cc000b90 osd_map(29..29 src has 1..29) 2026-02-12T03:58:48.912 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.900+0000 7fb1ba7fc640 3 client.4595.objecter handle_osd_map got epochs [29,29] > 0 2026-02-12T03:58:48.912 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.900+0000 7fb1ba7fc640 3 client.4595.objecter handle_osd_map decoding full epoch 29 2026-02-12T03:58:48.912 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.900+0000 7fb1ba7fc640 20 client.4595.objecter dump_active .. 0 homeless 2026-02-12T03:58:48.991 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.989+0000 7fb1ba7fc640 1 -- 10.20.193.91:0/1351130931 <== mon.2 v1:10.20.193.111:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7fb1bc0038d0 con 0x7fb1cc0560d0 2026-02-12T03:58:48.991 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.989+0000 7fb1ba7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T03:58:48.991 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:48.989+0000 7fb1ba7fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T03:58:49.125 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:49.123+0000 7fb1d4001640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-12T03:58:49.126 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:49.123+0000 7fb1d4001640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-12T03:58:49.126 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:49.123+0000 7fb1d4001640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:58:49.126 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:49.123+0000 7fb1d4001640 1 -- 10.20.193.91:0/1351130931 --> v1:10.20.193.111:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb1cc15f060 con 0x7fb1cc0560d0 2026-02-12T03:58:49.152 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:49.150+0000 7fb1ba7fc640 1 -- 10.20.193.91:0/1351130931 <== mon.2 v1:10.20.193.111:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (unknown 3730786198 0 4185958460) 0x7fb1bc05e1a0 con 0x7fb1cc0560d0 2026-02-12T03:58:49.152 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:49.150+0000 7fb1ba7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-12T03:58:49.152 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:49.150+0000 7fb1ba7fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T03:58:49.152 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T03:58:49.152 INFO:teuthology.orchestra.run.trial091.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-12T03:58:49.154 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:49.152+0000 7fb1d4001640 10 librados: watch_flush enter 2026-02-12T03:58:49.155 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:49.152+0000 7fb1d4001640 10 librados: watch_flush exit 2026-02-12T03:58:49.155 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:49.152+0000 7fb1d4001640 20 client.4595.objecter shutdown clearing up homeless session... 2026-02-12T03:58:49.155 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:49.152+0000 7fb1d4001640 10 client.4595.objecter successfully canceled tick 2026-02-12T03:58:49.155 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:49.152+0000 7fb1d4001640 1 -- 10.20.193.91:0/1351130931 >> v1:10.20.193.91:6800/2929217192 conn(0x7fb19c07a020 legacy=0x7fb19c09a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:49.155 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:49.152+0000 7fb1d4001640 10 monclient: shutdown 2026-02-12T03:58:49.155 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:49.152+0000 7fb1d4001640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:58:49.155 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:49.152+0000 7fb1d4001640 1 -- 10.20.193.91:0/1351130931 >> v1:10.20.193.111:6789/0 conn(0x7fb1cc0560d0 legacy=0x7fb1cc146770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:58:49.155 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:49.152+0000 7fb1d4001640 1 -- 10.20.193.91:0/1351130931 shutdown_connections 2026-02-12T03:58:49.155 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:49.152+0000 7fb1d4001640 1 -- 10.20.193.91:0/1351130931 >> 10.20.193.91:0/1351130931 conn(0x7fb1cc0b6560 msgr2=0x7fb1cc154df0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:58:49.156 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:49.152+0000 7fb1d4001640 1 -- 10.20.193.91:0/1351130931 shutdown_connections 2026-02-12T03:58:49.156 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:49.152+0000 7fb1d4001640 1 -- 10.20.193.91:0/1351130931 wait complete. 2026-02-12T03:58:49.156 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T03:58:49.152+0000 7fb1d4001640 1 librados: shutdown 2026-02-12T03:58:49.162 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-12T03:58:49.163 INFO:teuthology.run_tasks:Running task workunit... 2026-02-12T03:58:49.188 INFO:tasks.workunit:Pulling workunits from ref 1279775fef08a9169052c6dd6a10581353958aac 2026-02-12T03:58:49.188 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-12T03:58:49.188 DEBUG:teuthology.orchestra.run.trial154:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-12T03:58:49.207 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T03:58:49.208 INFO:teuthology.orchestra.run.trial154.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-12T03:58:49.208 DEBUG:teuthology.orchestra.run.trial154:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-12T03:58:49.264 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-12T03:58:49.265 DEBUG:teuthology.orchestra.run.trial154:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-12T03:58:49.321 INFO:tasks.workunit:timeout=6h 2026-02-12T03:58:49.321 INFO:tasks.workunit:cleanup=True 2026-02-12T03:58:49.322 DEBUG:teuthology.orchestra.run.trial154:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1279775fef08a9169052c6dd6a10581353958aac 2026-02-12T03:58:49.384 INFO:tasks.workunit.client.0.trial154.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-12T03:58:53.025 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:01:13.909 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T03:58:53.046 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:01:13.926 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T03:58:53.052 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:01:13.936 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T03:58:53.073 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:01:13.920 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T03:58:53.074 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:01:13.954 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T03:58:53.099 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:01:13.946 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T03:58:53.175 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:01:14.059 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T03:58:53.198 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:01:14.078 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T03:58:53.223 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:01:14.070 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T03:59:08.887 INFO:tasks.workunit.client.0.trial154.stderr:Note: switching to '1279775fef08a9169052c6dd6a10581353958aac'. 2026-02-12T03:59:08.887 INFO:tasks.workunit.client.0.trial154.stderr: 2026-02-12T03:59:08.887 INFO:tasks.workunit.client.0.trial154.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-12T03:59:08.887 INFO:tasks.workunit.client.0.trial154.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-12T03:59:08.887 INFO:tasks.workunit.client.0.trial154.stderr:state without impacting any branches by switching back to a branch. 2026-02-12T03:59:08.887 INFO:tasks.workunit.client.0.trial154.stderr: 2026-02-12T03:59:08.887 INFO:tasks.workunit.client.0.trial154.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-12T03:59:08.887 INFO:tasks.workunit.client.0.trial154.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-12T03:59:08.887 INFO:tasks.workunit.client.0.trial154.stderr: 2026-02-12T03:59:08.887 INFO:tasks.workunit.client.0.trial154.stderr: git switch -c 2026-02-12T03:59:08.887 INFO:tasks.workunit.client.0.trial154.stderr: 2026-02-12T03:59:08.887 INFO:tasks.workunit.client.0.trial154.stderr:Or undo this operation with: 2026-02-12T03:59:08.887 INFO:tasks.workunit.client.0.trial154.stderr: 2026-02-12T03:59:08.887 INFO:tasks.workunit.client.0.trial154.stderr: git switch - 2026-02-12T03:59:08.887 INFO:tasks.workunit.client.0.trial154.stderr: 2026-02-12T03:59:08.887 INFO:tasks.workunit.client.0.trial154.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-12T03:59:08.887 INFO:tasks.workunit.client.0.trial154.stderr: 2026-02-12T03:59:08.887 INFO:tasks.workunit.client.0.trial154.stderr:HEAD is now at 1279775fef0 Merge branch 'wip-74757-tentacle' of https://github.com/shraddhaag/ceph into wip-yuri3-testing-2026-02-09-1550-tentacle 2026-02-12T03:59:08.894 DEBUG:teuthology.orchestra.run.trial154:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-12T03:59:08.951 INFO:tasks.workunit.client.0.trial154.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-12T03:59:08.953 INFO:tasks.workunit.client.0.trial154.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-12T03:59:08.953 INFO:tasks.workunit.client.0.trial154.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-12T03:59:09.040 INFO:tasks.workunit.client.0.trial154.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-12T03:59:09.071 INFO:tasks.workunit.client.0.trial154.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-12T03:59:09.096 INFO:tasks.workunit.client.0.trial154.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-12T03:59:09.098 INFO:tasks.workunit.client.0.trial154.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-12T03:59:09.098 INFO:tasks.workunit.client.0.trial154.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-12T03:59:09.124 INFO:tasks.workunit.client.0.trial154.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-12T03:59:09.128 DEBUG:teuthology.orchestra.run.trial154:> set -ex 2026-02-12T03:59:09.129 DEBUG:teuthology.orchestra.run.trial154:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-12T03:59:09.186 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2026-02-12T03:59:09.188 INFO:tasks.workunit:Running workunit rados/test.sh... 2026-02-12T03:59:09.189 DEBUG:teuthology.orchestra.run.trial154:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1279775fef08a9169052c6dd6a10581353958aac TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2026-02-12T03:59:09.248 INFO:tasks.workunit.client.0.trial154.stderr:+ parallel=1 2026-02-12T03:59:09.248 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' '' = --serial ']' 2026-02-12T03:59:09.248 INFO:tasks.workunit.client.0.trial154.stderr:+ crimson=0 2026-02-12T03:59:09.248 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' '' = --crimson ']' 2026-02-12T03:59:09.249 INFO:tasks.workunit.client.0.trial154.stderr:+ color= 2026-02-12T03:59:09.249 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -t 1 ']' 2026-02-12T03:59:09.249 INFO:tasks.workunit.client.0.trial154.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2026-02-12T03:59:09.249 INFO:tasks.workunit.client.0.trial154.stderr:+ GTEST_OUTPUT_DIR=/home/ubuntu/cephtest/archive/unit_test_xml_report 2026-02-12T03:59:09.249 INFO:tasks.workunit.client.0.trial154.stderr:+ mkdir -p /home/ubuntu/cephtest/archive/unit_test_xml_report 2026-02-12T03:59:09.250 INFO:tasks.workunit.client.0.trial154.stderr:+ declare -A pids 2026-02-12T03:59:09.250 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-12T03:59:09.250 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.250 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s api_aio 2026-02-12T03:59:09.251 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' api_aio' 2026-02-12T03:59:09.251 INFO:tasks.workunit.client.0.trial154.stderr:++ echo api_aio 2026-02-12T03:59:09.251 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.251 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=api_aio 2026-02-12T03:59:09.251 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=29811 2026-02-12T03:59:09.252 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test api_aio on pid 29811' 2026-02-12T03:59:09.252 INFO:tasks.workunit.client.0.trial154.stdout:test api_aio on pid 29811 2026-02-12T03:59:09.254 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=29811 2026-02-12T03:59:09.254 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-12T03:59:09.254 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.254 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio.xml 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2026-02-12T03:59:09.255 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s api_aio_pp 2026-02-12T03:59:09.255 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' api_aio_pp' 2026-02-12T03:59:09.255 INFO:tasks.workunit.client.0.trial154.stderr:++ echo api_aio_pp 2026-02-12T03:59:09.255 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.255 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.255 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.255 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.255 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.255 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.255 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.256 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.256 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.256 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.256 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.256 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.256 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.256 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.256 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.256 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.256 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.256 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.256 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.257 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.257 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=api_aio_pp 2026-02-12T03:59:09.257 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=29818 2026-02-12T03:59:09.257 INFO:tasks.workunit.client.0.trial154.stdout:test api_aio_pp on pid 29818 2026-02-12T03:59:09.261 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test api_aio_pp on pid 29818' 2026-02-12T03:59:09.262 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=29818 2026-02-12T03:59:09.262 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-12T03:59:09.262 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.262 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio_pp.xml 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2026-02-12T03:59:09.262 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s api_io 2026-02-12T03:59:09.262 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' api_io' 2026-02-12T03:59:09.262 INFO:tasks.workunit.client.0.trial154.stderr:++ echo api_io 2026-02-12T03:59:09.262 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.262 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.262 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.262 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.263 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.263 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.263 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.263 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.263 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.263 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.263 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.263 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.263 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.263 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.263 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.263 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.264 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.264 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.264 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.264 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.264 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.264 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.264 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.264 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.264 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.264 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.264 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.264 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.265 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.265 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.265 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.265 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.265 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.265 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.265 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.265 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.265 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.265 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.265 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.265 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.266 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=api_io 2026-02-12T03:59:09.266 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=29829 2026-02-12T03:59:09.266 INFO:tasks.workunit.client.0.trial154.stdout:test api_io on pid 29829 2026-02-12T03:59:09.270 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test api_io on pid 29829' 2026-02-12T03:59:09.270 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=29829 2026-02-12T03:59:09.270 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-12T03:59:09.270 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.270 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io.xml 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2026-02-12T03:59:09.270 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s api_io_pp 2026-02-12T03:59:09.270 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' api_io_pp' 2026-02-12T03:59:09.271 INFO:tasks.workunit.client.0.trial154.stderr:++ echo api_io_pp 2026-02-12T03:59:09.271 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.271 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.271 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.271 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.271 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.271 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.271 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.271 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.271 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.271 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.271 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.271 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.272 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.272 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.272 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.272 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.272 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.272 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.272 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.272 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.272 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.272 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.272 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.272 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.273 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.273 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.273 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.273 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.273 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.273 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.273 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.273 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.273 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.273 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.273 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.273 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.274 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.274 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.274 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.274 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.274 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.274 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.274 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.274 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.274 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.274 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.274 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.274 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.274 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.275 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=api_io_pp 2026-02-12T03:59:09.275 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=29840 2026-02-12T03:59:09.275 INFO:tasks.workunit.client.0.trial154.stdout:test api_io_pp on pid 29840 2026-02-12T03:59:09.280 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test api_io_pp on pid 29840' 2026-02-12T03:59:09.280 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=29840 2026-02-12T03:59:09.281 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-12T03:59:09.281 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.281 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io_pp.xml 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2026-02-12T03:59:09.281 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s api_asio 2026-02-12T03:59:09.281 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' api_asio' 2026-02-12T03:59:09.281 INFO:tasks.workunit.client.0.trial154.stderr:++ echo api_asio 2026-02-12T03:59:09.281 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.281 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.281 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.281 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.281 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.282 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.282 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.282 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.282 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.282 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.282 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.282 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.282 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.282 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.282 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.282 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.282 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.282 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.283 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.283 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.283 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.283 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.283 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.283 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.283 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.283 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.283 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.283 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.283 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.283 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.283 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.283 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.284 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.284 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.284 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.284 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.284 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.284 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.284 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.284 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.284 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.284 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.284 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.284 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.284 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.284 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.285 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.285 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.285 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.285 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.285 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.285 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.285 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.285 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.285 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.285 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.285 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.285 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.285 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.285 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.285 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.286 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.286 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.286 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.286 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.286 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.286 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.286 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.286 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.286 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.286 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.286 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.286 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.286 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.286 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.287 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=api_asio 2026-02-12T03:59:09.287 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.287 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=29855 2026-02-12T03:59:09.287 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test api_asio on pid 29855' 2026-02-12T03:59:09.287 INFO:tasks.workunit.client.0.trial154.stdout:test api_asio on pid 29855 2026-02-12T03:59:09.292 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=29855 2026-02-12T03:59:09.292 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-12T03:59:09.292 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.292 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_asio.xml 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2026-02-12T03:59:09.292 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s api_list 2026-02-12T03:59:09.292 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' api_list' 2026-02-12T03:59:09.293 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.293 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.293 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.293 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.293 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.293 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.293 INFO:tasks.workunit.client.0.trial154.stderr:++ echo api_list 2026-02-12T03:59:09.293 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.293 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.293 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.293 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.293 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.293 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.293 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.293 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.293 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.293 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.293 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.293 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.294 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.294 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.294 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.294 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.294 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.294 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.294 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.294 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.294 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.294 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.294 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.294 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.294 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.294 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.294 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.294 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.294 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.294 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.294 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.295 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.295 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.295 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.295 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.295 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.295 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.295 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.295 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.295 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.295 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.295 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.295 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.295 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.295 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.295 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.295 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.295 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.295 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.295 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.296 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.296 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/29811/exe ']' 2026-02-12T03:59:09.296 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.296 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.296 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.296 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.296 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.296 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.296 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.296 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.296 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.296 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.296 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.296 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.296 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.296 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.296 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.296 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.296 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.296 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.297 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.297 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.297 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.297 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.297 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.297 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.297 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.297 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.297 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.297 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.297 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.297 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.297 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.297 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.297 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.297 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/29811/exe 2026-02-12T03:59:09.297 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.297 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.297 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=api_list 2026-02-12T03:59:09.297 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.298 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.298 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.298 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.298 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=29870 2026-02-12T03:59:09.298 INFO:tasks.workunit.client.0.trial154.stdout:test api_list on pid 29870 2026-02-12T03:59:09.302 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test api_list on pid 29870' 2026-02-12T03:59:09.302 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=29870 2026-02-12T03:59:09.302 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-12T03:59:09.302 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.302 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_list.xml 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2026-02-12T03:59:09.302 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.302 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s api_lock 2026-02-12T03:59:09.302 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' api_lock' 2026-02-12T03:59:09.303 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.303 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.303 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.303 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.303 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.303 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.303 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.303 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.303 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.303 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.303 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.303 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.303 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.303 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.303 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.303 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.303 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.303 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.303 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.303 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.303 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.303 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.303 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.303 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.304 INFO:tasks.workunit.client.0.trial154.stderr:++ echo api_lock 2026-02-12T03:59:09.304 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.304 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.304 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.304 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.304 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.304 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.304 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.304 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.304 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.304 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.304 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.304 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.304 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.304 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.304 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.304 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio.xml 2026-02-12T03:59:09.304 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.304 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_rados_api_aio.log 2026-02-12T03:59:09.304 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.304 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.304 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.304 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.304 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.304 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.304 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.305 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ api_aio: /' 2026-02-12T03:59:09.305 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.305 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.305 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.305 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.305 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.305 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.305 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.305 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.305 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.305 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.305 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.305 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.305 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.305 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.305 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.305 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.305 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.305 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.305 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.305 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.305 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.305 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.305 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.305 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.306 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.306 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.306 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.306 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.306 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.306 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/29818/exe ']' 2026-02-12T03:59:09.306 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.306 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.306 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.306 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.306 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.306 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.306 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.306 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.306 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.306 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.306 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.306 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.306 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.306 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.306 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.306 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.306 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.306 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.306 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.306 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.307 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.307 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.307 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.307 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.307 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.307 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.307 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/29818/exe 2026-02-12T03:59:09.307 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.307 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.307 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.307 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.307 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.307 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.307 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=api_lock 2026-02-12T03:59:09.307 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=29891 2026-02-12T03:59:09.307 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test api_lock on pid 29891' 2026-02-12T03:59:09.307 INFO:tasks.workunit.client.0.trial154.stdout:test api_lock on pid 29891 2026-02-12T03:59:09.311 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=29891 2026-02-12T03:59:09.311 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.311 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-12T03:59:09.311 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.311 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock.xml 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2026-02-12T03:59:09.311 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s api_lock_pp 2026-02-12T03:59:09.311 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' api_lock_pp' 2026-02-12T03:59:09.311 INFO:tasks.workunit.client.0.trial154.stderr:++ echo api_lock_pp 2026-02-12T03:59:09.311 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.311 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.311 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.311 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.311 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.311 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.311 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.311 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.311 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.311 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.311 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.312 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.312 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.312 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.312 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.312 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.312 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.312 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.312 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.312 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.312 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.312 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.312 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.312 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.312 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.312 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.312 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.312 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.312 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.312 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.312 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.312 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.312 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.312 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.312 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.312 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.312 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.312 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.312 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.312 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.313 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.313 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.313 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.313 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.313 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.313 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.313 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.313 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.313 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.313 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.313 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.313 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.313 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.313 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.313 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.313 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/29829/exe ']' 2026-02-12T03:59:09.313 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.313 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio_pp.xml 2026-02-12T03:59:09.313 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.313 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.313 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.313 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.313 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.313 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.313 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.313 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.313 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.313 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.313 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_rados_api_aio_pp.log 2026-02-12T03:59:09.313 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.313 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.314 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.314 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.314 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.314 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.314 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.314 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.314 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.314 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.314 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.314 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.314 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.314 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.314 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.314 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.314 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.314 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.314 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.314 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ api_aio_pp: /' 2026-02-12T03:59:09.314 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.314 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.314 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.314 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.314 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.314 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.314 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.314 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/29829/exe 2026-02-12T03:59:09.314 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.314 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.314 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.314 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.314 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.314 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.315 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.315 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.315 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.315 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.315 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.315 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.315 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.315 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=api_lock_pp 2026-02-12T03:59:09.315 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.315 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.315 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.315 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=29910 2026-02-12T03:59:09.315 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test api_lock_pp on pid 29910' 2026-02-12T03:59:09.315 INFO:tasks.workunit.client.0.trial154.stdout:test api_lock_pp on pid 29910 2026-02-12T03:59:09.318 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=29910 2026-02-12T03:59:09.318 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-12T03:59:09.318 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.318 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock_pp.xml 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2026-02-12T03:59:09.318 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.318 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s api_misc 2026-02-12T03:59:09.318 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' api_misc' 2026-02-12T03:59:09.318 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.318 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.318 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.318 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.318 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.318 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.318 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.318 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.318 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.319 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.319 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.319 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.319 INFO:tasks.workunit.client.0.trial154.stderr:++ echo api_misc 2026-02-12T03:59:09.319 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.319 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io.xml 2026-02-12T03:59:09.319 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.319 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.319 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_rados_api_io.log 2026-02-12T03:59:09.319 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.319 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.319 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.319 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.319 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.319 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.319 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.319 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.319 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.319 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.319 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.319 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.319 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.319 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ api_io: /' 2026-02-12T03:59:09.319 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.319 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.319 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.319 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.319 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.319 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.319 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.319 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.319 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.319 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.320 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.320 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.320 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.320 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.320 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.320 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.320 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.320 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.320 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.320 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.320 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.320 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.320 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.320 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.320 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.320 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.320 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.320 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.320 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.320 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.320 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.320 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.320 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.320 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.320 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.320 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.320 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.320 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.320 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.320 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.320 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.320 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/29840/exe ']' 2026-02-12T03:59:09.321 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.321 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.321 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.321 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.321 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.321 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.321 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.321 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.321 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.321 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.321 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.321 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.321 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.321 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.321 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.321 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.321 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.321 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.321 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.321 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.321 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.321 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.321 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.321 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.321 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.321 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.321 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.321 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.321 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.321 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.321 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.322 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.322 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/29840/exe 2026-02-12T03:59:09.322 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.322 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=api_misc 2026-02-12T03:59:09.322 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=29929 2026-02-12T03:59:09.322 INFO:tasks.workunit.client.0.trial154.stdout:test api_misc on pid 29929 2026-02-12T03:59:09.324 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test api_misc on pid 29929' 2026-02-12T03:59:09.324 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=29929 2026-02-12T03:59:09.324 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-12T03:59:09.324 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.325 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc.xml 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2026-02-12T03:59:09.325 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.325 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.325 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.325 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.325 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.325 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.325 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s api_misc_pp 2026-02-12T03:59:09.325 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' api_misc_pp' 2026-02-12T03:59:09.325 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.325 INFO:tasks.workunit.client.0.trial154.stderr:++ echo api_misc_pp 2026-02-12T03:59:09.325 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.325 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.325 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.325 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.325 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.325 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.325 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.325 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.325 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.325 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.325 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.325 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.325 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.325 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.325 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.325 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.325 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.325 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.325 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.325 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.325 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.325 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.325 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.325 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.325 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.325 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.326 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.326 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.326 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.326 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.326 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.326 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.326 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.326 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.326 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.326 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.326 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.326 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.326 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.326 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.326 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io_pp.xml 2026-02-12T03:59:09.326 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.326 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.326 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.326 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.326 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.326 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.326 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.326 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.326 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.326 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.326 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.326 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.326 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.326 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.326 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.326 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.326 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.326 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.326 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.326 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.326 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_rados_api_io_pp.log 2026-02-12T03:59:09.327 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.327 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.327 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.327 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.327 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.327 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.327 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.327 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.327 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.327 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.327 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.327 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.327 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.327 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.327 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.327 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.327 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.327 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.327 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.327 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.327 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.327 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.327 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.327 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.327 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.327 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.327 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.327 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/29855/exe ']' 2026-02-12T03:59:09.327 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ api_io_pp: /' 2026-02-12T03:59:09.327 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.327 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.327 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.327 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.327 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.327 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.327 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.328 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.328 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.328 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.328 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.328 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.328 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.328 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.328 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.328 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/29855/exe 2026-02-12T03:59:09.328 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=api_misc_pp 2026-02-12T03:59:09.328 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=29949 2026-02-12T03:59:09.328 INFO:tasks.workunit.client.0.trial154.stdout:test api_misc_pp on pid 29949 2026-02-12T03:59:09.330 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test api_misc_pp on pid 29949' 2026-02-12T03:59:09.330 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=29949 2026-02-12T03:59:09.330 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-12T03:59:09.330 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.330 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc_pp.xml 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2026-02-12T03:59:09.330 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.330 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.330 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.330 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.330 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.330 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.330 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s api_pool 2026-02-12T03:59:09.330 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' api_pool' 2026-02-12T03:59:09.330 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.330 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.330 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.330 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.330 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:++ echo api_pool 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_asio.xml 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_rados_api_asio.log 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ api_asio: /' 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.331 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/29870/exe ']' 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.332 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.333 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.333 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.333 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.333 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.333 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.333 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.333 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.333 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.333 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.333 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.333 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.333 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.333 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.333 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.333 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.333 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.333 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.333 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.333 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.333 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.333 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.333 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.333 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/29870/exe 2026-02-12T03:59:09.333 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=api_pool 2026-02-12T03:59:09.333 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=29970 2026-02-12T03:59:09.333 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test api_pool on pid 29970' 2026-02-12T03:59:09.333 INFO:tasks.workunit.client.0.trial154.stdout:test api_pool on pid 29970 2026-02-12T03:59:09.336 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=29970 2026-02-12T03:59:09.336 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-12T03:59:09.336 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.336 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_pool.xml 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2026-02-12T03:59:09.336 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s api_snapshots 2026-02-12T03:59:09.336 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.336 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.336 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.336 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' api_snapshots' 2026-02-12T03:59:09.336 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.336 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.336 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.336 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.336 INFO:tasks.workunit.client.0.trial154.stderr:++ echo api_snapshots 2026-02-12T03:59:09.336 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.336 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.336 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.336 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.336 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.336 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.336 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.336 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.336 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.336 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.336 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.336 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.336 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.336 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.336 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.336 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.336 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.336 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.336 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.336 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.336 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.336 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_list.xml 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.337 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_rados_api_list.log 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ api_list: /' 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/29891/exe ']' 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/29891/exe 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=api_snapshots 2026-02-12T03:59:09.338 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.339 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.339 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.339 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=29990 2026-02-12T03:59:09.339 INFO:tasks.workunit.client.0.trial154.stdout:test api_snapshots on pid 29990 2026-02-12T03:59:09.340 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test api_snapshots on pid 29990' 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=29990 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots.xml 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s api_snapshots_pp 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' api_snapshots_pp' 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:++ echo api_snapshots_pp 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.341 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/29910/exe ']' 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.342 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.343 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.343 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.343 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.343 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.343 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.343 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.343 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.343 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.343 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.343 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.343 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.343 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock.xml 2026-02-12T03:59:09.343 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.343 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_rados_api_lock.log 2026-02-12T03:59:09.343 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.343 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.343 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.343 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.343 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ api_lock: /' 2026-02-12T03:59:09.343 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.343 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.343 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.343 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.343 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.343 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.343 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/29910/exe 2026-02-12T03:59:09.343 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=api_snapshots_pp 2026-02-12T03:59:09.343 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30015 2026-02-12T03:59:09.343 INFO:tasks.workunit.client.0.trial154.stdout:test api_snapshots_pp on pid 30015 2026-02-12T03:59:09.345 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test api_snapshots_pp on pid 30015' 2026-02-12T03:59:09.345 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=30015 2026-02-12T03:59:09.345 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-12T03:59:09.345 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.345 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.345 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots_pp.xml 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2026-02-12T03:59:09.345 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.345 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.345 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.345 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.345 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s api_stat 2026-02-12T03:59:09.345 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' api_stat' 2026-02-12T03:59:09.345 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.345 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.345 INFO:tasks.workunit.client.0.trial154.stderr:++ echo api_stat 2026-02-12T03:59:09.345 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.345 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.345 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.345 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.345 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.345 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.345 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.345 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.345 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.345 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.345 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.345 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock_pp.xml 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.346 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_rados_api_lock_pp.log 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ api_lock_pp: /' 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/29929/exe ']' 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.347 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.348 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.348 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.348 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.348 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.348 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.348 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.348 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/29929/exe 2026-02-12T03:59:09.348 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=api_stat 2026-02-12T03:59:09.348 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30037 2026-02-12T03:59:09.348 INFO:tasks.workunit.client.0.trial154.stdout:test api_stat on pid 30037 2026-02-12T03:59:09.350 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test api_stat on pid 30037' 2026-02-12T03:59:09.350 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=30037 2026-02-12T03:59:09.350 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-12T03:59:09.350 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.350 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat.xml 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2026-02-12T03:59:09.350 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s api_stat_pp 2026-02-12T03:59:09.350 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.350 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' api_stat_pp' 2026-02-12T03:59:09.350 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.350 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.350 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.350 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.350 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.350 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.350 INFO:tasks.workunit.client.0.trial154.stderr:++ echo api_stat_pp 2026-02-12T03:59:09.350 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.350 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.350 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.350 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.350 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.350 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.350 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.350 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.350 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.350 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.350 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.350 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.350 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.350 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.350 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc.xml 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.351 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_rados_api_misc.log 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ api_misc: /' 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/29949/exe ']' 2026-02-12T03:59:09.352 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/29949/exe 2026-02-12T03:59:09.353 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=api_stat_pp 2026-02-12T03:59:09.353 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30072 2026-02-12T03:59:09.353 INFO:tasks.workunit.client.0.trial154.stdout:test api_stat_pp on pid 30072 2026-02-12T03:59:09.355 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test api_stat_pp on pid 30072' 2026-02-12T03:59:09.355 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=30072 2026-02-12T03:59:09.355 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-12T03:59:09.355 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.355 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat_pp.xml 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2026-02-12T03:59:09.355 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s api_watch_notify 2026-02-12T03:59:09.355 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' api_watch_notify' 2026-02-12T03:59:09.355 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.355 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.355 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.355 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.355 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.355 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.355 INFO:tasks.workunit.client.0.trial154.stderr:++ echo api_watch_notify 2026-02-12T03:59:09.355 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.355 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.355 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.355 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.355 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.355 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.355 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.355 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.355 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.355 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.355 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.355 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.355 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.355 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.355 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.355 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.355 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.355 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.356 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc_pp.xml 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_rados_api_misc_pp.log 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/29970/exe ']' 2026-02-12T03:59:09.357 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ api_misc_pp: /' 2026-02-12T03:59:09.358 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=api_watch_notify 2026-02-12T03:59:09.358 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30102 2026-02-12T03:59:09.358 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test api_watch_notify on pid 30102' 2026-02-12T03:59:09.358 INFO:tasks.workunit.client.0.trial154.stdout:test api_watch_notify on pid 30102 2026-02-12T03:59:09.361 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=30102 2026-02-12T03:59:09.361 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-12T03:59:09.361 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.361 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify.xml 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2026-02-12T03:59:09.361 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.361 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.361 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.361 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.361 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.361 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/29970/exe 2026-02-12T03:59:09.361 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s api_watch_notify_pp 2026-02-12T03:59:09.361 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' api_watch_notify_pp' 2026-02-12T03:59:09.361 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.361 INFO:tasks.workunit.client.0.trial154.stderr:++ echo api_watch_notify_pp 2026-02-12T03:59:09.361 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.361 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.361 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.361 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.361 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.361 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.361 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.361 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.361 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.361 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.361 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.361 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.361 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.361 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.361 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.361 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.361 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.361 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.361 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.362 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/29990/exe ']' 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/29990/exe 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_pool.xml 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_rados_api_pool.log 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ api_pool: /' 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=api_watch_notify_pp 2026-02-12T03:59:09.363 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30137 2026-02-12T03:59:09.364 INFO:tasks.workunit.client.0.trial154.stdout:test api_watch_notify_pp on pid 30137 2026-02-12T03:59:09.366 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test api_watch_notify_pp on pid 30137' 2026-02-12T03:59:09.366 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=30137 2026-02-12T03:59:09.366 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.366 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-12T03:59:09.366 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.366 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify_pp.xml 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2026-02-12T03:59:09.366 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.366 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.366 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.366 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.366 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.366 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s api_cmd 2026-02-12T03:59:09.366 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.366 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' api_cmd' 2026-02-12T03:59:09.366 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.366 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.366 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.366 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:++ echo api_cmd 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots.xml 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.367 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_rados_api_snapshots.log 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ api_snapshots: /' 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.368 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.369 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.369 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/30015/exe ']' 2026-02-12T03:59:09.369 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.369 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.369 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.369 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.369 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.369 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.369 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.369 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.369 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.369 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/30015/exe 2026-02-12T03:59:09.369 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.369 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.369 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.369 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.369 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.369 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.369 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.369 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=api_cmd 2026-02-12T03:59:09.369 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30160 2026-02-12T03:59:09.369 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test api_cmd on pid 30160' 2026-02-12T03:59:09.369 INFO:tasks.workunit.client.0.trial154.stdout:test api_cmd on pid 30160 2026-02-12T03:59:09.372 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=30160 2026-02-12T03:59:09.372 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-12T03:59:09.372 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.373 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd.xml 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2026-02-12T03:59:09.373 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s api_cmd_pp 2026-02-12T03:59:09.373 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.373 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.373 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.373 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.373 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.373 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.373 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.373 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.373 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.373 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' api_cmd_pp' 2026-02-12T03:59:09.373 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.373 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.373 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.373 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.373 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.373 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.373 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.373 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.373 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.373 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.373 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.373 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.373 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.374 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.374 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.374 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.374 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.374 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.374 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.374 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.374 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.374 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.374 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.374 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.374 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.374 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.374 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.374 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.374 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.374 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.374 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.374 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.374 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.374 INFO:tasks.workunit.client.0.trial154.stderr:++ echo api_cmd_pp 2026-02-12T03:59:09.374 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.374 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/30037/exe ']' 2026-02-12T03:59:09.374 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.374 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.374 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.375 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.375 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.375 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.375 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.375 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.375 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.375 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.375 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.375 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.375 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.375 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.375 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.375 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.375 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.375 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.375 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.375 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.375 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.375 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots_pp.xml 2026-02-12T03:59:09.375 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.375 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.375 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.375 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.375 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.375 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.376 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.376 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.376 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2026-02-12T03:59:09.376 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.376 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.376 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.376 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.376 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ api_snapshots_pp: /' 2026-02-12T03:59:09.376 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/30037/exe 2026-02-12T03:59:09.376 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.376 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.376 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.376 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.376 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.376 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.376 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.376 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.376 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.376 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.376 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.376 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.376 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.376 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.376 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.376 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.376 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.376 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.377 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.377 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.377 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.377 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.377 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.377 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.377 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.377 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.377 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.377 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=api_cmd_pp 2026-02-12T03:59:09.377 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.377 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.377 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.377 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.377 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.377 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30185 2026-02-12T03:59:09.377 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test api_cmd_pp on pid 30185' 2026-02-12T03:59:09.377 INFO:tasks.workunit.client.0.trial154.stdout:test api_cmd_pp on pid 30185 2026-02-12T03:59:09.380 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=30185 2026-02-12T03:59:09.380 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd_pp.xml 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s api_service 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' api_service' 2026-02-12T03:59:09.381 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat.xml 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_rados_api_stat.log 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:++ echo api_service 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ api_stat: /' 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.382 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/30072/exe ']' 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/30072/exe 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=api_service 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30235 2026-02-12T03:59:09.383 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test api_service on pid 30235' 2026-02-12T03:59:09.384 INFO:tasks.workunit.client.0.trial154.stdout:test api_service on pid 30235 2026-02-12T03:59:09.385 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=30235 2026-02-12T03:59:09.385 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-12T03:59:09.385 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.385 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service.xml 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s api_service_pp 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' api_service_pp' 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:++ echo api_service_pp 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/30102/exe ']' 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.386 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/30102/exe 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat_pp.xml 2026-02-12T03:59:09.387 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_rados_api_stat_pp.log 2026-02-12T03:59:09.388 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.388 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.388 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.388 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.388 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.388 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.388 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.388 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ api_stat_pp: /' 2026-02-12T03:59:09.388 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.388 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.388 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.388 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=api_service_pp 2026-02-12T03:59:09.388 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.388 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30259 2026-02-12T03:59:09.388 INFO:tasks.workunit.client.0.trial154.stdout:test api_service_pp on pid 30259 2026-02-12T03:59:09.390 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test api_service_pp on pid 30259' 2026-02-12T03:59:09.390 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=30259 2026-02-12T03:59:09.390 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.390 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.390 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.390 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-12T03:59:09.390 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.390 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.390 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.390 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service_pp.xml 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2026-02-12T03:59:09.390 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s api_c_write_operations 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/30137/exe ']' 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify.xml 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_rados_api_watch_notify.log 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' api_c_write_operations' 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ api_watch_notify: /' 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/30137/exe 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.391 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:++ echo api_c_write_operations 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.392 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.393 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.393 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.393 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.393 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.393 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.393 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.393 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.393 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.393 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.393 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.393 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.393 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.393 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.393 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.393 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.393 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.393 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.393 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.393 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.393 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.393 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.393 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.393 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.393 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.393 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.393 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.393 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.393 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.393 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify_pp.xml 2026-02-12T03:59:09.393 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2026-02-12T03:59:09.393 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2026-02-12T03:59:09.393 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=api_c_write_operations 2026-02-12T03:59:09.393 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30289 2026-02-12T03:59:09.393 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test api_c_write_operations on pid 30289' 2026-02-12T03:59:09.393 INFO:tasks.workunit.client.0.trial154.stdout:test api_c_write_operations on pid 30289 2026-02-12T03:59:09.396 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.396 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=30289 2026-02-12T03:59:09.396 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.396 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-12T03:59:09.396 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.396 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.396 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.396 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.396 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_write_operations.xml 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2026-02-12T03:59:09.396 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.396 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.396 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.396 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.396 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.396 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.396 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.396 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.396 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.396 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.396 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.396 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.396 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.396 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.396 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s api_c_read_operations 2026-02-12T03:59:09.396 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.396 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.396 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.396 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' api_c_read_operations' 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:++ echo api_c_read_operations 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.397 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/30160/exe ']' 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/30160/exe 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.398 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.399 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.399 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.399 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=api_c_read_operations 2026-02-12T03:59:09.399 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.399 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.399 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.399 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.399 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.399 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30324 2026-02-12T03:59:09.399 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test api_c_read_operations on pid 30324' 2026-02-12T03:59:09.399 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.399 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.399 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.399 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.399 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.399 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.399 INFO:tasks.workunit.client.0.trial154.stdout:test api_c_read_operations on pid 30324 2026-02-12T03:59:09.402 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_read_operations.xml 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2026-02-12T03:59:09.402 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=30324 2026-02-12T03:59:09.402 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.402 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.402 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.402 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.402 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.402 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-12T03:59:09.402 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/30185/exe ']' 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s list_parallel 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.403 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' list_parallel' 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd.xml 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/30185/exe 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_rados_api_cmd.log 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:++ echo list_parallel 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ api_cmd: /' 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.404 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.405 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.406 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.406 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.406 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.406 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.406 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.406 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.406 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.406 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.406 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.406 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.406 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.406 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.406 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.406 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.406 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.406 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.406 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.406 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/30235/exe ']' 2026-02-12T03:59:09.406 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.406 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.406 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.406 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.406 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.406 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd_pp.xml 2026-02-12T03:59:09.406 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=list_parallel 2026-02-12T03:59:09.406 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2026-02-12T03:59:09.406 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ api_cmd_pp: /' 2026-02-12T03:59:09.406 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30369 2026-02-12T03:59:09.406 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/list_parallel.xml 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2026-02-12T03:59:09.406 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test list_parallel on pid 30369' 2026-02-12T03:59:09.406 INFO:tasks.workunit.client.0.trial154.stdout:test list_parallel on pid 30369 2026-02-12T03:59:09.408 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=30369 2026-02-12T03:59:09.408 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/30235/exe 2026-02-12T03:59:09.408 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-12T03:59:09.408 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.408 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.408 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.408 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s open_pools_parallel 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' open_pools_parallel' 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:++ echo open_pools_parallel 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.409 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service.xml 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_rados_api_service.log 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ api_service: /' 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.410 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.411 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.411 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.411 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.411 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.411 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.411 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.411 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.411 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.411 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.411 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.411 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.411 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.411 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.411 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.411 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.411 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/30259/exe ']' 2026-02-12T03:59:09.411 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.411 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=open_pools_parallel 2026-02-12T03:59:09.411 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30397 2026-02-12T03:59:09.411 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test open_pools_parallel on pid 30397' 2026-02-12T03:59:09.411 INFO:tasks.workunit.client.0.trial154.stdout:test open_pools_parallel on pid 30397 2026-02-12T03:59:09.413 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/30259/exe 2026-02-12T03:59:09.413 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/open_pools_parallel.xml 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2026-02-12T03:59:09.413 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=30397 2026-02-12T03:59:09.413 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-12T03:59:09.413 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.413 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s delete_pools_parallel 2026-02-12T03:59:09.413 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' delete_pools_parallel' 2026-02-12T03:59:09.413 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.413 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.413 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.413 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.413 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.413 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.413 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:++ echo delete_pools_parallel 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.414 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service_pp.xml 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=delete_pools_parallel 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_rados_api_service_pp.log 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/30289/exe ']' 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ api_service_pp: /' 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30413 2026-02-12T03:59:09.415 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test delete_pools_parallel on pid 30413' 2026-02-12T03:59:09.416 INFO:tasks.workunit.client.0.trial154.stdout:test delete_pools_parallel on pid 30413 2026-02-12T03:59:09.417 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=30413 2026-02-12T03:59:09.417 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-12T03:59:09.417 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.417 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/delete_pools_parallel.xml 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2026-02-12T03:59:09.417 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.417 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s cls 2026-02-12T03:59:09.417 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.417 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.417 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.417 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.417 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.417 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.417 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.417 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' cls' 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/30289/exe 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:++ echo cls 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.418 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_write_operations.xml 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=cls 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30461 2026-02-12T03:59:09.419 INFO:tasks.workunit.client.0.trial154.stdout:test cls on pid 30461 2026-02-12T03:59:09.420 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test cls on pid 30461' 2026-02-12T03:59:09.420 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=30461 2026-02-12T03:59:09.420 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-12T03:59:09.420 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ api_c_write_operations: /' 2026-02-12T03:59:09.420 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.420 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cls 2>&1 | tee ceph_test_neorados_cls.log | sed "s/^/ cls: /"' 2026-02-12T03:59:09.420 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s cmd 2026-02-12T03:59:09.420 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' cmd' 2026-02-12T03:59:09.420 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [==========] Running 29 tests from 1 test suite. 2026-02-12T03:59:09.420 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [----------] Global test environment set-up. 2026-02-12T03:59:09.420 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [----------] 29 tests from AsioRados 2026-02-12T03:59:09.420 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.308+0000 7f4a3c022880 10 monclient: get_monmap_and_config 2026-02-12T03:59:09.420 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.308+0000 7f4a3c022880 10 monclient: build_initial_monmap 2026-02-12T03:59:09.420 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.308+0000 7f4a3c022880 10 monclient: monmap: 2026-02-12T03:59:09.420 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: epoch 0 2026-02-12T03:59:09.420 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:59:09.420 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: last_changed 0.000000 2026-02-12T03:59:09.420 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: created 0.000000 2026-02-12T03:59:09.420 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: min_mon_release 0 (unknown) 2026-02-12T03:59:09.420 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: election_strategy: 1 2026-02-12T03:59:09.420 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:59:09.420 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:59:09.420 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:59:09.420 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.420 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.308+0000 7f4a3c022880 1 Processor -- start 2026-02-12T03:59:09.420 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.308+0000 7f4a3c022880 1 -- start start 2026-02-12T03:59:09.420 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.308+0000 7f4a3c022880 10 monclient: init 2026-02-12T03:59:09.420 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.308+0000 7f4a3c022880 10 monclient: _reopen_session rank -1 2026-02-12T03:59:09.420 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.308+0000 7f4a3c022880 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T03:59:09.420 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.308+0000 7f4a3c022880 10 monclient(hunting): picked mon.noname-c con 0x55946bacc540 addr v1:10.20.193.111:6789/0 2026-02-12T03:59:09.420 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.308+0000 7f4a3c022880 10 monclient(hunting): picked mon.noname-a con 0x55946bacd020 addr v1:10.20.193.91:6789/0 2026-02-12T03:59:09.420 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.308+0000 7f4a3c022880 10 monclient(hunting): picked mon.noname-b con 0x55946bbc09c0 addr v1:10.20.193.98:6789/0 2026-02-12T03:59:09.421 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.308+0000 7f4a3c022880 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55946bb5a7e0 con 0x55946bacd020 2026-02-12T03:59:09.421 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.308+0000 7f4a3c022880 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55946bb5a9b0 con 0x55946bbc09c0 2026-02-12T03:59:09.421 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.308+0000 7f4a3c022880 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55946bbbad90 con 0x55946bacc540 2026-02-12T03:59:09.421 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.308+0000 7f4a3c022880 10 monclient(hunting): _renew_subs 2026-02-12T03:59:09.421 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.308+0000 7f4a3c022880 10 monclient(hunting): authenticate will time out at 1149.960714s 2026-02-12T03:59:09.421 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.312+0000 7f4a32ffd640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x55946bacd020 0x55946bb5bd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.154:51842/0 (socket says 10.20.193.154:51842) 2026-02-12T03:59:09.421 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.312+0000 7f4a32ffd640 1 -- 10.20.193.154:0/474084380 learned_addr learned my addr 10.20.193.154:0/474084380 (peer_addr_for_me v1:10.20.193.154:0/0) 2026-02-12T03:59:09.421 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.318+0000 7f4a31ffb640 1 -- 10.20.193.154:0/474084380 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4194742243 0 0) 0x55946bb5a7e0 con 0x55946bacd020 2026-02-12T03:59:09.421 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.318+0000 7f4a31ffb640 10 monclient(hunting): _negotiate 2026-02-12T03:59:09.421 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.318+0000 7f4a31ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:59:09.421 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.318+0000 7f4a31ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:59:09.421 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.318+0000 7f4a31ffb640 10 monclient(hunting): my global_id is 4668 2026-02-12T03:59:09.422 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.422 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.422 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/30324/exe ']' 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:++ echo cmd 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.423 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/30324/exe 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=cmd 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.424 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.425 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.425 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30477 2026-02-12T03:59:09.425 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test cmd on pid 30477' 2026-02-12T03:59:09.425 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.318+0000 7f4a31ffb640 1 -- 10.20.193.154:0/474084380 --> v1:10.20.1test cmd on pid 30477 2026-02-12T03:59:09.427 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=30477 2026-02-12T03:59:09.427 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-12T03:59:09.427 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.427 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cmd 2>&1 | tee ceph_test_neorados_cmd.log | sed "s/^/ cmd: /"' 2026-02-12T03:59:09.427 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.427 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.427 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.427 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s handler_error 2026-02-12T03:59:09.427 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.427 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.427 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.427 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.427 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.427 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.427 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.427 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' handler_error' 2026-02-12T03:59:09.427 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.427 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.427 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.427 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.427 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.427 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.427 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.427 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_read_operations.xml 2026-02-12T03:59:09.427 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2026-02-12T03:59:09.427 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.427 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ api_c_read_operations: /' 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:++ echo handler_error 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.428 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/30369/exe ']' 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.429 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.430 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.430 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.430 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=handler_error 2026-02-12T03:59:09.430 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/30369/exe 2026-02-12T03:59:09.430 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30506 2026-02-12T03:59:09.430 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test handler_error on pid 30506' 2026-02-12T03:59:09.430 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_handler_error 2>&1 | tee ceph_test_neorados_handler_error.log | sed "s/^/ handler_error: /"' 2026-02-12T03:59:09.430 INFO:tasks.workunit.client.0.trial154.stdout:test handler_error on pid 30506 2026-02-12T03:59:09.432 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=30506 2026-02-12T03:59:09.432 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-12T03:59:09.432 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.432 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s io 2026-02-12T03:59:09.432 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' io' 2026-02-12T03:59:09.432 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.432 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.432 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.432 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.432 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.432 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.432 INFO:tasks.workunit.client.0.trial154.stderr:++ echo io 2026-02-12T03:59:09.432 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.432 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.432 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.432 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.432 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.432 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.432 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.432 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.432 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.432 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.432 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.432 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.432 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.432 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.432 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.432 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.432 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.432 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.432 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.433 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/list_parallel.xml 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_rados_list_parallel.log 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ list_parallel: /' 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/30397/exe ']' 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=io 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.434 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30534 2026-02-12T03:59:09.435 INFO:tasks.workunit.client.0.trial154.stdout:test io on pid 30534 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test io on pid 30534' 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=30534 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_io 2>&1 | tee ceph_test_neorados_io.log | sed "s/^/ io: /"' 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s ec_io 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/30397/exe 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' ec_io' 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:++ echo ec_io 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.437 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/30413/exe ']' 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/30413/exe 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.438 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.439 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.439 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.439 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.439 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.439 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.439 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.439 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.439 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.439 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.439 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.439 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.439 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.439 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.439 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.439 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.439 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.439 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.439 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.439 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.439 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.439 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.439 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.439 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.439 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.439 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.439 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.439 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.439 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.439 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.439 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=ec_io 2026-02-12T03:59:09.439 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/open_pools_parallel.xml 2026-02-12T03:59:09.439 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.439 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30562 2026-02-12T03:59:09.439 INFO:tasks.workunit.client.0.trial154.stdout:test ec_io on pid 30562 2026-02-12T03:59:09.441 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test ec_io on pid 30562' 2026-02-12T03:59:09.441 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=30562 2026-02-12T03:59:09.441 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-12T03:59:09.441 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.441 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2026-02-12T03:59:09.441 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.441 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_io 2>&1 | tee ceph_test_neorados_ec_io.log | sed "s/^/ ec_io: /"' 2026-02-12T03:59:09.441 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ open_pools_parallel: /' 2026-02-12T03:59:09.441 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s list 2026-02-12T03:59:09.441 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' list' 2026-02-12T03:59:09.441 INFO:tasks.workunit.client.0.trial154.stderr:++ echo list 2026-02-12T03:59:09.441 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.441 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.441 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.441 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.441 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.441 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.442 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/delete_pools_parallel.xml 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ delete_pools_parallel: /' 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=list 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.443 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.444 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.444 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.444 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.444 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.444 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.444 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30581 2026-02-12T03:59:09.444 INFO:tasks.workunit.client.0.trial154.stdout:test list on pid 30581 2026-02-12T03:59:09.446 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.446 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.446 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test list on pid 30581' 2026-02-12T03:59:09.446 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=30581 2026-02-12T03:59:09.446 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.446 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-12T03:59:09.446 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.446 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.446 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.446 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.446 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.446 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_list 2>&1 | tee ceph_test_neorados_list.log | sed "s/^/ list: /"' 2026-02-12T03:59:09.446 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/30461/exe ']' 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s ec_list 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' ec_list' 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/30461/exe 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:++ echo ec_list 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.447 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/30477/exe ']' 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/30477/exe 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.448 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.449 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.449 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.449 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.449 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.449 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.449 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.449 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.449 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.449 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.449 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.449 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.449 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.449 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.449 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.449 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.449 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.449 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.449 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.449 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.449 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.449 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.449 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.449 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.449 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.449 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.449 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=ec_list 2026-02-12T03:59:09.449 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.449 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.449 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.449 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.449 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.449 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.449 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.449 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30618 2026-02-12T03:59:09.449 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test ec_list on pid 30618' 2026-02-12T03:59:09.449 INFO:tasks.workunit.client.0.trial154.stdout:test ec_list on pid 30618 2026-02-12T03:59:09.451 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=30618 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_list 2>&1 | tee ceph_test_neorados_ec_list.log | sed "s/^/ ec_list: /"' 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_neorados_cls 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s misc 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_neorados_cls.log 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' misc' 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ cls: /' 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/30506/exe ']' 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.452 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:++ echo misc 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_neorados_cmd 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_neorados_cmd.log 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/30506/exe 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ cmd: /' 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.453 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.454 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.454 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.454 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.454 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.454 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.454 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.454 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.454 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.454 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.454 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.454 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.454 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.454 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.454 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.454 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.454 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.454 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.454 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.454 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.454 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.454 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.454 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.454 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.454 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.454 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.454 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.454 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.454 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.454 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.454 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.454 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.454 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=misc 2026-02-12T03:59:09.454 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30648 2026-02-12T03:59:09.454 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test misc on pid 30648' 2026-02-12T03:59:09.454 INFO:tasks.workunit.client.0.trial154.stdout:test misc on pid 30648 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=30648 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_misc 2>&1 | tee ceph_test_neorados_misc.log | sed "s/^/ misc: /"' 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s pool 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_neorados_handler_error 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_neorados_handler_error.log 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ handler_error: /' 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' pool' 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:++ echo pool 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.457 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.458 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/30534/exe ']' 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/30534/exe 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=pool 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30683 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.459 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.460 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.460 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.460 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_pool 2>&1 | tee ceph_test_neorados_pool.log | sed "s/^/ pool: /"' 2026-02-12T03:59:09.460 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test pool on pid 30683' 2026-02-12T03:59:09.460 INFO:tasks.workunit.client.0.trial154.stdout:test pool on pid 30683 2026-02-12T03:59:09.462 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=30683 2026-02-12T03:59:09.462 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-12T03:59:09.462 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.462 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s read_operations 2026-02-12T03:59:09.462 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.462 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' read_operations' 2026-02-12T03:59:09.462 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.462 INFO:tasks.workunit.client.0.trial154.stderr:++ echo read_operations 2026-02-12T03:59:09.462 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.462 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.462 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.462 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.462 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.462 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.462 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.462 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.462 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.462 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.462 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.462 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.462 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.462 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.462 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.462 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.462 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.462 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.462 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.462 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.462 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.462 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/30562/exe ']' 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/30562/exe 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_neorados_io 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_neorados_io.log 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ io: /' 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.463 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.464 INFO:tasks.workunit.client.0.trial154.stdout:93.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a20001e10 con 0x55946bacd020 2026-02-12T03:59:09.465 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.323+0000 7f4a31ffb640 1 -- 10.20.193.154:0/474084380 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1289191614 0 0) 0x55946bbbad90 con 0x55946bacc540 2026-02-12T03:59:09.465 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.323+0000 7f4a31ffb640 10 monclient(hunting): _negotiate 2026-02-12T03:59:09.465 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.323+0000 7f4a31ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:59:09.465 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.323+0000 7f4a31ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:59:09.465 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.323+0000 7f4a31ffb640 10 monclient(hunting): my global_id is 4637 2026-02-12T03:59:09.465 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.323+0000 7f4a31ffb640 1 -- 10.20.193.154:0/474084380 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x55946bb5a7e0 con 0x55946bacc540 2026-02-12T03:59:09.465 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.326+0000 7f4a31ffb640 1 -- 10.20.193.154:0/474084380 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1516464983 0 0) 0x55946bb5a9b0 con 0x55946bbc09c0 2026-02-12T03:59:09.465 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.326+0000 7f4a31ffb640 10 monclient(hunting): _negotiate 2026-02-12T03:59:09.465 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.326+0000 7f4a31ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:59:09.465 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.326+0000 7f4a31ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:59:09.465 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.326+0000 7f4a31ffb640 10 monclient(hunting): my global_id is 4684 2026-02-12T03:59:09.465 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.326+0000 7f4a31ffb640 1 -- 10.20.193.154:0/474084380 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x55946bbbad90 con 0x55946bbc09c0 2026-02-12T03:59:09.465 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.343+0000 7f4a31ffb640 1 -- 10.20.193.154:0/474084380 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3015530671 0 0) 0x7f4a20001e10 con 0x55946bacd020 2026-02-12T03:59:09.465 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.343+0000 7f4a31ffb640 1 -- 10.20.193.154:0/474084380 >> v1:10.20.193.111:6789/0 conn(0x55946bacc540 legacy=0x55946bb5a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:59:09.465 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.343+0000 7f4a31ffb640 1 -- 10.20.193.154:0/474084380 >> v1:10.20.193.98:6789/0 conn(0x55946bbc09c0 legacy=0x55946bb5c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:59:09.465 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.343+0000 7f4a31ffb640 10 monclient: _finish_hunting 0 2026-02-12T03:59:09.465 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.343+0000 7f4a31ffb640 1 monclient: found mon.noname-a 2026-02-12T03:59:09.465 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.343+0000 7f4a31ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:59:09.465 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.343+0000 7f4a31ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.91:6789/0 2026-02-12T03:59:09.465 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.343+0000 7f4a31ffb640 1 -- 10.20.193.154:0/474084380 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55946bbbbf70 con 0x55946bacd020 2026-02-12T03:59:09.465 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.343+0000 7f4a31ffb640 10 monclient: _finish_auth 0 2026-02-12T03:59:09.465 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.343+0000 7f4a31ffb640 10 monclient: _check_auth_tickets 2026-02-12T03:59:09.465 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.343+0000 7f4a31ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:59:09.465 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.343+0000 7f4a31ffb640 1 -- 10.20.193.154:0/474084380 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f4a280017e0 con 0x55946bacd020 2026-02-12T03:59:09.465 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.343+0000 7f4a31ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:59:09.465 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.343+0000 7f4a31ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T03:59:09.465 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.465 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.466 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=read_operations 2026-02-12T03:59:09.466 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.466 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.466 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.466 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.466 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.466 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.466 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.466 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.466 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.466 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.466 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.466 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.466 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30716 2026-02-12T03:59:09.466 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test read_operations on pid 30716' 2026-02-12T03:59:09.466 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 20test read_operations on pid 30716 2026-02-12T03:59:09.468 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=30716 2026-02-12T03:59:09.468 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-12T03:59:09.468 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_read_operations 2>&1 | tee ceph_test_neorados_read_operations.log | sed "s/^/ read_operations: /"' 2026-02-12T03:59:09.468 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.468 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.468 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.468 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.468 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.468 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.468 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s snapshots 2026-02-12T03:59:09.468 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.468 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.468 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.468 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.468 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.468 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.468 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.468 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.468 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' snapshots' 2026-02-12T03:59:09.468 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_neorados_ec_io 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_neorados_ec_io.log 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:++ echo snapshots 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ ec_io: /' 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/30581/exe ']' 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.469 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.470 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.470 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.470 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.470 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.470 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.470 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.470 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.470 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.470 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.470 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.470 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.470 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.470 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.470 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.470 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.470 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.470 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.470 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.470 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.470 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.470 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.470 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.470 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.470 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.470 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.470 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.470 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.470 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.470 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.470 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.470 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.470 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.470 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/30581/exe 2026-02-12T03:59:09.470 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.470 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=snapshots 2026-02-12T03:59:09.470 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30742 2026-02-12T03:59:09.470 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test snapshots on pid 30742' 2026-02-12T03:59:09.470 INFO:tasks.workunit.client.0.trial154.stdout:test snapshots on pid 30742 2026-02-12T03:59:09.473 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=30742 2026-02-12T03:59:09.473 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-12T03:59:09.473 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_snapshots 2>&1 | tee ceph_test_neorados_snapshots.log | sed "s/^/ snapshots: /"' 2026-02-12T03:59:09.473 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.473 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.473 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s watch_notify 2026-02-12T03:59:09.473 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.473 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.473 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.473 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.473 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.473 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' watch_notify' 2026-02-12T03:59:09.473 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.473 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.473 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.473 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.473 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.473 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.473 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.473 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.473 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.473 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.473 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.473 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.473 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.473 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.473 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.473 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/30618/exe ']' 2026-02-12T03:59:09.473 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.473 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.473 INFO:tasks.workunit.client.0.trial154.stderr:++ echo watch_notify 2026-02-12T03:59:09.473 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.473 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.473 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.473 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/30618/exe 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_neorados_list 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_neorados_list.log 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ list: /' 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.474 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.475 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=watch_notify 2026-02-12T03:59:09.476 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.476 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.476 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.476 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30798 2026-02-12T03:59:09.476 INFO:tasks.workunit.client.0.trial154.stdout:test watch_notify on pid 30798 2026-02-12T03:59:09.477 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test watch_notify on pid 30798' 2026-02-12T03:59:09.477 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=30798 2026-02-12T03:59:09.477 INFO:tasks.workunit.client.0.trial154.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-12T03:59:09.477 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.477 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_watch_notify 2>&1 | tee ceph_test_neorados_watch_notify.log | sed "s/^/ watch_notify: /"' 2026-02-12T03:59:09.477 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_neorados_ec_list 2026-02-12T03:59:09.477 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_neorados_ec_list.log 2026-02-12T03:59:09.477 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ ec_list: /' 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:++ printf %25s write_operations 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:+ r=' write_operations' 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:++ echo write_operations 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:++ awk '{print $1}' 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.478 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:+ ff=write_operations 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30830 2026-02-12T03:59:09.479 INFO:tasks.workunit.client.0.trial154.stdout:test write_operations on pid 30830 2026-02-12T03:59:09.487 INFO:tasks.workunit.client.0.trial154.stderr:+ echo 'test write_operations on pid 30830' 2026-02-12T03:59:09.487 INFO:tasks.workunit.client.0.trial154.stderr:+ pids[$f]=30830 2026-02-12T03:59:09.487 INFO:tasks.workunit.client.0.trial154.stderr:+ ret=0 2026-02-12T03:59:09.487 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.487 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.487 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.487 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.487 INFO:tasks.workunit.client.0.trial154.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_write_operations 2>&1 | tee ceph_test_neorados_write_operations.log | sed "s/^/ write_operations: /"' 2026-02-12T03:59:09.487 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.487 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.487 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' 1 -eq 1 ']' 2026-02-12T03:59:09.487 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.487 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.487 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T03:59:09.487 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=29855 2026-02-12T03:59:09.487 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 29855 2026-02-12T03:59:09.487 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.487 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.487 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.487 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.487 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.487 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.487 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/30648/exe ']' 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.488 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/30648/exe 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -f /etc/bashrc ']' 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:+ . /etc/bashrc 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -z '' ']' 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:++ BASHRCSOURCED=Y 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:++ shopt -q login_shell 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:+++ umask 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' 0022 -eq 0 ']' 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:++ SHELL=/bin/bash 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/bash_completion.sh 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorgrep.sh 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.489 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/30683/exe ']' 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/30683/exe 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_neorados_misc 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_neorados_misc.log 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ misc: /' 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.490 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/30716/exe ']' 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'grep=grep --color=auto' 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'egrep=egrep --color=auto' 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'fgrep=fgrep --color=auto' 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/30716/exe 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.491 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorls.sh 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' '!' -t 0 ']' 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:+++ return 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorsysstat.sh 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:+++ export S_COLORS=auto 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:+++ S_COLORS=auto 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorxzgrep.sh 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_neorados_pool 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_neorados_pool.log 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ pool: /' 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.492 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_neorados_read_operations 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_neorados_read_operations.log 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ read_operations: /' 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/colorzgrep.sh 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:+++ /usr/libexec/grepconf.sh -c 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.493 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/30742/exe ']' 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/30742/exe 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zgrep=zgrep --color=auto' 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:+++ alias 'zegrep=zegrep --color=auto' 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/debuginfod.sh 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:+++ prefix=/usr 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z /etc/keys/ima: ']' 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset prefix 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/gawk.sh 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/lang.sh 2026-02-12T03:59:09.494 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/locale 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/30798/exe ']' 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_neorados_snapshots 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/30798/exe 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_neorados_snapshots.log 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ snapshots: /' 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG_backup=en_US.UTF-8 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /etc/locale.conf ']' 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -x /usr/bin/sed ']' 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.495 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_neorados_watch_notify 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:+++ eval export LANG=en_US.UTF-8 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:++++ export LANG=en_US.UTF-8 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:++++ LANG=en_US.UTF-8 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:+++ LANG=en_US.UTF-8 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:+++ unset LANG_backup config 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n '' ']' 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_neorados_watch_notify.log 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -n en_US.UTF-8 ']' 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' dumb = linux ']' 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/less.sh 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:++ for i in /etc/profile.d/*.sh 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:++ '[' '' ']' 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:++ . /etc/profile.d/which2.sh 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:+++ '[' -r /proc/30830/exe ']' 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ watch_notify: /' 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:+++++ readlink /proc/30830/exe 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:++++ basename /usr/bin/bash 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:+++ SHELLNAME=bash 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:+++ case "$SHELLNAME" in 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_declare='declare -f' 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:+++ which_opt=-f 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:+++ export which_declare 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:+++ export -f which 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:++ unset i 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:++ unset -f pathmunge 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:+ export PATH 2026-02-12T03:59:09.496 INFO:tasks.workunit.client.0.trial154.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2026-02-12T03:59:09.497 INFO:tasks.workunit.client.0.trial154.stderr:+ unset rc 2026-02-12T03:59:09.497 INFO:tasks.workunit.client.0.trial154.stderr:+ ceph_test_neorados_write_operations 2026-02-12T03:59:09.497 INFO:tasks.workunit.client.0.trial154.stderr:+ tee ceph_test_neorados_write_operations.log 2026-02-12T03:59:09.497 INFO:tasks.workunit.client.0.trial154.stderr:+ sed 's/^/ write_operations: /' 2026-02-12T03:59:09.497 INFO:tasks.workunit.client.0.trial154.stdout:26-02-12T03:59:09.343+0000 7f4a31ffb640 10 monclient: dump: 2026-02-12T03:59:09.497 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: epoch 1 2026-02-12T03:59:09.497 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:59:09.497 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:59:09.497 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:59:09.497 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-12T03:59:09.497 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: election_strategy: 3 2026-02-12T03:59:09.497 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:59:09.497 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:59:09.497 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:59:09.497 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.497 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.343+0000 7f4a3c022880 5 monclient: authenticate success, global_id 4668 2026-02-12T03:59:09.497 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.343+0000 7f4a3c022880 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T03:59:09.497 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.378+0000 7f4a31ffb640 1 -- 10.20.193.154:0/474084380 <== mon.0 v1:10.20.193.91:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4a28001980 con 0x55946bacd020 2026-02-12T03:59:09.497 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.378+0000 7f4a31ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T03:59:09.497 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.378+0000 7f4a31ffb640 1 -- 10.20.193.154:0/474084380 <== mon.0 v1:10.20.193.91:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f4a28001fa0 con 0x55946bacd020 2026-02-12T03:59:09.497 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.378+0000 7f4a31ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:59:09.497 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.378+0000 7f4a31ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T03:59:09.497 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.378+0000 7f4a31ffb640 10 monclient: dump: 2026-02-12T03:59:09.497 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: epoch 1 2026-02-12T03:59:09.497 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:59:09.497 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:59:09.497 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:59:09.497 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-12T03:59:09.497 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: election_strategy: 3 2026-02-12T03:59:09.497 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:59:09.497 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:59:09.497 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:59:09.497 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.497 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.378+0000 7f4a3c022880 10 monclient: get_monmap_and_config success 2026-02-12T03:59:09.497 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.378+0000 7f4a3c022880 4 set_mon_vals no callback set 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.379+0000 7f4a3c022880 10 monclient: shutdown 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.379+0000 7f4a3c022880 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.379+0000 7f4a3c022880 1 -- 10.20.193.154:0/474084380 >> v1:10.20.193.91:6789/0 conn(0x55946bacd020 legacy=0x55946bb5bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.379+0000 7f4a3c022880 1 -- 10.20.193.154:0/474084380 shutdown_connections 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.379+0000 7f4a3c022880 1 -- 10.20.193.154:0/474084380 >> 10.20.193.154:0/474084380 conn(0x55946bb528f0 msgr2=0x55946bb56a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.379+0000 7f4a3c022880 1 -- 10.20.193.154:0/474084380 shutdown_connections 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.379+0000 7f4a3c022880 1 -- 10.20.193.154:0/474084380 wait complete. 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.379+0000 7f4a3c022880 10 monclient: build_initial_monmap 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.379+0000 7f4a3c022880 10 monclient: monmap: 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: epoch 0 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: fsid 00000000-0000-0000-0000-000000000000 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: last_changed 0.000000 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: created 0.000000 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: min_mon_release 0 (unknown) 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: election_strategy: 1 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.379+0000 7f4a3c022880 1 librados: starting msgr at 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.379+0000 7f4a3c022880 1 librados: starting objecter 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.379+0000 7f4a3c022880 20 client.?.objecter Objecter: read policy: balance 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.379+0000 7f4a3c022880 1 Processor -- start 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.379+0000 7f4a3c022880 1 -- start start 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.379+0000 7f4a3c022880 1 librados: setting wanted keys 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.379+0000 7f4a3c022880 1 librados: calling monclient init 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.379+0000 7f4a3c022880 10 monclient: init 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.379+0000 7f4a3c022880 10 monclient: _reopen_session rank -1 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.379+0000 7f4a3c022880 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.379+0000 7f4a3c022880 10 monclient(hunting): picked mon.noname-b con 0x55946bacc540 addr v1:10.20.193.98:6789/0 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.379+0000 7f4a3c022880 10 monclient(hunting): picked mon.noname-a con 0x55946bacd020 addr v1:10.20.193.91:6789/0 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.379+0000 7f4a3c022880 10 monclient(hunting): picked mon.noname-c con 0x55946bbc09c0 addr v1:10.20.193.111:6789/0 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.379+0000 7f4a3c022880 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55946bbb96e0 con 0x55946bacd020 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.379+0000 7f4a3c022880 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55946bbba8e0 con 0x55946bacc540 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.379+0000 7f4a3c022880 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55946bbbaad0 con 0x55946bbc09c0 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.379+0000 7f4a3c022880 10 monclient(hunting): _renew_subs 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.379+0000 7f4a3c022880 10 monclient(hunting): authenticate will time out at 1150.031981s 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.415+0000 7f4a33fff640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x55946bbc09c0 0x55946bbb7de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.154:54570/0 (socket says 10.20.193.154:54570) 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.415+0000 7f4a33fff640 1 -- 10.20.193.154:0/1932936756 learned_addr learned my addr 10.20.193.154:0/1932936756 (peer_addr_for_me v1:10.20.193.154:0/0) 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.416+0000 7f4a30ff9640 10 client.?.objecter ms_handle_connect 0x55946bbc09c0 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.416+0000 7f4a30ff9640 10 client.?.objecter resend_mon_ops 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.426+0000 7f4a30ff9640 10 client.?.objecter ms_handle_connect 0x55946bacd020 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.426+0000 7f4a30ff9640 10 client.?.objecter resend_mon_ops 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.433+0000 7f4a30ff9640 10 client.?.objecter ms_handle_connect 0x55946bacc540 2026-02-12T03:59:09.498 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.433+0000 7f4a30ff9640 10 client.?.objecter resend_mon_ops 2026-02-12T03:59:09.499 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.452+0000 7f4a30ff9640 1 -- 10.20.193.154:0/1932936756 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3714702064 0 0) 0x55946bbbaad0 con 0x55946bbc09c0 2026-02-12T03:59:09.499 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.452+0000 7f4a30ff9640 10 monclient(hunting): _negotiate 2026-02-12T03:59:09.499 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.452+0000 7f4a30ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:59:09.510 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.452+0000 7f4a30ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:59:09.510 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.452+0000 7f4a30ff9640 10 monclient(hunting): my global_id is 4748 2026-02-12T03:59:09.510 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.452+0000 7f4a30ff9640 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a20001b30 con 0x55946bbc09c0 2026-02-12T03:59:09.510 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.459+0000 7f4a30ff9640 1 -- 10.20.193.154:0/1932936756 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 623056647 0 0) 0x55946bbb96e0 con 0x55946bacd020 2026-02-12T03:59:09.510 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.460+0000 7f4a30ff9640 10 monclient(hunting): _negotiate 2026-02-12T03:59:09.510 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.460+0000 7f4a30ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:59:09.510 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.460+0000 7f4a30ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:59:09.510 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.460+0000 7f4a30ff9640 10 monclient(hunting): my global_id is 4788 2026-02-12T03:59:09.510 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.460+0000 7f4a30ff9640 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x55946bbbaad0 con 0x55946bacd020 2026-02-12T03:59:09.510 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.477+0000 7f4a30ff9640 1 -- 10.20.193.154:0/1932936756 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 156089041 0 0) 0x55946bbba8e0 con 0x55946bacc540 2026-02-12T03:59:09.510 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.477+0000 7f4a30ff9640 10 monclient(hunting): _negotiate 2026-02-12T03:59:09.510 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.477+0000 7f4a30ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T03:59:09.510 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.477+0000 7f4a30ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T03:59:09.510 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.477+0000 7f4a30ff9640 10 monclient(hunting): my global_id is 4789 2026-02-12T03:59:09.510 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.477+0000 7f4a30ff9640 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x55946bbb96e0 con 0x55946bacc540 2026-02-12T03:59:09.510 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.487+0000 7f4a30ff9640 1 -- 10.20.193.154:0/1932936756 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4245007686 0 0) 0x7f4a20001b30 con 0x55946bbc09c0 2026-02-12T03:59:09.510 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.487+0000 7f4a30ff9640 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x55946bbba8e0 con 0x55946bbc09c0 2026-02-12T03:59:09.510 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.487+0000 7f4a30ff9640 1 -- 10.20.193.154:0/1932936756 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f4a2c001c30 con 0x55946bbc09c0 2026-02-12T03:59:09.510 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.488+0000 7f4a30ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:59:09.510 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.488+0000 7f4a30ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T03:59:09.510 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.488+0000 7f4a30ff9640 10 monclient(hunting): dump: 2026-02-12T03:59:09.510 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: epoch 1 2026-02-12T03:59:09.510 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:59:09.510 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:59:09.510 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:59:09.510 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-12T03:59:09.510 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: election_strategy: 3 2026-02-12T03:59:09.510 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:59:09.510 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:59:09.510 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:59:09.510 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.510 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.488+0000 7f4a30ff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T03:59:09.532 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.508+0000 7f4a30ff9640 1 -- 10.20.193.154:0/1932936756 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1907617856 0 0) 0x55946bbbaad0 con 0x55946bacd020 2026-02-12T03:59:09.532 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.508+0000 7f4a30ff9640 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4a20001b30 con 0x55946bacd020 2026-02-12T03:59:09.532 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.508+0000 7f4a30ff9640 1 -- 10.20.193.154:0/1932936756 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f4a28001b40 con 0x55946bacd020 2026-02-12T03:59:09.533 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.508+0000 7f4a30ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T03:59:09.533 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.508+0000 7f4a30ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T03:59:09.533 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.508+0000 7f4a30ff9640 10 monclient(hunting): dump: 2026-02-12T03:59:09.533 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: epoch 1 2026-02-12T03:59:09.533 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:59:09.533 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:59:09.533 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:59:09.533 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-12T03:59:09.533 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: election_strategy: 3 2026-02-12T03:59:09.533 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:59:09.533 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:59:09.533 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:59:09.533 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.533 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.531+0000 7f4a30ff9640 1 -- 10.20.193.154:0/1932936756 <== mon.2 v1:10.20.193.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1493599308 0 0) 0x55946bbba8e0 con 0x55946bbc09c0 2026-02-12T03:59:09.533 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.531+0000 7f4a30ff9640 1 -- 10.20.193.154:0/1932936756 >> v1:10.20.193.98:6789/0 conn(0x55946bacc540 legacy=0x55946bbe2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:59:09.533 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.531+0000 7f4a30ff9640 1 -- 10.20.193.154:0/1932936756 >> v1:10.20.193.91:6789/0 conn(0x55946bacd020 legacy=0x55946bbe31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:59:09.533 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.531+0000 7f4a30ff9640 10 monclient: _finish_hunting 0 2026-02-12T03:59:09.533 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.531+0000 7f4a30ff9640 1 monclient: found mon.c 2026-02-12T03:59:09.533 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.531+0000 7f4a30ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:59:09.533 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.531+0000 7f4a30ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:59:09.533 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.531+0000 7f4a30ff9640 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55946bb689d0 con 0x55946bbc09c0 2026-02-12T03:59:09.533 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.531+0000 7f4a30ff9640 10 monclient: _finish_auth 0 2026-02-12T03:59:09.533 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.531+0000 7f4a30ff9640 10 monclient: _check_auth_tickets 2026-02-12T03:59:09.533 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.531+0000 7f4a30ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:59:09.533 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.531+0000 7f4a3c022880 5 monclient: authenticate success, global_id 4748 2026-02-12T03:59:09.533 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.531+0000 7f4a3c022880 10 monclient: _renew_subs 2026-02-12T03:59:09.533 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.531+0000 7f4a3c022880 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:59:09.533 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.531+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x55946bbb9910 con 0x55946bbc09c0 2026-02-12T03:59:09.533 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.531+0000 7f4a3c022880 10 client.4748.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:59:09.533 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.531+0000 7f4a3c022880 10 monclient: _renew_subs 2026-02-12T03:59:09.533 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.531+0000 7f4a3c022880 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:59:09.576 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.531+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6789/0 -- mon_subscribe({osdmap=0}) -- 0x55946bbb9de0 con 0x55946bbc09c0 2026-02-12T03:59:09.576 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.531+0000 7f4a3c022880 1 librados: init done 2026-02-12T03:59:09.576 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.531+0000 7f4a3c022880 10 librados: wait_for_osdmap waiting 2026-02-12T03:59:09.576 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.553+0000 7f4a30ff9640 1 -- 10.20.193.154:0/1932936756 <== mon.2 v1:10.20.193.111:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4a2c003450 con 0x55946bbc09c0 2026-02-12T03:59:09.576 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.553+0000 7f4a30ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T03:59:09.576 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.553+0000 7f4a30ff9640 1 -- 10.20.193.154:0/1932936756 <== mon.2 v1:10.20.193.111:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f4a2c0037a0 con 0x55946bbc09c0 2026-02-12T03:59:09.576 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.553+0000 7f4a30ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T03:59:09.576 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.553+0000 7f4a30ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T03:59:09.576 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.553+0000 7f4a30ff9640 10 monclient: dump: 2026-02-12T03:59:09.576 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: epoch 1 2026-02-12T03:59:09.576 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:59:09.576 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T03:59:09.576 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: created 2026-02-12T03:57:12.286436+0000 2026-02-12T03:59:09.576 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-12T03:59:09.576 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: election_strategy: 3 2026-02-12T03:59:09.576 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T03:59:09.576 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T03:59:09.576 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T03:59:09.576 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.576 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.553+0000 7f4a31ffb640 4 set_mon_vals no callback set 2026-02-12T03:59:09.576 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.554+0000 7f4a30ff9640 1 -- 10.20.193.154:0/1932936756 <== mon.2 v1:10.20.193.111:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f4a2c01cc80 con 0x55946bbc09c0 2026-02-12T03:59:09.576 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.555+0000 7f4a337fe640 10 monclient: get_auth_request con 0x7f4a20078bf0 auth_method 0 2026-02-12T03:59:09.576 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.555+0000 7f4a30ff9640 10 client.4748.objecter ms_handle_connect 0x7f4a20078bf0 2026-02-12T03:59:09.576 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.557+0000 7f4a30ff9640 1 -- 10.20.193.154:0/1932936756 <== mon.2 v1:10.20.193.111:6789/0 8 ==== osd_map(29..29 src has 1..29) ==== 8141+0+0 (unknown 1201408556 0 0) 0x7f4a2c094800 con 0x55946bbc09c0 2026-02-12T03:59:09.576 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.557+0000 7f4a30ff9640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_map(29..29 src has 1..29) 2026-02-12T03:59:09.576 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.557+0000 7f4a30ff9640 3 client.4748.objecter handle_osd_map got epochs [29,29] > 0 2026-02-12T03:59:09.576 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.557+0000 7f4a30ff9640 3 client.4748.objecter handle_osd_map decoding full epoch 29 2026-02-12T03:59:09.576 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.557+0000 7f4a30ff9640 20 client.4748.objecter dump_active .. 0 homeless 2026-02-12T03:59:09.576 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.557+0000 7f4a3c022880 10 librados: wait_for_osdmap done waiting 2026-02-12T03:59:09.576 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.557+0000 7f4a3c022880 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:59:09.576 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.557+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x55946ba7bda0 con 0x55946bbc09c0 2026-02-12T03:59:09.576 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.574+0000 7f4a30ff9640 1 -- 10.20.193.154:0/1932936756 <== mon.2 v1:10.20.193.111:6789/0 9 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (unknown 1488460068 0 0) 0x7f4a2c05d830 con 0x55946bbc09c0 2026-02-12T03:59:09.576 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.574+0000 7f4a30ff9640 10 monclient: handle_get_version_reply finishing 1 version 29 2026-02-12T03:59:11.299 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.574+0000 7f4a317fa640 10 client.4748.objecter _get_latest_version latest 29, have it 2026-02-12T03:59:11.299 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.574+0000 7f4a3c022880 10 client.4748.objecter create_pool name=ceph_test_rados_api_asio 2026-02-12T03:59:11.299 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.574+0000 7f4a3c022880 10 client.4748.objecter pool_op_submit 1 2026-02-12T03:59:11.299 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.574+0000 7f4a3c022880 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:59:11.299 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:09.574+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6789/0 -- pool_op(create pool 0 tid 1 name ceph_test_rados_api_asio v0) -- 0x55946ba00570 con 0x55946bbc09c0 2026-02-12T03:59:11.299 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:11.284+0000 7f4a30ff9640 1 -- 10.20.193.154:0/1932936756 <== mon.2 v1:10.20.193.111:6789/0 10 ==== pool_op_reply(tid 1 (0) Success v31) ==== 43+0+0 (unknown 2768499741 0 0) 0x7f4a2c05e160 con 0x55946bbc09c0 2026-02-12T03:59:11.299 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:11.284+0000 7f4a30ff9640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 pool_op_reply(tid 1 (0) Success v31) 2026-02-12T03:59:11.299 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:11.284+0000 7f4a30ff9640 10 client.4748.objecter handle_pool_op_reply pool_op_reply(tid 1 (0) Success v31) 2026-02-12T03:59:11.299 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:11.284+0000 7f4a30ff9640 10 client.4748.objecter have request 1 at 0x55946bbbc200 Op: create 2026-02-12T03:59:11.300 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:11.284+0000 7f4a30ff9640 20 client.4748.objecter waiting for client to reach epoch 31 before calling back 2026-02-12T03:59:11.300 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:11.284+0000 7f4a30ff9640 10 client.4748.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T03:59:11.300 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:11.284+0000 7f4a30ff9640 10 monclient: _renew_subs 2026-02-12T03:59:11.300 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:11.284+0000 7f4a30ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T03:59:11.300 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:11.284+0000 7f4a30ff9640 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6789/0 -- mon_subscribe({osdmap=30}) -- 0x55946bbba8e0 con 0x55946bbc09c0 2026-02-12T03:59:11.300 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:11.284+0000 7f4a30ff9640 10 client.4748.objecter done 2026-02-12T03:59:11.300 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:11.297+0000 7f4a30ff9640 1 -- 10.20.193.154:0/1932936756 <== mon.2 v1:10.20.193.111:6789/0 11 ==== osd_map(30..31 src has 1..31) ==== 16155+0+0 (unknown 4040334154 0 0) 0x7f4a2c0599f0 con 0x55946bbc09c0 2026-02-12T03:59:11.300 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:11.297+0000 7f4a30ff9640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_map(30..31 src has 1..31) 2026-02-12T03:59:11.300 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:11.297+0000 7f4a30ff9640 3 client.4748.objecter handle_osd_map got epochs [30,31] > 29 2026-02-12T03:59:11.300 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:11.297+0000 7f4a30ff9640 3 client.4748.objecter handle_osd_map decoding incremental epoch 30 2026-02-12T03:59:11.300 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:11.297+0000 7f4a30ff9640 3 client.4748.objecter handle_osd_map decoding incremental epoch 31 2026-02-12T03:59:11.301 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:11.297+0000 7f4a30ff9640 20 client.4748.objecter dump_active .. 0 homeless 2026-02-12T03:59:11.301 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:11.297+0000 7f4a3c022880 10 librados: set snap read head -> 1 2026-02-12T03:59:11.301 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:11.297+0000 7f4a3c022880 10 librados: writefull oid=exist nspace= 2026-02-12T03:59:11.301 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:11.297+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bbba0d0 2026-02-12T03:59:11.301 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:11.297+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 31 base exist @10 precalc_pgid 0 pgid 0.0 is_write 2026-02-12T03:59:11.301 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:11.297+0000 7f4a3c022880 20 client.4748.objecter _calc_target target exist @10 -> pgid 10.d3a59201 2026-02-12T03:59:11.301 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:11.297+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.d3a59201 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:11.301 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:11.297+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:13.044 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:01:33.928 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T03:59:13.046 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:01:33.930 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T03:59:13.076 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:01:33.956 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T03:59:13.078 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:01:33.958 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T03:59:13.080 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:01:33.926 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T03:59:13.083 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:01:33.929 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T03:59:13.085 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:01:33.969 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T03:59:13.117 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:01:33.997 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T03:59:13.119 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:01:33.965 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T03:59:14.614 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:11.297+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid exist '@10' '@10' [writefull 0~5 in=5b] tid 2 osd.10 2026-02-12T03:59:14.614 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:11.297+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.614 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:11.297+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 10 2 2026-02-12T03:59:14.614 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:11.297+0000 7f4a3c022880 15 client.4748.objecter _send_op 2 to 10.1 on osd.10 2026-02-12T03:59:14.614 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:11.297+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:2 10.1 10:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31) -- 0x55946bb69bb0 con 0x55946bb67ed0 2026-02-12T03:59:14.614 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:11.297+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.614 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:11.297+0000 7f4a3c022880 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.614 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:11.309+0000 7f4a32ffd640 10 monclient: get_auth_request con 0x55946bb67ed0 auth_method 0 2026-02-12T03:59:14.614 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:11.321+0000 7f4a30ff9640 10 client.4748.objecter ms_handle_connect 0x55946bb67ed0 2026-02-12T03:59:14.614 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:12.380+0000 7f4a1b7fe640 10 monclient: tick 2026-02-12T03:59:14.614 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:12.380+0000 7f4a1b7fe640 10 monclient: _check_auth_tickets 2026-02-12T03:59:14.614 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:12.380+0000 7f4a1b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:59:14.614 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:12.380+0000 7f4a1b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T03:59:14.614 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:13.380+0000 7f4a1b7fe640 10 monclient: tick 2026-02-12T03:59:14.614 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:13.380+0000 7f4a1b7fe640 10 monclient: _check_auth_tickets 2026-02-12T03:59:14.615 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:13.380+0000 7f4a1b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:59:14.615 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:13.865+0000 7f4a30ff9640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 1 ==== osd_map(32..32 src has 1..32) ==== 7475+0+0 (unknown 28686083 0 0) 0x7f4a28004130 con 0x55946bb67ed0 2026-02-12T03:59:14.615 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:13.865+0000 7f4a30ff9640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_map(32..32 src has 1..32) 2026-02-12T03:59:14.615 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:13.865+0000 7f4a30ff9640 3 client.4748.objecter handle_osd_map got epochs [32,32] > 31 2026-02-12T03:59:14.615 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:13.865+0000 7f4a30ff9640 3 client.4748.objecter handle_osd_map decoding incremental epoch 32 2026-02-12T03:59:14.615 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:13.865+0000 7f4a30ff9640 10 client.4748.objecter checking op 2 2026-02-12T03:59:14.615 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:13.865+0000 7f4a30ff9640 20 client.4748.objecter _calc_target epoch 32 base exist @10 precalc_pgid 0 pgid 0.0 is_write 2026-02-12T03:59:14.615 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:13.865+0000 7f4a30ff9640 20 client.4748.objecter _calc_target target exist @10 -> pgid 10.d3a59201 2026-02-12T03:59:14.615 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:13.865+0000 7f4a30ff9640 20 client.4748.objecter dump_active .. 0 homeless 2026-02-12T03:59:14.615 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:13.865+0000 7f4a30ff9640 20 client.4748.objecter 2 10.d3a59201 osd.10 exist [writefull 0~5 in=5b] 2026-02-12T03:59:14.615 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.380+0000 7f4a1b7fe640 10 monclient: tick 2026-02-12T03:59:14.615 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.380+0000 7f4a1b7fe640 10 monclient: _check_auth_tickets 2026-02-12T03:59:14.615 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.380+0000 7f4a1b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T03:59:14.615 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.532+0000 7f4a3a192640 10 client.4748.objecter tick 2026-02-12T03:59:14.615 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.532+0000 7f4a3a192640 20 client.4748.objecter tick: elapsed since last osdmap request 3.24798s, stale_window 10s, epoch 33, monc->get_start(osdmap) 0 2026-02-12T03:59:14.615 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.612+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 2 ==== osd_op_reply(2 exist [writefull 0~5] v32'1 uv1 ondisk = 0) ==== 149+0+0 (unknown 379107231 0 0) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.615 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.612+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(2 exist [writefull 0~5] v32'1 uv1 ondisk = 0) 2026-02-12T03:59:14.615 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.612+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.615 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.612+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 2 ondisk uv 1 in 10.1 attempt 0 2026-02-12T03:59:14.615 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.612+0000 7f4a32ffd640 10 client.4748.objecter op 0 rval 0 len 0 2026-02-12T03:59:14.615 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.612+0000 7f4a32ffd640 15 client.4748.objecter handle_osd_op_reply completed tid 2 2026-02-12T03:59:14.615 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.612+0000 7f4a32ffd640 15 client.4748.objecter _finish_op 2 2026-02-12T03:59:14.615 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.612+0000 7f4a32ffd640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.615 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.612+0000 7f4a32ffd640 15 client.4748.objecter _session_op_remove 10 2 2026-02-12T03:59:14.615 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.612+0000 7f4a32ffd640 5 client.4748.objecter 0 in flight 2026-02-12T03:59:14.615 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2026-02-12T03:59:14.615 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.612+0000 7f4a3c022880 10 librados: Objecter returned from writefull r=0 2026-02-12T03:59:14.615 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.612+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bb669b0 2026-02-12T03:59:14.615 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.612+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 32 base exist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.615 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.612+0000 7f4a3c022880 20 client.4748.objecter _calc_target target exist @10 -> pgid 10.d3a59201 2026-02-12T03:59:14.616 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.612+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.d3a59201 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.616 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.612+0000 7f4a3c022880 10 client.4748.objecter chose random osd.10 of [10,7] 2026-02-12T03:59:14.616 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.612+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.616 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.612+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid exist '@10' '@10' [read 0~256] tid 3 osd.10 2026-02-12T03:59:14.616 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.612+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.616 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.612+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 10 3 2026-02-12T03:59:14.616 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.612+0000 7f4a3c022880 15 client.4748.objecter _send_op 3 to 10.1 on osd.10 2026-02-12T03:59:14.616 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.612+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:3 10.1 10:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e32) -- 0x55946bbba160 con 0x55946bb67ed0 2026-02-12T03:59:14.616 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.612+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.616 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.612+0000 7f4a3c022880 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.616 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.612+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bb66f40 2026-02-12T03:59:14.616 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.612+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 32 base noexist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.616 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.612+0000 7f4a3c022880 20 client.4748.objecter _calc_target target noexist @10 -> pgid 10.a7bbaa1 2026-02-12T03:59:14.636 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.612+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.a7bbaa1 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.636 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.612+0000 7f4a3c022880 10 client.4748.objecter chose random osd.7 of [10,7] 2026-02-12T03:59:14.636 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.613+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bb673f0 osd=7 3 2026-02-12T03:59:14.636 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.613+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid noexist '@10' '@10' [read 0~256] tid 4 osd.7 2026-02-12T03:59:14.636 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.613+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bb673f0 osd=7 3 2026-02-12T03:59:14.636 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.613+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 7 4 2026-02-12T03:59:14.636 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.613+0000 7f4a3c022880 15 client.4748.objecter _send_op 4 to 10.1 on osd.7 2026-02-12T03:59:14.636 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.613+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.154:6808/903276772 -- osd_op(unknown.0.0:4 10.1 10:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e32) -- 0x55946bb6bcf0 con 0x55946bb67560 2026-02-12T03:59:14.636 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.613+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bb673f0 osd=7 4 2026-02-12T03:59:14.636 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.613+0000 7f4a3c022880 5 client.4748.objecter 2 in flight 2026-02-12T03:59:14.637 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.626+0000 7f4a337fe640 10 monclient: get_auth_request con 0x55946bb67560 auth_method 0 2026-02-12T03:59:14.637 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.628+0000 7f4a30ff9640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 3 ==== osd_map(33..33 src has 1..33) ==== 3735+0+0 (unknown 1049649198 0 0) 0x7f4a28004640 con 0x55946bb67ed0 2026-02-12T03:59:14.637 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.628+0000 7f4a30ff9640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_map(33..33 src has 1..33) 2026-02-12T03:59:14.637 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.628+0000 7f4a30ff9640 3 client.4748.objecter handle_osd_map got epochs [33,33] > 32 2026-02-12T03:59:14.637 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.628+0000 7f4a30ff9640 3 client.4748.objecter handle_osd_map decoding incremental epoch 33 2026-02-12T03:59:14.637 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.628+0000 7f4a30ff9640 10 client.4748.objecter checking op 4 2026-02-12T03:59:14.637 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.628+0000 7f4a30ff9640 20 client.4748.objecter _calc_target epoch 33 base noexist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.637 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.628+0000 7f4a30ff9640 20 client.4748.objecter _calc_target target noexist @10 -> pgid 10.a7bbaa1 2026-02-12T03:59:14.637 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.628+0000 7f4a30ff9640 10 client.4748.objecter checking op 3 2026-02-12T03:59:14.637 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.628+0000 7f4a30ff9640 20 client.4748.objecter _calc_target epoch 33 base exist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.637 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.628+0000 7f4a30ff9640 20 client.4748.objecter _calc_target target exist @10 -> pgid 10.d3a59201 2026-02-12T03:59:14.637 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.628+0000 7f4a30ff9640 20 client.4748.objecter dump_active .. 0 homeless 2026-02-12T03:59:14.637 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.628+0000 7f4a30ff9640 20 client.4748.objecter 4 10.a7bbaa1 osd.7 noexist [read 0~256] 2026-02-12T03:59:14.637 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.628+0000 7f4a30ff9640 20 client.4748.objecter 3 10.d3a59201 osd.10 exist [read 0~256] 2026-02-12T03:59:14.637 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.628+0000 7f4a30ff9640 10 client.4748.objecter ms_handle_connect 0x55946bb67560 2026-02-12T03:59:14.637 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.635+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 4 ==== osd_op_reply(3 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 2461695437 0 3741568377) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.637 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.635+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(3 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-12T03:59:14.637 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.635+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.641 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.635+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 3 ondisk uv 1 in 10.1 attempt 0 2026-02-12T03:59:14.641 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.635+0000 7f4a32ffd640 10 client.4748.objecter op 0 rval 0 len 5 2026-02-12T03:59:14.641 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.635+0000 7f4a32ffd640 15 client.4748.objecter handle_osd_op_reply completed tid 3 2026-02-12T03:59:14.641 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.635+0000 7f4a32ffd640 15 client.4748.objecter _finish_op 3 2026-02-12T03:59:14.641 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.635+0000 7f4a32ffd640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.641 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.635+0000 7f4a32ffd640 15 client.4748.objecter _session_op_remove 10 3 2026-02-12T03:59:14.641 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.635+0000 7f4a32ffd640 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.641 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a30ff9640 1 -- 10.20.193.154:0/1932936756 <== osd.7 v1:10.20.193.154:6808/903276772 1 ==== osd_map(33..33 src has 1..33) ==== 3735+0+0 (unknown 1049649198 0 0) 0x7f4a24003ad0 con 0x55946bb67560 2026-02-12T03:59:14.641 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a30ff9640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_map(33..33 src has 1..33) 2026-02-12T03:59:14.641 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a337fe640 1 -- 10.20.193.154:0/1932936756 <== osd.7 v1:10.20.193.154:6808/903276772 2 ==== osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 90278164 0 0) 0x7f4a24003e10 con 0x55946bb67560 2026-02-12T03:59:14.641 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a337fe640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-12T03:59:14.641 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a337fe640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.641 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a30ff9640 3 client.4748.objecter handle_osd_map ignoring epochs [33,33] <= 33 2026-02-12T03:59:14.641 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a30ff9640 20 client.4748.objecter dump_active .. 0 homeless 2026-02-12T03:59:14.641 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a30ff9640 20 client.4748.objecter 4 10.a7bbaa1 osd.7 noexist [read 0~256] 2026-02-12T03:59:14.641 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a337fe640 7 client.4748.objecter handle_osd_op_reply 4 ondisk uv 0 in 10.1 attempt 0 2026-02-12T03:59:14.641 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a337fe640 10 client.4748.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-12T03:59:14.641 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a337fe640 10 client.4748.objecter op 0 rval 0 len 0 2026-02-12T03:59:14.641 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a337fe640 15 client.4748.objecter handle_osd_op_reply completed tid 4 2026-02-12T03:59:14.641 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a337fe640 15 client.4748.objecter _finish_op 4 2026-02-12T03:59:14.641 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a337fe640 20 client.4748.objecter put_session s=0x55946bb673f0 osd=7 4 2026-02-12T03:59:14.641 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a337fe640 15 client.4748.objecter _session_op_remove 7 4 2026-02-12T03:59:14.641 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a337fe640 5 client.4748.objecter 0 in flight 2026-02-12T03:59:14.642 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (27 ms) 2026-02-12T03:59:14.642 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ RUN ] AsioRados.AsyncReadDeferred 2026-02-12T03:59:14.642 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bb66f40 2026-02-12T03:59:14.642 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base exist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.642 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a3c022880 20 client.4748.objecter _calc_target target exist @10 -> pgid 10.d3a59201 2026-02-12T03:59:14.642 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.d3a59201 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.647 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a3c022880 10 client.4748.objecter chose random osd.7 of [10,7] 2026-02-12T03:59:14.647 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bb673f0 osd=7 3 2026-02-12T03:59:14.647 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid exist '@10' '@10' [read 0~256] tid 5 osd.7 2026-02-12T03:59:14.647 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bb673f0 osd=7 3 2026-02-12T03:59:14.648 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 7 5 2026-02-12T03:59:14.648 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a3c022880 15 client.4748.objecter _send_op 5 to 10.1 on osd.7 2026-02-12T03:59:14.648 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.154:6808/903276772 -- osd_op(unknown.0.0:5 10.1 10:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x55946bb669b0 con 0x55946bb67560 2026-02-12T03:59:14.648 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bb673f0 osd=7 4 2026-02-12T03:59:14.648 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a3c022880 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.648 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bb6c1e0 2026-02-12T03:59:14.648 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base noexist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.648 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a3c022880 20 client.4748.objecter _calc_target target noexist @10 -> pgid 10.a7bbaa1 2026-02-12T03:59:14.648 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.a7bbaa1 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.648 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a3c022880 10 client.4748.objecter chose random osd.7 of [10,7] 2026-02-12T03:59:14.648 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bb673f0 osd=7 4 2026-02-12T03:59:14.648 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid noexist '@10' '@10' [read 0~256] tid 6 osd.7 2026-02-12T03:59:14.648 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bb673f0 osd=7 4 2026-02-12T03:59:14.648 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 7 6 2026-02-12T03:59:14.648 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a3c022880 15 client.4748.objecter _send_op 6 to 10.1 on osd.7 2026-02-12T03:59:14.648 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.154:6808/903276772 -- osd_op(unknown.0.0:6 10.1 10:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x55946bb6c710 con 0x55946bb67560 2026-02-12T03:59:14.648 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bb673f0 osd=7 5 2026-02-12T03:59:14.648 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.640+0000 7f4a3c022880 5 client.4748.objecter 2 in flight 2026-02-12T03:59:14.648 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.646+0000 7f4a337fe640 1 -- 10.20.193.154:0/1932936756 <== osd.7 v1:10.20.193.154:6808/903276772 3 ==== osd_op_reply(5 exist [read 0~256] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) ==== 149+0+0 (unknown 3355934114 0 0) 0x7f4a24003e10 con 0x55946bb67560 2026-02-12T03:59:14.648 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.646+0000 7f4a337fe640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(5 exist [read 0~256] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) 2026-02-12T03:59:14.648 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.646+0000 7f4a337fe640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.648 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.646+0000 7f4a337fe640 7 client.4748.objecter handle_osd_op_reply 5 ondisk uv 0 in 10.1 attempt 0 2026-02-12T03:59:14.652 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.646+0000 7f4a337fe640 7 client.4748.objecter got -EAGAIN, resubmitting 2026-02-12T03:59:14.652 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.646+0000 7f4a337fe640 20 client.4748.objecter put_session s=0x55946bb673f0 osd=7 5 2026-02-12T03:59:14.652 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.646+0000 7f4a337fe640 15 client.4748.objecter _session_op_remove 7 5 2026-02-12T03:59:14.652 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.646+0000 7f4a337fe640 10 client.4748.objecter _op_submit op 0x55946bb66f40 2026-02-12T03:59:14.652 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.646+0000 7f4a337fe640 20 client.4748.objecter _calc_target epoch 33 base exist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.652 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.646+0000 7f4a337fe640 20 client.4748.objecter _calc_target target exist @10 -> pgid 10.d3a59201 2026-02-12T03:59:14.652 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.646+0000 7f4a337fe640 10 client.4748.objecter _calc_target raw pgid 10.d3a59201 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.652 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.646+0000 7f4a337fe640 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.652 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.646+0000 7f4a337fe640 10 client.4748.objecter _op_submit oid exist '@10' '@10' [read 0~256] tid 7 osd.10 2026-02-12T03:59:14.652 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.646+0000 7f4a337fe640 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.652 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.646+0000 7f4a337fe640 15 client.4748.objecter _session_op_assign 10 7 2026-02-12T03:59:14.652 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.646+0000 7f4a337fe640 15 client.4748.objecter _send_op 7 to 10.1 on osd.10 2026-02-12T03:59:14.652 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.646+0000 7f4a337fe640 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:7 10.1 10:8049a5cb:::exist:head [read 0~256] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e33) -- 0x55946bb6c710 con 0x55946bb67ed0 2026-02-12T03:59:14.652 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.646+0000 7f4a337fe640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.652 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.646+0000 7f4a337fe640 5 client.4748.objecter 2 in flight 2026-02-12T03:59:14.652 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.648+0000 7f4a337fe640 1 -- 10.20.193.154:0/1932936756 <== osd.7 v1:10.20.193.154:6808/903276772 4 ==== osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 90278164 0 0) 0x7f4a24003e10 con 0x55946bb67560 2026-02-12T03:59:14.653 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.648+0000 7f4a337fe640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-12T03:59:14.653 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.648+0000 7f4a337fe640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.653 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.648+0000 7f4a337fe640 7 client.4748.objecter handle_osd_op_reply 6 ondisk uv 0 in 10.1 attempt 0 2026-02-12T03:59:14.653 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.648+0000 7f4a337fe640 10 client.4748.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-12T03:59:14.653 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.648+0000 7f4a337fe640 10 client.4748.objecter op 0 rval 0 len 0 2026-02-12T03:59:14.653 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.648+0000 7f4a337fe640 15 client.4748.objecter handle_osd_op_reply completed tid 6 2026-02-12T03:59:14.653 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.648+0000 7f4a337fe640 15 client.4748.objecter _finish_op 6 2026-02-12T03:59:14.653 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.648+0000 7f4a337fe640 20 client.4748.objecter put_session s=0x55946bb673f0 osd=7 4 2026-02-12T03:59:14.653 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.648+0000 7f4a337fe640 15 client.4748.objecter _session_op_remove 7 6 2026-02-12T03:59:14.653 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.648+0000 7f4a337fe640 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.653 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.651+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 5 ==== osd_op_reply(7 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 644287108 0 3741568377) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.653 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.651+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(7 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-12T03:59:14.653 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.651+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.653 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.651+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 7 ondisk uv 1 in 10.1 attempt 1 2026-02-12T03:59:14.653 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.651+0000 7f4a32ffd640 10 client.4748.objecter op 0 rval 0 len 5 2026-02-12T03:59:14.653 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.651+0000 7f4a32ffd640 15 client.4748.objecter handle_osd_op_reply completed tid 7 2026-02-12T03:59:14.653 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.651+0000 7f4a32ffd640 15 client.4748.objecter _finish_op 7 2026-02-12T03:59:14.653 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.651+0000 7f4a32ffd640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.653 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.651+0000 7f4a32ffd640 15 client.4748.objecter _session_op_remove 10 7 2026-02-12T03:59:14.653 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.651+0000 7f4a32ffd640 5 client.4748.objecter 0 in flight 2026-02-12T03:59:14.653 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ OK ] AsioRados.AsyncReadDeferred (11 ms) 2026-02-12T03:59:14.653 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2026-02-12T03:59:14.653 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.651+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bb6c1e0 2026-02-12T03:59:14.653 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.651+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base exist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.653 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.651+0000 7f4a3c022880 20 client.4748.objecter _calc_target target exist @10 -> pgid 10.d3a59201 2026-02-12T03:59:14.654 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.651+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.d3a59201 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.654 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.651+0000 7f4a3c022880 10 client.4748.objecter chose random osd.10 of [10,7] 2026-02-12T03:59:14.654 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.651+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.654 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.651+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid exist '@10' '@10' [read 0~256] tid 8 osd.10 2026-02-12T03:59:14.654 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.651+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.654 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.651+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 10 8 2026-02-12T03:59:14.654 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.651+0000 7f4a3c022880 15 client.4748.objecter _send_op 8 to 10.1 on osd.10 2026-02-12T03:59:14.654 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.651+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:8 10.1 10:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x55946bb6cbe0 con 0x55946bb67ed0 2026-02-12T03:59:14.654 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.651+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.654 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.651+0000 7f4a3c022880 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.654 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.651+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bb6d2d0 2026-02-12T03:59:14.654 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.651+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base noexist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.654 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.651+0000 7f4a3c022880 20 client.4748.objecter _calc_target target noexist @10 -> pgid 10.a7bbaa1 2026-02-12T03:59:14.654 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.651+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.a7bbaa1 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.654 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.651+0000 7f4a3c022880 10 client.4748.objecter chose random osd.10 of [10,7] 2026-02-12T03:59:14.654 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.651+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.660 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.651+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid noexist '@10' '@10' [read 0~256] tid 9 osd.10 2026-02-12T03:59:14.660 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.651+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.660 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.651+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 10 9 2026-02-12T03:59:14.660 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.651+0000 7f4a3c022880 15 client.4748.objecter _send_op 9 to 10.1 on osd.10 2026-02-12T03:59:14.661 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.651+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:9 10.1 10:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x55946bb6d780 con 0x55946bb67ed0 2026-02-12T03:59:14.661 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.651+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 5 2026-02-12T03:59:14.661 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.651+0000 7f4a3c022880 5 client.4748.objecter 2 in flight 2026-02-12T03:59:14.661 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.658+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 6 ==== osd_op_reply(8 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 2461695437 0 3741568377) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.661 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.658+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(8 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-12T03:59:14.661 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.658+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.661 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.658+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 8 ondisk uv 1 in 10.1 attempt 0 2026-02-12T03:59:14.661 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.658+0000 7f4a32ffd640 10 client.4748.objecter op 0 rval 0 len 5 2026-02-12T03:59:14.661 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.658+0000 7f4a32ffd640 15 client.4748.objecter handle_osd_op_reply completed tid 8 2026-02-12T03:59:14.661 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.658+0000 7f4a32ffd640 15 client.4748.objecter _finish_op 8 2026-02-12T03:59:14.661 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.658+0000 7f4a32ffd640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 5 2026-02-12T03:59:14.661 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.658+0000 7f4a32ffd640 15 client.4748.objecter _session_op_remove 10 8 2026-02-12T03:59:14.662 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.658+0000 7f4a32ffd640 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.662 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.659+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 7 ==== osd_op_reply(9 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 90278164 0 0) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.662 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.659+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(9 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-12T03:59:14.662 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.659+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.662 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.659+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 9 ondisk uv 0 in 10.1 attempt 0 2026-02-12T03:59:14.662 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.659+0000 7f4a32ffd640 10 client.4748.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-12T03:59:14.662 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.659+0000 7f4a32ffd640 10 client.4748.objecter op 0 rval 0 len 0 2026-02-12T03:59:14.662 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.659+0000 7f4a32ffd640 15 client.4748.objecter handle_osd_op_reply completed tid 9 2026-02-12T03:59:14.662 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.659+0000 7f4a32ffd640 15 client.4748.objecter _finish_op 9 2026-02-12T03:59:14.662 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.659+0000 7f4a32ffd640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.662 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.659+0000 7f4a32ffd640 15 client.4748.objecter _session_op_remove 10 9 2026-02-12T03:59:14.663 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.659+0000 7f4a32ffd640 5 client.4748.objecter 0 in flight 2026-02-12T03:59:14.663 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (7 ms) 2026-02-12T03:59:14.663 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2026-02-12T03:59:14.663 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.659+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bb6c1e0 2026-02-12T03:59:14.663 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.659+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base exist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.663 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.659+0000 7f4a3c022880 20 client.4748.objecter _calc_target target exist @10 -> pgid 10.d3a59201 2026-02-12T03:59:14.663 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.659+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.d3a59201 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.664 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.659+0000 7f4a3c022880 10 client.4748.objecter chose random osd.7 of [10,7] 2026-02-12T03:59:14.664 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.659+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bb673f0 osd=7 3 2026-02-12T03:59:14.664 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.659+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid exist '@10' '@10' [read 0~256] tid 10 osd.7 2026-02-12T03:59:14.664 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.659+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bb673f0 osd=7 3 2026-02-12T03:59:14.664 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.659+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 7 10 2026-02-12T03:59:14.664 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.659+0000 7f4a3c022880 15 client.4748.objecter _send_op 10 to 10.1 on osd.7 2026-02-12T03:59:14.664 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.659+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.154:6808/903276772 -- osd_op(unknown.0.0:10 10.1 10:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x55946bb6d2b0 con 0x55946bb67560 2026-02-12T03:59:14.664 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.659+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bb673f0 osd=7 4 2026-02-12T03:59:14.664 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.659+0000 7f4a3c022880 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.664 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.659+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bb6dd20 2026-02-12T03:59:14.664 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.659+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base noexist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.664 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.659+0000 7f4a3c022880 20 client.4748.objecter _calc_target target noexist @10 -> pgid 10.a7bbaa1 2026-02-12T03:59:14.664 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.659+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.a7bbaa1 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.665 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.659+0000 7f4a3c022880 10 client.4748.objecter chose random osd.10 of [10,7] 2026-02-12T03:59:14.665 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.659+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.665 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.659+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid noexist '@10' '@10' [read 0~256] tid 11 osd.10 2026-02-12T03:59:14.665 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.659+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.665 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.659+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 10 11 2026-02-12T03:59:14.665 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.659+0000 7f4a3c022880 15 client.4748.objecter _send_op 11 to 10.1 on osd.10 2026-02-12T03:59:14.665 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.659+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:11 10.1 10:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x55946bb6e1d0 con 0x55946bb67ed0 2026-02-12T03:59:14.665 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.659+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.665 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.659+0000 7f4a3c022880 5 client.4748.objecter 2 in flight 2026-02-12T03:59:14.667 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.661+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 8 ==== osd_op_reply(11 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 90278164 0 0) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.667 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.661+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(11 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-12T03:59:14.667 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.661+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.667 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.661+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 11 ondisk uv 0 in 10.1 attempt 0 2026-02-12T03:59:14.667 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.661+0000 7f4a32ffd640 10 client.4748.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-12T03:59:14.667 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.661+0000 7f4a32ffd640 10 client.4748.objecter op 0 rval 0 len 0 2026-02-12T03:59:14.667 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.661+0000 7f4a32ffd640 15 client.4748.objecter handle_osd_op_reply completed tid 11 2026-02-12T03:59:14.667 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.661+0000 7f4a32ffd640 15 client.4748.objecter _finish_op 11 2026-02-12T03:59:14.667 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.661+0000 7f4a32ffd640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.668 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.661+0000 7f4a32ffd640 15 client.4748.objecter _session_op_remove 10 11 2026-02-12T03:59:14.668 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.661+0000 7f4a32ffd640 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.668 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.665+0000 7f4a337fe640 1 -- 10.20.193.154:0/1932936756 <== osd.7 v1:10.20.193.154:6808/903276772 5 ==== osd_op_reply(10 exist [read 0~256] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) ==== 149+0+0 (unknown 3355934114 0 0) 0x7f4a24003e10 con 0x55946bb67560 2026-02-12T03:59:14.668 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.665+0000 7f4a337fe640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(10 exist [read 0~256] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) 2026-02-12T03:59:14.668 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.665+0000 7f4a337fe640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.668 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.665+0000 7f4a337fe640 7 client.4748.objecter handle_osd_op_reply 10 ondisk uv 0 in 10.1 attempt 0 2026-02-12T03:59:14.668 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.665+0000 7f4a337fe640 7 client.4748.objecter got -EAGAIN, resubmitting 2026-02-12T03:59:14.668 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.665+0000 7f4a337fe640 20 client.4748.objecter put_session s=0x55946bb673f0 osd=7 4 2026-02-12T03:59:14.668 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.665+0000 7f4a337fe640 15 client.4748.objecter _session_op_remove 7 10 2026-02-12T03:59:14.668 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.665+0000 7f4a337fe640 10 client.4748.objecter _op_submit op 0x55946bb6c1e0 2026-02-12T03:59:14.668 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.665+0000 7f4a337fe640 20 client.4748.objecter _calc_target epoch 33 base exist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.668 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.665+0000 7f4a337fe640 20 client.4748.objecter _calc_target target exist @10 -> pgid 10.d3a59201 2026-02-12T03:59:14.669 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.665+0000 7f4a337fe640 10 client.4748.objecter _calc_target raw pgid 10.d3a59201 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.669 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.665+0000 7f4a337fe640 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.669 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.665+0000 7f4a337fe640 10 client.4748.objecter _op_submit oid exist '@10' '@10' [read 0~256] tid 12 osd.10 2026-02-12T03:59:14.669 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.665+0000 7f4a337fe640 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.669 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.665+0000 7f4a337fe640 15 client.4748.objecter _session_op_assign 10 12 2026-02-12T03:59:14.669 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.665+0000 7f4a337fe640 15 client.4748.objecter _send_op 12 to 10.1 on osd.10 2026-02-12T03:59:14.670 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.665+0000 7f4a337fe640 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:12 10.1 10:8049a5cb:::exist:head [read 0~256] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e33) -- 0x55946bb6d2b0 con 0x55946bb67ed0 2026-02-12T03:59:14.670 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.665+0000 7f4a337fe640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.670 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.665+0000 7f4a337fe640 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.670 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.668+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 9 ==== osd_op_reply(12 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 644287108 0 3741568377) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.670 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.668+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(12 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-12T03:59:14.670 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.668+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.670 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.668+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 12 ondisk uv 1 in 10.1 attempt 1 2026-02-12T03:59:14.670 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.668+0000 7f4a32ffd640 10 client.4748.objecter op 0 rval 0 len 5 2026-02-12T03:59:14.670 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.668+0000 7f4a32ffd640 15 client.4748.objecter handle_osd_op_reply completed tid 12 2026-02-12T03:59:14.670 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.668+0000 7f4a32ffd640 15 client.4748.objecter _finish_op 12 2026-02-12T03:59:14.670 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.668+0000 7f4a32ffd640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.671 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.668+0000 7f4a32ffd640 15 client.4748.objecter _session_op_remove 10 12 2026-02-12T03:59:14.671 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.668+0000 7f4a32ffd640 5 client.4748.objecter 0 in flight 2026-02-12T03:59:14.671 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield (9 ms) 2026-02-12T03:59:14.671 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ RUN ] AsioRados.AsyncReadAwaitable 2026-02-12T03:59:14.671 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.668+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bb6dd00 2026-02-12T03:59:14.671 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.668+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base exist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.671 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.668+0000 7f4a3c022880 20 client.4748.objecter _calc_target target exist @10 -> pgid 10.d3a59201 2026-02-12T03:59:14.671 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.668+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.d3a59201 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.671 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.668+0000 7f4a3c022880 10 client.4748.objecter chose random osd.10 of [10,7] 2026-02-12T03:59:14.671 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.668+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.671 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.668+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid exist '@10' '@10' [read 0~256] tid 13 osd.10 2026-02-12T03:59:14.671 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.668+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.672 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.668+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 10 13 2026-02-12T03:59:14.672 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.668+0000 7f4a3c022880 15 client.4748.objecter _send_op 13 to 10.1 on osd.10 2026-02-12T03:59:14.672 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.668+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:13 10.1 10:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x55946bb6e5c0 con 0x55946bb67ed0 2026-02-12T03:59:14.672 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.668+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.672 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.668+0000 7f4a3c022880 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.672 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.668+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bb6eac0 2026-02-12T03:59:14.674 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.668+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base noexist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.674 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.668+0000 7f4a3c022880 20 client.4748.objecter _calc_target target noexist @10 -> pgid 10.a7bbaa1 2026-02-12T03:59:14.674 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.668+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.a7bbaa1 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.674 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.668+0000 7f4a3c022880 10 client.4748.objecter chose random osd.10 of [10,7] 2026-02-12T03:59:14.674 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.668+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.674 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.668+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid noexist '@10' '@10' [read 0~256] tid 14 osd.10 2026-02-12T03:59:14.675 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.668+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.675 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.668+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 10 14 2026-02-12T03:59:14.675 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.668+0000 7f4a3c022880 15 client.4748.objecter _send_op 14 to 10.1 on osd.10 2026-02-12T03:59:14.675 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.668+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:14 10.1 10:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x55946bb6ef70 con 0x55946bb67ed0 2026-02-12T03:59:14.675 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.668+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 5 2026-02-12T03:59:14.675 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.668+0000 7f4a3c022880 5 client.4748.objecter 2 in flight 2026-02-12T03:59:14.675 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.672+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 10 ==== osd_op_reply(13 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 2461695437 0 3741568377) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.675 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.672+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(13 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-12T03:59:14.675 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.672+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.675 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.672+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 13 ondisk uv 1 in 10.1 attempt 0 2026-02-12T03:59:14.675 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.672+0000 7f4a32ffd640 10 client.4748.objecter op 0 rval 0 len 5 2026-02-12T03:59:14.675 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.672+0000 7f4a32ffd640 15 client.4748.objecter handle_osd_op_reply completed tid 13 2026-02-12T03:59:14.676 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.672+0000 7f4a32ffd640 15 client.4748.objecter _finish_op 13 2026-02-12T03:59:14.676 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.672+0000 7f4a32ffd640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 5 2026-02-12T03:59:14.676 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.672+0000 7f4a32ffd640 15 client.4748.objecter _session_op_remove 10 13 2026-02-12T03:59:14.676 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.672+0000 7f4a32ffd640 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.676 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.673+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 11 ==== osd_op_reply(14 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 90278164 0 0) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.676 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.673+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(14 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-12T03:59:14.676 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.673+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.676 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.673+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 14 ondisk uv 0 in 10.1 attempt 0 2026-02-12T03:59:14.700 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.673+0000 7f4a32ffd640 10 client.4748.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-12T03:59:14.700 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.673+0000 7f4a32ffd640 10 client.4748.objecter op 0 rval 0 len 0 2026-02-12T03:59:14.700 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.673+0000 7f4a32ffd640 15 client.4748.objecter handle_osd_op_reply completed tid 14 2026-02-12T03:59:14.700 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.673+0000 7f4a32ffd640 15 client.4748.objecter _finish_op 14 2026-02-12T03:59:14.700 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.673+0000 7f4a32ffd640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.701 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.673+0000 7f4a32ffd640 15 client.4748.objecter _session_op_remove 10 14 2026-02-12T03:59:14.701 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.673+0000 7f4a32ffd640 5 client.4748.objecter 0 in flight 2026-02-12T03:59:14.701 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ OK ] AsioRados.AsyncReadAwaitable (4 ms) 2026-02-12T03:59:14.701 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2026-02-12T03:59:14.701 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.673+0000 7f4a3c022880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-12T03:59:14.701 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.673+0000 7f4a3c022880 20 librados: queue_aio_write 0x55946ba26390 completion 0x55946bb6c540 write_seq 1 2026-02-12T03:59:14.701 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.673+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bb6dd00 2026-02-12T03:59:14.701 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.673+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base exist @10 precalc_pgid 0 pgid 0.0 is_write 2026-02-12T03:59:14.701 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.673+0000 7f4a3c022880 20 client.4748.objecter _calc_target target exist @10 -> pgid 10.d3a59201 2026-02-12T03:59:14.701 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.673+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.d3a59201 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.701 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.673+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.701 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.673+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid exist '@10' '@10' [write 0~5 in=5b] tid 15 osd.10 2026-02-12T03:59:14.702 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.673+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.702 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.673+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 10 15 2026-02-12T03:59:14.702 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.673+0000 7f4a3c022880 15 client.4748.objecter _send_op 15 to 10.1 on osd.10 2026-02-12T03:59:14.702 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.673+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:15 10.1 10:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55946bb6e5c0 con 0x55946bb67ed0 2026-02-12T03:59:14.702 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.673+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.702 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.673+0000 7f4a3c022880 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.702 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.673+0000 7f4a3c022880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-12T03:59:14.702 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.698+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 12 ==== osd_op_reply(15 exist [write 0~5] v33'2 uv2 ondisk = 0) ==== 149+0+0 (unknown 3552064025 0 0) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.702 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.698+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(15 exist [write 0~5] v33'2 uv2 ondisk = 0) 2026-02-12T03:59:14.702 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.698+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.702 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.698+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 15 ondisk uv 2 in 10.1 attempt 0 2026-02-12T03:59:14.702 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.698+0000 7f4a32ffd640 10 client.4748.objecter op 0 rval 0 len 0 2026-02-12T03:59:14.723 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.698+0000 7f4a32ffd640 15 client.4748.objecter handle_osd_op_reply completed tid 15 2026-02-12T03:59:14.723 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.698+0000 7f4a32ffd640 15 client.4748.objecter _finish_op 15 2026-02-12T03:59:14.723 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.698+0000 7f4a32ffd640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.723 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (25 ms) 2026-02-12T03:59:14.723 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.698+0000 7f4a32ffd640 15 client.4748.objecter _session_op_remove 10 15 2026-02-12T03:59:14.723 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteDeferred 2026-02-12T03:59:14.723 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.698+0000 7f4a32ffd640 5 client.4748.objecter 0 in flight 2026-02-12T03:59:14.723 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.698+0000 7f4a32ffd640 20 librados: complete_aio_write 0x55946bb6c540 2026-02-12T03:59:14.723 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.698+0000 7f4a3c022880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-12T03:59:14.724 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.698+0000 7f4a3c022880 20 librados: queue_aio_write 0x55946ba26390 completion 0x55946bb6eaa0 write_seq 2 2026-02-12T03:59:14.724 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.698+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bb6dd00 2026-02-12T03:59:14.724 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.698+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base exist @10 precalc_pgid 0 pgid 0.0 is_write 2026-02-12T03:59:14.724 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.698+0000 7f4a3c022880 20 client.4748.objecter _calc_target target exist @10 -> pgid 10.d3a59201 2026-02-12T03:59:14.724 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.698+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.d3a59201 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.724 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.698+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.724 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.698+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid exist '@10' '@10' [write 0~5 in=5b] tid 16 osd.10 2026-02-12T03:59:14.724 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.698+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.724 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.698+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 10 16 2026-02-12T03:59:14.724 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.698+0000 7f4a3c022880 15 client.4748.objecter _send_op 16 to 10.1 on osd.10 2026-02-12T03:59:14.724 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.698+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:16 10.1 10:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55946bb6e5c0 con 0x55946bb67ed0 2026-02-12T03:59:14.725 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.698+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.725 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.698+0000 7f4a3c022880 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.725 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.698+0000 7f4a3c022880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-12T03:59:14.725 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.721+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 13 ==== osd_op_reply(16 exist [write 0~5] v33'3 uv3 ondisk = 0) ==== 149+0+0 (unknown 2805500365 0 0) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.725 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.721+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(16 exist [write 0~5] v33'3 uv3 ondisk = 0) 2026-02-12T03:59:14.725 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.721+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.725 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.721+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 16 ondisk uv 3 in 10.1 attempt 0 2026-02-12T03:59:14.725 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.721+0000 7f4a32ffd640 10 client.4748.objecter op 0 rval 0 len 0 2026-02-12T03:59:14.725 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.721+0000 7f4a32ffd640 15 client.4748.objecter handle_osd_op_reply completed tid 16 2026-02-12T03:59:14.725 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.721+0000 7f4a32ffd640 15 client.4748.objecter _finish_op 16 2026-02-12T03:59:14.756 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.721+0000 7f4a32ffd640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.756 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.721+0000 7f4a32ffd640 15 client.4748.objecter _session_op_remove 10 16 2026-02-12T03:59:14.756 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.721+0000 7f4a32ffd640 5 client.4748.objecter 0 in flight 2026-02-12T03:59:14.756 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.721+0000 7f4a32ffd640 20 librados: complete_aio_write 0x55946bb6eaa0 2026-02-12T03:59:14.756 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ OK ] AsioRados.AsyncWriteDeferred (22 ms) 2026-02-12T03:59:14.756 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2026-02-12T03:59:14.756 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.721+0000 7f4a3c022880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-12T03:59:14.756 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.721+0000 7f4a3c022880 20 librados: queue_aio_write 0x55946ba26390 completion 0x55946bb6ebf0 write_seq 3 2026-02-12T03:59:14.756 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.721+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bb6dd00 2026-02-12T03:59:14.757 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.721+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base exist @10 precalc_pgid 0 pgid 0.0 is_write 2026-02-12T03:59:14.757 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.721+0000 7f4a3c022880 20 client.4748.objecter _calc_target target exist @10 -> pgid 10.d3a59201 2026-02-12T03:59:14.757 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.721+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.d3a59201 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.757 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.721+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.757 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.721+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid exist '@10' '@10' [write 0~5 in=5b] tid 17 osd.10 2026-02-12T03:59:14.757 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.721+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.757 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.721+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 10 17 2026-02-12T03:59:14.757 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.721+0000 7f4a3c022880 15 client.4748.objecter _send_op 17 to 10.1 on osd.10 2026-02-12T03:59:14.757 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.721+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:17 10.1 10:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55946bb6e5b0 con 0x55946bb67ed0 2026-02-12T03:59:14.757 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.721+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.757 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.721+0000 7f4a3c022880 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.757 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.721+0000 7f4a3c022880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-12T03:59:14.758 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.754+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 14 ==== osd_op_reply(17 exist [write 0~5] v33'4 uv4 ondisk = 0) ==== 149+0+0 (unknown 3981958160 0 0) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.758 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.754+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(17 exist [write 0~5] v33'4 uv4 ondisk = 0) 2026-02-12T03:59:14.758 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.754+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.758 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.754+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 17 ondisk uv 4 in 10.1 attempt 0 2026-02-12T03:59:14.758 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.754+0000 7f4a32ffd640 10 client.4748.objecter op 0 rval 0 len 0 2026-02-12T03:59:14.758 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.754+0000 7f4a32ffd640 15 client.4748.objecter handle_osd_op_reply completed tid 17 2026-02-12T03:59:14.758 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.754+0000 7f4a32ffd640 15 client.4748.objecter _finish_op 17 2026-02-12T03:59:14.758 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.754+0000 7f4a32ffd640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.758 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.754+0000 7f4a32ffd640 15 client.4748.objecter _session_op_remove 10 17 2026-02-12T03:59:14.775 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.754+0000 7f4a32ffd640 5 client.4748.objecter 0 in flight 2026-02-12T03:59:14.775 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.754+0000 7f4a32ffd640 20 librados: complete_aio_write 0x55946bb6ebf0 2026-02-12T03:59:14.775 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ OK ] AsioRados.AsyncWriteFuture (32 ms) 2026-02-12T03:59:14.775 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2026-02-12T03:59:14.775 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.754+0000 7f4a3c022880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-12T03:59:14.775 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.754+0000 7f4a3c022880 20 librados: queue_aio_write 0x55946ba26390 completion 0x55946bb6ee40 write_seq 4 2026-02-12T03:59:14.775 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.754+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bb6dd00 2026-02-12T03:59:14.775 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.754+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base exist @10 precalc_pgid 0 pgid 0.0 is_write 2026-02-12T03:59:14.775 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.754+0000 7f4a3c022880 20 client.4748.objecter _calc_target target exist @10 -> pgid 10.d3a59201 2026-02-12T03:59:14.775 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.754+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.d3a59201 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.775 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.754+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.776 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.754+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid exist '@10' '@10' [write 0~5 in=5b] tid 18 osd.10 2026-02-12T03:59:14.776 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.754+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.776 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.754+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 10 18 2026-02-12T03:59:14.776 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.754+0000 7f4a3c022880 15 client.4748.objecter _send_op 18 to 10.1 on osd.10 2026-02-12T03:59:14.776 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.754+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:18 10.1 10:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55946bd0f6e0 con 0x55946bb67ed0 2026-02-12T03:59:14.776 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.754+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.776 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.754+0000 7f4a3c022880 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.776 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.754+0000 7f4a3c022880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-12T03:59:14.776 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.773+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 15 ==== osd_op_reply(18 exist [write 0~5] v33'5 uv5 ondisk = 0) ==== 149+0+0 (unknown 2581030852 0 0) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.776 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.773+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(18 exist [write 0~5] v33'5 uv5 ondisk = 0) 2026-02-12T03:59:14.776 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.773+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.776 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.773+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 18 ondisk uv 5 in 10.1 attempt 0 2026-02-12T03:59:14.777 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.773+0000 7f4a32ffd640 10 client.4748.objecter op 0 rval 0 len 0 2026-02-12T03:59:14.777 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.773+0000 7f4a32ffd640 15 client.4748.objecter handle_osd_op_reply completed tid 18 2026-02-12T03:59:14.777 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.773+0000 7f4a32ffd640 15 client.4748.objecter _finish_op 18 2026-02-12T03:59:14.777 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.773+0000 7f4a32ffd640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.777 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.773+0000 7f4a32ffd640 15 client.4748.objecter _session_op_remove 10 18 2026-02-12T03:59:14.777 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.773+0000 7f4a32ffd640 5 client.4748.objecter 0 in flight 2026-02-12T03:59:14.777 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.773+0000 7f4a32ffd640 20 librados: complete_aio_write 0x55946bb6ee40 2026-02-12T03:59:14.789 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (18 ms) 2026-02-12T03:59:14.790 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteAwaitable 2026-02-12T03:59:14.790 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.773+0000 7f4a3c022880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-12T03:59:14.790 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.773+0000 7f4a3c022880 20 librados: queue_aio_write 0x55946ba26390 completion 0x55946bd0fad0 write_seq 5 2026-02-12T03:59:14.790 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.773+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bccf6c0 2026-02-12T03:59:14.790 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.773+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base exist @10 precalc_pgid 0 pgid 0.0 is_write 2026-02-12T03:59:14.790 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.773+0000 7f4a3c022880 20 client.4748.objecter _calc_target target exist @10 -> pgid 10.d3a59201 2026-02-12T03:59:14.790 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.773+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.d3a59201 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.790 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.773+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.790 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.773+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid exist '@10' '@10' [write 0~5 in=5b] tid 19 osd.10 2026-02-12T03:59:14.790 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.773+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.790 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.773+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 10 19 2026-02-12T03:59:14.790 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.773+0000 7f4a3c022880 15 client.4748.objecter _send_op 19 to 10.1 on osd.10 2026-02-12T03:59:14.791 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.773+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:19 10.1 10:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55946bccfb70 con 0x55946bb67ed0 2026-02-12T03:59:14.791 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.773+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.791 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.773+0000 7f4a3c022880 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.791 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.773+0000 7f4a3c022880 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-12T03:59:14.791 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.788+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 16 ==== osd_op_reply(19 exist [write 0~5] v33'6 uv6 ondisk = 0) ==== 149+0+0 (unknown 72788920 0 0) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.791 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.788+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(19 exist [write 0~5] v33'6 uv6 ondisk = 0) 2026-02-12T03:59:14.791 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.788+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.791 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.788+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 19 ondisk uv 6 in 10.1 attempt 0 2026-02-12T03:59:14.791 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.788+0000 7f4a32ffd640 10 client.4748.objecter op 0 rval 0 len 0 2026-02-12T03:59:14.791 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.788+0000 7f4a32ffd640 15 client.4748.objecter handle_osd_op_reply completed tid 19 2026-02-12T03:59:14.791 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.788+0000 7f4a32ffd640 15 client.4748.objecter _finish_op 19 2026-02-12T03:59:14.791 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.788+0000 7f4a32ffd640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.792 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.788+0000 7f4a32ffd640 15 client.4748.objecter _session_op_remove 10 19 2026-02-12T03:59:14.792 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.788+0000 7f4a32ffd640 5 client.4748.objecter 0 in flight 2026-02-12T03:59:14.792 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.788+0000 7f4a32ffd640 20 librados: complete_aio_write 0x55946bd0fad0 2026-02-12T03:59:14.792 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ OK ] AsioRados.AsyncWriteAwaitable (14 ms) 2026-02-12T03:59:14.792 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2026-02-12T03:59:14.794 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.788+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bccf6c0 2026-02-12T03:59:14.794 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.788+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base exist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.794 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.788+0000 7f4a3c022880 20 client.4748.objecter _calc_target target exist @10 -> pgid 10.d3a59201 2026-02-12T03:59:14.794 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.788+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.d3a59201 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.794 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.788+0000 7f4a3c022880 10 client.4748.objecter chose random osd.7 of [10,7] 2026-02-12T03:59:14.795 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.788+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bb673f0 osd=7 3 2026-02-12T03:59:14.795 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.788+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid exist '@10' '@10' [read 0~0] tid 20 osd.7 2026-02-12T03:59:14.795 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.788+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bb673f0 osd=7 3 2026-02-12T03:59:14.795 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.788+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 7 20 2026-02-12T03:59:14.795 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.788+0000 7f4a3c022880 15 client.4748.objecter _send_op 20 to 10.1 on osd.7 2026-02-12T03:59:14.795 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.788+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.154:6808/903276772 -- osd_op(unknown.0.0:20 10.1 10:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x55946bccfb70 con 0x55946bb67560 2026-02-12T03:59:14.795 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.788+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bb673f0 osd=7 4 2026-02-12T03:59:14.795 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.788+0000 7f4a3c022880 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.795 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.788+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bb6f310 2026-02-12T03:59:14.795 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.788+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base noexist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.795 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.788+0000 7f4a3c022880 20 client.4748.objecter _calc_target target noexist @10 -> pgid 10.a7bbaa1 2026-02-12T03:59:14.795 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.788+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.a7bbaa1 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.796 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.788+0000 7f4a3c022880 10 client.4748.objecter chose random osd.7 of [10,7] 2026-02-12T03:59:14.796 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.788+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bb673f0 osd=7 4 2026-02-12T03:59:14.796 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.788+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid noexist '@10' '@10' [read 0~0] tid 21 osd.7 2026-02-12T03:59:14.796 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.788+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bb673f0 osd=7 4 2026-02-12T03:59:14.796 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.788+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 7 21 2026-02-12T03:59:14.796 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.788+0000 7f4a3c022880 15 client.4748.objecter _send_op 21 to 10.1 on osd.7 2026-02-12T03:59:14.796 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.788+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.154:6808/903276772 -- osd_op(unknown.0.0:21 10.1 10:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x55946bb6f7c0 con 0x55946bb67560 2026-02-12T03:59:14.796 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.788+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bb673f0 osd=7 5 2026-02-12T03:59:14.796 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.788+0000 7f4a3c022880 5 client.4748.objecter 2 in flight 2026-02-12T03:59:14.796 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.793+0000 7f4a337fe640 1 -- 10.20.193.154:0/1932936756 <== osd.7 v1:10.20.193.154:6808/903276772 6 ==== osd_op_reply(20 exist [read 0~0] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) ==== 149+0+0 (unknown 2777629594 0 0) 0x7f4a24003e10 con 0x55946bb67560 2026-02-12T03:59:14.796 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.793+0000 7f4a337fe640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(20 exist [read 0~0] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) 2026-02-12T03:59:14.796 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.793+0000 7f4a337fe640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.797 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.793+0000 7f4a337fe640 7 client.4748.objecter handle_osd_op_reply 20 ondisk uv 0 in 10.1 attempt 0 2026-02-12T03:59:14.797 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.793+0000 7f4a337fe640 7 client.4748.objecter got -EAGAIN, resubmitting 2026-02-12T03:59:14.797 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.793+0000 7f4a337fe640 20 client.4748.objecter put_session s=0x55946bb673f0 osd=7 5 2026-02-12T03:59:14.797 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.793+0000 7f4a337fe640 15 client.4748.objecter _session_op_remove 7 20 2026-02-12T03:59:14.797 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.793+0000 7f4a337fe640 10 client.4748.objecter _op_submit op 0x55946bccf6c0 2026-02-12T03:59:14.797 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.793+0000 7f4a337fe640 20 client.4748.objecter _calc_target epoch 33 base exist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.797 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.793+0000 7f4a337fe640 20 client.4748.objecter _calc_target target exist @10 -> pgid 10.d3a59201 2026-02-12T03:59:14.797 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.793+0000 7f4a337fe640 10 client.4748.objecter _calc_target raw pgid 10.d3a59201 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.797 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.793+0000 7f4a337fe640 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.797 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.793+0000 7f4a337fe640 10 client.4748.objecter _op_submit oid exist '@10' '@10' [read 0~0] tid 22 osd.10 2026-02-12T03:59:14.797 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.793+0000 7f4a337fe640 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.797 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.793+0000 7f4a337fe640 15 client.4748.objecter _session_op_assign 10 22 2026-02-12T03:59:14.798 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.793+0000 7f4a337fe640 15 client.4748.objecter _send_op 22 to 10.1 on osd.10 2026-02-12T03:59:14.798 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.793+0000 7f4a337fe640 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:22 10.1 10:8049a5cb:::exist:head [read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e33) -- 0x55946bb6f7c0 con 0x55946bb67ed0 2026-02-12T03:59:14.798 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.793+0000 7f4a337fe640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.798 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.793+0000 7f4a337fe640 5 client.4748.objecter 2 in flight 2026-02-12T03:59:14.798 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.793+0000 7f4a337fe640 1 -- 10.20.193.154:0/1932936756 <== osd.7 v1:10.20.193.154:6808/903276772 7 ==== osd_op_reply(21 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 1760147244 0 0) 0x7f4a24003e10 con 0x55946bb67560 2026-02-12T03:59:14.798 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.793+0000 7f4a337fe640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(21 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-12T03:59:14.798 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.793+0000 7f4a337fe640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.798 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.793+0000 7f4a337fe640 7 client.4748.objecter handle_osd_op_reply 21 ondisk uv 0 in 10.1 attempt 0 2026-02-12T03:59:14.798 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.793+0000 7f4a337fe640 10 client.4748.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-12T03:59:14.798 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.793+0000 7f4a337fe640 10 client.4748.objecter op 0 rval 0 len 0 2026-02-12T03:59:14.798 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.793+0000 7f4a337fe640 15 client.4748.objecter handle_osd_op_reply completed tid 21 2026-02-12T03:59:14.798 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.793+0000 7f4a337fe640 15 client.4748.objecter _finish_op 21 2026-02-12T03:59:14.799 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.793+0000 7f4a337fe640 20 client.4748.objecter put_session s=0x55946bb673f0 osd=7 4 2026-02-12T03:59:14.799 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.793+0000 7f4a337fe640 15 client.4748.objecter _session_op_remove 7 21 2026-02-12T03:59:14.799 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.793+0000 7f4a337fe640 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.799 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.796+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 17 ==== osd_op_reply(22 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 1611978431 0 3741568377) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.799 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.796+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(22 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-12T03:59:14.799 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.796+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.799 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.796+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 22 ondisk uv 6 in 10.1 attempt 1 2026-02-12T03:59:14.800 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.796+0000 7f4a32ffd640 10 client.4748.objecter op 0 rval 0 len 5 2026-02-12T03:59:14.800 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.796+0000 7f4a32ffd640 15 client.4748.objecter handle_osd_op_reply completed tid 22 2026-02-12T03:59:14.800 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.796+0000 7f4a32ffd640 15 client.4748.objecter _finish_op 22 2026-02-12T03:59:14.800 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.796+0000 7f4a32ffd640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.800 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.796+0000 7f4a32ffd640 15 client.4748.objecter _session_op_remove 10 22 2026-02-12T03:59:14.800 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCallback (8 ms) 2026-02-12T03:59:14.800 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.796+0000 7f4a32ffd640 5 client.4748.objecter 0 in flight 2026-02-12T03:59:14.800 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationDeferred 2026-02-12T03:59:14.800 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.796+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bccf6c0 2026-02-12T03:59:14.800 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.796+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base exist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.800 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.796+0000 7f4a3c022880 20 client.4748.objecter _calc_target target exist @10 -> pgid 10.d3a59201 2026-02-12T03:59:14.800 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.796+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.d3a59201 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.801 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.796+0000 7f4a3c022880 10 client.4748.objecter chose random osd.7 of [10,7] 2026-02-12T03:59:14.801 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.796+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bb673f0 osd=7 3 2026-02-12T03:59:14.801 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.796+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid exist '@10' '@10' [read 0~0] tid 23 osd.7 2026-02-12T03:59:14.801 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.796+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bb673f0 osd=7 3 2026-02-12T03:59:14.801 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.796+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 7 23 2026-02-12T03:59:14.801 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.796+0000 7f4a3c022880 15 client.4748.objecter _send_op 23 to 10.1 on osd.7 2026-02-12T03:59:14.801 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.796+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.154:6808/903276772 -- osd_op(unknown.0.0:23 10.1 10:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x55946bb6fbb0 con 0x55946bb67560 2026-02-12T03:59:14.801 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.796+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bb673f0 osd=7 4 2026-02-12T03:59:14.801 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.796+0000 7f4a3c022880 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.801 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.796+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bb6f310 2026-02-12T03:59:14.801 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.796+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base noexist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.802 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.796+0000 7f4a3c022880 20 client.4748.objecter _calc_target target noexist @10 -> pgid 10.a7bbaa1 2026-02-12T03:59:14.802 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.796+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.a7bbaa1 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.802 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.796+0000 7f4a3c022880 10 client.4748.objecter chose random osd.7 of [10,7] 2026-02-12T03:59:14.802 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.796+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bb673f0 osd=7 4 2026-02-12T03:59:14.802 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.796+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid noexist '@10' '@10' [read 0~0] tid 24 osd.7 2026-02-12T03:59:14.802 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.796+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bb673f0 osd=7 4 2026-02-12T03:59:14.802 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.796+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 7 24 2026-02-12T03:59:14.803 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.796+0000 7f4a3c022880 15 client.4748.objecter _send_op 24 to 10.1 on osd.7 2026-02-12T03:59:14.803 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.796+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.154:6808/903276772 -- osd_op(unknown.0.0:24 10.1 10:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x55946bb6f7c0 con 0x55946bb67560 2026-02-12T03:59:14.803 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.796+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bb673f0 osd=7 5 2026-02-12T03:59:14.803 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.796+0000 7f4a3c022880 5 client.4748.objecter 2 in flight 2026-02-12T03:59:14.803 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.798+0000 7f4a337fe640 1 -- 10.20.193.154:0/1932936756 <== osd.7 v1:10.20.193.154:6808/903276772 8 ==== osd_op_reply(23 exist [read 0~0] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) ==== 149+0+0 (unknown 2777629594 0 0) 0x7f4a24003e10 con 0x55946bb67560 2026-02-12T03:59:14.803 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.798+0000 7f4a337fe640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(23 exist [read 0~0] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) 2026-02-12T03:59:14.803 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.798+0000 7f4a337fe640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.803 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.798+0000 7f4a337fe640 7 client.4748.objecter handle_osd_op_reply 23 ondisk uv 0 in 10.1 attempt 0 2026-02-12T03:59:14.803 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.798+0000 7f4a337fe640 7 client.4748.objecter got -EAGAIN, resubmitting 2026-02-12T03:59:14.803 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.798+0000 7f4a337fe640 20 client.4748.objecter put_session s=0x55946bb673f0 osd=7 5 2026-02-12T03:59:14.803 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.798+0000 7f4a337fe640 15 client.4748.objecter _session_op_remove 7 23 2026-02-12T03:59:14.803 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.798+0000 7f4a337fe640 10 client.4748.objecter _op_submit op 0x55946bccf6c0 2026-02-12T03:59:14.804 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.798+0000 7f4a337fe640 20 client.4748.objecter _calc_target epoch 33 base exist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.804 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.798+0000 7f4a337fe640 20 client.4748.objecter _calc_target target exist @10 -> pgid 10.d3a59201 2026-02-12T03:59:14.804 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.798+0000 7f4a337fe640 10 client.4748.objecter _calc_target raw pgid 10.d3a59201 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.804 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.798+0000 7f4a337fe640 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.804 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.798+0000 7f4a337fe640 10 client.4748.objecter _op_submit oid exist '@10' '@10' [read 0~0] tid 25 osd.10 2026-02-12T03:59:14.804 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.798+0000 7f4a337fe640 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.804 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.798+0000 7f4a337fe640 15 client.4748.objecter _session_op_assign 10 25 2026-02-12T03:59:14.804 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.798+0000 7f4a337fe640 15 client.4748.objecter _send_op 25 to 10.1 on osd.10 2026-02-12T03:59:14.805 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.798+0000 7f4a337fe640 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:25 10.1 10:8049a5cb:::exist:head [read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e33) -- 0x55946bb6f7c0 con 0x55946bb67ed0 2026-02-12T03:59:14.805 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.798+0000 7f4a337fe640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.805 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.798+0000 7f4a337fe640 5 client.4748.objecter 2 in flight 2026-02-12T03:59:14.805 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.800+0000 7f4a337fe640 1 -- 10.20.193.154:0/1932936756 <== osd.7 v1:10.20.193.154:6808/903276772 9 ==== osd_op_reply(24 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 1760147244 0 0) 0x7f4a24003e10 con 0x55946bb67560 2026-02-12T03:59:14.805 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.800+0000 7f4a337fe640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(24 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-12T03:59:14.805 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.800+0000 7f4a337fe640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.805 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.800+0000 7f4a337fe640 7 client.4748.objecter handle_osd_op_reply 24 ondisk uv 0 in 10.1 attempt 0 2026-02-12T03:59:14.805 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.800+0000 7f4a337fe640 10 client.4748.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-12T03:59:14.805 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.800+0000 7f4a337fe640 10 client.4748.objecter op 0 rval 0 len 0 2026-02-12T03:59:14.805 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.800+0000 7f4a337fe640 15 client.4748.objecter handle_osd_op_reply completed tid 24 2026-02-12T03:59:14.806 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.800+0000 7f4a337fe640 15 client.4748.objecter _finish_op 24 2026-02-12T03:59:14.806 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.800+0000 7f4a337fe640 20 client.4748.objecter put_session s=0x55946bb673f0 osd=7 4 2026-02-12T03:59:14.806 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.800+0000 7f4a337fe640 15 client.4748.objecter _session_op_remove 7 24 2026-02-12T03:59:14.806 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.800+0000 7f4a337fe640 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.806 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.802+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 18 ==== osd_op_reply(25 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 1611978431 0 3741568377) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.806 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.802+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(25 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-12T03:59:14.806 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.802+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.806 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.802+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 25 ondisk uv 6 in 10.1 attempt 1 2026-02-12T03:59:14.806 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.802+0000 7f4a32ffd640 10 client.4748.objecter op 0 rval 0 len 5 2026-02-12T03:59:14.806 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.802+0000 7f4a32ffd640 15 client.4748.objecter handle_osd_op_reply completed tid 25 2026-02-12T03:59:14.806 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.802+0000 7f4a32ffd640 15 client.4748.objecter _finish_op 25 2026-02-12T03:59:14.806 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.802+0000 7f4a32ffd640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.806 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationDeferred (5 ms) 2026-02-12T03:59:14.807 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.802+0000 7f4a32ffd640 15 client.4748.objecter _session_op_remove 10 25 2026-02-12T03:59:14.807 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2026-02-12T03:59:14.807 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.802+0000 7f4a32ffd640 5 client.4748.objecter 0 in flight 2026-02-12T03:59:14.807 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.802+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bccf6c0 2026-02-12T03:59:14.807 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.802+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base exist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.808 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.802+0000 7f4a3c022880 20 client.4748.objecter _calc_target target exist @10 -> pgid 10.d3a59201 2026-02-12T03:59:14.808 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.802+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.d3a59201 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.809 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.802+0000 7f4a3c022880 10 client.4748.objecter chose random osd.10 of [10,7] 2026-02-12T03:59:14.809 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.802+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.809 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.802+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid exist '@10' '@10' [read 0~0] tid 26 osd.10 2026-02-12T03:59:14.809 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.802+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.809 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.802+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 10 26 2026-02-12T03:59:14.809 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.802+0000 7f4a3c022880 15 client.4748.objecter _send_op 26 to 10.1 on osd.10 2026-02-12T03:59:14.809 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.802+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:26 10.1 10:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x55946bb6f310 con 0x55946bb67ed0 2026-02-12T03:59:14.809 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.802+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.809 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.802+0000 7f4a3c022880 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.809 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.802+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bcd0100 2026-02-12T03:59:14.809 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.802+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base noexist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.809 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.802+0000 7f4a3c022880 20 client.4748.objecter _calc_target target noexist @10 -> pgid 10.a7bbaa1 2026-02-12T03:59:14.810 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.802+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.a7bbaa1 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.810 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.802+0000 7f4a3c022880 10 client.4748.objecter chose random osd.10 of [10,7] 2026-02-12T03:59:14.810 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.802+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.810 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.802+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid noexist '@10' '@10' [read 0~0] tid 27 osd.10 2026-02-12T03:59:14.810 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.802+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.810 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.802+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 10 27 2026-02-12T03:59:14.810 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.802+0000 7f4a3c022880 15 client.4748.objecter _send_op 27 to 10.1 on osd.10 2026-02-12T03:59:14.810 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.802+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:27 10.1 10:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x55946bcd05b0 con 0x55946bb67ed0 2026-02-12T03:59:14.810 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.802+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 5 2026-02-12T03:59:14.810 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.802+0000 7f4a3c022880 5 client.4748.objecter 2 in flight 2026-02-12T03:59:14.810 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 19 ==== osd_op_reply(26 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 3569983990 0 3741568377) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.810 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(26 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-12T03:59:14.811 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.811 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 26 ondisk uv 6 in 10.1 attempt 0 2026-02-12T03:59:14.811 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a32ffd640 10 client.4748.objecter op 0 rval 0 len 5 2026-02-12T03:59:14.811 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a32ffd640 15 client.4748.objecter handle_osd_op_reply completed tid 26 2026-02-12T03:59:14.811 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a32ffd640 15 client.4748.objecter _finish_op 26 2026-02-12T03:59:14.811 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a32ffd640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 5 2026-02-12T03:59:14.811 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a32ffd640 15 client.4748.objecter _session_op_remove 10 26 2026-02-12T03:59:14.811 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a32ffd640 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.811 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 20 ==== osd_op_reply(27 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 1760147244 0 0) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.811 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(27 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-12T03:59:14.811 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.811 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 27 ondisk uv 0 in 10.1 attempt 0 2026-02-12T03:59:14.811 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a32ffd640 10 client.4748.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-12T03:59:14.812 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a32ffd640 10 client.4748.objecter op 0 rval 0 len 0 2026-02-12T03:59:14.812 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a32ffd640 15 client.4748.objecter handle_osd_op_reply completed tid 27 2026-02-12T03:59:14.812 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a32ffd640 15 client.4748.objecter _finish_op 27 2026-02-12T03:59:14.812 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a32ffd640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.812 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a32ffd640 15 client.4748.objecter _session_op_remove 10 27 2026-02-12T03:59:14.812 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a32ffd640 5 client.4748.objecter 0 in flight 2026-02-12T03:59:14.812 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture (5 ms) 2026-02-12T03:59:14.812 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2026-02-12T03:59:14.812 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bccf6c0 2026-02-12T03:59:14.812 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base exist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.812 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a3c022880 20 client.4748.objecter _calc_target target exist @10 -> pgid 10.d3a59201 2026-02-12T03:59:14.812 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.d3a59201 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.812 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a3c022880 10 client.4748.objecter chose random osd.7 of [10,7] 2026-02-12T03:59:14.813 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bb673f0 osd=7 3 2026-02-12T03:59:14.813 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid exist '@10' '@10' [read 0~0] tid 28 osd.7 2026-02-12T03:59:14.813 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bb673f0 osd=7 3 2026-02-12T03:59:14.813 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 7 28 2026-02-12T03:59:14.813 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a3c022880 15 client.4748.objecter _send_op 28 to 10.1 on osd.7 2026-02-12T03:59:14.813 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.154:6808/903276772 -- osd_op(unknown.0.0:28 10.1 10:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x55946bb6f310 con 0x55946bb67560 2026-02-12T03:59:14.813 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bb673f0 osd=7 4 2026-02-12T03:59:14.814 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a3c022880 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.814 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bcf0110 2026-02-12T03:59:14.814 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base noexist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.814 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a3c022880 20 client.4748.objecter _calc_target target noexist @10 -> pgid 10.a7bbaa1 2026-02-12T03:59:14.814 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.a7bbaa1 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.814 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a3c022880 10 client.4748.objecter chose random osd.7 of [10,7] 2026-02-12T03:59:14.814 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bb673f0 osd=7 4 2026-02-12T03:59:14.814 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid noexist '@10' '@10' [read 0~0] tid 29 osd.7 2026-02-12T03:59:14.814 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bb673f0 osd=7 4 2026-02-12T03:59:14.814 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 7 29 2026-02-12T03:59:14.814 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a3c022880 15 client.4748.objecter _send_op 29 to 10.1 on osd.7 2026-02-12T03:59:14.814 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.154:6808/903276772 -- osd_op(unknown.0.0:29 10.1 10:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x55946bb6f790 con 0x55946bb67560 2026-02-12T03:59:14.815 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bb673f0 osd=7 5 2026-02-12T03:59:14.815 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.807+0000 7f4a3c022880 5 client.4748.objecter 2 in flight 2026-02-12T03:59:14.815 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.810+0000 7f4a337fe640 1 -- 10.20.193.154:0/1932936756 <== osd.7 v1:10.20.193.154:6808/903276772 10 ==== osd_op_reply(28 exist [read 0~0] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) ==== 149+0+0 (unknown 2777629594 0 0) 0x7f4a24003e10 con 0x55946bb67560 2026-02-12T03:59:14.815 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.810+0000 7f4a337fe640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(28 exist [read 0~0] v0'0 uv0 ondisk = -11 ((11) Resource temporarily unavailable)) 2026-02-12T03:59:14.815 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.810+0000 7f4a337fe640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.815 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.810+0000 7f4a337fe640 7 client.4748.objecter handle_osd_op_reply 28 ondisk uv 0 in 10.1 attempt 0 2026-02-12T03:59:14.815 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.810+0000 7f4a337fe640 7 client.4748.objecter got -EAGAIN, resubmitting 2026-02-12T03:59:14.815 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.810+0000 7f4a337fe640 20 client.4748.objecter put_session s=0x55946bb673f0 osd=7 5 2026-02-12T03:59:14.815 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.810+0000 7f4a337fe640 15 client.4748.objecter _session_op_remove 7 28 2026-02-12T03:59:14.815 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.810+0000 7f4a337fe640 10 client.4748.objecter _op_submit op 0x55946bccf6c0 2026-02-12T03:59:14.815 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.810+0000 7f4a337fe640 20 client.4748.objecter _calc_target epoch 33 base exist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.815 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.810+0000 7f4a337fe640 20 client.4748.objecter _calc_target target exist @10 -> pgid 10.d3a59201 2026-02-12T03:59:14.816 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.810+0000 7f4a337fe640 10 client.4748.objecter _calc_target raw pgid 10.d3a59201 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.816 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.810+0000 7f4a337fe640 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.816 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.810+0000 7f4a337fe640 10 client.4748.objecter _op_submit oid exist '@10' '@10' [read 0~0] tid 30 osd.10 2026-02-12T03:59:14.816 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.810+0000 7f4a337fe640 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.816 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.810+0000 7f4a337fe640 15 client.4748.objecter _session_op_assign 10 30 2026-02-12T03:59:14.816 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.810+0000 7f4a337fe640 15 client.4748.objecter _send_op 30 to 10.1 on osd.10 2026-02-12T03:59:14.817 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.810+0000 7f4a337fe640 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:30 10.1 10:8049a5cb:::exist:head [read 0~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e33) -- 0x55946bb6f790 con 0x55946bb67ed0 2026-02-12T03:59:14.817 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.810+0000 7f4a337fe640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.817 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.810+0000 7f4a337fe640 5 client.4748.objecter 2 in flight 2026-02-12T03:59:14.817 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.810+0000 7f4a337fe640 1 -- 10.20.193.154:0/1932936756 <== osd.7 v1:10.20.193.154:6808/903276772 11 ==== osd_op_reply(29 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 1760147244 0 0) 0x7f4a24003e10 con 0x55946bb67560 2026-02-12T03:59:14.817 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.810+0000 7f4a337fe640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(29 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-12T03:59:14.817 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.810+0000 7f4a337fe640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.817 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.810+0000 7f4a337fe640 7 client.4748.objecter handle_osd_op_reply 29 ondisk uv 0 in 10.1 attempt 0 2026-02-12T03:59:14.817 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.810+0000 7f4a337fe640 10 client.4748.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-12T03:59:14.817 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.810+0000 7f4a337fe640 10 client.4748.objecter op 0 rval 0 len 0 2026-02-12T03:59:14.817 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.810+0000 7f4a337fe640 15 client.4748.objecter handle_osd_op_reply completed tid 29 2026-02-12T03:59:14.817 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.810+0000 7f4a337fe640 15 client.4748.objecter _finish_op 29 2026-02-12T03:59:14.817 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.810+0000 7f4a337fe640 20 client.4748.objecter put_session s=0x55946bb673f0 osd=7 4 2026-02-12T03:59:14.818 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.810+0000 7f4a337fe640 15 client.4748.objecter _session_op_remove 7 29 2026-02-12T03:59:14.818 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.810+0000 7f4a337fe640 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.818 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.813+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 21 ==== osd_op_reply(30 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 1611978431 0 3741568377) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.818 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.813+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(30 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-12T03:59:14.818 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.813+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.818 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.813+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 30 ondisk uv 6 in 10.1 attempt 1 2026-02-12T03:59:14.818 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.813+0000 7f4a32ffd640 10 client.4748.objecter op 0 rval 0 len 5 2026-02-12T03:59:14.818 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.813+0000 7f4a32ffd640 15 client.4748.objecter handle_osd_op_reply completed tid 30 2026-02-12T03:59:14.818 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.813+0000 7f4a32ffd640 15 client.4748.objecter _finish_op 30 2026-02-12T03:59:14.818 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.813+0000 7f4a32ffd640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.818 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationYield (6 ms) 2026-02-12T03:59:14.818 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.813+0000 7f4a32ffd640 15 client.4748.objecter _session_op_remove 10 30 2026-02-12T03:59:14.819 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationAwaitable 2026-02-12T03:59:14.819 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.813+0000 7f4a32ffd640 5 client.4748.objecter 0 in flight 2026-02-12T03:59:14.819 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.813+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bccf6c0 2026-02-12T03:59:14.819 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.813+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base exist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.819 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.813+0000 7f4a3c022880 20 client.4748.objecter _calc_target target exist @10 -> pgid 10.d3a59201 2026-02-12T03:59:14.819 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.813+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.d3a59201 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.819 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.813+0000 7f4a3c022880 10 client.4748.objecter chose random osd.10 of [10,7] 2026-02-12T03:59:14.819 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.813+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.819 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.813+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid exist '@10' '@10' [read 0~0] tid 31 osd.10 2026-02-12T03:59:14.819 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.813+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.819 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.813+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 10 31 2026-02-12T03:59:14.819 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.813+0000 7f4a3c022880 15 client.4748.objecter _send_op 31 to 10.1 on osd.10 2026-02-12T03:59:14.819 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.813+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:31 10.1 10:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x55946bb6f790 con 0x55946bb67ed0 2026-02-12T03:59:14.820 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.813+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.820 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.813+0000 7f4a3c022880 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.820 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.813+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bcd0100 2026-02-12T03:59:14.820 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.813+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base noexist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.820 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.813+0000 7f4a3c022880 20 client.4748.objecter _calc_target target noexist @10 -> pgid 10.a7bbaa1 2026-02-12T03:59:14.820 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.813+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.a7bbaa1 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.820 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.813+0000 7f4a3c022880 10 client.4748.objecter chose random osd.10 of [10,7] 2026-02-12T03:59:14.820 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.813+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.820 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.813+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid noexist '@10' '@10' [read 0~0] tid 32 osd.10 2026-02-12T03:59:14.820 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.813+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.820 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.813+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 10 32 2026-02-12T03:59:14.820 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.813+0000 7f4a3c022880 15 client.4748.objecter _send_op 32 to 10.1 on osd.10 2026-02-12T03:59:14.821 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.813+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:32 10.1 10:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x55946bcd05b0 con 0x55946bb67ed0 2026-02-12T03:59:14.821 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.813+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 5 2026-02-12T03:59:14.821 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.813+0000 7f4a3c022880 5 client.4748.objecter 2 in flight 2026-02-12T03:59:14.821 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.816+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 22 ==== osd_op_reply(31 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 3569983990 0 3741568377) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.821 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.816+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(31 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-12T03:59:14.821 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.816+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.821 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.816+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 31 ondisk uv 6 in 10.1 attempt 0 2026-02-12T03:59:14.821 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.816+0000 7f4a32ffd640 10 client.4748.objecter op 0 rval 0 len 5 2026-02-12T03:59:14.822 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.816+0000 7f4a32ffd640 15 client.4748.objecter handle_osd_op_reply completed tid 31 2026-02-12T03:59:14.822 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.816+0000 7f4a32ffd640 15 client.4748.objecter _finish_op 31 2026-02-12T03:59:14.822 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.816+0000 7f4a32ffd640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 5 2026-02-12T03:59:14.822 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.816+0000 7f4a32ffd640 15 client.4748.objecter _session_op_remove 10 31 2026-02-12T03:59:14.822 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.816+0000 7f4a32ffd640 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.822 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.818+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 23 ==== osd_op_reply(32 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 1760147244 0 0) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.822 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.818+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(32 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-12T03:59:14.822 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.818+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.822 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.818+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 32 ondisk uv 0 in 10.1 attempt 0 2026-02-12T03:59:14.822 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.818+0000 7f4a32ffd640 10 client.4748.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-12T03:59:14.822 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.818+0000 7f4a32ffd640 10 client.4748.objecter op 0 rval 0 len 0 2026-02-12T03:59:14.822 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.818+0000 7f4a32ffd640 15 client.4748.objecter handle_osd_op_reply completed tid 32 2026-02-12T03:59:14.823 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.818+0000 7f4a32ffd640 15 client.4748.objecter _finish_op 32 2026-02-12T03:59:14.823 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.818+0000 7f4a32ffd640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.823 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.818+0000 7f4a32ffd640 15 client.4748.objecter _session_op_remove 10 32 2026-02-12T03:59:14.823 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.818+0000 7f4a32ffd640 5 client.4748.objecter 0 in flight 2026-02-12T03:59:14.823 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationAwaitable (4 ms) 2026-02-12T03:59:14.823 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2026-02-12T03:59:14.823 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.818+0000 7f4a3c022880 20 librados: queue_aio_write 0x55946ba26390 completion 0x55946bbba790 write_seq 6 2026-02-12T03:59:14.823 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.818+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bccf6c0 2026-02-12T03:59:14.823 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.818+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base exist @10 precalc_pgid 0 pgid 0.0 is_write 2026-02-12T03:59:14.833 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.818+0000 7f4a3c022880 20 client.4748.objecter _calc_target target exist @10 -> pgid 10.d3a59201 2026-02-12T03:59:14.833 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.818+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.d3a59201 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.833 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.818+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.833 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.818+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid exist '@10' '@10' [writefull 0~5 in=5b] tid 33 osd.10 2026-02-12T03:59:14.833 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.818+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.833 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.818+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 10 33 2026-02-12T03:59:14.833 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.818+0000 7f4a3c022880 15 client.4748.objecter _send_op 33 to 10.1 on osd.10 2026-02-12T03:59:14.833 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.818+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:33 10.1 10:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55946bb6f790 con 0x55946bb67ed0 2026-02-12T03:59:14.834 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.818+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.834 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.818+0000 7f4a3c022880 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.834 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.831+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 24 ==== osd_op_reply(33 exist [writefull 0~5] v33'7 uv7 ondisk = 0) ==== 149+0+0 (unknown 3990988536 0 0) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.834 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.831+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(33 exist [writefull 0~5] v33'7 uv7 ondisk = 0) 2026-02-12T03:59:14.834 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.831+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.834 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.831+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 33 ondisk uv 7 in 10.1 attempt 0 2026-02-12T03:59:14.834 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.831+0000 7f4a32ffd640 10 client.4748.objecter op 0 rval 0 len 0 2026-02-12T03:59:14.834 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.831+0000 7f4a32ffd640 15 client.4748.objecter handle_osd_op_reply completed tid 33 2026-02-12T03:59:14.834 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.831+0000 7f4a32ffd640 15 client.4748.objecter _finish_op 33 2026-02-12T03:59:14.834 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.831+0000 7f4a32ffd640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.834 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.831+0000 7f4a32ffd640 15 client.4748.objecter _session_op_remove 10 33 2026-02-12T03:59:14.834 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.831+0000 7f4a32ffd640 5 client.4748.objecter 0 in flight 2026-02-12T03:59:14.834 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.831+0000 7f4a32ffd640 20 librados: complete_aio_write 0x55946bbba790 2026-02-12T03:59:14.835 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (12 ms) 2026-02-12T03:59:14.835 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationDeferred 2026-02-12T03:59:14.835 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.831+0000 7f4a3c022880 20 librados: queue_aio_write 0x55946ba26390 completion 0x55946bccff10 write_seq 7 2026-02-12T03:59:14.835 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.831+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bccf6c0 2026-02-12T03:59:14.835 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.831+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base exist @10 precalc_pgid 0 pgid 0.0 is_write 2026-02-12T03:59:14.835 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.831+0000 7f4a3c022880 20 client.4748.objecter _calc_target target exist @10 -> pgid 10.d3a59201 2026-02-12T03:59:14.835 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.831+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.d3a59201 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.835 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.831+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.846 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.831+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid exist '@10' '@10' [writefull 0~5 in=5b] tid 34 osd.10 2026-02-12T03:59:14.846 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.831+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.846 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.831+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 10 34 2026-02-12T03:59:14.846 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.831+0000 7f4a3c022880 15 client.4748.objecter _send_op 34 to 10.1 on osd.10 2026-02-12T03:59:14.846 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.831+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:34 10.1 10:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55946bb6f790 con 0x55946bb67ed0 2026-02-12T03:59:14.846 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.831+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.846 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.831+0000 7f4a3c022880 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.846 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.844+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 25 ==== osd_op_reply(34 exist [writefull 0~5] v33'8 uv8 ondisk = 0) ==== 149+0+0 (unknown 230667926 0 0) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.847 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.844+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(34 exist [writefull 0~5] v33'8 uv8 ondisk = 0) 2026-02-12T03:59:14.847 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.844+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.847 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.844+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 34 ondisk uv 8 in 10.1 attempt 0 2026-02-12T03:59:14.847 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.844+0000 7f4a32ffd640 10 client.4748.objecter op 0 rval 0 len 0 2026-02-12T03:59:14.847 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.844+0000 7f4a32ffd640 15 client.4748.objecter handle_osd_op_reply completed tid 34 2026-02-12T03:59:14.847 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.844+0000 7f4a32ffd640 15 client.4748.objecter _finish_op 34 2026-02-12T03:59:14.847 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationDeferred (13 ms) 2026-02-12T03:59:14.847 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.844+0000 7f4a32ffd640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.847 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2026-02-12T03:59:14.847 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.844+0000 7f4a32ffd640 15 client.4748.objecter _session_op_remove 10 34 2026-02-12T03:59:14.847 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.844+0000 7f4a32ffd640 5 client.4748.objecter 0 in flight 2026-02-12T03:59:14.847 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.844+0000 7f4a32ffd640 20 librados: complete_aio_write 0x55946bccff10 2026-02-12T03:59:14.847 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.844+0000 7f4a3c022880 20 librados: queue_aio_write 0x55946ba26390 completion 0x55946bbba790 write_seq 8 2026-02-12T03:59:14.848 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.844+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bccf6c0 2026-02-12T03:59:14.848 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.844+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base exist @10 precalc_pgid 0 pgid 0.0 is_write 2026-02-12T03:59:14.848 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.844+0000 7f4a3c022880 20 client.4748.objecter _calc_target target exist @10 -> pgid 10.d3a59201 2026-02-12T03:59:14.848 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.844+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.d3a59201 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.848 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.844+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.848 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.844+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid exist '@10' '@10' [writefull 0~5 in=5b] tid 35 osd.10 2026-02-12T03:59:14.848 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.844+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.848 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.844+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 10 35 2026-02-12T03:59:14.860 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.844+0000 7f4a3c022880 15 client.4748.objecter _send_op 35 to 10.1 on osd.10 2026-02-12T03:59:14.860 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.844+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:35 10.1 10:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55946bb6f790 con 0x55946bb67ed0 2026-02-12T03:59:14.860 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.844+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.860 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.844+0000 7f4a3c022880 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.860 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.859+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 26 ==== osd_op_reply(35 exist [writefull 0~5] v33'9 uv9 ondisk = 0) ==== 149+0+0 (unknown 2034175298 0 0) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.861 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.859+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(35 exist [writefull 0~5] v33'9 uv9 ondisk = 0) 2026-02-12T03:59:14.861 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.859+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.861 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.859+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 35 ondisk uv 9 in 10.1 attempt 0 2026-02-12T03:59:14.861 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.859+0000 7f4a32ffd640 10 client.4748.objecter op 0 rval 0 len 0 2026-02-12T03:59:14.861 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.859+0000 7f4a32ffd640 15 client.4748.objecter handle_osd_op_reply completed tid 35 2026-02-12T03:59:14.861 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.859+0000 7f4a32ffd640 15 client.4748.objecter _finish_op 35 2026-02-12T03:59:14.861 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.859+0000 7f4a32ffd640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.861 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.859+0000 7f4a32ffd640 15 client.4748.objecter _session_op_remove 10 35 2026-02-12T03:59:14.861 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.859+0000 7f4a32ffd640 5 client.4748.objecter 0 in flight 2026-02-12T03:59:14.861 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.859+0000 7f4a32ffd640 20 librados: complete_aio_write 0x55946bbba790 2026-02-12T03:59:14.861 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (14 ms) 2026-02-12T03:59:14.861 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2026-02-12T03:59:14.861 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.859+0000 7f4a3c022880 20 librados: queue_aio_write 0x55946ba26390 completion 0x55946bb701e0 write_seq 9 2026-02-12T03:59:14.862 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.859+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bccf6c0 2026-02-12T03:59:14.862 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.859+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base exist @10 precalc_pgid 0 pgid 0.0 is_write 2026-02-12T03:59:14.862 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.859+0000 7f4a3c022880 20 client.4748.objecter _calc_target target exist @10 -> pgid 10.d3a59201 2026-02-12T03:59:14.862 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.859+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.d3a59201 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.862 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.859+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.862 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.859+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid exist '@10' '@10' [writefull 0~5 in=5b] tid 36 osd.10 2026-02-12T03:59:14.862 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.859+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.862 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.859+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 10 36 2026-02-12T03:59:14.862 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.859+0000 7f4a3c022880 15 client.4748.objecter _send_op 36 to 10.1 on osd.10 2026-02-12T03:59:14.862 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.859+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:36 10.1 10:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55946bb6f790 con 0x55946bb67ed0 2026-02-12T03:59:14.888 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.859+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.888 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.859+0000 7f4a3c022880 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.888 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.872+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 27 ==== osd_op_reply(36 exist [writefull 0~5] v33'10 uv10 ondisk = 0) ==== 149+0+0 (unknown 3837706558 0 0) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.888 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.872+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(36 exist [writefull 0~5] v33'10 uv10 ondisk = 0) 2026-02-12T03:59:14.888 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.872+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.888 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.872+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 36 ondisk uv 10 in 10.1 attempt 0 2026-02-12T03:59:14.888 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.872+0000 7f4a32ffd640 10 client.4748.objecter op 0 rval 0 len 0 2026-02-12T03:59:14.888 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.872+0000 7f4a32ffd640 15 client.4748.objecter handle_osd_op_reply completed tid 36 2026-02-12T03:59:14.888 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.872+0000 7f4a32ffd640 15 client.4748.objecter _finish_op 36 2026-02-12T03:59:14.888 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.872+0000 7f4a32ffd640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.889 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.872+0000 7f4a32ffd640 15 client.4748.objecter _session_op_remove 10 36 2026-02-12T03:59:14.889 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.872+0000 7f4a32ffd640 5 client.4748.objecter 0 in flight 2026-02-12T03:59:14.889 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationYield (13 ms) 2026-02-12T03:59:14.889 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationAwaitable 2026-02-12T03:59:14.889 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.872+0000 7f4a32ffd640 20 librados: complete_aio_write 0x55946bb701e0 2026-02-12T03:59:14.889 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.872+0000 7f4a3c022880 20 librados: queue_aio_write 0x55946ba26390 completion 0x55946bbba790 write_seq 10 2026-02-12T03:59:14.889 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.872+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bccf6c0 2026-02-12T03:59:14.889 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.872+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base exist @10 precalc_pgid 0 pgid 0.0 is_write 2026-02-12T03:59:14.889 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.872+0000 7f4a3c022880 20 client.4748.objecter _calc_target target exist @10 -> pgid 10.d3a59201 2026-02-12T03:59:14.889 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.872+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.d3a59201 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.889 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.872+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.889 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.872+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid exist '@10' '@10' [writefull 0~5 in=5b] tid 37 osd.10 2026-02-12T03:59:14.890 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.872+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.890 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.872+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 10 37 2026-02-12T03:59:14.890 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.872+0000 7f4a3c022880 15 client.4748.objecter _send_op 37 to 10.1 on osd.10 2026-02-12T03:59:14.890 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.872+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:37 10.1 10:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55946bb6f790 con 0x55946bb67ed0 2026-02-12T03:59:14.890 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.872+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.890 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.872+0000 7f4a3c022880 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.890 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 28 ==== osd_op_reply(37 exist [writefull 0~5] v33'11 uv11 ondisk = 0) ==== 149+0+0 (unknown 2420013802 0 0) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.890 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(37 exist [writefull 0~5] v33'11 uv11 ondisk = 0) 2026-02-12T03:59:14.890 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.890 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 37 ondisk uv 11 in 10.1 attempt 0 2026-02-12T03:59:14.890 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a32ffd640 10 client.4748.objecter op 0 rval 0 len 0 2026-02-12T03:59:14.890 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a32ffd640 15 client.4748.objecter handle_osd_op_reply completed tid 37 2026-02-12T03:59:14.891 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a32ffd640 15 client.4748.objecter _finish_op 37 2026-02-12T03:59:14.891 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a32ffd640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.891 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a32ffd640 15 client.4748.objecter _session_op_remove 10 37 2026-02-12T03:59:14.891 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a32ffd640 5 client.4748.objecter 0 in flight 2026-02-12T03:59:14.891 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationAwaitable (13 ms) 2026-02-12T03:59:14.891 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyCallback 2026-02-12T03:59:14.891 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a32ffd640 20 librados: complete_aio_write 0x55946bbba790 2026-02-12T03:59:14.891 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 10 client.4748.objecter linger_register info 0x55946bccf6c0 linger_id 1 cookie 94095952115392 2026-02-12T03:59:14.891 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base exist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.891 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 20 client.4748.objecter _calc_target target exist @10 -> pgid 10.d3a59201 2026-02-12T03:59:14.891 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.d3a59201 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.891 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.892 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.892 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 15 client.4748.objecter _session_linger_op_assign 10 1 2026-02-12T03:59:14.892 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.892 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 15 client.4748.objecter send_linger 1 register 2026-02-12T03:59:14.892 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bcd00e0 2026-02-12T03:59:14.892 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base exist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.892 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 20 client.4748.objecter _calc_target target exist @10 -> pgid 10.d3a59201 2026-02-12T03:59:14.892 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.892 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid exist '@10' '@10' [notify cookie 94095952115392 in=17b] tid 38 osd.10 2026-02-12T03:59:14.892 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.892 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 10 38 2026-02-12T03:59:14.892 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 15 client.4748.objecter _send_op 38 to 10.1 on osd.10 2026-02-12T03:59:14.901 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:38 10.1 10:8049a5cb:::exist:head [notify cookie 94095952115392 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55946bb6f790 con 0x55946bb67ed0 2026-02-12T03:59:14.901 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 5 2026-02-12T03:59:14.901 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.901 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 10 client.4748.objecter linger_register info 0x55946bcd29c0 linger_id 2 cookie 94095952128448 2026-02-12T03:59:14.901 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base noexist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.901 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 20 client.4748.objecter _calc_target target noexist @10 -> pgid 10.a7bbaa1 2026-02-12T03:59:14.901 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.a7bbaa1 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.901 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 5 2026-02-12T03:59:14.901 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 5 2026-02-12T03:59:14.902 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 15 client.4748.objecter _session_linger_op_assign 10 2 2026-02-12T03:59:14.902 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 6 2026-02-12T03:59:14.902 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 15 client.4748.objecter send_linger 2 register 2026-02-12T03:59:14.902 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bcd3e00 2026-02-12T03:59:14.902 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base noexist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.902 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 20 client.4748.objecter _calc_target target noexist @10 -> pgid 10.a7bbaa1 2026-02-12T03:59:14.902 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 6 2026-02-12T03:59:14.902 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid noexist '@10' '@10' [notify cookie 94095952128448 in=17b] tid 39 osd.10 2026-02-12T03:59:14.902 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 6 2026-02-12T03:59:14.902 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 10 39 2026-02-12T03:59:14.902 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 15 client.4748.objecter _send_op 39 to 10.1 on osd.10 2026-02-12T03:59:14.902 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:39 10.1 10:855dde50:::noexist:head [notify cookie 94095952128448 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55946bcd4330 con 0x55946bb67ed0 2026-02-12T03:59:14.903 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 7 2026-02-12T03:59:14.903 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.886+0000 7f4a3c022880 5 client.4748.objecter 2 in flight 2026-02-12T03:59:14.903 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 29 ==== watch-notify(notify_complete (2) cookie 94095952115392 notify 141733920768 ret 0) ==== 42+0+8 (unknown 2787121972 0 0) 0x7f4a28008020 con 0x55946bb67ed0 2026-02-12T03:59:14.903 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 watch-notify(notify_complete (2) cookie 94095952115392 notify 141733920768 ret 0) 2026-02-12T03:59:14.903 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 30 ==== osd_op_reply(38 exist [notify cookie 94095952115392 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 1863566485 0 174112307) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.903 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(38 exist [notify cookie 94095952115392 out=8b] v0'0 uv11 ondisk = 0) 2026-02-12T03:59:14.903 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.903 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 38 ondisk uv 11 in 10.1 attempt 0 2026-02-12T03:59:14.903 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a317fa640 10 librados: operator() completed notify (linger op 0x55946bccf6c0), ec = system:0 2026-02-12T03:59:14.903 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a32ffd640 10 client.4748.objecter op 0 rval 0 len 8 2026-02-12T03:59:14.903 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a32ffd640 15 client.4748.objecter handle_osd_op_reply completed tid 38 2026-02-12T03:59:14.903 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a32ffd640 15 client.4748.objecter _finish_op 38 2026-02-12T03:59:14.904 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a32ffd640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 7 2026-02-12T03:59:14.904 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a32ffd640 15 client.4748.objecter _session_op_remove 10 38 2026-02-12T03:59:14.904 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a32ffd640 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.904 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 31 ==== osd_op_reply(39 noexist [notify cookie 94095952128448] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 1068196704 0 0) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.904 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(39 noexist [notify cookie 94095952128448] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-12T03:59:14.904 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.904 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 39 ondisk uv 0 in 10.1 attempt 0 2026-02-12T03:59:14.904 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a32ffd640 10 client.4748.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-12T03:59:14.904 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a32ffd640 10 client.4748.objecter op 0 rval 0 len 0 2026-02-12T03:59:14.904 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a32ffd640 15 client.4748.objecter handle_osd_op_reply completed tid 39 2026-02-12T03:59:14.904 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a32ffd640 15 client.4748.objecter _finish_op 39 2026-02-12T03:59:14.904 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a31ffb640 10 client.4748.objecter _linger_commit 1 2026-02-12T03:59:14.905 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a32ffd640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 6 2026-02-12T03:59:14.905 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a31ffb640 10 client.4748.objecter _linger_commit notify_id=141733920768 2026-02-12T03:59:14.905 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a32ffd640 15 client.4748.objecter _session_op_remove 10 39 2026-02-12T03:59:14.905 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a32ffd640 5 client.4748.objecter 0 in flight 2026-02-12T03:59:14.905 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a317fa640 10 client.4748.objecter _linger_commit 2 2026-02-12T03:59:14.905 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a31ffb640 10 librados: finish linger op 0x55946bccf6c0 acked (0) 2026-02-12T03:59:14.905 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a31ffb640 20 client.4748.objecter _linger_cancel linger_id=1 2026-02-12T03:59:14.905 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a31ffb640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.905 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a31ffb640 15 client.4748.objecter _session_linger_op_remove 10 1 2026-02-12T03:59:14.905 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a317fa640 10 librados: finish linger op 0x55946bcd29c0 acked (-2) 2026-02-12T03:59:14.905 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a31ffb640 10 librados: operator() completed notify (linger op 0x55946bcd29c0), ec = osd:2 2026-02-12T03:59:14.905 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a31ffb640 20 client.4748.objecter _linger_cancel linger_id=2 2026-02-12T03:59:14.906 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a31ffb640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.906 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a31ffb640 15 client.4748.objecter _session_linger_op_remove 10 2 2026-02-12T03:59:14.906 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyCallback (13 ms) 2026-02-12T03:59:14.906 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyDeferred 2026-02-12T03:59:14.906 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 10 client.4748.objecter linger_register info 0x55946bccf6c0 linger_id 3 cookie 94095952115392 2026-02-12T03:59:14.906 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base exist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.906 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 20 client.4748.objecter _calc_target target exist @10 -> pgid 10.d3a59201 2026-02-12T03:59:14.906 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.d3a59201 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.906 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.906 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.906 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 15 client.4748.objecter _session_linger_op_assign 10 3 2026-02-12T03:59:14.907 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.907 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 15 client.4748.objecter send_linger 3 register 2026-02-12T03:59:14.907 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bccffd0 2026-02-12T03:59:14.907 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base exist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.907 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 20 client.4748.objecter _calc_target target exist @10 -> pgid 10.d3a59201 2026-02-12T03:59:14.907 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.907 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid exist '@10' '@10' [notify cookie 94095952115392 in=17b] tid 40 osd.10 2026-02-12T03:59:14.907 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.907 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 10 40 2026-02-12T03:59:14.907 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 15 client.4748.objecter _send_op 40 to 10.1 on osd.10 2026-02-12T03:59:14.907 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:40 10.1 10:8049a5cb:::exist:head [notify cookie 94095952115392 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55946bcd29c0 con 0x55946bb67ed0 2026-02-12T03:59:14.907 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 5 2026-02-12T03:59:14.907 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.908 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 10 client.4748.objecter linger_register info 0x55946bcd3d70 linger_id 4 cookie 94095952133488 2026-02-12T03:59:14.908 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base noexist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.908 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 20 client.4748.objecter _calc_target target noexist @10 -> pgid 10.a7bbaa1 2026-02-12T03:59:14.909 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.a7bbaa1 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.909 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 5 2026-02-12T03:59:14.909 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 5 2026-02-12T03:59:14.909 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 15 client.4748.objecter _session_linger_op_assign 10 4 2026-02-12T03:59:14.909 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 6 2026-02-12T03:59:14.909 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 15 client.4748.objecter send_linger 4 register 2026-02-12T03:59:14.909 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bcd5340 2026-02-12T03:59:14.909 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base noexist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.909 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 20 client.4748.objecter _calc_target target noexist @10 -> pgid 10.a7bbaa1 2026-02-12T03:59:14.910 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 6 2026-02-12T03:59:14.910 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid noexist '@10' '@10' [notify cookie 94095952133488 in=17b] tid 41 osd.10 2026-02-12T03:59:14.910 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 6 2026-02-12T03:59:14.910 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 10 41 2026-02-12T03:59:14.910 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 15 client.4748.objecter _send_op 41 to 10.1 on osd.10 2026-02-12T03:59:14.910 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:41 10.1 10:855dde50:::noexist:head [notify cookie 94095952133488 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55946bcd29c0 con 0x55946bb67ed0 2026-02-12T03:59:14.910 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 7 2026-02-12T03:59:14.910 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.899+0000 7f4a3c022880 5 client.4748.objecter 2 in flight 2026-02-12T03:59:14.910 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 32 ==== watch-notify(notify_complete (2) cookie 94095952115392 notify 141733920769 ret 0) ==== 42+0+8 (unknown 477092282 0 0) 0x7f4a28008020 con 0x55946bb67ed0 2026-02-12T03:59:14.910 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 watch-notify(notify_complete (2) cookie 94095952115392 notify 141733920769 ret 0) 2026-02-12T03:59:14.910 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a317fa640 10 librados: operator() completed notify (linger op 0x55946bccf6c0), ec = system:0 2026-02-12T03:59:14.911 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 33 ==== osd_op_reply(40 exist [notify cookie 94095952115392 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 1863566485 0 1130152724) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.911 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(40 exist [notify cookie 94095952115392 out=8b] v0'0 uv11 ondisk = 0) 2026-02-12T03:59:14.911 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.911 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 40 ondisk uv 11 in 10.1 attempt 0 2026-02-12T03:59:14.911 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a32ffd640 10 client.4748.objecter op 0 rval 0 len 8 2026-02-12T03:59:14.911 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a32ffd640 15 client.4748.objecter handle_osd_op_reply completed tid 40 2026-02-12T03:59:14.911 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a32ffd640 15 client.4748.objecter _finish_op 40 2026-02-12T03:59:14.911 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a32ffd640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 7 2026-02-12T03:59:14.911 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a32ffd640 15 client.4748.objecter _session_op_remove 10 40 2026-02-12T03:59:14.911 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a32ffd640 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.911 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 34 ==== osd_op_reply(41 noexist [notify cookie 94095952133488] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 1356800715 0 0) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.911 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(41 noexist [notify cookie 94095952133488] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-12T03:59:14.911 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.912 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 41 ondisk uv 0 in 10.1 attempt 0 2026-02-12T03:59:14.912 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a32ffd640 10 client.4748.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-12T03:59:14.912 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a31ffb640 10 client.4748.objecter _linger_commit 3 2026-02-12T03:59:14.912 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a32ffd640 10 client.4748.objecter op 0 rval 0 len 0 2026-02-12T03:59:14.912 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a32ffd640 15 client.4748.objecter handle_osd_op_reply completed tid 41 2026-02-12T03:59:14.912 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a32ffd640 15 client.4748.objecter _finish_op 41 2026-02-12T03:59:14.912 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a32ffd640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 6 2026-02-12T03:59:14.912 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a31ffb640 10 client.4748.objecter _linger_commit notify_id=141733920769 2026-02-12T03:59:14.912 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a32ffd640 15 client.4748.objecter _session_op_remove 10 41 2026-02-12T03:59:14.912 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a32ffd640 5 client.4748.objecter 0 in flight 2026-02-12T03:59:14.912 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a31ffb640 10 librados: finish linger op 0x55946bccf6c0 acked (0) 2026-02-12T03:59:14.912 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a31ffb640 10 client.4748.objecter _linger_commit 4 2026-02-12T03:59:14.913 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a317fa640 20 client.4748.objecter _linger_cancel linger_id=3 2026-02-12T03:59:14.913 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a317fa640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.913 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a317fa640 15 client.4748.objecter _session_linger_op_remove 10 3 2026-02-12T03:59:14.913 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a31ffb640 10 librados: finish linger op 0x55946bcd3d70 acked (-2) 2026-02-12T03:59:14.913 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a317fa640 10 librados: operator() completed notify (linger op 0x55946bcd3d70), ec = osd:2 2026-02-12T03:59:14.913 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a317fa640 20 client.4748.objecter _linger_cancel linger_id=4 2026-02-12T03:59:14.913 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a317fa640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.913 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a317fa640 15 client.4748.objecter _session_linger_op_remove 10 4 2026-02-12T03:59:14.913 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyDeferred (5 ms) 2026-02-12T03:59:14.913 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyFuture 2026-02-12T03:59:14.913 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 10 client.4748.objecter linger_register info 0x55946bccf6c0 linger_id 5 cookie 94095952115392 2026-02-12T03:59:14.913 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base exist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.914 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 20 client.4748.objecter _calc_target target exist @10 -> pgid 10.d3a59201 2026-02-12T03:59:14.914 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.d3a59201 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.914 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.914 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.914 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 15 client.4748.objecter _session_linger_op_assign 10 5 2026-02-12T03:59:14.914 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.914 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 15 client.4748.objecter send_linger 5 register 2026-02-12T03:59:14.914 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bccffd0 2026-02-12T03:59:14.914 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base exist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.914 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 20 client.4748.objecter _calc_target target exist @10 -> pgid 10.d3a59201 2026-02-12T03:59:14.914 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.914 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid exist '@10' '@10' [notify cookie 94095952115392 in=17b] tid 42 osd.10 2026-02-12T03:59:14.915 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.915 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 10 42 2026-02-12T03:59:14.915 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 15 client.4748.objecter _send_op 42 to 10.1 on osd.10 2026-02-12T03:59:14.915 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:42 10.1 10:8049a5cb:::exist:head [notify cookie 94095952115392 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55946bcd2970 con 0x55946bb67ed0 2026-02-12T03:59:14.915 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 5 2026-02-12T03:59:14.915 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.915 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 10 client.4748.objecter linger_register info 0x55946bcd2e40 linger_id 6 cookie 94095952129600 2026-02-12T03:59:14.915 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base noexist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.915 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 20 client.4748.objecter _calc_target target noexist @10 -> pgid 10.a7bbaa1 2026-02-12T03:59:14.915 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.a7bbaa1 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.915 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 5 2026-02-12T03:59:14.915 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 5 2026-02-12T03:59:14.916 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 15 client.4748.objecter _session_linger_op_assign 10 6 2026-02-12T03:59:14.916 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 6 2026-02-12T03:59:14.916 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 15 client.4748.objecter send_linger 6 register 2026-02-12T03:59:14.916 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bcd4330 2026-02-12T03:59:14.916 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base noexist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.917 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 20 client.4748.objecter _calc_target target noexist @10 -> pgid 10.a7bbaa1 2026-02-12T03:59:14.917 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 6 2026-02-12T03:59:14.917 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid noexist '@10' '@10' [notify cookie 94095952129600 in=17b] tid 43 osd.10 2026-02-12T03:59:14.917 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 6 2026-02-12T03:59:14.917 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 10 43 2026-02-12T03:59:14.917 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 15 client.4748.objecter _send_op 43 to 10.1 on osd.10 2026-02-12T03:59:14.917 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:43 10.1 10:855dde50:::noexist:head [notify cookie 94095952129600 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55946bcd47e0 con 0x55946bb67ed0 2026-02-12T03:59:14.917 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 7 2026-02-12T03:59:14.917 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.904+0000 7f4a3c022880 5 client.4748.objecter 2 in flight 2026-02-12T03:59:14.917 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 35 ==== watch-notify(notify_complete (2) cookie 94095952115392 notify 141733920770 ret 0) ==== 42+0+8 (unknown 3612600537 0 0) 0x7f4a28008020 con 0x55946bb67ed0 2026-02-12T03:59:14.918 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 watch-notify(notify_complete (2) cookie 94095952115392 notify 141733920770 ret 0) 2026-02-12T03:59:14.918 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 36 ==== osd_op_reply(42 exist [notify cookie 94095952115392 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 1863566485 0 2551727229) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.918 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(42 exist [notify cookie 94095952115392 out=8b] v0'0 uv11 ondisk = 0) 2026-02-12T03:59:14.918 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.918 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 42 ondisk uv 11 in 10.1 attempt 0 2026-02-12T03:59:14.918 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a32ffd640 10 client.4748.objecter op 0 rval 0 len 8 2026-02-12T03:59:14.918 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a31ffb640 10 librados: operator() completed notify (linger op 0x55946bccf6c0), ec = system:0 2026-02-12T03:59:14.918 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a32ffd640 15 client.4748.objecter handle_osd_op_reply completed tid 42 2026-02-12T03:59:14.918 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a32ffd640 15 client.4748.objecter _finish_op 42 2026-02-12T03:59:14.918 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a32ffd640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 7 2026-02-12T03:59:14.918 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a32ffd640 15 client.4748.objecter _session_op_remove 10 42 2026-02-12T03:59:14.918 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a32ffd640 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.918 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a317fa640 10 client.4748.objecter _linger_commit 5 2026-02-12T03:59:14.919 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a317fa640 10 client.4748.objecter _linger_commit notify_id=141733920770 2026-02-12T03:59:14.919 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a317fa640 10 librados: finish linger op 0x55946bccf6c0 acked (0) 2026-02-12T03:59:14.919 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 37 ==== osd_op_reply(43 noexist [notify cookie 94095952129600] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3870307056 0 0) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.919 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a317fa640 20 client.4748.objecter _linger_cancel linger_id=5 2026-02-12T03:59:14.919 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(43 noexist [notify cookie 94095952129600] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-12T03:59:14.919 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a317fa640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 5 2026-02-12T03:59:14.919 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.919 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a317fa640 15 client.4748.objecter _session_linger_op_remove 10 5 2026-02-12T03:59:14.919 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 43 ondisk uv 0 in 10.1 attempt 0 2026-02-12T03:59:14.919 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a32ffd640 10 client.4748.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-12T03:59:14.919 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a32ffd640 10 client.4748.objecter op 0 rval 0 len 0 2026-02-12T03:59:14.919 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a32ffd640 15 client.4748.objecter handle_osd_op_reply completed tid 43 2026-02-12T03:59:14.920 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a32ffd640 15 client.4748.objecter _finish_op 43 2026-02-12T03:59:14.920 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a32ffd640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 5 2026-02-12T03:59:14.920 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a32ffd640 15 client.4748.objecter _session_op_remove 10 43 2026-02-12T03:59:14.920 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a32ffd640 5 client.4748.objecter 0 in flight 2026-02-12T03:59:14.920 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a31ffb640 10 client.4748.objecter _linger_commit 6 2026-02-12T03:59:14.920 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a31ffb640 10 librados: finish linger op 0x55946bcd2e40 acked (-2) 2026-02-12T03:59:14.920 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a317fa640 10 librados: operator() completed notify (linger op 0x55946bcd2e40), ec = osd:2 2026-02-12T03:59:14.920 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a317fa640 20 client.4748.objecter _linger_cancel linger_id=6 2026-02-12T03:59:14.920 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a317fa640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.920 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a317fa640 15 client.4748.objecter _session_linger_op_remove 10 6 2026-02-12T03:59:14.920 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyFuture (8 ms) 2026-02-12T03:59:14.920 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyYield 2026-02-12T03:59:14.920 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 10 client.4748.objecter linger_register info 0x55946bcd3e50 linger_id 7 cookie 94095952133712 2026-02-12T03:59:14.921 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base exist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.921 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 20 client.4748.objecter _calc_target target exist @10 -> pgid 10.d3a59201 2026-02-12T03:59:14.921 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.d3a59201 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.921 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.921 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.921 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 15 client.4748.objecter _session_linger_op_assign 10 7 2026-02-12T03:59:14.921 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.921 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 15 client.4748.objecter send_linger 7 register 2026-02-12T03:59:14.921 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bccffd0 2026-02-12T03:59:14.921 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base exist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.921 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 20 client.4748.objecter _calc_target target exist @10 -> pgid 10.d3a59201 2026-02-12T03:59:14.921 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.922 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid exist '@10' '@10' [notify cookie 94095952133712 in=17b] tid 44 osd.10 2026-02-12T03:59:14.922 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.922 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 10 44 2026-02-12T03:59:14.922 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 15 client.4748.objecter _send_op 44 to 10.1 on osd.10 2026-02-12T03:59:14.922 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:44 10.1 10:8049a5cb:::exist:head [notify cookie 94095952133712 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55946bccf6c0 con 0x55946bb67ed0 2026-02-12T03:59:14.922 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 5 2026-02-12T03:59:14.922 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.922 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 10 client.4748.objecter linger_register info 0x55946bcd1960 linger_id 8 cookie 94095952124256 2026-02-12T03:59:14.922 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base noexist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.922 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 20 client.4748.objecter _calc_target target noexist @10 -> pgid 10.a7bbaa1 2026-02-12T03:59:14.922 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.a7bbaa1 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.922 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 5 2026-02-12T03:59:14.923 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 5 2026-02-12T03:59:14.923 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 15 client.4748.objecter _session_linger_op_assign 10 8 2026-02-12T03:59:14.923 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 6 2026-02-12T03:59:14.923 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 15 client.4748.objecter send_linger 8 register 2026-02-12T03:59:14.923 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bcd1d90 2026-02-12T03:59:14.923 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base noexist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.923 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 20 client.4748.objecter _calc_target target noexist @10 -> pgid 10.a7bbaa1 2026-02-12T03:59:14.923 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 6 2026-02-12T03:59:14.923 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid noexist '@10' '@10' [notify cookie 94095952124256 in=17b] tid 45 osd.10 2026-02-12T03:59:14.923 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 6 2026-02-12T03:59:14.923 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 10 45 2026-02-12T03:59:14.924 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 15 client.4748.objecter _send_op 45 to 10.1 on osd.10 2026-02-12T03:59:14.924 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:45 10.1 10:855dde50:::noexist:head [notify cookie 94095952124256 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55946bcd2300 con 0x55946bb67ed0 2026-02-12T03:59:14.924 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 7 2026-02-12T03:59:14.924 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.913+0000 7f4a3c022880 5 client.4748.objecter 2 in flight 2026-02-12T03:59:14.924 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 38 ==== watch-notify(notify_complete (2) cookie 94095952133712 notify 141733920771 ret 0) ==== 42+0+8 (unknown 3974858716 0 0) 0x7f4a28008020 con 0x55946bb67ed0 2026-02-12T03:59:14.924 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 watch-notify(notify_complete (2) cookie 94095952133712 notify 141733920771 ret 0) 2026-02-12T03:59:14.924 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a31ffb640 10 librados: operator() completed notify (linger op 0x55946bcd3e50), ec = system:0 2026-02-12T03:59:14.925 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 39 ==== osd_op_reply(44 exist [notify cookie 94095952133712 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 258872484 0 3508812122) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.925 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(44 exist [notify cookie 94095952133712 out=8b] v0'0 uv11 ondisk = 0) 2026-02-12T03:59:14.925 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.925 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 44 ondisk uv 11 in 10.1 attempt 0 2026-02-12T03:59:14.925 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a32ffd640 10 client.4748.objecter op 0 rval 0 len 8 2026-02-12T03:59:14.925 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a32ffd640 15 client.4748.objecter handle_osd_op_reply completed tid 44 2026-02-12T03:59:14.925 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a32ffd640 15 client.4748.objecter _finish_op 44 2026-02-12T03:59:14.925 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a32ffd640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 7 2026-02-12T03:59:14.925 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a32ffd640 15 client.4748.objecter _session_op_remove 10 44 2026-02-12T03:59:14.925 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a32ffd640 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.925 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a317fa640 10 client.4748.objecter _linger_commit 7 2026-02-12T03:59:14.925 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a317fa640 10 client.4748.objecter _linger_commit notify_id=141733920771 2026-02-12T03:59:14.925 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a317fa640 10 librados: finish linger op 0x55946bcd3e50 acked (0) 2026-02-12T03:59:14.926 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a317fa640 20 client.4748.objecter _linger_cancel linger_id=7 2026-02-12T03:59:14.926 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 40 ==== osd_op_reply(45 noexist [notify cookie 94095952124256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2526870689 0 0) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.926 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a317fa640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 5 2026-02-12T03:59:14.926 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a317fa640 15 client.4748.objecter _session_linger_op_remove 10 7 2026-02-12T03:59:14.926 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(45 noexist [notify cookie 94095952124256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-12T03:59:14.926 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.926 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 45 ondisk uv 0 in 10.1 attempt 0 2026-02-12T03:59:14.926 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a32ffd640 10 client.4748.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-12T03:59:14.926 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a32ffd640 10 client.4748.objecter op 0 rval 0 len 0 2026-02-12T03:59:14.926 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a32ffd640 15 client.4748.objecter handle_osd_op_reply completed tid 45 2026-02-12T03:59:14.926 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a32ffd640 15 client.4748.objecter _finish_op 45 2026-02-12T03:59:14.927 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a32ffd640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 5 2026-02-12T03:59:14.927 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a32ffd640 15 client.4748.objecter _session_op_remove 10 45 2026-02-12T03:59:14.927 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a32ffd640 5 client.4748.objecter 0 in flight 2026-02-12T03:59:14.927 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a31ffb640 10 client.4748.objecter _linger_commit 8 2026-02-12T03:59:14.927 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a31ffb640 10 librados: finish linger op 0x55946bcd1960 acked (-2) 2026-02-12T03:59:14.927 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a31ffb640 10 librados: operator() completed notify (linger op 0x55946bcd1960), ec = osd:2 2026-02-12T03:59:14.927 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a31ffb640 20 client.4748.objecter _linger_cancel linger_id=8 2026-02-12T03:59:14.927 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyYield (4 ms) 2026-02-12T03:59:14.927 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a31ffb640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.927 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyAwaitable 2026-02-12T03:59:14.927 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a31ffb640 15 client.4748.objecter _session_linger_op_remove 10 8 2026-02-12T03:59:14.927 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 10 client.4748.objecter linger_register info 0x55946bcd3dc0 linger_id 9 cookie 94095952133568 2026-02-12T03:59:14.927 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base exist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.927 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 20 client.4748.objecter _calc_target target exist @10 -> pgid 10.d3a59201 2026-02-12T03:59:14.928 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.d3a59201 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.928 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.928 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.928 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 15 client.4748.objecter _session_linger_op_assign 10 9 2026-02-12T03:59:14.928 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.928 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 15 client.4748.objecter send_linger 9 register 2026-02-12T03:59:14.928 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bccffd0 2026-02-12T03:59:14.928 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base exist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.928 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 20 client.4748.objecter _calc_target target exist @10 -> pgid 10.d3a59201 2026-02-12T03:59:14.928 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.928 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid exist '@10' '@10' [notify cookie 94095952133568 in=17b] tid 46 osd.10 2026-02-12T03:59:14.929 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.929 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 10 46 2026-02-12T03:59:14.929 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 15 client.4748.objecter _send_op 46 to 10.1 on osd.10 2026-02-12T03:59:14.929 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:46 10.1 10:8049a5cb:::exist:head [notify cookie 94095952133568 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55946bccf6c0 con 0x55946bb67ed0 2026-02-12T03:59:14.929 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 5 2026-02-12T03:59:14.929 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.929 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 10 client.4748.objecter linger_register info 0x55946bcd1960 linger_id 10 cookie 94095952124256 2026-02-12T03:59:14.929 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base noexist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.930 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 20 client.4748.objecter _calc_target target noexist @10 -> pgid 10.a7bbaa1 2026-02-12T03:59:14.930 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.a7bbaa1 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.930 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 5 2026-02-12T03:59:14.930 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 5 2026-02-12T03:59:14.930 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 15 client.4748.objecter _session_linger_op_assign 10 10 2026-02-12T03:59:14.930 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 6 2026-02-12T03:59:14.930 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 15 client.4748.objecter send_linger 10 register 2026-02-12T03:59:14.930 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bcd1d90 2026-02-12T03:59:14.930 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base noexist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.930 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 20 client.4748.objecter _calc_target target noexist @10 -> pgid 10.a7bbaa1 2026-02-12T03:59:14.930 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 6 2026-02-12T03:59:14.930 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid noexist '@10' '@10' [notify cookie 94095952124256 in=17b] tid 47 osd.10 2026-02-12T03:59:14.930 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 6 2026-02-12T03:59:14.930 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 10 47 2026-02-12T03:59:14.930 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 15 client.4748.objecter _send_op 47 to 10.1 on osd.10 2026-02-12T03:59:14.930 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:47 10.1 10:855dde50:::noexist:head [notify cookie 94095952124256 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33) -- 0x55946bcd2320 con 0x55946bb67ed0 2026-02-12T03:59:14.931 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 7 2026-02-12T03:59:14.931 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.918+0000 7f4a3c022880 5 client.4748.objecter 2 in flight 2026-02-12T03:59:14.931 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 41 ==== watch-notify(notify_complete (2) cookie 94095952133568 notify 141733920772 ret 0) ==== 42+0+8 (unknown 1433541205 0 0) 0x7f4a28008020 con 0x55946bb67ed0 2026-02-12T03:59:14.931 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 watch-notify(notify_complete (2) cookie 94095952133568 notify 141733920772 ret 0) 2026-02-12T03:59:14.931 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a317fa640 10 librados: operator() completed notify (linger op 0x55946bcd3dc0), ec = system:0 2026-02-12T03:59:14.931 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 42 ==== osd_op_reply(46 exist [notify cookie 94095952133568 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 2522433581 0 729627742) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.931 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(46 exist [notify cookie 94095952133568 out=8b] v0'0 uv11 ondisk = 0) 2026-02-12T03:59:14.931 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.931 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 46 ondisk uv 11 in 10.1 attempt 0 2026-02-12T03:59:14.931 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a32ffd640 10 client.4748.objecter op 0 rval 0 len 8 2026-02-12T03:59:14.931 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a32ffd640 15 client.4748.objecter handle_osd_op_reply completed tid 46 2026-02-12T03:59:14.931 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a32ffd640 15 client.4748.objecter _finish_op 46 2026-02-12T03:59:14.931 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a32ffd640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 7 2026-02-12T03:59:14.931 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a32ffd640 15 client.4748.objecter _session_op_remove 10 46 2026-02-12T03:59:14.932 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a32ffd640 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.932 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a31ffb640 10 client.4748.objecter _linger_commit 9 2026-02-12T03:59:14.932 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 43 ==== osd_op_reply(47 noexist [notify cookie 94095952124256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2526870689 0 0) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.932 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a31ffb640 10 client.4748.objecter _linger_commit notify_id=141733920772 2026-02-12T03:59:14.932 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(47 noexist [notify cookie 94095952124256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-12T03:59:14.932 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.932 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 47 ondisk uv 0 in 10.1 attempt 0 2026-02-12T03:59:14.932 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a31ffb640 10 librados: finish linger op 0x55946bcd3dc0 acked (0) 2026-02-12T03:59:14.932 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a32ffd640 10 client.4748.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-12T03:59:14.932 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a31ffb640 20 client.4748.objecter _linger_cancel linger_id=9 2026-02-12T03:59:14.932 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a32ffd640 10 client.4748.objecter op 0 rval 0 len 0 2026-02-12T03:59:14.932 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a32ffd640 15 client.4748.objecter handle_osd_op_reply completed tid 47 2026-02-12T03:59:14.932 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a32ffd640 15 client.4748.objecter _finish_op 47 2026-02-12T03:59:14.932 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a32ffd640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 6 2026-02-12T03:59:14.932 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a32ffd640 15 client.4748.objecter _session_op_remove 10 47 2026-02-12T03:59:14.932 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a32ffd640 5 client.4748.objecter 0 in flight 2026-02-12T03:59:14.932 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a31ffb640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.933 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a31ffb640 15 client.4748.objecter _session_linger_op_remove 10 9 2026-02-12T03:59:14.933 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a317fa640 10 client.4748.objecter _linger_commit 10 2026-02-12T03:59:14.933 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a317fa640 10 librados: finish linger op 0x55946bcd1960 acked (-2) 2026-02-12T03:59:14.933 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a31ffb640 10 librados: operator() completed notify (linger op 0x55946bcd1960), ec = osd:2 2026-02-12T03:59:14.933 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a31ffb640 20 client.4748.objecter _linger_cancel linger_id=10 2026-02-12T03:59:14.933 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a31ffb640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.933 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a31ffb640 15 client.4748.objecter _session_linger_op_remove 10 10 2026-02-12T03:59:14.933 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyAwaitable (5 ms) 2026-02-12T03:59:14.933 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCancelTerminal 2026-02-12T03:59:14.933 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bccffd0 2026-02-12T03:59:14.933 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base noexist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.933 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 20 client.4748.objecter _calc_target target noexist @10 -> pgid 10.a7bbaa1 2026-02-12T03:59:14.933 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.a7bbaa1 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.933 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 10 client.4748.objecter chose random osd.10 of [10,7] 2026-02-12T03:59:14.933 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.933 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid noexist '@10' '@10' [stat] tid 48 osd.10 2026-02-12T03:59:14.933 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.934 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 10 48 2026-02-12T03:59:14.934 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 15 client.4748.objecter _send_op 48 to 10.1 on osd.10 2026-02-12T03:59:14.934 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:48 10.1 10:855dde50:::noexist:head [stat] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x55946bccf6c0 con 0x55946bb67ed0 2026-02-12T03:59:14.934 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.934 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCancelTerminal (0 ms) 2026-02-12T03:59:14.934 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.934 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCancelTotal 2026-02-12T03:59:14.934 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 5 client.4748.objecter _op_cancel: cancelling tid 48 r=-125 2026-02-12T03:59:14.934 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 10 client.4748.objecter op_cancel tid 48 in session 10 2026-02-12T03:59:14.934 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 15 client.4748.objecter _finish_op 48 2026-02-12T03:59:14.934 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.934 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 15 client.4748.objecter _session_op_remove 10 48 2026-02-12T03:59:14.934 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bccffd0 2026-02-12T03:59:14.934 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base noexist @10 precalc_pgid 0 pgid 0.0 is_read 2026-02-12T03:59:14.934 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 20 client.4748.objecter _calc_target target noexist @10 -> pgid 10.a7bbaa1 2026-02-12T03:59:14.934 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.a7bbaa1 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.934 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 10 client.4748.objecter chose random osd.7 of [10,7] 2026-02-12T03:59:14.934 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bb673f0 osd=7 3 2026-02-12T03:59:14.935 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid noexist '@10' '@10' [stat] tid 49 osd.7 2026-02-12T03:59:14.935 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bb673f0 osd=7 3 2026-02-12T03:59:14.935 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCancelTotal (0 ms) 2026-02-12T03:59:14.935 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCancelTerminal 2026-02-12T03:59:14.935 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 7 49 2026-02-12T03:59:14.935 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 15 client.4748.objecter _send_op 49 to 10.1 on osd.7 2026-02-12T03:59:14.935 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.154:6808/903276772 -- osd_op(unknown.0.0:49 10.1 10:855dde50:::noexist:head [stat] snapc 0=[] ondisk+read+balance_reads+known_if_redirected+supports_pool_eio e33) -- 0x55946bccf6c0 con 0x55946bb67560 2026-02-12T03:59:14.935 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bb673f0 osd=7 4 2026-02-12T03:59:14.935 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.935 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 5 client.4748.objecter _op_cancel: cancelling tid 49 r=-125 2026-02-12T03:59:14.935 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 10 client.4748.objecter op_cancel tid 49 in session 7 2026-02-12T03:59:14.935 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 15 client.4748.objecter _finish_op 49 2026-02-12T03:59:14.935 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bb673f0 osd=7 3 2026-02-12T03:59:14.935 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 15 client.4748.objecter _session_op_remove 7 49 2026-02-12T03:59:14.935 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 20 librados: queue_aio_write 0x55946ba26390 completion 0x55946bb6e080 write_seq 11 2026-02-12T03:59:14.935 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bccffd0 2026-02-12T03:59:14.935 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base noexist @10 precalc_pgid 0 pgid 0.0 is_write 2026-02-12T03:59:14.935 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 20 client.4748.objecter _calc_target target noexist @10 -> pgid 10.a7bbaa1 2026-02-12T03:59:14.935 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCancelTerminal (0 ms) 2026-02-12T03:59:14.936 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.a7bbaa1 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.936 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCancelTotal 2026-02-12T03:59:14.936 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.936 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid noexist '@10' '@10' [stat] tid 50 osd.10 2026-02-12T03:59:14.936 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.936 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 10 50 2026-02-12T03:59:14.936 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 15 client.4748.objecter _send_op 50 to 10.1 on osd.10 2026-02-12T03:59:14.937 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:50 10.1 10:855dde50:::noexist:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55946bcd09a0 con 0x55946bb67ed0 2026-02-12T03:59:14.937 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.937 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.937 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 5 client.4748.objecter _op_cancel: cancelling tid 50 r=-125 2026-02-12T03:59:14.937 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 10 client.4748.objecter op_cancel tid 50 in session 10 2026-02-12T03:59:14.937 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 20 librados: complete_aio_write 0x55946bb6e080 2026-02-12T03:59:14.937 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 15 client.4748.objecter _finish_op 50 2026-02-12T03:59:14.937 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.937 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 15 client.4748.objecter _session_op_remove 10 50 2026-02-12T03:59:14.937 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 20 librados: queue_aio_write 0x55946ba26390 completion 0x55946bb6f790 write_seq 12 2026-02-12T03:59:14.937 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 10 client.4748.objecter _op_submit op 0x55946bccffd0 2026-02-12T03:59:14.937 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 20 client.4748.objecter _calc_target epoch 33 base noexist @10 precalc_pgid 0 pgid 0.0 is_write 2026-02-12T03:59:14.937 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 20 client.4748.objecter _calc_target target noexist @10 -> pgid 10.a7bbaa1 2026-02-12T03:59:14.937 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 10 client.4748.objecter _calc_target raw pgid 10.a7bbaa1 -> actual 10.1 acting [10,7] primary 10 2026-02-12T03:59:14.937 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 20 client.4748.objecter _get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.937 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 10 client.4748.objecter _op_submit oid noexist '@10' '@10' [stat] tid 51 osd.10 2026-02-12T03:59:14.937 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 20 client.4748.objecter get_session s=0x55946bbba580 osd=10 3 2026-02-12T03:59:14.938 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 15 client.4748.objecter _session_op_assign 10 51 2026-02-12T03:59:14.938 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 15 client.4748.objecter _send_op 51 to 10.1 on osd.10 2026-02-12T03:59:14.938 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 --> v1:10.20.193.111:6808/1268343515 -- osd_op(unknown.0.0:51 10.1 10:855dde50:::noexist:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33) -- 0x55946bcd09a0 con 0x55946bb67ed0 2026-02-12T03:59:14.938 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.938 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.924+0000 7f4a3c022880 5 client.4748.objecter 1 in flight 2026-02-12T03:59:14.938 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.927+0000 7f4a337fe640 1 -- 10.20.193.154:0/1932936756 <== osd.7 v1:10.20.193.154:6808/903276772 12 ==== osd_op_reply(49 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 4124967352 0 0) 0x7f4a24003e10 con 0x55946bb67560 2026-02-12T03:59:14.938 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.927+0000 7f4a337fe640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(49 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-12T03:59:14.938 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.927+0000 7f4a337fe640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.938 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.927+0000 7f4a337fe640 7 client.4748.objecter handle_osd_op_reply 49 ondisk ... stray 2026-02-12T03:59:14.938 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.928+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 44 ==== osd_op_reply(48 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 4124967352 0 0) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.938 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.928+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(48 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-12T03:59:14.938 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.928+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.938 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.928+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 48 ondisk ... stray 2026-02-12T03:59:14.938 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.929+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 45 ==== osd_op_reply(50 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2138934781 0 0) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.938 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.929+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(50 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-12T03:59:14.938 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.929+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.938 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.929+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 50 ondisk ... stray 2026-02-12T03:59:14.938 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.929+0000 7f4a32ffd640 1 -- 10.20.193.154:0/1932936756 <== osd.10 v1:10.20.193.111:6808/1268343515 46 ==== osd_op_reply(51 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2138934781 0 0) 0x7f4a28004330 con 0x55946bb67ed0 2026-02-12T03:59:14.938 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.929+0000 7f4a32ffd640 10 client.4748.objecter ms_dispatch2 0x55946ba42590 osd_op_reply(51 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-12T03:59:14.939 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.929+0000 7f4a32ffd640 10 client.4748.objecter in handle_osd_op_reply 2026-02-12T03:59:14.939 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.929+0000 7f4a32ffd640 7 client.4748.objecter handle_osd_op_reply 51 ondisk uv 0 in 10.1 attempt 0 2026-02-12T03:59:14.939 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.929+0000 7f4a32ffd640 10 client.4748.objecter op 0 rval 0 len 0 2026-02-12T03:59:14.939 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.929+0000 7f4a32ffd640 15 client.4748.objecter handle_osd_op_reply completed tid 51 2026-02-12T03:59:14.939 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.929+0000 7f4a32ffd640 15 client.4748.objecter _finish_op 51 2026-02-12T03:59:14.939 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.929+0000 7f4a32ffd640 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 4 2026-02-12T03:59:14.939 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.929+0000 7f4a32ffd640 15 client.4748.objecter _session_op_remove 10 51 2026-02-12T03:59:14.939 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.929+0000 7f4a32ffd640 5 client.4748.objecter 0 in flight 2026-02-12T03:59:14.939 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.929+0000 7f4a32ffd640 20 librados: complete_aio_write 0x55946bb6f790 2026-02-12T03:59:14.939 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCancelTotal (5 ms) 2026-02-12T03:59:14.939 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.929+0000 7f4a3c022880 10 librados: watch_flush enter 2026-02-12T03:59:14.939 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.929+0000 7f4a3c022880 10 librados: watch_flush exit 2026-02-12T03:59:14.939 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.929+0000 7f4a3c022880 10 client.4748.objecter close_session for osd.7 2026-02-12T03:59:14.939 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.929+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 >> v1:10.20.193.154:6808/903276772 conn(0x55946bb67560 legacy=0x55946bb6a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:59:14.939 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.929+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bb673f0 osd=7 1 2026-02-12T03:59:14.939 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.929+0000 7f4a3c022880 10 client.4748.objecter close_session for osd.10 2026-02-12T03:59:14.939 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.929+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 >> v1:10.20.193.111:6808/1268343515 conn(0x55946bb67ed0 legacy=0x55946bb682a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:59:14.939 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.929+0000 7f4a3c022880 20 client.4748.objecter put_session s=0x55946bbba580 osd=10 1 2026-02-12T03:59:14.939 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.929+0000 7f4a3c022880 20 client.4748.objecter shutdown clearing up homeless session... 2026-02-12T03:59:14.939 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.929+0000 7f4a3c022880 10 client.4748.objecter successfully canceled tick 2026-02-12T03:59:14.939 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.929+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 >> v1:10.20.193.91:6800/2929217192 conn(0x7f4a20078bf0 legacy=0x7f4a200990a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:59:14.940 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.929+0000 7f4a3c022880 10 monclient: shutdown 2026-02-12T03:59:14.940 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.929+0000 7f4a3c022880 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T03:59:14.940 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.929+0000 7f4a33fff640 1 -- 10.20.193.154:0/1932936756 reap_dead start 2026-02-12T03:59:14.940 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.929+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 >> v1:10.20.193.111:6789/0 conn(0x55946bbc09c0 legacy=0x55946bbb7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T03:59:14.940 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.929+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 shutdown_connections 2026-02-12T03:59:14.940 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.929+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 >> 10.20.193.154:0/1932936756 conn(0x55946bb528f0 msgr2=0x55946bb5a020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T03:59:14.940 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.929+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 shutdown_connections 2026-02-12T03:59:14.940 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.929+0000 7f4a3c022880 1 -- 10.20.193.154:0/1932936756 wait complete. 2026-02-12T03:59:14.940 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.930+0000 7f4a3c022880 1 librados: shutdown 2026-02-12T03:59:14.940 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [----------] 29 tests from AsioRados (316 ms total) 2026-02-12T03:59:14.940 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: 2026-02-12T03:59:14.940 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [----------] Global test environment tear-down 2026-02-12T03:59:14.940 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [==========] 29 tests from 1 test suite ran. (5621 ms total) 2026-02-12T03:59:14.940 INFO:tasks.workunit.client.0.trial154.stdout: api_asio: [ PASSED ] 29 tests. 2026-02-12T03:59:14.940 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T03:59:14.941 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=29990 2026-02-12T03:59:14.941 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 29990 2026-02-12T03:59:17.280 INFO:tasks.workunit.client.0.trial154.stdout: handler_error: Running main() from gmock_main.cc 2026-02-12T03:59:17.280 INFO:tasks.workunit.client.0.trial154.stdout: handler_error: [==========] Running 1 test from 1 test suite. 2026-02-12T03:59:17.280 INFO:tasks.workunit.client.0.trial154.stdout: handler_error: [----------] Global test environment set-up. 2026-02-12T03:59:17.280 INFO:tasks.workunit.client.0.trial154.stdout: handler_error: [----------] 1 test from neocls_handler_error 2026-02-12T03:59:17.281 INFO:tasks.workunit.client.0.trial154.stdout: handler_error: [ RUN ] neocls_handler_error.test_handler_error 2026-02-12T03:59:17.281 INFO:tasks.workunit.client.0.trial154.stdout: handler_error: [ OK ] neocls_handler_error.test_handler_error (7930 ms) 2026-02-12T03:59:17.281 INFO:tasks.workunit.client.0.trial154.stdout: handler_error: [----------] 1 test from neocls_handler_error (7930 ms total) 2026-02-12T03:59:17.281 INFO:tasks.workunit.client.0.trial154.stdout: handler_error: 2026-02-12T03:59:17.281 INFO:tasks.workunit.client.0.trial154.stdout: handler_error: [----------] Global test environment tear-down 2026-02-12T03:59:17.281 INFO:tasks.workunit.client.0.trial154.stdout: handler_error: [==========] 1 test from 1 test suite ran. (7930 ms total) 2026-02-12T03:59:17.281 INFO:tasks.workunit.client.0.trial154.stdout: handler_error: [ PASSED ] 1 test. 2026-02-12T03:59:17.456 INFO:tasks.workunit.client.0.trial154.stdout: cls: Running main() from gmock_main.cc 2026-02-12T03:59:17.457 INFO:tasks.workunit.client.0.trial154.stdout: cls: [==========] Running 1 test from 1 test suite. 2026-02-12T03:59:17.457 INFO:tasks.workunit.client.0.trial154.stdout: cls: [----------] Global test environment set-up. 2026-02-12T03:59:17.457 INFO:tasks.workunit.client.0.trial154.stdout: cls: [----------] 1 test from NeoRadosCls 2026-02-12T03:59:17.457 INFO:tasks.workunit.client.0.trial154.stdout: cls: [ RUN ] NeoRadosCls.DNE 2026-02-12T03:59:17.457 INFO:tasks.workunit.client.0.trial154.stdout: cls: [ OK ] NeoRadosCls.DNE (8110 ms) 2026-02-12T03:59:17.458 INFO:tasks.workunit.client.0.trial154.stdout: cls: [----------] 1 test from NeoRadosCls (8110 ms total) 2026-02-12T03:59:17.458 INFO:tasks.workunit.client.0.trial154.stdout: cls: 2026-02-12T03:59:17.458 INFO:tasks.workunit.client.0.trial154.stdout: cls: [----------] Global test environment tear-down 2026-02-12T03:59:17.458 INFO:tasks.workunit.client.0.trial154.stdout: cls: [==========] 1 test from 1 test suite ran. (8110 ms total) 2026-02-12T03:59:17.458 INFO:tasks.workunit.client.0.trial154.stdout: cls: [ PASSED ] 1 test. 2026-02-12T03:59:18.049 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd_pp: Running main() from gmock_main.cc 2026-02-12T03:59:18.049 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd_pp: [==========] Running 3 tests from 1 test suite. 2026-02-12T03:59:18.050 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd_pp: [----------] Global test environment set-up. 2026-02-12T03:59:18.050 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd 2026-02-12T03:59:18.050 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.MonDescribePP 2026-02-12T03:59:18.050 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd_pp: [ OK ] LibRadosCmd.MonDescribePP (423 ms) 2026-02-12T03:59:18.050 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.OSDCmdPP 2026-02-12T03:59:18.050 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd_pp: [ OK ] LibRadosCmd.OSDCmdPP (455 ms) 2026-02-12T03:59:18.050 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.PGCmdPP 2026-02-12T03:59:18.050 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd_pp: [ OK ] LibRadosCmd.PGCmdPP (7849 ms) 2026-02-12T03:59:18.050 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd (8727 ms total) 2026-02-12T03:59:18.050 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd_pp: 2026-02-12T03:59:18.050 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd_pp: [----------] Global test environment tear-down 2026-02-12T03:59:18.050 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd_pp: [==========] 3 tests from 1 test suite ran. (8727 ms total) 2026-02-12T03:59:18.051 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd_pp: [ PASSED ] 3 tests. 2026-02-12T03:59:18.068 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: Running main() from gmock_main.cc 2026-02-12T03:59:18.068 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [==========] Running 17 tests from 1 test suite. 2026-02-12T03:59:18.068 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [----------] Global test environment set-up. 2026-02-12T03:59:18.069 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest 2026-02-12T03:59:18.069 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.NewDelete 2026-02-12T03:59:18.069 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [ OK ] CReadOpsTest.NewDelete (0 ms) 2026-02-12T03:59:18.069 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.SetOpFlags 2026-02-12T03:59:18.069 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [ OK ] CReadOpsTest.SetOpFlags (2136 ms) 2026-02-12T03:59:18.069 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertExists 2026-02-12T03:59:18.070 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertExists (130 ms) 2026-02-12T03:59:18.070 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertVersion 2026-02-12T03:59:18.070 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertVersion (90 ms) 2026-02-12T03:59:18.070 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpXattr 2026-02-12T03:59:18.070 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpXattr (401 ms) 2026-02-12T03:59:18.070 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Read 2026-02-12T03:59:18.070 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Read (85 ms) 2026-02-12T03:59:18.071 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Checksum 2026-02-12T03:59:18.071 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Checksum (92 ms) 2026-02-12T03:59:18.071 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.RWOrderedRead 2026-02-12T03:59:18.071 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [ OK ] CReadOpsTest.RWOrderedRead (35 ms) 2026-02-12T03:59:18.071 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ShortRead 2026-02-12T03:59:18.071 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ShortRead (64 ms) 2026-02-12T03:59:18.072 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Exec 2026-02-12T03:59:18.072 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Exec (56 ms) 2026-02-12T03:59:18.072 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ExecUserBuf 2026-02-12T03:59:18.072 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ExecUserBuf (127 ms) 2026-02-12T03:59:18.072 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat 2026-02-12T03:59:18.072 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat (76 ms) 2026-02-12T03:59:18.073 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat2 2026-02-12T03:59:18.073 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat2 (39 ms) 2026-02-12T03:59:18.073 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Omap 2026-02-12T03:59:18.073 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Omap (506 ms) 2026-02-12T03:59:18.073 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.OmapNuls 2026-02-12T03:59:18.073 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [ OK ] CReadOpsTest.OmapNuls (439 ms) 2026-02-12T03:59:18.073 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.GetXattrs 2026-02-12T03:59:18.074 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [ OK ] CReadOpsTest.GetXattrs (150 ms) 2026-02-12T03:59:18.074 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpExt 2026-02-12T03:59:18.074 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpExt (80 ms) 2026-02-12T03:59:18.074 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest (4515 ms total) 2026-02-12T03:59:18.074 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: 2026-02-12T03:59:18.074 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [----------] Global test environment tear-down 2026-02-12T03:59:18.074 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [==========] 17 tests from 1 test suite ran. (8731 ms total) 2026-02-12T03:59:18.074 INFO:tasks.workunit.client.0.trial154.stdout: api_c_read_operations: [ PASSED ] 17 tests. 2026-02-12T03:59:19.194 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: Running main() from gmock_main.cc 2026-02-12T03:59:19.194 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: [==========] Running 4 tests from 1 test suite. 2026-02-12T03:59:19.194 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: [----------] Global test environment set-up. 2026-02-12T03:59:19.195 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: [----------] 4 tests from LibRadosCmd 2026-02-12T03:59:19.195 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: [ RUN ] LibRadosCmd.MonDescribe 2026-02-12T03:59:19.195 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: [ OK ] LibRadosCmd.MonDescribe (473 ms) 2026-02-12T03:59:19.195 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: [ RUN ] LibRadosCmd.OSDCmd 2026-02-12T03:59:19.195 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: [ OK ] LibRadosCmd.OSDCmd (404 ms) 2026-02-12T03:59:19.195 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: [ RUN ] LibRadosCmd.PGCmd 2026-02-12T03:59:19.195 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: [ OK ] LibRadosCmd.PGCmd (7865 ms) 2026-02-12T03:59:19.195 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: [ RUN ] LibRadosCmd.WatchLog 2026-02-12T03:59:19.195 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:15.264861+0000 mon.a [INF] from='client.? v1:10.20.193.154:0/884617942' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_trial154-29898-2","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-12T03:59:19.195 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:15.273444+0000 mon.a [INF] from='client.4901 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_trial154-29879-2","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-12T03:59:19.195 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:15.751738+0000 mon.a [INF] from='client.? v1:10.20.193.154:0/1622290343' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritetrial154-30723-1"} : dispatch 2026-02-12T03:59:19.196 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:16.038799+0000 mon.b [INF] from='client.? v1:10.20.193.154:0/2642534934' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial154-30129-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-12T03:59:19.196 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:16.613974+0000 mon.a [INF] from='client.4951 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial154-30129-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-12T03:59:19.196 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:16.829872+0000 mon.a [INF] from='client.? v1:10.20.193.154:0/1622290343' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritetrial154-30723-1"}]': finished 2026-02-12T03:59:19.196 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:17.091027+0000 mon.a [INF] from='client.? v1:10.20.193.154:0/1622290343' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"SimpleWritetrial154-30723-1"} : dispatch 2026-02-12T03:59:19.196 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:17.244091+0000 mon.a [INF] from='client.? v1:10.20.193.154:0/884617942' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "PoolQuotaPP_trial154-29898-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-12T03:59:19.196 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:17.922870+0000 mon.a [INF] from='client.4951 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial154-30129-2","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-12T03:59:19.196 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:17.925091+0000 mon.a [INF] from='client.? v1:10.20.193.154:0/1622290343' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritetrial154-30723-1"}]': finished 2026-02-12T03:59:19.196 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:17.932444+0000 mon.a [INF] from='client.? v1:10.20.193.154:0/884617942' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_trial154-29898-3","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-12T03:59:19.196 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:18.080861+0000 mon.c [INF] from='client.? v1:10.20.193.154:0/2745681539' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_trial154-30253-7"} : dispatch 2026-02-12T03:59:19.196 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:18.084734+0000 mon.b [INF] from='client.? v1:10.20.193.154:0/444122828' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOptrial154-30723-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-12T03:59:19.196 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:18.102920+0000 mon.a [INF] from='client.? v1:10.20.193.154:0/884617942' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_trial154-29898-3", "field": "max_bytes", "val": "4096"} : dispatch 2026-02-12T03:59:19.197 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:18.108312+0000 mon.c [INF] from='client.? v1:10.20.193.154:0/2404312981' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2026-02-12T03:59:19.197 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:18.114444+0000 mon.a [INF] from='client.4982 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_trial154-30253-7"} : dispatch 2026-02-12T03:59:19.197 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:18.125530+0000 mon.a [INF] from='client.5059 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOptrial154-30723-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-12T03:59:19.197 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:18.133631+0000 mon.c [INF] from='client.? v1:10.20.193.154:0/2745681539' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_trial154-30253-7"} : dispatch 2026-02-12T03:59:19.197 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:18.135667+0000 client.admin [INF] onexx 2026-02-12T03:59:19.197 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:18.137626+0000 mon.b [INF] from='client.? v1:10.20.193.154:0/1176334894' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_trial154-30189-7"} : dispatch 2026-02-12T03:59:19.197 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:18.139567+0000 mon.a [INF] from='client.4988 ' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2026-02-12T03:59:19.197 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:18.149465+0000 mon.a [INF] from='client.4982 ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_trial154-30253-7"} : dispatch 2026-02-12T03:59:19.197 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:18.155915+0000 mon.a [INF] from='client.? v1:10.20.193.154:0/3852329013' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial154-30457-2","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-12T03:59:19.197 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:18.158434+0000 mon.a [INF] from='client.5074 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_trial154-30189-7"} : dispatch 2026-02-12T03:59:19.198 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:18.165295+0000 mon.b [INF] from='client.? v1:10.20.193.154:0/1176334894' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_trial154-30189-7"} : dispatch 2026-02-12T03:59:19.198 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:18.168050+0000 mon.c [INF] from='client.? v1:10.20.193.154:0/2745681539' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_trial154-30253-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-12T03:59:19.198 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:18.170916+0000 mon.a [INF] from='client.5074 ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_trial154-30189-7"} : dispatch 2026-02-12T03:59:19.198 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:18.176777+0000 mon.b [INF] from='client.? v1:10.20.193.154:0/1176334894' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_trial154-30189-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-12T03:59:19.198 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:18.179051+0000 mon.a [INF] from='client.4982 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_trial154-30253-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-12T03:59:20.770 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:18.188796+0000 mon.a [INF] from='client.5074 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC api_service: [==========] Running 4 tests from 1 test suite. 2026-02-12T03:59:20.770 INFO:tasks.workunit.client.0.trial154.stdout: api_service: [----------] Global test environment set-up. 2026-02-12T03:59:20.770 INFO:tasks.workunit.client.0.trial154.stdout: api_service: [----------] 4 tests from LibRadosService 2026-02-12T03:59:20.770 INFO:tasks.workunit.client.0.trial154.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2026-02-12T03:59:20.770 INFO:tasks.workunit.client.0.trial154.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (5381 ms) 2026-02-12T03:59:20.770 INFO:tasks.workunit.client.0.trial154.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2026-02-12T03:59:20.771 INFO:tasks.workunit.client.0.trial154.stdout: api_service: [ OK ] LibRadosService.RegisterLate (27 ms) 2026-02-12T03:59:20.771 INFO:tasks.workunit.client.0.trial154.stdout: api_service: [ RUN ] LibRadosService.StatusFormat 2026-02-12T03:59:20.771 INFO:tasks.workunit.client.0.trial154.stdout: api_service: cluster: 2026-02-12T03:59:20.771 INFO:tasks.workunit.client.0.trial154.stdout: api_service: id: 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:59:20.771 INFO:tasks.workunit.client.0.trial154.stdout: api_service: health: HEALTH_OK 2026-02-12T03:59:20.771 INFO:tasks.workunit.client.0.trial154.stdout: api_service: 2026-02-12T03:59:20.771 INFO:tasks.workunit.client.0.trial154.stdout: api_service: services: 2026-02-12T03:59:20.771 INFO:tasks.workunit.client.0.trial154.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 77s) [leader: a] 2026-02-12T03:59:20.771 INFO:tasks.workunit.client.0.trial154.stdout: api_service: mgr: y(active, since 74s), standbys: x 2026-02-12T03:59:20.771 INFO:tasks.workunit.client.0.trial154.stdout: api_service: osd: 16 osds: 16 up (since 44s), 16 in (since 71s) 2026-02-12T03:59:20.771 INFO:tasks.workunit.client.0.trial154.stdout: api_service: laundry: 2 daemons active (1 hosts) 2026-02-12T03:59:20.771 INFO:tasks.workunit.client.0.trial154.stdout: api_service: 2026-02-12T03:59:20.772 INFO:tasks.workunit.client.0.trial154.stdout: api_service: data: 2026-02-12T03:59:20.772 INFO:tasks.workunit.client.0.trial154.stdout: api_service: pools: 37 pools, 1057 pgs 2026-02-12T03:59:20.772 INFO:tasks.workunit.client.0.trial154.stdout: api_service: objects: 10 objects, 449 KiB 2026-02-12T03:59:20.772 INFO:tasks.workunit.client.0.trial154.stdout: api_service: usage: 425 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-12T03:59:20.772 INFO:tasks.workunit.client.0.trial154.stdout: api_service: pgs: 32.829% pgs unknown 2026-02-12T03:59:20.772 INFO:tasks.workunit.client.0.trial154.stdout: api_service: 49.385% pgs not active 2026-02-12T03:59:20.772 INFO:tasks.workunit.client.0.trial154.stdout: api_service: 347 unknown 2026-02-12T03:59:20.772 INFO:tasks.workunit.client.0.trial154.stdout: api_service: 286 creating+peering 2026-02-12T03:59:20.772 INFO:tasks.workunit.client.0.trial154.stdout: api_service: 236 creating+activating 2026-02-12T03:59:20.772 INFO:tasks.workunit.client.0.trial154.stdout: api_service: 188 active+clean 2026-02-12T03:59:20.772 INFO:tasks.workunit.client.0.trial154.stdout: api_service: 2026-02-12T03:59:20.772 INFO:tasks.workunit.client.0.trial154.stdout: api_service: io: 2026-02-12T03:59:20.773 INFO:tasks.workunit.client.0.trial154.stdout: api_service: client: 0 B/s rd, 1.2 KiB/s wr, 0 op/s rd, 1 op/s wr 2026-02-12T03:59:20.773 INFO:tasks.workunit.client.0.trial154.stdout: api_service: 2026-02-12T03:59:20.773 INFO:tasks.workunit.client.0.trial154.stdout: api_service: 2026-02-12T03:59:20.773 INFO:tasks.workunit.client.0.trial154.stdout: api_service: cluster: 2026-02-12T03:59:20.773 INFO:tasks.workunit.client.0.trial154.stdout: api_service: id: 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:59:20.773 INFO:tasks.workunit.client.0.trial154.stdout: api_service: health: HEALTH_OK 2026-02-12T03:59:20.773 INFO:tasks.workunit.client.0.trial154.stdout: api_service: 2026-02-12T03:59:20.773 INFO:tasks.workunit.client.0.trial154.stdout: api_service: services: 2026-02-12T03:59:20.773 INFO:tasks.workunit.client.0.trial154.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 79s) [leader: a] 2026-02-12T03:59:20.773 INFO:tasks.workunit.client.0.trial154.stdout: api_service: mgr: y(active, since 76s), standbys: x 2026-02-12T03:59:20.773 INFO:tasks.workunit.client.0.trial154.stdout: api_service: osd: 16 osds: 16 up (since 46s), 16 in (since 73s) 2026-02-12T03:59:20.773 INFO:tasks.workunit.client.0.trial154.stdout: api_service: foo: 4 portals active (1 hosts, 3 zones) 2026-02-12T03:59:20.774 INFO:tasks.workunit.client.0.trial154.stdout: api_service: laundry: 1 daemon active (1 hosts) 2026-02-12T03:59:20.774 INFO:tasks.workunit.client.0.trial154.stdout: api_service: 2026-02-12T03:59:20.774 INFO:tasks.workunit.client.0.trial154.stdout: api_service: data: 2026-02-12T03:59:20.774 INFO:tasks.workunit.client.0.trial154.stdout: api_service: pools: 33 pools, 953 pgs 2026-02-12T03:59:20.774 INFO:tasks.workunit.client.0.trial154.stdout: api_service: objects: 10 objects, 449 KiB 2026-02-12T03:59:20.774 INFO:tasks.workunit.client.0.trial154.stdout: api_service: usage: 426 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-12T03:59:20.774 INFO:tasks.workunit.client.0.trial154.stdout: api_service: pgs: 15.845% pgs unknown 2026-02-12T03:59:20.774 INFO:tasks.workunit.client.0.trial154.stdout: api_service: 59.916% pgs not active 2026-02-12T03:59:20.774 INFO:tasks.workunit.client.0.trial154.stdout: api_service: 293 creating+activating 2026-02-12T03:59:20.774 INFO:tasks.workunit.client.0.trial154.stdout: api_service: 278 creating+peering 2026-02-12T03:59:20.774 INFO:tasks.workunit.client.0.trial154.stdout: api_service: 231 active+clean 2026-02-12T03:59:20.774 INFO:tasks.workunit.client.0.trial154.stdout: api_service: 151 unknown 2026-02-12T03:59:20.774 INFO:tasks.workunit.client.0.trial154.stdout: api_service: 2026-02-12T03:59:20.775 INFO:tasks.workunit.client.0.trial154.stdout: api_service: io: 2026-02-12T03:59:20.775 INFO:tasks.workunit.client.0.trial154.stdout: api_service: client: 0 B/s rd, 1.0 KiB/s wr, 0 op/s rd, 1 op/s wr 2026-02-12T03:59:20.775 INFO:tasks.workunit.client.0.trial154.stdout: api_service: 2026-02-12T03:59:20.775 INFO:tasks.workunit.client.0.trial154.stdout: api_service: 2026-02-12T03:59:20.775 INFO:tasks.workunit.client.0.trial154.stdout: api_service: cluster: 2026-02-12T03:59:20.775 INFO:tasks.workunit.client.0.trial154.stdout: api_service: id: 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T03:59:20.775 INFO:tasks.workunit.client.0.trial154.stdout: api_service: health: HEALTH_OK 2026-02-12T03:59:20.775 INFO:tasks.workunit.client.0.trial154.stdout: api_service: 2026-02-12T03:59:20.775 INFO:tasks.workunit.client.0.trial154.stdout: api_service: services: 2026-02-12T03:59:20.775 INFO:tasks.workunit.client.0.trial154.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 81s) [leader: a] 2026-02-12T03:59:20.775 INFO:tasks.workunit.client.0.trial154.stdout: api_service: mgr: y(active, since 78s), standbys: x 2026-02-12T03:59:20.775 INFO:tasks.workunit.client.0.trial154.stdout: api_service: osd: 16 osds: 16 up (since 48s), 16 in (since 75s) 2026-02-12T03:59:20.776 INFO:tasks.workunit.client.0.trial154.stdout: api_service: foo: 16 portals active (1 hosts, 3 zones) 2026-02-12T03:59:20.776 INFO:tasks.workunit.client.0.trial154.stdout: api_service: laundry: 1 daemon active (1 hosts) 2026-02-12T03:59:20.776 INFO:tasks.workunit.client.0.trial154.stdout: api_service: 2026-02-12T03:59:20.776 INFO:tasks.workunit.client.0.trial154.stdout: api_service: data: 2026-02-12T03:59:22.340 INFO:tasks.workunit.client.0.trial154.stdout: api_servi_trial154-30189-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-12T03:59:22.340 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:20.122210+0000 mon.a [INF] from='client.? v1:10.20.193.154:0/588904228' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectstrial154-30800-1"}]': finished 2026-02-12T03:59:22.341 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:20.197639+0000 mon.b [INF] from='client.? v1:10.20.193.154:0/3604419920' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial154-30129-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-12T03:59:22.341 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:20.201774+0000 mon.b [INF] from='client.? v1:10.20.193.154:0/397631307' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafe_trial154-29879-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-12T03:59:22.341 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:20.215860+0000 mon.a [INF] from='client.? v1:10.20.193.154:0/588904228' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"ListObjectstrial154-30800-1"} : dispatch 2026-02-12T03:59:22.341 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:20.228256+0000 mon.a [INF] from='client.5086 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial154-30129-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-12T03:59:22.341 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:20.240586+0000 mon.a [INF] from='client.5092 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafe_trial154-29879-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-12T03:59:22.341 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:20.244949+0000 mon.a [INF] from='client.? v1:10.20.193.154:0/913531013' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_trial154-30280-1"} : dispatch 2026-02-12T03:59:22.341 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:20.262200+0000 mon.a [INF] from='client.4988 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2026-02-12T03:59:22.341 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:20.361277+0000 mon.b [INF] from='client.? v1:10.20.193.154:0/1639939792' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_trial154-30000-10"} : dispatch 2026-02-12T03:59:22.341 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:20.362959+0000 mon.a [INF] from='client.? v1:10.20.193.154:0/3093090886' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_trial154-29918-16"} : dispatch 2026-02-12T03:59:22.342 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:20.382036+0000 mon.a [INF] from='client.5122 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_trial154-30000-10"} : dispatch 2026-02-12T03:59:22.342 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:20.388264+0000 mon.a [INF] from='client.? v1:10.20.193.154:0/3093090886' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoEC_trial154-29918-16"} : dispatch 2026-02-12T03:59:22.342 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:20.392120+0000 mon.b [INF] from='client.? v1:10.20.193.154:0/1639939792' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_trial154-30000-10"} : dispatch 2026-02-12T03:59:22.342 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:20.395640+0000 mon.a [INF] from='client.? v1:10.20.193.154:0/3093090886' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_trial154-29918-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-12T03:59:22.342 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:20.399213+0000 mon.a [INF] from='client.5122 ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockEC_trial154-30000-10"} : dispatch 2026-02-12T03:59:22.350 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:20.410012+0000 mon.b [INF] from='client.? v1:10.20.193.154:0/1639939792' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_trial154-30000-10", "profile": [ "k=2", "m=1 cmd: Running main() from gmock_main.cc 2026-02-12T03:59:22.350 INFO:tasks.workunit.client.0.trial154.stdout: cmd: [==========] Running 3 tests from 1 test suite. 2026-02-12T03:59:22.350 INFO:tasks.workunit.client.0.trial154.stdout: cmd: [----------] Global test environment set-up. 2026-02-12T03:59:22.350 INFO:tasks.workunit.client.0.trial154.stdout: cmd: [----------] 3 tests from NeoRadosCmd 2026-02-12T03:59:22.351 INFO:tasks.workunit.client.0.trial154.stdout: cmd: [ RUN ] NeoRadosCmd.MonDescribe 2026-02-12T03:59:22.351 INFO:tasks.workunit.client.0.trial154.stdout: cmd: [ OK ] NeoRadosCmd.MonDescribe (3085 ms) 2026-02-12T03:59:22.351 INFO:tasks.workunit.client.0.trial154.stdout: cmd: [ RUN ] NeoRadosCmd.OSDCmd 2026-02-12T03:59:22.351 INFO:tasks.workunit.client.0.trial154.stdout: cmd: [ OK ] NeoRadosCmd.OSDCmd (3312 ms) 2026-02-12T03:59:22.351 INFO:tasks.workunit.client.0.trial154.stdout: cmd: [ RUN ] NeoRadosCmd.PGCmd 2026-02-12T03:59:22.351 INFO:tasks.workunit.client.0.trial154.stdout: cmd: [ OK ] NeoRadosCmd.PGCmd (6603 ms) 2026-02-12T03:59:22.351 INFO:tasks.workunit.client.0.trial154.stdout: cmd: [----------] 3 tests from NeoRadosCmd (13001 ms total) 2026-02-12T03:59:22.351 INFO:tasks.workunit.client.0.trial154.stdout: cmd: 2026-02-12T03:59:22.351 INFO:tasks.workunit.client.0.trial154.stdout: cmd: [----------] Global test environment tear-down 2026-02-12T03:59:22.351 INFO:tasks.workunit.client.0.trial154.stdout: cmd: [==========] 3 tests from 1 test suite ran. (13001 ms total) 2026-02-12T03:59:22.351 INFO:tasks.workunit.client.0.trial154.stdout: cmd: [ PASSED ] 3 tests. 2026-02-12T03:59:22.531 INFO:tasks.workunit.client.0.trial154.stdout:", "crush-failure-domain=osd"]} : dispatch 2026-02-12T03:59:22.531 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:20.416793+0000 mon.a [INF] from='client.5122 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_trial154-30000-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-12T03:59:22.531 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:21.166985+0000 mon.a [INF] from='client.5059 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReadOptrial154-30723-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOptrial154-30723-2"}]': finished 2026-02-12T03:59:22.532 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:21.168704+0000 mon.a [INF] from='client.5074 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_trial154-30189-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_trial154-30189-7"}]': finished 2026-02-12T03:59:22.532 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:21.169899+0000 mon.a [INF] from='client.4982 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_trial154-30253-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_trial154-30253-7"}]': finished 2026-02-12T03:59:22.532 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:21.171078+0000 mon.a [INF] from='client.? v1:10.20.193.154:0/588904228' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectstrial154-30800-1"}]': finished 2026-02-12T03:59:22.532 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:21.172656+0000 mon.a [INF] from='client.5086 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial154-30129-3","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-12T03:59:22.532 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:21.173949+0000 mon.a [INF] from='client.5092 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_trial154-29879-3","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-12T03:59:22.532 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:21.175196+0000 mon.a [INF] from='client.? v1:10.20.193.154:0/913531013' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_trial154-30280-1"}]': finished 2026-02-12T03:59:22.532 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:21.176169+0000 mon.a [INF] from='client.? v1:10.20.193.154:0/3093090886' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_trial154-29918-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-12T03:59:22.532 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:21.177017+0000 mon.a [INF] from='client.5122 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_trial154-30000-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-12T03:59:22.532 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:21.245475+0000 mon.b [INF] from='client.? v1:10.20.193.154:0/1639939792' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockEC_trial154-30000-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_trial154-30000-10"} : dispatch 2026-02-12T03:59:22.532 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:21.263355+0000 mon.a [INF] from='client.? v1:10.20.193.154:0/3093090886' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosIoEC_trial154-29918-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_trial154-29918-16"} : dispatch 2026-02-12T03:59:22.532 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:21.271821+0000 mon.a [INF] from='client.? v1:10.20.193.154:0/913531013' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_trial154-30280-1"} : dispatch 2026-02-12T03:59:23.554 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:21.289144+0000 mon.a [INF] from='client.5122 ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockEC_trial154-30000-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_trial154-30000-10"} : dispatch 2026-02-12T03:59:23.555 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:21.300445+0000 mon.b [INF] from='client.? v1:10.20.193.154:0/322358306' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNStrial154-30800-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-12T03:59:23.555 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:21.318392+0000 mon.a [INF] from='client.5158 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNStrial154-30800-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-12T03:59:23.555 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:21.411824+0000 mon.a [INF] from='client.? v1:10.20.193.154:0/2042211454' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_trial154-30026-10"} : dispatch 2026-02-12T03:59:23.555 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:21.437705+0000 mon.a [INF] from='client.? v1:10.20.193.154:0/2042211454' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_trial154-30026-10"} : dispatch 2026-02-12T03:59:23.555 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:21.458303+0000 mon.a [INF] from='client.? v1:10.20.193.154:0/2042211454' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_trial154-30026-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-12T03:59:23.555 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:22.227120+0000 mon.a [INF] from='client.? v1:10.20.193.154:0/913531013' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_trial154-30280-1"}]': finished 2026-02-12T03:59:23.555 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:22.228786+0000 mon.a [INF] from='client.5158 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNStrial154-30800-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-12T03:59:23.555 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:22.229904+0000 mon.a [INF] from='client.? v1:10.20.193.154:0/2042211454' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_trial154-30026-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-12T03:59:23.555 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:22.315731+0000 mon.b [INF] from='client.? v1:10.20.193.154:0/322358306' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectsNStrial154-30800-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNStrial154-30800-2"} : dispatch 2026-02-12T03:59:23.555 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:22.335081+0000 mon.c [INF] from='client.? v1:10.20.193.154:0/2404312981' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2026-02-12T03:59:23.555 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:22.341070+0000 client.admin [INF] threexx 2026-02-12T03:59:23.555 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:22.342379+0000 mon.b [INF] from='client.? v1:10.20.193.154:0/2840592272' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial154-30457-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-12T03:59:23.555 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:22.347011+0000 mon.c [INF] from='client.? v1:10.20.193.154:0/1068485502' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_trial154-30059-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-12T03:59:23.555 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:22.349396+0000 mon.a [INF] from='client.? v1:10.20.193.154:0/2042211454' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "LibRadosLockECPP_trial154-30026-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_trial154-30026-10"} : dispatch 2026-02-12T03:59:25.481 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:22.356636+0000 mon.a [INF] from='client.5158 ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectsNSt pool: Running main() from gmock_main.cc 2026-02-12T03:59:25.481 INFO:tasks.workunit.client.0.trial154.stdout: pool: [==========] Running 6 tests from 1 test suite. 2026-02-12T03:59:25.482 INFO:tasks.workunit.client.0.trial154.stdout: pool: [----------] Global test environment set-up. 2026-02-12T03:59:25.482 INFO:tasks.workunit.client.0.trial154.stdout: pool: [----------] 6 tests from NeoRadosPools 2026-02-12T03:59:25.482 INFO:tasks.workunit.client.0.trial154.stdout: pool: [ RUN ] NeoRadosPools.PoolList 2026-02-12T03:59:25.482 INFO:tasks.workunit.client.0.trial154.stdout: pool: [ OK ] NeoRadosPools.PoolList (3190 ms) 2026-02-12T03:59:25.482 INFO:tasks.workunit.client.0.trial154.stdout: pool: [ RUN ] NeoRadosPools.PoolLookup 2026-02-12T03:59:25.482 INFO:tasks.workunit.client.0.trial154.stdout: pool: [ OK ] NeoRadosPools.PoolLookup (3491 ms) 2026-02-12T03:59:25.482 INFO:tasks.workunit.client.0.trial154.stdout: pool: [ RUN ] NeoRadosPools.PoolLookupOtherInstance 2026-02-12T03:59:25.482 INFO:tasks.workunit.client.0.trial154.stdout: pool: [ OK ] NeoRadosPools.PoolLookupOtherInstance (3181 ms) 2026-02-12T03:59:25.482 INFO:tasks.workunit.client.0.trial154.stdout: pool: [ RUN ] NeoRadosPools.PoolDelete 2026-02-12T03:59:25.482 INFO:tasks.workunit.client.0.trial154.stdout: pool: [ OK ] NeoRadosPools.PoolDelete (2063 ms) 2026-02-12T03:59:25.482 INFO:tasks.workunit.client.0.trial154.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateDelete 2026-02-12T03:59:25.483 INFO:tasks.workunit.client.0.trial154.stdout: pool: [ OK ] NeoRadosPools.PoolCreateDelete (2091 ms) 2026-02-12T03:59:25.483 INFO:tasks.workunit.client.0.trial154.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateWithCrushRule 2026-02-12T03:59:25.483 INFO:tasks.workunit.client.0.trial154.stdout: pool: [ OK ] NeoRadosPools.PoolCreateWithCrushRule (2094 ms) 2026-02-12T03:59:25.483 INFO:tasks.workunit.client.0.trial154.stdout: pool: [----------] 6 tests from NeoRadosPools (16112 ms total) 2026-02-12T03:59:25.483 INFO:tasks.workunit.client.0.trial154.stdout: pool: 2026-02-12T03:59:25.483 INFO:tasks.workunit.client.0.trial154.stdout: pool: [----------] Global test environment tear-down 2026-02-12T03:59:25.483 INFO:tasks.workunit.client.0.trial154.stdout: pool: [==========] 6 tests from 1 test suite ran. (16112 ms total) 2026-02-12T03:59:25.483 INFO:tasks.workunit.client.0.trial154.stdout: pool: [ PASSED ] 6 tests. 2026-02-12T03:59:26.507 INFO:tasks.workunit.client.0.trial154.stdout: ec_io: Running main() from gmock_main.cc 2026-02-12T03:59:26.507 INFO:tasks.workunit.client.0.trial154.stdout: ec_io: [==========] Running 2 tests from 1 test suite. 2026-02-12T03:59:26.507 INFO:tasks.workunit.client.0.trial154.stdout: ec_io: [----------] Global test environment set-up. 2026-02-12T03:59:26.507 INFO:tasks.workunit.client.0.trial154.stdout: ec_io: [----------] 2 tests from NeoRadosECIo 2026-02-12T03:59:26.507 INFO:tasks.workunit.client.0.trial154.stdout: ec_io: [ RUN ] NeoRadosECIo.SimpleWrite 2026-02-12T03:59:26.507 INFO:tasks.workunit.client.0.trial154.stdout: ec_io: [ OK ] NeoRadosECIo.SimpleWrite (8578 ms) 2026-02-12T03:59:26.507 INFO:tasks.workunit.client.0.trial154.stdout: ec_io: [ RUN ] NeoRadosECIo.ReadOp 2026-02-12T03:59:26.507 INFO:tasks.workunit.client.0.trial154.stdout: ec_io: [ OK ] NeoRadosECIo.ReadOp (8570 ms) 2026-02-12T03:59:26.508 INFO:tasks.workunit.client.0.trial154.stdout: ec_io: [----------] 2 tests from NeoRadosECIo (17149 ms total) 2026-02-12T03:59:26.508 INFO:tasks.workunit.client.0.trial154.stdout: ec_io: 2026-02-12T03:59:26.508 INFO:tasks.workunit.client.0.trial154.stdout: ec_io: [----------] Global test environment tear-down 2026-02-12T03:59:26.508 INFO:tasks.workunit.client.0.trial154.stdout: ec_io: [==========] 2 tests from 1 test suite ran. (17149 ms total) 2026-02-12T03:59:26.508 INFO:tasks.workunit.client.0.trial154.stdout: ec_io: [ PASSED ] 2 tests. 2026-02-12T03:59:26.516 INFO:tasks.workunit.client.0.trial154.stdout: api_stat_pp: Running main() from gmock_main.cc 2026-02-12T03:59:26.516 INFO:tasks.workunit.client.0.trial154.stdout: api_stat_pp: [==========] Running 9 tests from 2 test suites. 2026-02-12T03:59:26.516 INFO:tasks.workunit.client.0.trial154.stdout: api_stat_pp: [----------] Global test environment set-up. 2026-02-12T03:59:26.516 INFO:tasks.workunit.client.0.trial154.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP 2026-02-12T03:59:26.516 INFO:tasks.workunit.client.0.trial154.stdout: api_stat_pp: seed 30253 2026-02-12T03:59:26.516 INFO:tasks.workunit.client.0.trial154.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPP 2026-02-12T03:59:26.516 INFO:tasks.workunit.client.0.trial154.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPP (2104 ms) 2026-02-12T03:59:26.517 INFO:tasks.workunit.client.0.trial154.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.Stat2Mtime2PP 2026-02-12T03:59:26.517 INFO:tasks.workunit.client.0.trial154.stdout: api_stat_pp: [ OK ] LibRadosStatPP.Stat2Mtime2PP (196 ms) 2026-02-12T03:59:26.517 INFO:tasks.workunit.client.0.trial154.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.ClusterStatPP 2026-02-12T03:59:26.517 INFO:tasks.workunit.client.0.trial154.stdout: api_stat_pp: [ OK ] LibRadosStatPP.ClusterStatPP (8 ms) 2026-02-12T03:59:26.517 INFO:tasks.workunit.client.0.trial154.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.PoolStatPP 2026-02-12T03:59:26.517 INFO:tasks.workunit.client.0.trial154.stdout: api_stat_pp: [ OK ] LibRadosStatPP.PoolStatPP (1230 ms) 2026-02-12T03:59:26.517 INFO:tasks.workunit.client.0.trial154.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPPNS 2026-02-12T03:59:26.517 INFO:tasks.workunit.client.0.trial154.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPPNS (464 ms) 2026-02-12T03:59:26.517 INFO:tasks.workunit.client.0.trial154.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP (4004 ms total) 2026-02-12T03:59:26.518 INFO:tasks.workunit.client.0.trial154.stdout: api_stat_pp: 2026-02-12T03:59:26.518 INFO:tasks.workunit.client.0.trial154.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP 2026-02-12T03:59:26.518 INFO:tasks.workunit.client.0.trial154.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPP 2026-02-12T03:59:26.518 INFO:tasks.workunit.client.0.trial154.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPP (1761 ms) 2026-02-12T03:59:26.518 INFO:tasks.workunit.client.0.trial154.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.ClusterStatPP 2026-02-12T03:59:26.518 INFO:tasks.workunit.client.0.trial154.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.ClusterStatPP (13 ms) 2026-02-12T03:59:26.518 INFO:tasks.workunit.client.0.trial154.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.PoolStatPP 2026-02-12T03:59:26.519 INFO:tasks.workunit.client.0.trial154.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.PoolStatPP (149 ms) 2026-02-12T03:59:26.519 INFO:tasks.workunit.client.0.trial154.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPPNS 2026-02-12T03:59:26.519 INFO:tasks.workunit.client.0.trial154.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPPNS (864 ms) 2026-02-12T03:59:26.519 INFO:tasks.workunit.client.0.trial154.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP (2788 ms total) 2026-02-12T03:59:26.519 INFO:tasks.workunit.client.0.trial154.stdout: api_stat_pp: 2026-02-12T03:59:26.519 INFO:tasks.workunit.client.0.trial154.stdout: api_stat_pp: [----------] Global test environment tear-down 2026-02-12T03:59:26.520 INFO:tasks.workunit.client.0.trial154.stdout: api_stat_pp: [==========] 9 tests from 2 test suites ran. (17204 ms total) 2026-02-12T03:59:26.520 INFO:tasks.workunit.client.0.trial154.stdout: api_stat_pp: [ PASSED ] 9 tests. 2026-02-12T03:59:26.520 INFO:tasks.workunit.client.0.trial154.stdout: api_stat: Running main() from gmock_main.cc 2026-02-12T03:59:26.520 INFO:tasks.workunit.client.0.trial154.stdout: api_stat: [==========] Running 9 tests from 2 test suites. 2026-02-12T03:59:26.520 INFO:tasks.workunit.client.0.trial154.stdout: api_stat: [----------] Global test environment set-up. 2026-02-12T03:59:26.520 INFO:tasks.workunit.client.0.trial154.stdout: api_stat: [----------] 5 tests from LibRadosStat 2026-02-12T03:59:26.521 INFO:tasks.workunit.client.0.trial154.stdout: api_stat: [ RUN ] LibRadosStat.Stat 2026-02-12T03:59:26.521 INFO:tasks.workunit.client.0.trial154.stdout: api_stat: [ OK ] LibRadosStat.Stat (2015 ms) 2026-02-12T03:59:26.521 INFO:tasks.workunit.client.0.trial154.stdout: api_stat: [ RUN ] LibRadosStat.Stat2 2026-02-12T03:59:26.521 INFO:tasks.workunit.client.0.trial154.stdout: api_stat: [ OK ] LibRadosStat.Stat2 (203 ms) 2026-02-12T03:59:26.521 INFO:tasks.workunit.client.0.trial154.stdout: api_stat: [ RUN ] LibRadosStat.StatNS 2026-02-12T03:59:26.521 INFO:tasks.workunit.client.0.trial154.stdout: api_stat: [ OK ] LibRadosStat.StatNS (308 ms) 2026-02-12T03:59:26.522 INFO:tasks.workunit.client.0.trial154.stdout: api_stat: [ RUN ] LibRadosStat.ClusterStat 2026-02-12T03:59:26.522 INFO:tasks.workunit.client.0.trial154.stdout: api_stat: [ OK ] LibRadosStat.ClusterStat (843 ms) 2026-02-12T03:59:26.522 INFO:tasks.workunit.client.0.trial154.stdout: api_stat: [ RUN ] LibRadosStat.PoolStat 2026-02-12T03:59:26.522 INFO:tasks.workunit.client.0.trial154.stdout: api_stat: [ OK ] LibRadosStat.PoolStat (446 ms) 2026-02-12T03:59:26.522 INFO:tasks.workunit.client.0.trial154.stdout: api_stat: [----------] 5 tests from LibRadosStat (3816 ms total) 2026-02-12T03:59:26.522 INFO:tasks.workunit.client.0.trial154.stdout: api_stat: 2026-02-12T03:59:26.523 INFO:tasks.workunit.client.0.trial154.stdout: api_stat: [----------] 4 tests from LibRadosStatEC 2026-02-12T03:59:26.523 INFO:tasks.workunit.client.0.trial154.stdout: api_stat: [ RUN ] LibRadosStatEC.Stat 2026-02-12T03:59:26.523 INFO:tasks.workunit.client.0.trial154.stdout: api_stat: [ OK ] LibRadosStatEC.Stat (1917 ms) 2026-02-12T03:59:26.523 INFO:tasks.workunit.client.0.trial154.stdout: api_stat: [ RUN ] LibRadosStatEC.StatNS 2026-02-12T03:59:26.523 INFO:tasks.workunit.client.0.trial154.stdout: api_stat: [ OK ] LibRadosStatEC.StatNS (213 ms) 2026-02-12T03:59:26.523 INFO:tasks.workunit.client.0.trial154.stdout: api_stat: [ RUN ] LibRadosStatEC.ClusterStat 2026-02-12T03:59:26.524 INFO:tasks.workunit.client.0.trial154.stdout: api_stat: [ OK ] LibRadosStatEC.ClusterStat (1 ms) 2026-02-12T03:59:26.524 INFO:tasks.workunit.client.0.trial154.stdout: api_stat: [ RUN ] LibRadosStatEC.PoolStat 2026-02-12T03:59:26.524 INFO:tasks.workunit.client.0.trial154.stdout: api_stat: [ OK ] LibRadosStatEC.PoolStat (478 ms) 2026-02-12T03:59:26.524 INFO:tasks.workunit.client.0.trial154.stdout: api_stat: [----------] 4 tests from LibRadosStatEC (2610 ms total) 2026-02-12T03:59:26.524 INFO:tasks.workunit.client.0.trial154.stdout: api_stat: 2026-02-12T03:59:26.524 INFO:tasks.workunit.client.0.trial154.stdout: api_stat: [----------] Global test environment tear-down 2026-02-12T03:59:26.524 INFO:tasks.workunit.client.0.trial154.stdout: api_stat: [==========] 9 tests from 2 test suites ran. (17208 ms total) 2026-02-12T03:59:26.525 INFO:tasks.workunit.client.0.trial154.stdout: api_stat: [ PASSED ] 9 tests. 2026-02-12T03:59:26.717 INFO:tasks.workunit.client.0.trial154.stdout:rial154-30800-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNStrial154-30800-2"} : dispatch 2026-02-12T03:59:26.717 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:22.362058+0000 mon.a [INF] from='client.4988 ' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2026-02-12T03:59:26.717 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:22.371320+0000 mon.a [INF] from='client.5078 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosMisc_trial154-30059-1","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-12T03:59:26.718 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:22.385358+0000 mon.a [INF] from='client.5188 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial154-30457-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-12T03:59:26.718 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:23.288291+0000 mon.a [INF] from='client.? v1:10.20.193.154:0/3093090886' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_trial154-29918-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_trial154-29918-16"}]': finished 2026-02-12T03:59:26.718 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:23.289820+0000 mon.a [INF] from='client.5122 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_trial154-30000-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_trial154-30000-10"}]': finished 2026-02-12T03:59:26.718 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:23.290971+0000 mon.a [INF] from='client.5078 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_trial154-30059-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-12T03:59:26.718 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:23.291903+0000 mon.a [INF] from='client.5188 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial154-30457-3","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-12T03:59:26.718 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:23.388210+0000 mon.b [INF] from='client.? v1:10.20.193.154:0/4044581618' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_trial154-30280-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-12T03:59:26.719 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:23.399720+0000 mon.a [INF] from='client.5221 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_trial154-30280-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-12T03:59:26.719 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:23.413861+0000 mon.a [INF] from='client.? v1:10.20.193.154:0/3985487946' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "RoundTrip_trial154-29879-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-12T03:59:26.719 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:23.419645+0000 mon.c [INF] from='client.? v1:10.20.193.154:0/2168761122' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial154-30129-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-12T03:59:26.719 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: got: 2026-02-12T03:59:23.424492+0000 mon.a [INF] from='client.5147 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial154-30129-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-12T03:59:26.719 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: [ OK ] LibRadosCmd.WatchLog (8653 ms) 2026-02-12T03:59:26.719 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: [----------] 4 tests from LibRadosCmd (17397 ms total) 2026-02-12T03:59:26.719 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: 2026-02-12T03:59:26.719 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: [----------] Global test environment tear-down 2026-02-12T03:59:26.719 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: [==========] 4 tests from 1 test suite ran. (17397 ms total) 2026-02-12T03:59:26.719 INFO:tasks.workunit.client.0.trial154.stdout: api_cmd: [ PASSED ] 4 tests. 2026-02-12T03:59:28.268 INFO:tasks.workunit.client.0.trial154.stdout: open_pools_parallel: process_1_[30664]: starting. 2026-02-12T03:59:28.269 INFO:tasks.workunit.client.0.trial154.stdout: open_pools_parallel: process_1_[30664]: creating pool ceph_test_rados_open_pools_parallel.trial154-30558 2026-02-12T03:59:28.269 INFO:tasks.workunit.client.0.trial154.stdout: open_pools_parallel: process_1_[30664]: created object 0... 2026-02-12T03:59:28.269 INFO:tasks.workunit.client.0.trial154.stdout: open_pools_parallel: process_1_[30664]: created object 25... 2026-02-12T03:59:28.269 INFO:tasks.workunit.client.0.trial154.stdout: open_pools_parallel: process_1_[30664]: created object 49... 2026-02-12T03:59:28.269 INFO:tasks.workunit.client.0.trial154.stdout: open_pools_parallel: process_1_[30664]: finishing. 2026-02-12T03:59:28.269 INFO:tasks.workunit.client.0.trial154.stdout: open_pools_parallel: process_1_[30664]: shutting down. 2026-02-12T03:59:28.269 INFO:tasks.workunit.client.0.trial154.stdout: open_pools_parallel: process_2_[30669]: starting. 2026-02-12T03:59:28.269 INFO:tasks.workunit.client.0.trial154.stdout: open_pools_parallel: process_2_[30669]: rados_pool_create. 2026-02-12T03:59:28.269 INFO:tasks.workunit.client.0.trial154.stdout: open_pools_parallel: process_2_[30669]: rados_ioctx_create. 2026-02-12T03:59:28.269 INFO:tasks.workunit.client.0.trial154.stdout: open_pools_parallel: process_2_[30669]: shutting down. 2026-02-12T03:59:28.270 INFO:tasks.workunit.client.0.trial154.stdout: open_pools_parallel: ******************************* 2026-02-12T03:59:28.270 INFO:tasks.workunit.client.0.trial154.stdout: open_pools_parallel: process_3_[32294]: starting. 2026-02-12T03:59:28.270 INFO:tasks.workunit.client.0.trial154.stdout: open_pools_parallel: process_3_[32294]: creating pool ceph_test_rados_open_pools_parallel.trial154-30558 2026-02-12T03:59:28.270 INFO:tasks.workunit.client.0.trial154.stdout: open_pools_parallel: process_3_[32294]: created object 0... 2026-02-12T03:59:28.270 INFO:tasks.workunit.client.0.trial154.stdout: open_pools_parallel: process_3_[32294]: created object 25... 2026-02-12T03:59:28.270 INFO:tasks.workunit.client.0.trial154.stdout: open_pools_parallel: process_3_[32294]: created object 49... 2026-02-12T03:59:28.270 INFO:tasks.workunit.client.0.trial154.stdout: open_pools_parallel: process_3_[32294]: finishing. 2026-02-12T03:59:28.270 INFO:tasks.workunit.client.0.trial154.stdout: open_pools_parallel: process_3_[32294]: shutting down. 2026-02-12T03:59:28.270 INFO:tasks.workunit.client.0.trial154.stdout: open_pools_parallel: ******************************* 2026-02-12T03:59:28.270 INFO:tasks.workunit.client.0.trial154.stdout: open_pools_parallel: process_4_[32295]: starting. 2026-02-12T03:59:28.270 INFO:tasks.workunit.client.0.trial154.stdout: open_pools_parallel: process_4_[32295]: rados_pool_create. 2026-02-12T03:59:28.270 INFO:tasks.workunit.client.0.trial154.stdout: open_pools_parallel: process_4_[32295]: rados_ioctx_create. 2026-02-12T03:59:28.271 INFO:tasks.workunit.client.0.trial154.stdout: open_pools_parallel: process_4_[32295]: shutting down. 2026-02-12T03:59:28.271 INFO:tasks.workunit.client.0.trial154.stdout: open_pools_parallel: ******************************* 2026-02-12T03:59:28.271 INFO:tasks.workunit.client.0.trial154.stdout: open_pools_parallel: ******************************* 2026-02-12T03:59:28.271 INFO:tasks.workunit.client.0.trial154.stdout: open_pools_parallel: ******* SUCCESS ********** 2026-02-12T03:59:29.282 INFO:tasks.workunit.client.0.trial154.stdout: delete_pools_parallel: process_1_[30677]: starting. 2026-02-12T03:59:29.282 INFO:tasks.workunit.client.0.trial154.stdout: delete_pools_parallel: process_1_[30677]: creating pool ceph_test_rados_delete_pools_parallel.trial154-30570 2026-02-12T03:59:29.282 INFO:tasks.workunit.client.0.trial154.stdout: delete_pools_parallel: process_1_[30677]: created object 0... 2026-02-12T03:59:29.283 INFO:tasks.workunit.client.0.trial154.stdout: delete_pools_parallel: process_1_[30677]: created object 25... 2026-02-12T03:59:29.283 INFO:tasks.workunit.client.0.trial154.stdout: delete_pools_parallel: process_1_[30677]: created object 49... 2026-02-12T03:59:29.283 INFO:tasks.workunit.client.0.trial154.stdout: delete_pools_parallel: process_1_[30677]: finishing. 2026-02-12T03:59:29.283 INFO:tasks.workunit.client.0.trial154.stdout: delete_pools_parallel: process_1_[30677]: shutting down. 2026-02-12T03:59:29.283 INFO:tasks.workunit.client.0.trial154.stdout: delete_pools_parallel: process_2_[30682]: starting. 2026-02-12T03:59:29.283 INFO:tasks.workunit.client.0.trial154.stdout: delete_pools_parallel: process_2_[30682]: deleting pool ceph_test_rados_delete_pools_parallel.trial154-30570 2026-02-12T03:59:29.283 INFO:tasks.workunit.client.0.trial154.stdout: delete_pools_parallel: process_2_[30682]: shutting down. 2026-02-12T03:59:29.283 INFO:tasks.workunit.client.0.trial154.stdout: delete_pools_parallel: ******************************* 2026-02-12T03:59:29.283 INFO:tasks.workunit.client.0.trial154.stdout: delete_pools_parallel: process_3_[32291]: starting. 2026-02-12T03:59:29.283 INFO:tasks.workunit.client.0.trial154.stdout: delete_pools_parallel: process_3_[32291]: creating pool ceph_test_rados_delete_pools_parallel.trial154-30570 2026-02-12T03:59:29.284 INFO:tasks.workunit.client.0.trial154.stdout: delete_pools_parallel: process_3_[32291]: created object 0... 2026-02-12T03:59:29.284 INFO:tasks.workunit.client.0.trial154.stdout: delete_pools_parallel: process_3_[32291]: created object 25... 2026-02-12T03:59:29.284 INFO:tasks.workunit.client.0.trial154.stdout: delete_pools_parallel: process_3_[32291]: created object 49... 2026-02-12T03:59:29.284 INFO:tasks.workunit.client.0.trial154.stdout: delete_pools_parallel: process_3_[32291]: finishing. 2026-02-12T03:59:29.284 INFO:tasks.workunit.client.0.trial154.stdout: delete_pools_parallel: process_3_[32291]: shutting down. 2026-02-12T03:59:29.284 INFO:tasks.workunit.client.0.trial154.stdout: delete_pools_parallel: ******************************* 2026-02-12T03:59:29.284 INFO:tasks.workunit.client.0.trial154.stdout: delete_pools_parallel: process_5_[32293]: starting. 2026-02-12T03:59:29.284 INFO:tasks.workunit.client.0.trial154.stdout: delete_pools_parallel: process_5_[32293]: listing objects. 2026-02-12T03:59:29.284 INFO:tasks.workunit.client.0.trial154.stdout: delete_pools_parallel: process_5_[32293]: listed object 0... 2026-02-12T03:59:29.284 INFO:tasks.workunit.client.0.trial154.stdout: delete_pools_parallel: process_5_[32293]: listed object 25... 2026-02-12T03:59:29.284 INFO:tasks.workunit.client.0.trial154.stdout: delete_pools_parallel: process_5_[32293]: saw 50 objects 2026-02-12T03:59:29.284 INFO:tasks.workunit.client.0.trial154.stdout: delete_pools_parallel: process_5_[32293]: shutting down. 2026-02-12T03:59:29.285 INFO:tasks.workunit.client.0.trial154.stdout: delete_pools_parallel: ******************************* 2026-02-12T03:59:29.285 INFO:tasks.workunit.client.0.trial154.stdout: delete_pools_parallel: process_4_[32292]: starting. 2026-02-12T03:59:29.285 INFO:tasks.workunit.client.0.trial154.stdout: delete_pools_parallel: process_4_[32292]: deleting pool ceph_test_rados_delete_pools_parallel.trial154-30570 2026-02-12T03:59:29.285 INFO:tasks.workunit.client.0.trial154.stdout: delete_pools_parallel: process_4_[32292]: shutting down. 2026-02-12T03:59:29.285 INFO:tasks.workunit.client.0.trial154.stdout: delete_pools_parallel: ******************************* 2026-02-12T03:59:29.285 INFO:tasks.workunit.client.0.trial154.stdout: delete_pools_parallel: ******************************* 2026-02-12T03:59:29.285 INFO:tasks.workunit.client.0.trial154.stdout: delete_pools_parallel: ******* SUCCESS ********** 2026-02-12T03:59:30.522 INFO:tasks.workunit.client.0.trial154.stdout: api_list: [==========] Running 11 tests from 3 test suites. 2026-02-12T03:59:30.522 INFO:tasks.workunit.client.0.trial154.stdout: api_list: [----------] Global test environment set-up. 2026-02-12T03:59:30.522 INFO:tasks.workunit.client.0.trial154.stdout: api_list: [----------] 7 tests from LibRadosList 2026-02-12T03:59:30.523 INFO:tasks.workunit.client.0.trial154.stdout: api_list: [ RUN ] LibRadosList.ListObjects 2026-02-12T03:59:30.523 INFO:tasks.workunit.client.0.trial154.stdout: api_list: [ OK ] LibRadosList.ListObjects (5169 ms) 2026-02-12T03:59:30.523 INFO:tasks.workunit.client.0.trial154.stdout: api_list: [ RUN ] LibRadosList.ListObjectsZeroInName 2026-02-12T03:59:30.523 INFO:tasks.workunit.client.0.trial154.stdout: api_list: [ OK ] LibRadosList.ListObjectsZeroInName (318 ms) 2026-02-12T03:59:30.523 INFO:tasks.workunit.client.0.trial154.stdout: api_list: [ RUN ] LibRadosList.ListObjectsNS 2026-02-12T03:59:30.523 INFO:tasks.workunit.client.0.trial154.stdout: api_list: myset foo1,foo2,foo3 2026-02-12T03:59:30.523 INFO:tasks.workunit.client.0.trial154.stdout: api_list: foo1 2026-02-12T03:59:30.523 INFO:tasks.workunit.client.0.trial154.stdout: api_list: foo2 2026-02-12T03:59:30.523 INFO:tasks.workunit.client.0.trial154.stdout: api_list: foo3 2026-02-12T03:59:30.523 INFO:tasks.workunit.client.0.trial154.stdout: api_list: myset foo1,foo4,foo5 2026-02-12T03:59:30.523 INFO:tasks.workunit.client.0.trial154.stdout: api_list: foo4 2026-02-12T03:59:30.524 INFO:tasks.workunit.client.0.trial154.stdout: api_list: foo5 2026-02-12T03:59:30.524 INFO:tasks.workunit.client.0.trial154.stdout: api_list: foo1 2026-02-12T03:59:30.524 INFO:tasks.workunit.client.0.trial154.stdout: api_list: myset foo6,foo7 2026-02-12T03:59:30.524 INFO:tasks.workunit.client.0.trial154.stdout: api_list: foo7 2026-02-12T03:59:30.524 INFO:tasks.workunit.client.0.trial154.stdout: api_list: foo6 2026-02-12T03:59:30.524 INFO:tasks.workunit.client.0.trial154.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2026-02-12T03:59:30.524 INFO:tasks.workunit.client.0.trial154.stdout: api_list: ns1:foo4 2026-02-12T03:59:30.524 INFO:tasks.workunit.client.0.trial154.stdout: api_list: ns1:foo5 2026-02-12T03:59:30.524 INFO:tasks.workunit.client.0.trial154.stdout: api_list: ns2:foo7 2026-02-12T03:59:30.524 INFO:tasks.workunit.client.0.trial154.stdout: api_list: ns2:foo6 2026-02-12T03:59:30.524 INFO:tasks.workunit.client.0.trial154.stdout: api_list: ns1:foo1 2026-02-12T03:59:30.524 INFO:tasks.workunit.client.0.trial154.stdout: api_list: :foo1 2026-02-12T03:59:30.525 INFO:tasks.workunit.client.0.trial154.stdout: api_list: :foo2 2026-02-12T03:59:30.525 INFO:tasks.workunit.client.0.trial154.stdout: api_list: :foo3 2026-02-12T03:59:30.525 INFO:tasks.workunit.client.0.trial154.stdout: api_list: [ OK ] LibRadosList.ListObjectsNS (6548 ms) 2026-02-12T03:59:30.525 INFO:tasks.workunit.client.0.trial154.stdout: api_list: [ RUN ] LibRadosList.ListObjectsStart 2026-02-12T03:59:30.525 INFO:tasks.workunit.client.0.trial154.stdout: api_list: 1 0 2026-02-12T03:59:30.525 INFO:tasks.workunit.client.0.trial154.stdout: api_list: 10 0 2026-02-12T03:59:30.525 INFO:tasks.workunit.client.0.trial154.stdout: api_list: 13 0 2026-02-12T03:59:30.525 INFO:tasks.workunit.client.0.trial154.stdout: api_list: 7 0 2026-02-12T03:59:30.525 INFO:tasks.workunit.client.0.trial154.stdout: api_list: 14 0 2026-02-12T03:59:30.525 INFO:tasks.workunit.client.0.trial154.stdout: api_list: 0 0 2026-02-12T03:59:30.525 INFO:tasks.workunit.client.0.trial154.stdout: api_list: 15 0 2026-02-12T03:59:30.525 INFO:tasks.workunit.client.0.trial154.stdout: api_list: 11 0 2026-02-12T03:59:30.526 INFO:tasks.workunit.client.0.trial154.stdout: api_list: 5 0 2026-02-12T03:59:30.526 INFO:tasks.workunit.client.0.trial154.stdout: api_list: 8 0 2026-02-12T03:59:30.526 INFO:tasks.workunit.client.0.trial154.stdout: api_list: 6 0 2026-02-12T03:59:30.526 INFO:tasks.workunit.client.0.trial154.stdout: api_list: 3 0 2026-02-12T03:59:30.526 INFO:tasks.workunit.client.0.trial154.stdout: api_list: 4 0 2026-02-12T03:59:30.526 INFO:tasks.workunit.client.0.trial154.stdout: api_list: 12 0 2026-02-12T03:59:30.526 INFO:tasks.workunit.client.0.trial154.stdout: api_list: 9 0 2026-02-12T03:59:30.526 INFO:tasks.workunit.client.0.trial154.stdout: api_list: 2 0 2026-02-12T03:59:30.526 INFO:tasks.workunit.client.0.trial154.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2026-02-12T03:59:30.526 INFO:tasks.workunit.client.0.trial154.stdout: api_list: [ OK ] LibRadosList.ListObjectsStart (4716 ms) 2026-02-12T03:59:30.526 INFO:tasks.workunit.client.0.trial154.stdout: api_list: [ RUN ] LibRadosList.ListObjectsCursor 2026-02-12T03:59:30.526 INFO:tasks.workunit.client.0.trial154.stdout: api_list: x cursor=MIN 2026-02-12T03:59:30.527 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > oid=1 cursor=8:02547ec2:::1:head 2026-02-12T03:59:30.527 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > oid=10 cursor=8:52ea6a34:::10:head 2026-02-12T03:59:30.527 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > oid=13 cursor=8:566253c9:::13:head 2026-02-12T03:59:30.527 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > oid=7 cursor=8:5c6b0b28:::7:head 2026-02-12T03:59:30.527 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > oid=14 cursor=8:62a1935d:::14:head 2026-02-12T03:59:30.527 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > oid=0 cursor=8:6cac518f:::0:head 2026-02-12T03:59:30.527 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > oid=15 cursor=8:863748b0:::15:head 2026-02-12T03:59:30.527 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > oid=11 cursor=8:89d3ae78:::11:head 2026-02-12T03:59:30.527 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > oid=5 cursor=8:b29083e3:::5:head 2026-02-12T03:59:30.527 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > oid=8 cursor=8:bd63b0f1:::8:head 2026-02-12T03:59:30.527 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > oid=6 cursor=8:c4fdafeb:::6:head 2026-02-12T03:59:30.527 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > oid=3 cursor=8:cfc208b3:::3:head 2026-02-12T03:59:30.527 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > oid=4 cursor=8:d83876eb:::4:head 2026-02-12T03:59:30.528 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > oid=12 cursor=8:de5d7c5f:::12:head 2026-02-12T03:59:30.528 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > oid=9 cursor=8:e960b815:::9:head 2026-02-12T03:59:30.528 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > oid=2 cursor=8:f905c69b:::2:head 2026-02-12T03:59:30.528 INFO:tasks.workunit.client.0.trial154.stdout: api_list: FIRST> seek to MIN oid=1 2026-02-12T03:59:30.528 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : oid=1 cursor=8:02547ec2:::1:head 2026-02-12T03:59:30.528 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : seek to 8:02547ec2:::1:head 2026-02-12T03:59:30.528 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > 8:02547ec2:::1:head -> 1 2026-02-12T03:59:30.528 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : oid=10 cursor=8:52ea6a34:::10:head 2026-02-12T03:59:30.528 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : seek to 8:52ea6a34:::10:head 2026-02-12T03:59:30.528 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > 8:52ea6a34:::10:head -> 10 2026-02-12T03:59:30.528 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : oid=13 cursor=8:566253c9:::13:head 2026-02-12T03:59:30.528 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : seek to 8:566253c9:::13:head 2026-02-12T03:59:30.528 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > 8:566253c9:::13:head -> 13 2026-02-12T03:59:30.529 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : oid=7 cursor=8:5c6b0b28:::7:head 2026-02-12T03:59:30.529 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : seek to 8:5c6b0b28:::7:head 2026-02-12T03:59:30.529 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > 8:5c6b0b28:::7:head -> 7 2026-02-12T03:59:31.584 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : oid=14 cursor=8:62a1935d:::14:he api_watch_notify_pp: Running main() from gmock_main.cc 2026-02-12T03:59:31.584 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [==========] Running 16 tests from 2 test suites. 2026-02-12T03:59:31.584 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [----------] Global test environment set-up. 2026-02-12T03:59:31.584 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP 2026-02-12T03:59:31.584 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2026-02-12T03:59:31.584 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: notify 2026-02-12T03:59:31.584 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotify (4415 ms) 2026-02-12T03:59:31.585 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2026-02-12T03:59:31.585 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (1585 ms) 2026-02-12T03:59:31.585 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP (6000 ms total) 2026-02-12T03:59:31.585 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: 2026-02-12T03:59:31.585 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2026-02-12T03:59:31.585 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2026-02-12T03:59:31.585 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: notify 2026-02-12T03:59:31.585 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (982 ms) 2026-02-12T03:59:31.585 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2026-02-12T03:59:31.585 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: notify 2026-02-12T03:59:31.586 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (4683 ms) 2026-02-12T03:59:31.586 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2026-02-12T03:59:31.586 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (165 ms) 2026-02-12T03:59:31.586 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2026-02-12T03:59:31.586 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (92 ms) 2026-02-12T03:59:31.586 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2026-02-12T03:59:31.586 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: handle_notify cookie 94241838073632 notify_id 201863462913 notifier_gid 5221 2026-02-12T03:59:31.586 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (171 ms) 2026-02-12T03:59:31.586 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2026-02-12T03:59:31.586 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: handle_notify cookie 94241838073632 notify_id 201863462914 notifier_gid 5221 2026-02-12T03:59:31.586 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: handle_notify cookie 94241838073632 notify_id 201863462914 notifier_gid 5221 2026-02-12T03:59:31.586 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: handle_notify cookie 94241838073632 notify_id 201863462915 notifier_gid 5221 2026-02-12T03:59:31.587 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (115 ms) 2026-02-12T03:59:31.587 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2026-02-12T03:59:31.587 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: handle_notify cookie 94241838085120 notify_id 201863462912 notifier_gid 5221 2026-02-12T03:59:31.587 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (225 ms) 2026-02-12T03:59:31.587 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2026-02-12T03:59:31.587 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: handle_notify cookie 94241838085120 notify_id 201863462913 notifier_gid 5221 2026-02-12T03:59:31.587 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (93 ms) 2026-02-12T03:59:31.587 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2026-02-12T03:59:31.587 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: handle_notify cookie 94241838085120 notify_id 201863462916 notifier_gid 5221 2026-02-12T03:59:31.587 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (85 ms) 2026-02-12T03:59:31.587 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2026-02-12T03:59:31.587 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: handle_notify cookie 94241838085120 notify_id 201863462915 notifier_gid 5221 2026-02-12T03:59:31.587 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (70 ms) 2026-02-12T03:59:31.588 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2026-02-12T03:59:31.933 INFO:tasks.workunit.client.0.trial154.stdout: api_watchad 2026-02-12T03:59:31.933 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : seek to 8:62a1935d:::14:head 2026-02-12T03:59:31.933 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > 8:62a1935d:::14:head -> 14 2026-02-12T03:59:31.934 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : oid=0 cursor=8:6cac518f:::0:head 2026-02-12T03:59:31.934 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : seek to 8:6cac518f:::0:head 2026-02-12T03:59:31.934 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > 8:6cac518f:::0:head -> 0 2026-02-12T03:59:31.934 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : oid=15 cursor=8:863748b0:::15:head 2026-02-12T03:59:31.934 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : seek to 8:863748b0:::15:head 2026-02-12T03:59:31.934 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > 8:863748b0:::15:head -> 15 2026-02-12T03:59:31.934 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : oid=11 cursor=8:89d3ae78:::11:head 2026-02-12T03:59:31.934 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : seek to 8:89d3ae78:::11:head 2026-02-12T03:59:31.934 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > 8:89d3ae78:::11:head -> 11 2026-02-12T03:59:31.934 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : oid=5 cursor=8:b29083e3:::5:head 2026-02-12T03:59:31.934 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : seek to 8:b29083e3:::5:head 2026-02-12T03:59:31.934 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > 8:b29083e3:::5:head -> 5 2026-02-12T03:59:31.934 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : oid=8 cursor=8:bd63b0f1:::8:head 2026-02-12T03:59:31.935 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : seek to 8:bd63b0f1:::8:head 2026-02-12T03:59:31.935 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > 8:bd63b0f1:::8:head -> 8 2026-02-12T03:59:31.935 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : oid=6 cursor=8:c4fdafeb:::6:head 2026-02-12T03:59:31.935 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : seek to 8:c4fdafeb:::6:head 2026-02-12T03:59:31.935 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > 8:c4fdafeb:::6:head -> 6 2026-02-12T03:59:31.935 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : oid=3 cursor=8:cfc208b3:::3:head 2026-02-12T03:59:31.935 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : seek to 8:cfc208b3:::3:head 2026-02-12T03:59:31.935 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > 8:cfc208b3:::3:head -> 3 2026-02-12T03:59:31.935 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : oid=4 cursor=8:d83876eb:::4:head 2026-02-12T03:59:31.935 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : seek to 8:d83876eb:::4:head 2026-02-12T03:59:31.935 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > 8:d83876eb:::4:head -> 4 2026-02-12T03:59:31.935 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : oid=12 cursor=8:de5d7c5f:::12:head 2026-02-12T03:59:31.936 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : seek to 8:de5d7c5f:::12:head 2026-02-12T03:59:31.936 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > 8:de5d7c5f:::12:head -> 12 2026-02-12T03:59:31.936 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : oid=9 cursor=8:e960b815:::9:head 2026-02-12T03:59:31.936 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : seek to 8:e960b815:::9:head 2026-02-12T03:59:31.936 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > 8:e960b815:::9:head -> 9 2026-02-12T03:59:31.936 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : oid=2 cursor=8:f905c69b:::2:head 2026-02-12T03:59:31.936 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : seek to 8:f905c69b:::2:head 2026-02-12T03:59:31.936 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > 8:f905c69b:::2:head -> 2 2026-02-12T03:59:31.936 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : seek to 8:89d3ae78:::11:head 2026-02-12T03:59:31.936 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : cursor()=8:89d3ae78:::11:head expected=8:89d3ae78:::11:head 2026-02-12T03:59:31.936 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > 8:89d3ae78:::11:head -> 11 2026-02-12T03:59:31.936 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : entry=11 expected=11 2026-02-12T03:59:31.936 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : seek to 8:863748b0:::15:head 2026-02-12T03:59:31.937 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : cursor()=8:863748b0:::15:head expected=8:863748b0:::15:head 2026-02-12T03:59:31.937 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > 8:863748b0:::15:head -> 15 2026-02-12T03:59:31.937 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : entry=15 expected=15 2026-02-12T03:59:31.937 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : seek to 8:6cac518f:::0:head 2026-02-12T03:59:31.937 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : cursor()=8:6cac518f:::0:head expected=8:6cac518f:::0:head 2026-02-12T03:59:31.937 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > 8:6cac518f:::0:head -> 0 2026-02-12T03:59:31.937 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : entry=0 expected=0 2026-02-12T03:59:31.937 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : seek to 8:62a1935d:::14:head 2026-02-12T03:59:31.937 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : cursor()=8:62a1935d:::14:head expected=8:62a1935d:::14:head 2026-02-12T03:59:31.937 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > 8:62a1935d:::14:head -> 14 2026-02-12T03:59:31.937 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : entry=14 expected=14 2026-02-12T03:59:31.937 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : seek to 8:5c6b0b28:::7:head 2026-02-12T03:59:31.937 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : cursor()=8:5c6b0b28:::7:head expected=8:5c6b0b28:::7:head 2026-02-12T03:59:31.938 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > 8:5c6b0b28:::7:head -> 7 2026-02-12T03:59:31.938 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : entry=7 expected=7 2026-02-12T03:59:31.938 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : seek to 8:52ea6a34:::10:head 2026-02-12T03:59:31.938 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : cursor()=8:52ea6a34:::10:head expected=8:52ea6a34:::10:head 2026-02-12T03:59:31.938 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > 8:52ea6a34:::10:head -> 10 2026-02-12T03:59:31.938 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : entry=10 expected=10 2026-02-12T03:59:31.938 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : seek to 8:f905c69b:::2:head 2026-02-12T03:59:31.938 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : cursor()=8:f905c69b:::2:head expected=8:f905c69b:::2:head 2026-02-12T03:59:31.938 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > 8:f905c69b:::2:head -> 2 2026-02-12T03:59:31.938 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : entry=2 expected=2 2026-02-12T03:59:31.938 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : seek to 8:e960b815:::9:head 2026-02-12T03:59:31.938 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : cursor()=8:e960b815:::9:head expected=8:e960b815:::9:head 2026-02-12T03:59:31.939 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > 8:e960b815:::9:head -> 9 2026-02-12T03:59:31.939 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : entry=9 expected=9 2026-02-12T03:59:31.939 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : seek to 8:de5d7c5f:::12:head 2026-02-12T03:59:36.375 INFO:tasks.workunit.client.0.trial154.stdout: api_io: Running main() from gmock_main.cc 2026-02-12T03:59:36.375 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [==========] Running 24 tests from 2 test suites. 2026-02-12T03:59:36.375 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [----------] Global test environment set-up. 2026-02-12T03:59:36.376 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [----------] 14 tests from LibRadosIo 2026-02-12T03:59:36.376 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ RUN ] LibRadosIo.SimpleWrite 2026-02-12T03:59:36.376 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ OK ] LibRadosIo.SimpleWrite (2456 ms) 2026-02-12T03:59:36.376 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ RUN ] LibRadosIo.TooBig 2026-02-12T03:59:36.376 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ OK ] LibRadosIo.TooBig (0 ms) 2026-02-12T03:59:36.376 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ RUN ] LibRadosIo.ReadTimeout 2026-02-12T03:59:36.376 INFO:tasks.workunit.client.0.trial154.stdout: api_io: no timeout :/ 2026-02-12T03:59:36.376 INFO:tasks.workunit.client.0.trial154.stdout: api_io: no timeout :/ 2026-02-12T03:59:36.377 INFO:tasks.workunit.client.0.trial154.stdout: api_io: no timeout :/ 2026-02-12T03:59:36.377 INFO:tasks.workunit.client.0.trial154.stdout: api_io: no timeout :/ 2026-02-12T03:59:36.377 INFO:tasks.workunit.client.0.trial154.stdout: api_io: no timeout :/ 2026-02-12T03:59:36.377 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ OK ] LibRadosIo.ReadTimeout (2473 ms) 2026-02-12T03:59:36.377 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ RUN ] LibRadosIo.RoundTrip 2026-02-12T03:59:36.377 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ OK ] LibRadosIo.RoundTrip (296 ms) 2026-02-12T03:59:36.377 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ RUN ] LibRadosIo.Checksum 2026-02-12T03:59:36.377 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ OK ] LibRadosIo.Checksum (40 ms) 2026-02-12T03:59:36.378 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2026-02-12T03:59:36.378 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ OK ] LibRadosIo.OverlappingWriteRoundTrip (84 ms) 2026-02-12T03:59:36.378 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ RUN ] LibRadosIo.WriteFullRoundTrip 2026-02-12T03:59:36.378 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ OK ] LibRadosIo.WriteFullRoundTrip (68 ms) 2026-02-12T03:59:36.378 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ RUN ] LibRadosIo.AppendRoundTrip 2026-02-12T03:59:36.378 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ OK ] LibRadosIo.AppendRoundTrip (51 ms) 2026-02-12T03:59:36.378 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ RUN ] LibRadosIo.ZeroLenZero 2026-02-12T03:59:36.378 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ OK ] LibRadosIo.ZeroLenZero (54 ms) 2026-02-12T03:59:36.378 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ RUN ] LibRadosIo.TruncTest 2026-02-12T03:59:36.379 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ OK ] LibRadosIo.TruncTest (67 ms) 2026-02-12T03:59:36.379 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ RUN ] LibRadosIo.RemoveTest 2026-02-12T03:59:36.379 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ OK ] LibRadosIo.RemoveTest (37 ms) 2026-02-12T03:59:36.379 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ RUN ] LibRadosIo.XattrsRoundTrip 2026-02-12T03:59:36.379 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ OK ] LibRadosIo.XattrsRoundTrip (48 ms) 2026-02-12T03:59:36.379 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ RUN ] LibRadosIo.RmXattr 2026-02-12T03:59:36.379 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ OK ] LibRadosIo.RmXattr (1261 ms) 2026-02-12T03:59:36.379 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ RUN ] LibRadosIo.XattrIter 2026-02-12T03:59:36.380 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ OK ] LibRadosIo.XattrIter (1824 ms) 2026-02-12T03:59:36.380 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [----------] 14 tests from LibRadosIo (8766 ms total) 2026-02-12T03:59:36.380 INFO:tasks.workunit.client.0.trial154.stdout: api_io: 2026-02-12T03:59:36.380 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [----------] 10 tests from LibRadosIoEC 2026-02-12T03:59:36.380 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ RUN ] LibRadosIoEC.SimpleWrite 2026-02-12T03:59:36.380 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ OK ] LibRadosIoEC.SimpleWrite (1986 ms) 2026-02-12T03:59:36.380 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ RUN ] LibRadosIoEC.RoundTrip 2026-02-12T03:59:36.380 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ OK ] LibRadosIoEC.RoundTrip (656 ms) 2026-02-12T03:59:36.381 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2026-02-12T03:59:36.381 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ OK ] LibRadosIoEC.OverlappingWriteRoundTrip (209 ms) 2026-02-12T03:59:36.381 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ RUN ] LibRadosIoEC.WriteFullRoundTrip 2026-02-12T03:59:36.381 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ OK ] LibRadosIoEC.WriteFullRoundTrip (87 ms) 2026-02-12T03:59:36.381 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ RUN ] LibRadosIoEC.AppendRoundTrip 2026-02-12T03:59:36.381 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ OK ] LibRadosIoEC.AppendRoundTrip (2162 ms) 2026-02-12T03:59:36.381 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ RUN ] LibRadosIoEC.TruncTest 2026-02-12T03:59:36.381 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ OK ] LibRadosIoEC.TruncTest (401 ms) 2026-02-12T03:59:36.381 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ RUN ] LibRadosIoEC.RemoveTest 2026-02-12T03:59:36.382 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ OK ] LibRadosIoEC.RemoveTest (152 ms) 2026-02-12T03:59:36.382 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ RUN ] LibRadosIoEC.XattrsRoundTrip 2026-02-12T03:59:36.382 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ OK ] LibRadosIoEC.XattrsRoundTrip (87 ms) 2026-02-12T03:59:36.382 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ RUN ] LibRadosIoEC.RmXattr 2026-02-12T03:59:36.382 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ OK ] LibRadosIoEC.RmXattr (889 ms) 2026-02-12T03:59:36.382 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ RUN ] LibRadosIoEC.XattrIter 2026-02-12T03:59:36.382 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ OK ] LibRadosIoEC.XattrIter (86 ms) 2026-02-12T03:59:36.382 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [----------] 10 tests from LibRadosIoEC (6719 ms total) 2026-02-12T03:59:36.383 INFO:tasks.workunit.client.0.trial154.stdout: api_io: 2026-02-12T03:59:36.383 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [----------] Global test environment tear-down 2026-02-12T03:59:36.384 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [==========] 24 tests from 2 test suites ran. (27098 ms total) 2026-02-12T03:59:36.384 INFO:tasks.workunit.client.0.trial154.stdout: api_io: [ PASSED ] 24 tests. 2026-02-12T03:59:36.593 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: Running main() from gmock_main.cc 2026-02-12T03:59:36.593 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [==========] Running 16 tests from 2 test suites. 2026-02-12T03:59:36.593 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [----------] Global test environment set-up. 2026-02-12T03:59:36.593 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP 2026-02-12T03:59:36.593 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: seed 30026 2026-02-12T03:59:36.593 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusivePP 2026-02-12T03:59:36.594 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusivePP (2485 ms) 2026-02-12T03:59:36.594 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedPP 2026-02-12T03:59:36.594 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedPP (905 ms) 2026-02-12T03:59:36.594 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusiveDurPP 2026-02-12T03:59:36.594 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusiveDurPP (1510 ms) 2026-02-12T03:59:36.594 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedDurPP 2026-02-12T03:59:36.594 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedDurPP (1661 ms) 2026-02-12T03:59:36.594 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockMayRenewPP 2026-02-12T03:59:36.594 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockMayRenewPP (1065 ms) 2026-02-12T03:59:36.594 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.UnlockPP 2026-02-12T03:59:36.594 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [ OK ] LibRadosLockPP.UnlockPP (209 ms) 2026-02-12T03:59:36.594 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.ListLockersPP 2026-02-12T03:59:36.595 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [ OK ] LibRadosLockPP.ListLockersPP (969 ms) 2026-02-12T03:59:36.595 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.BreakLockPP 2026-02-12T03:59:36.595 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [ OK ] LibRadosLockPP.BreakLockPP (72 ms) 2026-02-12T03:59:36.595 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP (8879 ms total) 2026-02-12T03:59:36.595 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: 2026-02-12T03:59:36.595 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP 2026-02-12T03:59:36.595 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusivePP 2026-02-12T03:59:36.595 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusivePP (1638 ms) 2026-02-12T03:59:36.595 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedPP 2026-02-12T03:59:36.595 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedPP (44 ms) 2026-02-12T03:59:36.595 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2026-02-12T03:59:36.595 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusiveDurPP (1764 ms) 2026-02-12T03:59:36.595 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedDurPP 2026-02-12T03:59:36.596 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedDurPP (1062 ms) 2026-02-12T03:59:36.596 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockMayRenewPP 2026-02-12T03:59:36.596 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockMayRenewPP (157 ms) 2026-02-12T03:59:36.596 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.UnlockPP 2026-02-12T03:59:36.596 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.UnlockPP (692 ms) 2026-02-12T03:59:36.596 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.ListLockersPP 2026-02-12T03:59:36.596 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.ListLockersPP (202 ms) 2026-02-12T03:59:36.596 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.BreakLockPP 2026-02-12T03:59:36.596 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.BreakLockPP (80 ms) 2026-02-12T03:59:36.596 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP (5643 ms total) 2026-02-12T03:59:36.596 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: 2026-02-12T03:59:36.596 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [----------] Global test environment tear-down 2026-02-12T03:59:36.597 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [==========] 16 tests from 2 test suites ran. (27302 ms total) 2026-02-12T03:59:36.597 INFO:tasks.workunit.client.0.trial154.stdout: api_lock_pp: [ PASSED ] 16 tests. 2026-02-12T03:59:36.832 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: Running main() from gmock_main.cc 2026-02-12T03:59:36.832 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [==========] Running 16 tests from 2 test suites. 2026-02-12T03:59:36.832 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [----------] Global test environment set-up. 2026-02-12T03:59:36.832 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [----------] 8 tests from LibRadosLock 2026-02-12T03:59:36.832 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusive 2026-02-12T03:59:36.833 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [ OK ] LibRadosLock.LockExclusive (3538 ms) 2026-02-12T03:59:36.833 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [ RUN ] LibRadosLock.LockShared 2026-02-12T03:59:36.833 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [ OK ] LibRadosLock.LockShared (215 ms) 2026-02-12T03:59:36.833 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusiveDur 2026-02-12T03:59:36.833 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [ OK ] LibRadosLock.LockExclusiveDur (1222 ms) 2026-02-12T03:59:36.833 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [ RUN ] LibRadosLock.LockSharedDur 2026-02-12T03:59:36.833 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [ OK ] LibRadosLock.LockSharedDur (1459 ms) 2026-02-12T03:59:36.834 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [ RUN ] LibRadosLock.LockMayRenew 2026-02-12T03:59:36.834 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [ OK ] LibRadosLock.LockMayRenew (1085 ms) 2026-02-12T03:59:36.834 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [ RUN ] LibRadosLock.Unlock 2026-02-12T03:59:36.834 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [ OK ] LibRadosLock.Unlock (59 ms) 2026-02-12T03:59:36.834 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [ RUN ] LibRadosLock.ListLockers 2026-02-12T03:59:36.834 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [ OK ] LibRadosLock.ListLockers (108 ms) 2026-02-12T03:59:36.835 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [ RUN ] LibRadosLock.BreakLock 2026-02-12T03:59:36.835 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [ OK ] LibRadosLock.BreakLock (646 ms) 2026-02-12T03:59:36.835 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [----------] 8 tests from LibRadosLock (8334 ms total) 2026-02-12T03:59:36.835 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: 2026-02-12T03:59:36.835 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [----------] 8 tests from LibRadosLockEC 2026-02-12T03:59:36.835 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusive 2026-02-12T03:59:36.835 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusive (2583 ms) 2026-02-12T03:59:36.836 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [ RUN ] LibRadosLockEC.LockShared 2026-02-12T03:59:36.836 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [ OK ] LibRadosLockEC.LockShared (95 ms) 2026-02-12T03:59:36.836 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusiveDur 2026-02-12T03:59:36.836 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusiveDur (1420 ms) 2026-02-12T03:59:36.836 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [ RUN ] LibRadosLockEC.LockSharedDur 2026-02-12T03:59:36.836 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [ OK ] LibRadosLockEC.LockSharedDur (1377 ms) 2026-02-12T03:59:36.836 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [ RUN ] LibRadosLockEC.LockMayRenew 2026-02-12T03:59:36.836 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [ OK ] LibRadosLockEC.LockMayRenew (78 ms) 2026-02-12T03:59:36.836 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [ RUN ] LibRadosLockEC.Unlock 2026-02-12T03:59:36.837 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [ OK ] LibRadosLockEC.Unlock (163 ms) 2026-02-12T03:59:36.837 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [ RUN ] LibRadosLockEC.ListLockers 2026-02-12T03:59:36.837 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [ OK ] LibRadosLockEC.ListLockers (773 ms) 2026-02-12T03:59:36.837 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [ RUN ] LibRadosLockEC.BreakLock 2026-02-12T03:59:36.837 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [ OK ] LibRadosLockEC.BreakLock (64 ms) 2026-02-12T03:59:36.837 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [----------] 8 tests from LibRadosLockEC (6558 ms total) 2026-02-12T03:59:36.837 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: 2026-02-12T03:59:36.837 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [----------] Global test environment tear-down 2026-02-12T03:59:36.838 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [==========] 16 tests from 2 test suites ran. (27542 ms total) 2026-02-12T03:59:36.838 INFO:tasks.workunit.client.0.trial154.stdout: api_lock: [ PASSED ] 16 tests. 2026-02-12T03:59:37.490 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_1_[30614]: starting. 2026-02-12T03:59:37.490 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_1_[30614]: creating pool ceph_test_rados_list_parallel.trial154-30523 2026-02-12T03:59:37.490 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_1_[30614]: created object 0... 2026-02-12T03:59:37.490 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_1_[30614]: created object 25... 2026-02-12T03:59:37.491 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_1_[30614]: created object 49... 2026-02-12T03:59:37.491 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_1_[30614]: finishing. 2026-02-12T03:59:37.491 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_1_[30614]: shutting down. 2026-02-12T03:59:37.491 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_2_[30616]: starting. 2026-02-12T03:59:37.491 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_2_[30616]: listing objects. 2026-02-12T03:59:37.491 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_2_[30616]: listed object 0... 2026-02-12T03:59:37.492 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_2_[30616]: listed object 25... 2026-02-12T03:59:37.492 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_2_[30616]: saw 50 objects 2026-02-12T03:59:37.492 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_2_[30616]: shutting down. 2026-02-12T03:59:37.492 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:37.492 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_3_[32161]: starting. 2026-02-12T03:59:37.492 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_3_[32161]: creating pool ceph_test_rados_list_parallel.trial154-30523 2026-02-12T03:59:37.493 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_3_[32161]: created object 0... 2026-02-12T03:59:37.493 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_3_[32161]: created object 25... 2026-02-12T03:59:37.493 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_3_[32161]: created object 49... 2026-02-12T03:59:37.493 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_3_[32161]: finishing. 2026-02-12T03:59:37.493 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_3_[32161]: shutting down. 2026-02-12T03:59:37.494 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:37.494 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_4_[32162]: starting. 2026-02-12T03:59:37.494 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_4_[32162]: listing objects. 2026-02-12T03:59:37.494 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_4_[32162]: listed object 0... 2026-02-12T03:59:37.494 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_4_[32162]: listed object 25... 2026-02-12T03:59:37.494 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_4_[32162]: saw 45 objects 2026-02-12T03:59:37.495 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_4_[32162]: shutting down. 2026-02-12T03:59:37.495 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:37.495 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_5_[32163]: starting. 2026-02-12T03:59:37.495 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_5_[32163]: removed 25 objects... 2026-02-12T03:59:37.495 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_5_[32163]: removed half of the objects 2026-02-12T03:59:37.495 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_5_[32163]: removed 50 objects... 2026-02-12T03:59:37.496 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_5_[32163]: removed 50 objects 2026-02-12T03:59:37.496 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_5_[32163]: shutting down. 2026-02-12T03:59:37.496 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:37.496 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:37.496 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_6_[34640]: starting. 2026-02-12T03:59:37.496 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_6_[34640]: creating pool ceph_test_rados_list_parallel.trial154-30523 2026-02-12T03:59:37.497 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_6_[34640]: created object 0... 2026-02-12T03:59:37.497 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_6_[34640]: created object 25... 2026-02-12T03:59:37.497 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_6_[34640]: created object 49... 2026-02-12T03:59:37.497 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_6_[34640]: finishing. 2026-02-12T03:59:37.497 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_6_[34640]: shutting down. 2026-02-12T03:59:37.498 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:37.498 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:37.498 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_7_[34641]: starting. 2026-02-12T03:59:37.498 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_7_[34641]: listing objects. 2026-02-12T03:59:37.498 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_7_[34641]: listed object 0... 2026-02-12T03:59:37.498 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_7_[34641]: listed object 25... 2026-02-12T03:59:37.499 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_7_[34641]: listed object 50... 2026-02-12T03:59:37.499 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_7_[34641]: saw 57 objects 2026-02-12T03:59:37.499 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_7_[34641]: shutting down. 2026-02-12T03:59:37.499 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:37.499 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:37.499 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_8_[34642]: starting. 2026-02-12T03:59:37.500 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_8_[34642]: added 25 objects... 2026-02-12T03:59:37.500 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_8_[34642]: added half of the objects 2026-02-12T03:59:37.500 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_8_[34642]: added 50 objects... 2026-02-12T03:59:37.500 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_8_[34642]: added 50 objects 2026-02-12T03:59:37.500 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_8_[34642]: shutting down. 2026-02-12T03:59:37.500 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:37.501 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:39.179 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:02:00.064 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T03:59:39.187 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:02:00.071 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T03:59:39.261 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:02:00.145 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T03:59:39.395 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:02:00.242 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T03:59:39.414 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:02:00.294 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T03:59:39.465 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:02:00.345 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T03:59:39.472 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:02:00.319 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T03:59:39.525 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:02:00.405 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T03:59:39.543 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:02:00.390 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T03:59:41.814 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: *************************ce: pools: 28 pools, 817 pgs 2026-02-12T03:59:41.814 INFO:tasks.workunit.client.0.trial154.stdout: api_service: objects: 158 objects, 477 KiB 2026-02-12T03:59:41.815 INFO:tasks.workunit.client.0.trial154.stdout: api_service: usage: 428 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-12T03:59:41.815 INFO:tasks.workunit.client.0.trial154.stdout: api_service: pgs: 22.644% pgs unknown 2026-02-12T03:59:41.815 INFO:tasks.workunit.client.0.trial154.stdout: api_service: 20.073% pgs not active 2026-02-12T03:59:41.815 INFO:tasks.workunit.client.0.trial154.stdout: api_service: 468 active+clean 2026-02-12T03:59:41.815 INFO:tasks.workunit.client.0.trial154.stdout: api_service: 185 unknown 2026-02-12T03:59:41.815 INFO:tasks.workunit.client.0.trial154.stdout: api_service: 136 creating+peering 2026-02-12T03:59:41.815 INFO:tasks.workunit.client.0.trial154.stdout: api_service: 28 creating+activating 2026-02-12T03:59:41.815 INFO:tasks.workunit.client.0.trial154.stdout: api_service: 2026-02-12T03:59:41.815 INFO:tasks.workunit.client.0.trial154.stdout: api_service: io: 2026-02-12T03:59:41.815 INFO:tasks.workunit.client.0.trial154.stdout: api_service: client: 10 KiB/s rd, 54 KiB/s wr, 19 op/s rd, 67 op/s wr 2026-02-12T03:59:41.816 INFO:tasks.workunit.client.0.trial154.stdout: api_service: 2026-02-12T03:59:41.816 INFO:tasks.workunit.client.0.trial154.stdout: api_service: 2026-02-12T03:59:41.816 INFO:tasks.workunit.client.0.trial154.stdout: api_service: [ OK ] LibRadosService.StatusFormat (7049 ms) 2026-02-12T03:59:41.816 INFO:tasks.workunit.client.0.trial154.stdout: api_service: [ RUN ] LibRadosService.Status 2026-02-12T03:59:41.816 INFO:tasks.workunit.client.0.trial154.stdout: api_service: [ OK ] LibRadosService.Status (20023 ms) 2026-02-12T03:59:41.816 INFO:tasks.workunit.client.0.trial154.stdout: api_service: [----------] 4 tests from LibRadosService (32482 ms total) 2026-02-12T03:59:41.816 INFO:tasks.workunit.client.0.trial154.stdout: api_service: 2026-02-12T03:59:41.816 INFO:tasks.workunit.client.0.trial154.stdout: api_service: [----------] Global test environment tear-down 2026-02-12T03:59:41.816 INFO:tasks.workunit.client.0.trial154.stdout: api_service: [==========] 4 tests from 1 test suite ran. (32482 ms total) 2026-02-12T03:59:41.816 INFO:tasks.workunit.client.0.trial154.stdout: api_service: [ PASSED ] 4 tests. 2026-02-12T03:59:42.832 INFO:tasks.workunit.client.0.trial154.stdout:****** 2026-02-12T03:59:42.832 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_9_[39333]: starting. 2026-02-12T03:59:42.832 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_9_[39333]: creating pool ceph_test_rados_list_parallel.trial154-30523 2026-02-12T03:59:42.832 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_9_[39333]: created object 0... 2026-02-12T03:59:42.832 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_9_[39333]: created object 25... 2026-02-12T03:59:42.832 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_9_[39333]: created object 49... 2026-02-12T03:59:42.832 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_9_[39333]: finishing. 2026-02-12T03:59:42.832 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_9_[39333]: shutting down. 2026-02-12T03:59:42.833 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:42.833 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:42.833 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:42.833 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_10_[39334]: starting. 2026-02-12T03:59:42.833 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_10_[39334]: listing objects. 2026-02-12T03:59:42.833 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_10_[39334]: listed object 0... 2026-02-12T03:59:42.833 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_10_[39334]: listed object 25... 2026-02-12T03:59:42.833 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_10_[39334]: listed object 50... 2026-02-12T03:59:42.833 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_10_[39334]: listed object 75... 2026-02-12T03:59:42.833 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_10_[39334]: saw 97 objects 2026-02-12T03:59:42.833 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_10_[39334]: shutting down. 2026-02-12T03:59:42.833 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:42.833 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:42.834 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:42.834 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_13_[39337]: starting. 2026-02-12T03:59:42.834 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_13_[39337]: removed 25 objects... 2026-02-12T03:59:42.834 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_13_[39337]: removed half of the objects 2026-02-12T03:59:42.834 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_13_[39337]: removed 50 objects... 2026-02-12T03:59:42.834 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_13_[39337]: removed 50 objects 2026-02-12T03:59:42.834 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_13_[39337]: shutting down. 2026-02-12T03:59:42.834 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:42.834 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:42.834 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:42.834 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_11_[39335]: starting. 2026-02-12T03:59:42.834 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_11_[39335]: added 25 objects... 2026-02-12T03:59:42.835 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_11_[39335]: added half of the objects 2026-02-12T03:59:42.835 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_11_[39335]: added 50 objects... 2026-02-12T03:59:42.835 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_11_[39335]: added 50 objects 2026-02-12T03:59:42.835 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_11_[39335]: shutting down. 2026-02-12T03:59:42.835 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:42.835 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:42.835 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:42.835 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_12_[39336]: starting. 2026-02-12T03:59:42.835 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_12_[39336]: added 25 objects... 2026-02-12T03:59:42.835 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_12_[39336]: added half of the objects 2026-02-12T03:59:42.835 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_12_[39336]: added 50 objects... 2026-02-12T03:59:42.835 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_12_[39336]: added 50 objects 2026-02-12T03:59:42.835 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_12_[39336]: shutting down. 2026-02-12T03:59:42.836 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:42.836 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:42.836 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:42.836 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:42.836 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_14_[43665]: starting. 2026-02-12T03:59:42.836 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_14_[43665]: creating pool ceph_test_rados_list_parallel.trial154-30523 2026-02-12T03:59:42.836 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_14_[43665]: created object 0... 2026-02-12T03:59:42.836 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_14_[43665]: created object 25... 2026-02-12T03:59:42.836 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_14_[43665]: created object 49... 2026-02-12T03:59:42.836 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_14_[43665]: finishing. 2026-02-12T03:59:42.836 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_14_[43665]: shutting down. 2026-02-12T03:59:42.836 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:42.837 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:42.837 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:42.837 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:42.837 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_15_[43666]: starting. 2026-02-12T03:59:42.837 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_15_[43666]: listing objects. 2026-02-12T03:59:42.837 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_15_[43666]: listed object 0... 2026-02-12T03:59:42.837 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_15_[43666]: listed object 25... 2026-02-12T03:59:43.948 INFO:tasks.workunit.client.0.trial154.stdout: list: Running main() from gmock_main.cc 2026-02-12T03:59:43.948 INFO:tasks.workunit.client.0.trial154.stdout: list: [==========] Running 3 tests from 1 test suite. 2026-02-12T03:59:43.949 INFO:tasks.workunit.client.0.trial154.stdout: list: [----------] Global test environment set-up. 2026-02-12T03:59:43.949 INFO:tasks.workunit.client.0.trial154.stdout: list: [----------] 3 tests from NeoradosList 2026-02-12T03:59:43.949 INFO:tasks.workunit.client.0.trial154.stdout: list: [ RUN ] NeoradosList.ListObjects 2026-02-12T03:59:43.949 INFO:tasks.workunit.client.0.trial154.stdout: list: [ OK ] NeoradosList.ListObjects (7923 ms) 2026-02-12T03:59:43.949 INFO:tasks.workunit.client.0.trial154.stdout: list: [ RUN ] NeoradosList.ListObjectsNS 2026-02-12T03:59:43.949 INFO:tasks.workunit.client.0.trial154.stdout: list: [ OK ] NeoradosList.ListObjectsNS (7138 ms) 2026-02-12T03:59:43.949 INFO:tasks.workunit.client.0.trial154.stdout: list: [ RUN ] NeoradosList.ListObjectsMany 2026-02-12T03:59:43.950 INFO:tasks.workunit.client.0.trial154.stdout: list: [ OK ] NeoradosList.ListObjectsMany (19525 ms) 2026-02-12T03:59:43.950 INFO:tasks.workunit.client.0.trial154.stdout: list: [----------] 3 tests from NeoradosList (34587 ms total) 2026-02-12T03:59:43.950 INFO:tasks.workunit.client.0.trial154.stdout: list: 2026-02-12T03:59:43.950 INFO:tasks.workunit.client.0.trial154.stdout: list: [----------] Global test environment tear-down 2026-02-12T03:59:43.950 INFO:tasks.workunit.client.0.trial154.stdout: list: [==========] 3 tests from 1 test suite ran. (34587 ms total) 2026-02-12T03:59:43.950 INFO:tasks.workunit.client.0.trial154.stdout: list: [ PASSED ] 3 tests. 2026-02-12T03:59:45.422 INFO:tasks.workunit.client.0.trial154.stdout: api_service_pp: [==========] Running 4 tests from 1 test suite. 2026-02-12T03:59:45.423 INFO:tasks.workunit.client.0.trial154.stdout: api_service_pp: [----------] Global test environment set-up. 2026-02-12T03:59:45.423 INFO:tasks.workunit.client.0.trial154.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2026-02-12T03:59:45.423 INFO:tasks.workunit.client.0.trial154.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2026-02-12T03:59:45.423 INFO:tasks.workunit.client.0.trial154.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (5422 ms) 2026-02-12T03:59:45.423 INFO:tasks.workunit.client.0.trial154.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2026-02-12T03:59:45.423 INFO:tasks.workunit.client.0.trial154.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (994 ms) 2026-02-12T03:59:45.423 INFO:tasks.workunit.client.0.trial154.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2026-02-12T03:59:45.423 INFO:tasks.workunit.client.0.trial154.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (20156 ms) 2026-02-12T03:59:45.423 INFO:tasks.workunit.client.0.trial154.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2026-02-12T03:59:45.423 INFO:tasks.workunit.client.0.trial154.stdout: api_service_pp: attempt 0 of 20 2026-02-12T03:59:45.423 INFO:tasks.workunit.client.0.trial154.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (9514 ms) 2026-02-12T03:59:45.423 INFO:tasks.workunit.client.0.trial154.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (36087 ms total) 2026-02-12T03:59:45.423 INFO:tasks.workunit.client.0.trial154.stdout: api_service_pp: 2026-02-12T03:59:45.423 INFO:tasks.workunit.client.0.trial154.stdout: api_service_pp: [----------] Global test environment tear-down 2026-02-12T03:59:45.423 INFO:tasks.workunit.client.0.trial154.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (36087 ms total) 2026-02-12T03:59:45.423 INFO:tasks.workunit.client.0.trial154.stdout: api_service_pp: [ PASSED ] 4 tests. 2026-02-12T03:59:48.371 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_15_[43666]: listed object 50... 2026-02-12T03:59:48.371 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_15_[43666]: listed object 75... 2026-02-12T03:59:48.372 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_15_[43666]: listed object 100... 2026-02-12T03:59:48.372 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_15_[43666]: listed object 125... 2026-02-12T03:59:48.372 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_15_[43666]: saw 150 objects 2026-02-12T03:59:48.372 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_15_[43666]: shutting down. 2026-02-12T03:59:48.372 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:48.372 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:48.372 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:48.372 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:48.372 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_16_[43667]: starting. 2026-02-12T03:59:48.372 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_16_[43667]: added 25 objects... 2026-02-12T03:59:48.372 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_16_[43667]: added half of the objects 2026-02-12T03:59:48.373 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_16_[43667]: added 50 objects... 2026-02-12T03:59:48.373 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_16_[43667]: added 50 objects 2026-02-12T03:59:48.373 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: process_16_[43667]: shutting down. 2026-02-12T03:59:48.373 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:48.373 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:48.373 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:48.373 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:48.373 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******************************* 2026-02-12T03:59:48.373 INFO:tasks.workunit.client.0.trial154.stdout: list_parallel: ******* SUCCESS ********** 2026-02-12T03:59:49.808 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: Running main() from gmock_main.cc 2026-02-12T03:59:49.808 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [==========] Running 40 tests from 2 test suites. 2026-02-12T03:59:49.808 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [----------] Global test environment set-up. 2026-02-12T03:59:49.808 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [----------] 22 tests from LibRadosIoPP 2026-02-12T03:59:49.808 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: seed 29939 2026-02-12T03:59:49.808 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TooBigPP 2026-02-12T03:59:49.809 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoPP.TooBigPP (0 ms) 2026-02-12T03:59:49.809 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SimpleWritePP 2026-02-12T03:59:49.809 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoPP.SimpleWritePP (2321 ms) 2026-02-12T03:59:49.809 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadOpPP 2026-02-12T03:59:49.809 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadOpPP (1539 ms) 2026-02-12T03:59:49.809 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadOpPP 2026-02-12T03:59:49.809 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadOpPP (35 ms) 2026-02-12T03:59:49.809 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadExtentArrayOpPP 2026-02-12T03:59:49.809 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadExtentArrayOpPP (12990 ms) 2026-02-12T03:59:49.809 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP 2026-02-12T03:59:49.809 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP (641 ms) 2026-02-12T03:59:49.810 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP2 2026-02-12T03:59:49.810 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP2 (67 ms) 2026-02-12T03:59:49.810 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoPP.Checksum 2026-02-12T03:59:49.810 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoPP.Checksum (33 ms) 2026-02-12T03:59:49.810 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadIntoBufferlist 2026-02-12T03:59:49.810 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadIntoBufferlist (24 ms) 2026-02-12T03:59:49.810 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2026-02-12T03:59:49.810 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (47 ms) 2026-02-12T03:59:49.810 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2026-02-12T03:59:49.810 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP (64 ms) 2026-02-12T03:59:49.810 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2026-02-12T03:59:49.810 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (20 ms) 2026-02-12T03:59:49.810 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoPP.AppendRoundTripPP 2026-02-12T03:59:49.811 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoPP.AppendRoundTripPP (33 ms) 2026-02-12T03:59:49.811 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TruncTestPP 2026-02-12T03:59:49.811 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoPP.TruncTestPP (231 ms) 2026-02-12T03:59:49.811 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RemoveTestPP 2026-02-12T03:59:49.811 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoPP.RemoveTestPP (527 ms) 2026-02-12T03:59:49.811 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrsRoundTripPP 2026-02-12T03:59:49.811 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrsRoundTripPP (41 ms) 2026-02-12T03:59:49.811 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RmXattrPP 2026-02-12T03:59:49.811 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoPP.RmXattrPP (156 ms) 2026-02-12T03:59:49.811 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrListPP 2026-02-12T03:59:49.811 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrListPP (55 ms) 2026-02-12T03:59:49.811 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CrcZeroWrite 2026-02-12T03:59:49.811 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoPP.CrcZeroWrite (38 ms) 2026-02-12T03:59:49.811 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtPP 2026-02-12T03:59:49.812 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtPP (46 ms) 2026-02-12T03:59:49.812 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtDNEPP 2026-02-12T03:59:49.812 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtDNEPP (51 ms) 2026-02-12T03:59:49.812 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtMismatchPP 2026-02-12T03:59:49.812 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtMismatchPP (47 ms) 2026-02-12T03:59:49.812 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [----------] 22 tests from LibRadosIoPP (19014 ms total) 2026-02-12T03:59:49.812 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: 2026-02-12T03:59:49.812 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [----------] 18 tests from LibRadosIoECPP 2026-02-12T03:59:49.812 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SimpleWritePP 2026-02-12T03:59:49.812 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SimpleWritePP (3620 ms) 2026-02-12T03:59:49.812 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.ReadOpPP 2026-02-12T03:59:49.812 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoECPP.ReadOpPP (140 ms) 2026-02-12T03:59:49.812 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SparseReadOpPP 2026-02-12T03:59:57.312 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SparseRead_notify_pp: trying... 2026-02-12T03:59:57.312 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: handle_notify cookie 94241838085120 notify_id 206158430212 notifier_gid 5221 2026-02-12T03:59:57.312 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: timed out 2026-02-12T03:59:57.312 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: flushing 2026-02-12T03:59:57.313 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: flushed 2026-02-12T03:59:57.313 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3489 ms) 2026-02-12T03:59:57.313 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2026-02-12T03:59:57.313 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: trying... 2026-02-12T03:59:57.313 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: handle_notify cookie 94241838085120 notify_id 214748364802 notifier_gid 5221 2026-02-12T03:59:57.313 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: timed out 2026-02-12T03:59:57.313 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: flushing 2026-02-12T03:59:57.313 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: flushed 2026-02-12T03:59:57.313 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3067 ms) 2026-02-12T03:59:57.313 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2026-02-12T03:59:57.313 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: List watches 2026-02-12T03:59:57.313 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: notify2 2026-02-12T03:59:57.314 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: handle_notify cookie 94241838085120 notify_id 219043332101 notifier_gid 5221 2026-02-12T03:59:57.314 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: notify2 done 2026-02-12T03:59:57.314 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: watch_check 2026-02-12T03:59:57.314 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: unwatch2 2026-02-12T03:59:57.314 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: flushing 2026-02-12T03:59:57.314 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: done 2026-02-12T03:59:57.314 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3068 ms) 2026-02-12T03:59:57.314 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2026-02-12T03:59:57.314 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: List watches 2026-02-12T03:59:57.314 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: notify2 2026-02-12T03:59:57.314 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: handle_notify cookie 94241838085120 notify_id 227633266694 notifier_gid 5221 2026-02-12T03:59:57.314 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: notify2 done 2026-02-12T03:59:57.315 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: watch_check 2026-02-12T03:59:57.315 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: unwatch2 2026-02-12T03:59:57.315 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: flushing 2026-02-12T03:59:57.315 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: done 2026-02-12T03:59:57.315 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3071 ms) 2026-02-12T03:59:57.315 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (19383 ms total) 2026-02-12T03:59:57.315 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: 2026-02-12T03:59:57.315 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [----------] Global test environment tear-down 2026-02-12T03:59:57.315 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [==========] 16 tests from 2 test suites ran. (47998 ms total) 2026-02-12T03:59:57.315 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify_pp: [ PASSED ] 16 tests. 2026-02-12T03:59:58.703 INFO:tasks.workunit.client.0.trial154.stdout: watch_notify: Running main() from gmock_main.cc 2026-02-12T03:59:58.703 INFO:tasks.workunit.client.0.trial154.stdout: watch_notify: [==========] Running 6 tests from 2 test suites. 2026-02-12T03:59:58.703 INFO:tasks.workunit.client.0.trial154.stdout: watch_notify: [----------] Global test environment set-up. 2026-02-12T03:59:58.703 INFO:tasks.workunit.client.0.trial154.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify 2026-02-12T03:59:58.703 INFO:tasks.workunit.client.0.trial154.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotify 2026-02-12T03:59:58.704 INFO:tasks.workunit.client.0.trial154.stdout: watch_notify: handle_notify cookie 93852174797504 notify_id 141733920768 notifier_gid 4884 2026-02-12T03:59:58.704 INFO:tasks.workunit.client.0.trial154.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotify (8001 ms) 2026-02-12T03:59:58.704 INFO:tasks.workunit.client.0.trial154.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotifyTimeout 2026-02-12T03:59:58.704 INFO:tasks.workunit.client.0.trial154.stdout: watch_notify: Trying... 2026-02-12T03:59:58.704 INFO:tasks.workunit.client.0.trial154.stdout: watch_notify: handle_notify cookie 93852187617264 notify_id 158913789952 notifier_gid 5058 2026-02-12T03:59:58.704 INFO:tasks.workunit.client.0.trial154.stdout: watch_notify: Waiting for 3.000000000s 2026-02-12T03:59:58.704 INFO:tasks.workunit.client.0.trial154.stdout: watch_notify: Timed out. 2026-02-12T03:59:58.704 INFO:tasks.workunit.client.0.trial154.stdout: watch_notify: Flushing... 2026-02-12T03:59:58.704 INFO:tasks.workunit.client.0.trial154.stdout: watch_notify: Flushed... 2026-02-12T03:59:58.704 INFO:tasks.workunit.client.0.trial154.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotifyTimeout (7046 ms) 2026-02-12T03:59:58.704 INFO:tasks.workunit.client.0.trial154.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify (15048 ms total) 2026-02-12T03:59:58.704 INFO:tasks.workunit.client.0.trial154.stdout: watch_notify: 2026-02-12T03:59:58.705 INFO:tasks.workunit.client.0.trial154.stdout: watch_notify: [----------] 4 tests from NeoRadosWatchNotifyPoll 2026-02-12T03:59:58.705 INFO:tasks.workunit.client.0.trial154.stdout: watch_notify: [ RUN ] NeoRadosWatchNotifyPoll.WatchNotify 2026-02-12T03:59:58.705 INFO:tasks.workunit.client.0.trial154.stdout: watch_notify: [ OK ] NeoRadosWatchNotifyPoll.WatchNotify (3133 ms) 2026-02-12T03:59:58.705 INFO:tasks.workunit.client.0.trial154.stdout: watch_notify: [ RUN ] NeoRadosWatchNotifyPoll.WatchNotifyTimeout 2026-02-12T03:59:58.705 INFO:tasks.workunit.client.0.trial154.stdout: watch_notify: [ OK ] NeoRadosWatchNotifyPoll.WatchNotifyTimeout (5452 ms) 2026-02-12T03:59:58.705 INFO:tasks.workunit.client.0.trial154.stdout: watch_notify: [ RUN ] NeoRadosWatchNotifyPoll.WrongWatchType 2026-02-12T03:59:58.705 INFO:tasks.workunit.client.0.trial154.stdout: watch_notify: [ OK ] NeoRadosWatchNotifyPoll.WrongWatchType (11294 ms) 2026-02-12T03:59:58.705 INFO:tasks.workunit.client.0.trial154.stdout: watch_notify: [ RUN ] NeoRadosWatchNotifyPoll.WatchNotifyCancel 2026-02-12T03:59:58.705 INFO:tasks.workunit.client.0.trial154.stdout: watch_notify: [ OK ] NeoRadosWatchNotifyPoll.WatchNotifyCancel (14398 ms) 2026-02-12T03:59:58.705 INFO:tasks.workunit.client.0.trial154.stdout: watch_notify: [----------] 4 tests from NeoRadosWatchNotifyPoll (34278 ms total) 2026-02-12T03:59:58.705 INFO:tasks.workunit.client.0.trial154.stdout: watch_notify: 2026-02-12T03:59:58.705 INFO:tasks.workunit.client.0.trial154.stdout: watch_notify: [----------] Global test environment tear-down 2026-02-12T03:59:58.706 INFO:tasks.workunit.client.0.trial154.stdout: watch_notify: [==========] 6 tests from 2 test suites ran. (49326 ms total) 2026-02-12T03:59:58.706 INFO:tasks.workunit.client.0.trial154.stdout: watch_notify: [ PASSED ] 6 tests. 2026-02-12T03:59:59.089 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: Running main() from gmock_main.cc 2026-02-12T03:59:59.089 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: [==========] Running 11 tests from 2 test suites. 2026-02-12T03:59:59.090 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: [----------] Global test environment set-up. 2026-02-12T03:59:59.090 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify 2026-02-12T03:59:59.090 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify 2026-02-12T03:59:59.090 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: watch_notify_test_cb 2026-02-12T03:59:59.090 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify (2700 ms) 2026-02-12T03:59:59.090 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch2Delete 2026-02-12T03:59:59.090 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2026-02-12T03:59:59.090 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94122816301216 err -107 2026-02-12T03:59:59.090 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch2Delete (1105 ms) 2026-02-12T03:59:59.090 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete 2026-02-12T03:59:59.090 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2026-02-12T03:59:59.091 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94122816308992 err -107 2026-02-12T03:59:59.091 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete (1734 ms) 2026-02-12T03:59:59.091 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2 2026-02-12T03:59:59.091 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: watch_notify2_test_cb from 4819 notify_id 154618822656 cookie 94122816311360 2026-02-12T03:59:59.091 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2 (1153 ms) 2026-02-12T03:59:59.091 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchNotify2 2026-02-12T03:59:59.091 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: watch_notify2_test_cb from 4819 notify_id 154618822656 cookie 94122816322112 2026-02-12T03:59:59.091 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchNotify2 (753 ms) 2026-02-12T03:59:59.091 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioNotify 2026-02-12T03:59:59.091 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: watch_notify2_test_cb from 4819 notify_id 158913789953 cookie 94122816322112 2026-02-12T03:59:59.091 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioNotify (179 ms) 2026-02-12T03:59:59.091 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2026-02-12T03:59:59.092 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: watch_notify2_test_cb from 4819 notify_id 163208757248 cookie 94122816358272 2026-02-12T03:59:59.092 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: watch_notify2_test_cb from 4819 notify_id 163208757248 cookie 94122817991056 2026-02-12T03:59:59.092 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Multi (786 ms) 2026-02-12T03:59:59.092 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2026-02-12T03:59:59.092 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: watch_notify2_test_cb from 4819 notify_id 163208757248 cookie 94122817991056 2026-02-12T03:59:59.092 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: watch_notify2_test_cb from 4819 notify_id 167503724545 cookie 94122817991056 2026-02-12T03:59:59.092 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3208 ms) 2026-02-12T03:59:59.092 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch3Timeout 2026-02-12T03:59:59.092 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: waiting up to 1024 for osd to time us out ... 2026-02-12T03:59:59.092 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94122817993264 err -107 2026-02-12T03:59:59.092 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: watch_notify2_test_cb from 4819 notify_id 201863462919 cookie 94122817993184 2026-02-12T03:59:59.092 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch3Timeout (5700 ms) 2026-02-12T03:59:59.092 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete2 2026-02-12T03:59:59.093 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: waiting up to 30 for disconnect notification ... 2026-02-12T03:59:59.093 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94122817993184 err -107 2026-02-12T03:59:59.093 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete2 (1114 ms) 2026-02-12T03:59:59.093 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify (18438 ms total) 2026-02-12T03:59:59.093 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: 2026-02-12T03:59:59.093 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC 2026-02-12T03:59:59.093 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotifyEC.WatchNotify 2026-02-12T03:59:59.093 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: watch_notify_test_cb 2026-02-12T03:59:59.093 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: [ OK ] LibRadosWatchNotifyEC.WatchNotify (2636 ms) 2026-02-12T03:59:59.093 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC (2636 ms total) 2026-02-12T03:59:59.093 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: 2026-02-12T03:59:59.093 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: [----------] Global test environment tear-down 2026-02-12T03:59:59.094 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: [==========] 11 tests from 2 test suites ran. (49778 ms total) 2026-02-12T03:59:59.094 INFO:tasks.workunit.client.0.trial154.stdout: api_watch_notify: [ PASSED ] 11 tests. 2026-02-12T04:00:02.174 INFO:tasks.workunit.client.0.trial154.stdout: ec_list: Running main() from gmock_main.cc 2026-02-12T04:00:02.174 INFO:tasks.workunit.client.0.trial154.stdout: ec_list: [==========] Running 3 tests from 1 test suite. 2026-02-12T04:00:02.174 INFO:tasks.workunit.client.0.trial154.stdout: ec_list: [----------] Global test environment set-up. 2026-02-12T04:00:02.174 INFO:tasks.workunit.client.0.trial154.stdout: ec_list: [----------] 3 tests from NeoradosECList 2026-02-12T04:00:02.174 INFO:tasks.workunit.client.0.trial154.stdout: ec_list: [ RUN ] NeoradosECList.ListObjects 2026-02-12T04:00:02.174 INFO:tasks.workunit.client.0.trial154.stdout: ec_list: [ OK ] NeoradosECList.ListObjects (11829 ms) 2026-02-12T04:00:02.175 INFO:tasks.workunit.client.0.trial154.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsNS 2026-02-12T04:00:02.175 INFO:tasks.workunit.client.0.trial154.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsNS (8090 ms) 2026-02-12T04:00:02.175 INFO:tasks.workunit.client.0.trial154.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsMany 2026-02-12T04:00:02.175 INFO:tasks.workunit.client.0.trial154.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsMany (32891 ms) 2026-02-12T04:00:02.175 INFO:tasks.workunit.client.0.trial154.stdout: ec_list: [----------] 3 tests from NeoradosECList (52810 ms total) 2026-02-12T04:00:02.175 INFO:tasks.workunit.client.0.trial154.stdout: ec_list: 2026-02-12T04:00:02.175 INFO:tasks.workunit.client.0.trial154.stdout: ec_list: [----------] Global test environment tear-down 2026-02-12T04:00:02.175 INFO:tasks.workunit.client.0.trial154.stdout: ec_list: [==========] 3 tests from 1 test suite ran. (52810 ms total) 2026-02-12T04:00:02.175 INFO:tasks.workunit.client.0.trial154.stdout: ec_list: [ PASSED ] 3 tests. 2026-02-12T04:00:09.355 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:02:30.239 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:00:09.360 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:02:30.244 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:00:09.478 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:02:30.362 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:00:09.519 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:02:30.366 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:00:09.521 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:02:30.368 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:00:09.579 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:02:30.459 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:00:09.581 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:02:30.461 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:00:09.733 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:02:30.580 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:00:09.767 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:02:30.647 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:00:18.842 INFO:tasks.workunit.client.0.trial154.stdout: api_c_write_operations: Running main() from gmock_main.cc 2026-02-12T04:00:18.842 INFO:tasks.workunit.client.0.trial154.stdout: api_c_write_operations: [==========] Running 8 tests from 2 test suites. 2026-02-12T04:00:18.842 INFO:tasks.workunit.client.0.trial154.stdout: api_c_write_operations: [----------] Global test environment set-up. 2026-02-12T04:00:18.842 INFO:tasks.workunit.client.0.trial154.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps 2026-02-12T04:00:18.842 INFO:tasks.workunit.client.0.trial154.stdout: api_c_write_operations: [ RUN ] LibradosCWriteOps.NewDelete 2026-02-12T04:00:18.842 INFO:tasks.workunit.client.0.trial154.stdout: api_c_write_operations: [ OK ] LibradosCWriteOps.NewDelete (0 ms) 2026-02-12T04:00:18.842 INFO:tasks.workunit.client.0.trial154.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps (0 ms total) 2026-02-12T04:00:18.842 INFO:tasks.workunit.client.0.trial154.stdout: api_c_write_operations: 2026-02-12T04:00:18.843 INFO:tasks.workunit.client.0.trial154.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps 2026-02-12T04:00:18.843 INFO:tasks.workunit.client.0.trial154.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.assertExists 2026-02-12T04:00:18.843 INFO:tasks.workunit.client.0.trial154.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.assertExists (6678 ms) 2026-02-12T04:00:18.843 INFO:tasks.workunit.client.0.trial154.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2026-02-12T04:00:18.843 INFO:tasks.workunit.client.0.trial154.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteOpAssertVersion (5302 ms) 2026-02-12T04:00:18.843 INFO:tasks.workunit.client.0.trial154.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Xattrs 2026-02-12T04:00:18.843 INFO:tasks.workunit.client.0.trial154.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Xattrs (3114 ms) 2026-02-12T04:00:18.843 INFO:tasks.workunit.client.0.trial154.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Write 2026-02-12T04:00:18.843 INFO:tasks.workunit.client.0.trial154.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Write (3077 ms) 2026-02-12T04:00:18.843 INFO:tasks.workunit.client.0.trial154.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Exec 2026-02-12T04:00:18.843 INFO:tasks.workunit.client.0.trial154.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Exec (5492 ms) 2026-02-12T04:00:18.843 INFO:tasks.workunit.client.0.trial154.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteSame 2026-02-12T04:00:18.843 INFO:tasks.workunit.client.0.trial154.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteSame (10953 ms) 2026-02-12T04:00:18.843 INFO:tasks.workunit.client.0.trial154.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.CmpExt 2026-02-12T04:00:18.843 INFO:tasks.workunit.client.0.trial154.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.CmpExt (34894 ms) 2026-02-12T04:00:18.843 INFO:tasks.workunit.client.0.trial154.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps (69512 ms total) 2026-02-12T04:00:18.843 INFO:tasks.workunit.client.0.trial154.stdout: api_c_write_operations: 2026-02-12T04:00:18.843 INFO:tasks.workunit.client.0.trial154.stdout: api_c_write_operations: [----------] Global test environment tear-down 2026-02-12T04:00:18.843 INFO:tasks.workunit.client.0.trial154.stdout: api_c_write_operations: [==========] 8 tests from 2 test suites ran. (69513 ms total) 2026-02-12T04:00:18.843 INFO:tasks.workunit.client.0.trial154.stdout: api_c_write_operations: [ PASSED ] 8 tests. 2026-02-12T04:00:22.789 INFO:tasks.workunit.client.0.trial154.stdout:OpPP (106 ms) 2026-02-12T04:00:22.790 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP 2026-02-12T04:00:22.790 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP (97 ms) 2026-02-12T04:00:22.790 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP2 2026-02-12T04:00:22.790 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP2 (105 ms) 2026-02-12T04:00:22.790 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2026-02-12T04:00:22.790 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoECPP.OverlappingWriteRoundTripPP (141 ms) 2026-02-12T04:00:22.790 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2026-02-12T04:00:22.790 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP (81 ms) 2026-02-12T04:00:22.790 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2026-02-12T04:00:22.791 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP2 (45 ms) 2026-02-12T04:00:22.791 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.AppendRoundTripPP 2026-02-12T04:00:22.791 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoECPP.AppendRoundTripPP (91 ms) 2026-02-12T04:00:22.791 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.TruncTestPP 2026-02-12T04:00:22.791 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoECPP.TruncTestPP (43 ms) 2026-02-12T04:00:22.791 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RemoveTestPP 2026-02-12T04:00:22.791 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RemoveTestPP (70 ms) 2026-02-12T04:00:22.791 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2026-02-12T04:00:22.791 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrsRoundTripPP (57 ms) 2026-02-12T04:00:22.791 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RmXattrPP 2026-02-12T04:00:22.791 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RmXattrPP (171 ms) 2026-02-12T04:00:22.791 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CrcZeroWrite 2026-02-12T04:00:22.792 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CrcZeroWrite (22087 ms) 2026-02-12T04:00:22.792 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrListPP 2026-02-12T04:00:22.792 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrListPP (1286 ms) 2026-02-12T04:00:22.792 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtPP 2026-02-12T04:00:22.792 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtPP (75 ms) 2026-02-12T04:00:22.792 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtDNEPP 2026-02-12T04:00:22.792 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtDNEPP (39 ms) 2026-02-12T04:00:22.792 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2026-02-12T04:00:22.792 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtMismatchPP (131 ms) 2026-02-12T04:00:22.792 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [----------] 18 tests from LibRadosIoECPP (28395 ms total) 2026-02-12T04:00:22.792 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: 2026-02-12T04:00:22.792 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [----------] Global test environment tear-down 2026-02-12T04:00:22.792 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [==========] 40 tests from 2 test suites ran. (73508 ms total) 2026-02-12T04:00:22.793 INFO:tasks.workunit.client.0.trial154.stdout: api_io_pp: [ PASSED ] 40 tests. 2026-02-12T04:00:23.801 INFO:tasks.workunit.client.0.trial154.stdout: api_pool: Running main() from gmock_main.cc 2026-02-12T04:00:23.801 INFO:tasks.workunit.client.0.trial154.stdout: api_pool: [==========] Running 9 tests from 1 test suite. 2026-02-12T04:00:23.801 INFO:tasks.workunit.client.0.trial154.stdout: api_pool: [----------] Global test environment set-up. 2026-02-12T04:00:23.801 INFO:tasks.workunit.client.0.trial154.stdout: api_pool: [----------] 9 tests from LibRadosPools 2026-02-12T04:00:23.801 INFO:tasks.workunit.client.0.trial154.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2026-02-12T04:00:23.801 INFO:tasks.workunit.client.0.trial154.stdout: api_pool: [ OK ] LibRadosPools.PoolList (4236 ms) 2026-02-12T04:00:23.801 INFO:tasks.workunit.client.0.trial154.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2026-02-12T04:00:23.802 INFO:tasks.workunit.client.0.trial154.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (5648 ms) 2026-02-12T04:00:23.802 INFO:tasks.workunit.client.0.trial154.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2026-02-12T04:00:23.802 INFO:tasks.workunit.client.0.trial154.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (3147 ms) 2026-02-12T04:00:23.802 INFO:tasks.workunit.client.0.trial154.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookupOtherInstance 2026-02-12T04:00:23.802 INFO:tasks.workunit.client.0.trial154.stdout: api_pool: [ OK ] LibRadosPools.PoolLookupOtherInstance (3169 ms) 2026-02-12T04:00:23.802 INFO:tasks.workunit.client.0.trial154.stdout: api_pool: [ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2026-02-12T04:00:23.802 INFO:tasks.workunit.client.0.trial154.stdout: api_pool: [ OK ] LibRadosPools.PoolReverseLookupOtherInstance (2764 ms) 2026-02-12T04:00:23.802 INFO:tasks.workunit.client.0.trial154.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2026-02-12T04:00:23.802 INFO:tasks.workunit.client.0.trial154.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (11925 ms) 2026-02-12T04:00:23.802 INFO:tasks.workunit.client.0.trial154.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2026-02-12T04:00:23.802 INFO:tasks.workunit.client.0.trial154.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (17249 ms) 2026-02-12T04:00:23.802 INFO:tasks.workunit.client.0.trial154.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2026-02-12T04:00:23.802 INFO:tasks.workunit.client.0.trial154.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (11335 ms) 2026-02-12T04:00:23.803 INFO:tasks.workunit.client.0.trial154.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2026-02-12T04:00:23.803 INFO:tasks.workunit.client.0.trial154.stdout: api_pool: [ OK ] LibRadosPools.PoolGetBaseTier (15023 ms) 2026-02-12T04:00:23.803 INFO:tasks.workunit.client.0.trial154.stdout: api_pool: [----------] 9 tests from LibRadosPools (74501 ms total) 2026-02-12T04:00:23.803 INFO:tasks.workunit.client.0.trial154.stdout: api_pool: 2026-02-12T04:00:23.803 INFO:tasks.workunit.client.0.trial154.stdout: api_pool: [----------] Global test environment tear-down 2026-02-12T04:00:23.803 INFO:tasks.workunit.client.0.trial154.stdout: api_pool: [==========] 9 tests from 1 test suite ran. (74501 ms total) 2026-02-12T04:00:23.803 INFO:tasks.workunit.client.0.trial154.stdout: api_pool: [ PASSED ] 9 tests. 2026-02-12T04:00:30.185 INFO:tasks.workunit.client.0.trial154.stdout: write_operations: Running main() from gmock_main.cc 2026-02-12T04:00:30.186 INFO:tasks.workunit.client.0.trial154.stdout: write_operations: [==========] Running 8 tests from 1 test suite. 2026-02-12T04:00:30.186 INFO:tasks.workunit.client.0.trial154.stdout: write_operations: [----------] Global test environment set-up. 2026-02-12T04:00:30.186 INFO:tasks.workunit.client.0.trial154.stdout: write_operations: [----------] 8 tests from NeoRadosWriteOps 2026-02-12T04:00:30.186 INFO:tasks.workunit.client.0.trial154.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertExists 2026-02-12T04:00:30.186 INFO:tasks.workunit.client.0.trial154.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertExists (7689 ms) 2026-02-12T04:00:30.186 INFO:tasks.workunit.client.0.trial154.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertVersion 2026-02-12T04:00:30.186 INFO:tasks.workunit.client.0.trial154.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertVersion (4192 ms) 2026-02-12T04:00:30.186 INFO:tasks.workunit.client.0.trial154.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Xattrs 2026-02-12T04:00:30.186 INFO:tasks.workunit.client.0.trial154.stdout: write_operations: [ OK ] NeoRadosWriteOps.Xattrs (3161 ms) 2026-02-12T04:00:30.186 INFO:tasks.workunit.client.0.trial154.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Write 2026-02-12T04:00:30.187 INFO:tasks.workunit.client.0.trial154.stdout: write_operations: [ OK ] NeoRadosWriteOps.Write (3126 ms) 2026-02-12T04:00:30.187 INFO:tasks.workunit.client.0.trial154.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Exec 2026-02-12T04:00:30.187 INFO:tasks.workunit.client.0.trial154.stdout: write_operations: [ OK ] NeoRadosWriteOps.Exec (5449 ms) 2026-02-12T04:00:30.187 INFO:tasks.workunit.client.0.trial154.stdout: write_operations: [ RUN ] NeoRadosWriteOps.WriteSame 2026-02-12T04:00:30.187 INFO:tasks.workunit.client.0.trial154.stdout: write_operations: [ OK ] NeoRadosWriteOps.WriteSame (11107 ms) 2026-02-12T04:00:30.187 INFO:tasks.workunit.client.0.trial154.stdout: write_operations: [ RUN ] NeoRadosWriteOps.CmpExt 2026-02-12T04:00:30.187 INFO:tasks.workunit.client.0.trial154.stdout: write_operations: [ OK ] NeoRadosWriteOps.CmpExt (34744 ms) 2026-02-12T04:00:30.187 INFO:tasks.workunit.client.0.trial154.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Cancel 2026-02-12T04:00:30.187 INFO:tasks.workunit.client.0.trial154.stdout: write_operations: [ OK ] NeoRadosWriteOps.Cancel (11335 ms) 2026-02-12T04:00:30.188 INFO:tasks.workunit.client.0.trial154.stdout: write_operations: [----------] 8 tests from NeoRadosWriteOps (80806 ms total) 2026-02-12T04:00:30.188 INFO:tasks.workunit.client.0.trial154.stdout: write_operations: 2026-02-12T04:00:30.188 INFO:tasks.workunit.client.0.trial154.stdout: write_operations: [----------] Global test environment tear-down 2026-02-12T04:00:30.188 INFO:tasks.workunit.client.0.trial154.stdout: write_operations: [==========] 8 tests from 1 test suite ran. (80806 ms total) 2026-02-12T04:00:30.188 INFO:tasks.workunit.client.0.trial154.stdout: write_operations: [ PASSED ] 8 tests. 2026-02-12T04:00:30.921 INFO:tasks.workunit.client.0.trial154.stdout: misc: Running main() from gmock_main.cc 2026-02-12T04:00:30.921 INFO:tasks.workunit.client.0.trial154.stdout: misc: [==========] Running 12 tests from 1 test suite. 2026-02-12T04:00:30.921 INFO:tasks.workunit.client.0.trial154.stdout: misc: [----------] Global test environment set-up. 2026-02-12T04:00:30.921 INFO:tasks.workunit.client.0.trial154.stdout: misc: [----------] 12 tests from NeoRadosMisc 2026-02-12T04:00:30.921 INFO:tasks.workunit.client.0.trial154.stdout: misc: [ RUN ] NeoRadosMisc.Version 2026-02-12T04:00:30.922 INFO:tasks.workunit.client.0.trial154.stdout: misc: [ OK ] NeoRadosMisc.Version (3066 ms) 2026-02-12T04:00:30.922 INFO:tasks.workunit.client.0.trial154.stdout: misc: [ RUN ] NeoRadosMisc.WaitOSDMap 2026-02-12T04:00:30.922 INFO:tasks.workunit.client.0.trial154.stdout: misc: [ OK ] NeoRadosMisc.WaitOSDMap (3315 ms) 2026-02-12T04:00:30.922 INFO:tasks.workunit.client.0.trial154.stdout: misc: [ RUN ] NeoRadosMisc.LongName 2026-02-12T04:00:30.922 INFO:tasks.workunit.client.0.trial154.stdout: misc: [ OK ] NeoRadosMisc.LongName (4487 ms) 2026-02-12T04:00:30.922 INFO:tasks.workunit.client.0.trial154.stdout: misc: [ RUN ] NeoRadosMisc.LongLocator 2026-02-12T04:00:30.922 INFO:tasks.workunit.client.0.trial154.stdout: misc: [ OK ] NeoRadosMisc.LongLocator (4178 ms) 2026-02-12T04:00:30.922 INFO:tasks.workunit.client.0.trial154.stdout: misc: [ RUN ] NeoRadosMisc.LongNamespace 2026-02-12T04:00:30.922 INFO:tasks.workunit.client.0.trial154.stdout: misc: [ OK ] NeoRadosMisc.LongNamespace (3803 ms) 2026-02-12T04:00:30.922 INFO:tasks.workunit.client.0.trial154.stdout: misc: [ RUN ] NeoRadosMisc.LongAttrName 2026-02-12T04:00:30.922 INFO:tasks.workunit.client.0.trial154.stdout: misc: [ OK ] NeoRadosMisc.LongAttrName (6263 ms) 2026-02-12T04:00:30.922 INFO:tasks.workunit.client.0.trial154.stdout: misc: [ RUN ] NeoRadosMisc.Exec 2026-02-12T04:00:30.923 INFO:tasks.workunit.client.0.trial154.stdout: misc: [ OK ] NeoRadosMisc.Exec (11187 ms) 2026-02-12T04:00:30.923 INFO:tasks.workunit.client.0.trial154.stdout: misc: [ RUN ] NeoRadosMisc.Operate1 2026-02-12T04:00:30.923 INFO:tasks.workunit.client.0.trial154.stdout: misc: [ OK ] NeoRadosMisc.Operate1 (11569 ms) 2026-02-12T04:00:30.923 INFO:tasks.workunit.client.0.trial154.stdout: misc: [ RUN ] NeoRadosMisc.Operate2 2026-02-12T04:00:30.923 INFO:tasks.workunit.client.0.trial154.stdout: misc: [ OK ] NeoRadosMisc.Operate2 (8474 ms) 2026-02-12T04:00:30.923 INFO:tasks.workunit.client.0.trial154.stdout: misc: [ RUN ] NeoRadosMisc.BigObject 2026-02-12T04:00:30.923 INFO:tasks.workunit.client.0.trial154.stdout: misc: [ OK ] NeoRadosMisc.BigObject (6712 ms) 2026-02-12T04:00:30.923 INFO:tasks.workunit.client.0.trial154.stdout: misc: [ RUN ] NeoRadosMisc.BigAttr 2026-02-12T04:00:30.923 INFO:tasks.workunit.client.0.trial154.stdout: misc: [ OK ] NeoRadosMisc.BigAttr (6417 ms) 2026-02-12T04:00:30.923 INFO:tasks.workunit.client.0.trial154.stdout: misc: [ RUN ] NeoRadosMisc.WriteSame 2026-02-12T04:00:30.923 INFO:tasks.workunit.client.0.trial154.stdout: misc: [ OK ] NeoRadosMisc.WriteSame (12075 ms) 2026-02-12T04:00:30.923 INFO:tasks.workunit.client.0.trial154.stdout: misc: [----------] 12 tests from NeoRadosMisc (81552 ms total) 2026-02-12T04:00:30.923 INFO:tasks.workunit.client.0.trial154.stdout: misc: 2026-02-12T04:00:30.924 INFO:tasks.workunit.client.0.trial154.stdout: misc: [----------] Global test environment tear-down 2026-02-12T04:00:30.924 INFO:tasks.workunit.client.0.trial154.stdout: misc: [==========] 12 tests from 1 test suite ran. (81552 ms total) 2026-02-12T04:00:30.924 INFO:tasks.workunit.client.0.trial154.stdout: misc: [ PASSED ] 12 tests. 2026-02-12T04:00:30.939 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: [==========] Running 12 tests from 4 test suites. 2026-02-12T04:00:30.939 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: [----------] Global test environment set-up. 2026-02-12T04:00:30.939 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2026-02-12T04:00:30.939 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2026-02-12T04:00:30.940 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2026-02-12T04:00:30.940 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2026-02-12T04:00:30.940 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: 2026-02-12T04:00:30.940 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure 2026-02-12T04:00:30.940 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2026-02-12T04:00:30.940 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: unable to get monitor info from DNS SRV with service name: ceph-mon 2026-02-12T04:00:30.940 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: 2026-02-12T03:59:09.618+0000 7f376a615880 -1 failed for service _ceph-mon._tcp 2026-02-12T04:00:30.940 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: 2026-02-12T03:59:09.618+0000 7f376a615880 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2026-02-12T04:00:30.940 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (320 ms) 2026-02-12T04:00:30.940 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2026-02-12T04:00:30.940 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectTimeout (5003 ms) 2026-02-12T04:00:30.940 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure (5324 ms total) 2026-02-12T04:00:30.941 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: 2026-02-12T04:00:30.941 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2026-02-12T04:00:30.941 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2026-02-12T04:00:30.941 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: started 0x565306cccfb0 2026-02-12T04:00:30.941 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: started 0x565306cc9470 2026-02-12T04:00:30.941 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: started 2 aios 2026-02-12T04:00:30.941 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: waiting 0x565306cccfb0 2026-02-12T04:00:30.941 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: waiting 0x565306cc9470 2026-02-12T04:00:30.941 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: done. 2026-02-12T04:00:30.941 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: [ OK ] LibRadosMiscPool.PoolCreationRace (6639 ms) 2026-02-12T04:00:30.941 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: [----------] 1 test from LibRadosMiscPool (6639 ms total) 2026-02-12T04:00:30.941 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: 2026-02-12T04:00:30.942 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: [----------] 8 tests from LibRadosMisc 2026-02-12T04:00:30.942 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: [ RUN ] LibRadosMisc.ClusterFSID 2026-02-12T04:00:30.942 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: [ OK ] LibRadosMisc.ClusterFSID (0 ms) 2026-02-12T04:00:30.942 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: [ RUN ] LibRadosMisc.Exec 2026-02-12T04:00:30.942 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: [ OK ] LibRadosMisc.Exec (551 ms) 2026-02-12T04:00:30.942 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: [ RUN ] LibRadosMisc.WriteSame 2026-02-12T04:00:30.942 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: [ OK ] LibRadosMisc.WriteSame (167 ms) 2026-02-12T04:00:30.942 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: [ RUN ] LibRadosMisc.CmpExt 2026-02-12T04:00:30.942 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: [ OK ] LibRadosMisc.CmpExt (61 ms) 2026-02-12T04:00:30.942 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: [ RUN ] LibRadosMisc.Applications 2026-02-12T04:00:30.942 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: [ OK ] LibRadosMisc.Applications (5087 ms) 2026-02-12T04:00:30.942 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatOSD 2026-02-12T04:00:30.942 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2026-02-12T04:00:30.943 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatClient 2026-02-12T04:00:30.943 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatClient (0 ms) 2026-02-12T04:00:30.943 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: [ RUN ] LibRadosMisc.ShutdownRace 2026-02-12T04:00:30.943 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: [ OK ] LibRadosMisc.ShutdownRace (61346 ms) 2026-02-12T04:00:30.943 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: [----------] 8 tests from LibRadosMisc (67215 ms total) 2026-02-12T04:00:30.943 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: 2026-02-12T04:00:30.943 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: [----------] Global test environment tear-down 2026-02-12T04:00:30.943 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: [==========] 12 tests from 4 test suites ran. (81624 ms total) 2026-02-12T04:00:30.943 INFO:tasks.workunit.client.0.trial154.stdout: api_misc: [ PASSED ] 12 tests. 2026-02-12T04:00:33.604 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:02:54.488 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:00:33.611 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:02:54.495 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:00:33.635 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:02:54.515 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:00:33.639 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:02:54.519 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:00:33.651 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:02:54.535 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:00:33.666 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:02:54.513 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:00:33.673 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:02:54.519 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:00:33.675 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:02:54.555 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:00:33.709 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:02:54.556 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:00:39.635 INFO:tasks.workunit.client.0.trial154.stdout: io: Running main() from gmock_main.cc 2026-02-12T04:00:39.635 INFO:tasks.workunit.client.0.trial154.stdout: io: [==========] Running 14 tests from 1 test suite. 2026-02-12T04:00:39.635 INFO:tasks.workunit.client.0.trial154.stdout: io: [----------] Global test environment set-up. 2026-02-12T04:00:39.635 INFO:tasks.workunit.client.0.trial154.stdout: io: [----------] 14 tests from NeoRadosIo 2026-02-12T04:00:39.635 INFO:tasks.workunit.client.0.trial154.stdout: io: [ RUN ] NeoRadosIo.Limits 2026-02-12T04:00:39.635 INFO:tasks.workunit.client.0.trial154.stdout: io: [ OK ] NeoRadosIo.Limits (7810 ms) 2026-02-12T04:00:39.635 INFO:tasks.workunit.client.0.trial154.stdout: io: [ RUN ] NeoRadosIo.SimpleWrite 2026-02-12T04:00:39.636 INFO:tasks.workunit.client.0.trial154.stdout: io: [ OK ] NeoRadosIo.SimpleWrite (3040 ms) 2026-02-12T04:00:39.636 INFO:tasks.workunit.client.0.trial154.stdout: io: [ RUN ] NeoRadosIo.ReadOp 2026-02-12T04:00:39.636 INFO:tasks.workunit.client.0.trial154.stdout: io: [ OK ] NeoRadosIo.ReadOp (4210 ms) 2026-02-12T04:00:39.636 INFO:tasks.workunit.client.0.trial154.stdout: io: [ RUN ] NeoRadosIo.SparseRead 2026-02-12T04:00:39.636 INFO:tasks.workunit.client.0.trial154.stdout: io: [ OK ] NeoRadosIo.SparseRead (3800 ms) 2026-02-12T04:00:39.636 INFO:tasks.workunit.client.0.trial154.stdout: io: [ RUN ] NeoRadosIo.RoundTrip 2026-02-12T04:00:39.636 INFO:tasks.workunit.client.0.trial154.stdout: io: [ OK ] NeoRadosIo.RoundTrip (4526 ms) 2026-02-12T04:00:39.636 INFO:tasks.workunit.client.0.trial154.stdout: io: [ RUN ] NeoRadosIo.ReadIntoBuufferlist 2026-02-12T04:00:39.636 INFO:tasks.workunit.client.0.trial154.stdout: io: [ OK ] NeoRadosIo.ReadIntoBuufferlist (11207 ms) 2026-02-12T04:00:39.636 INFO:tasks.workunit.client.0.trial154.stdout: io: [ RUN ] NeoRadosIo.OverlappingWriteRoundTrip 2026-02-12T04:00:39.636 INFO:tasks.workunit.client.0.trial154.stdout: io: [ OK ] NeoRadosIo.OverlappingWriteRoundTrip (7389 ms) 2026-02-12T04:00:39.636 INFO:tasks.workunit.client.0.trial154.stdout: io: [ RUN ] NeoRadosIo.WriteFullRoundTrip 2026-02-12T04:00:39.637 INFO:tasks.workunit.client.0.trial154.stdout: io: [ OK ] NeoRadosIo.WriteFullRoundTrip (12885 ms) 2026-02-12T04:00:39.637 INFO:tasks.workunit.client.0.trial154.stdout: io: [ RUN ] NeoRadosIo.AppendRoundTrip 2026-02-12T04:00:39.637 INFO:tasks.workunit.client.0.trial154.stdout: io: [ OK ] NeoRadosIo.AppendRoundTrip (8147 ms) 2026-02-12T04:00:39.637 INFO:tasks.workunit.client.0.trial154.stdout: io: [ RUN ] NeoRadosIo.Trunc 2026-02-12T04:00:39.637 INFO:tasks.workunit.client.0.trial154.stdout: io: [ OK ] NeoRadosIo.Trunc (8341 ms) 2026-02-12T04:00:39.637 INFO:tasks.workunit.client.0.trial154.stdout: io: [ RUN ] NeoRadosIo.Remove 2026-02-12T04:00:39.637 INFO:tasks.workunit.client.0.trial154.stdout: io: [ OK ] NeoRadosIo.Remove (10202 ms) 2026-02-12T04:00:39.637 INFO:tasks.workunit.client.0.trial154.stdout: io: [ RUN ] NeoRadosIo.XattrsRoundTrip 2026-02-12T04:00:39.637 INFO:tasks.workunit.client.0.trial154.stdout: io: [ OK ] NeoRadosIo.XattrsRoundTrip (2653 ms) 2026-02-12T04:00:39.637 INFO:tasks.workunit.client.0.trial154.stdout: io: [ RUN ] NeoRadosIo.RmXattr 2026-02-12T04:00:39.637 INFO:tasks.workunit.client.0.trial154.stdout: io: [ OK ] NeoRadosIo.RmXattr (3113 ms) 2026-02-12T04:00:39.637 INFO:tasks.workunit.client.0.trial154.stdout: io: [ RUN ] NeoRadosIo.GetXattrs 2026-02-12T04:00:39.637 INFO:tasks.workunit.client.0.trial154.stdout: io: [ OK ] NeoRadosIo.GetXattrs (2947 ms) 2026-02-12T04:00:39.638 INFO:tasks.workunit.client.0.trial154.stdout: io: [----------] 14 tests from NeoRadosIo (90277 ms total) 2026-02-12T04:00:39.638 INFO:tasks.workunit.client.0.trial154.stdout: io: 2026-02-12T04:00:39.638 INFO:tasks.workunit.client.0.trial154.stdout: io: [----------] Global test environment tear-down 2026-02-12T04:00:39.638 INFO:tasks.workunit.client.0.trial154.stdout: io: [==========] 14 tests from 1 test suite ran. (90277 ms total) 2026-02-12T04:00:39.638 INFO:tasks.workunit.client.0.trial154.stdout: io: [ PASSED ] 14 tests. 2026-02-12T04:00:42.792 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: Running main() from gmock_main.cc 2026-02-12T04:00:42.793 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: [==========] Running 15 tests from 1 test suite. 2026-02-12T04:00:42.793 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: [----------] Global test environment set-up. 2026-02-12T04:00:42.793 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: [----------] 15 tests from NeoRadosReadOps 2026-02-12T04:00:42.793 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: [ RUN ] NeoRadosReadOps.SetOpFlags 2026-02-12T04:00:42.793 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: [ OK ] NeoRadosReadOps.SetOpFlags (7909 ms) 2026-02-12T04:00:42.793 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertExists 2026-02-12T04:00:42.793 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertExists (3983 ms) 2026-02-12T04:00:42.793 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertVersion 2026-02-12T04:00:42.794 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertVersion (3151 ms) 2026-02-12T04:00:42.794 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpXattr 2026-02-12T04:00:42.794 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpXattr (3852 ms) 2026-02-12T04:00:42.794 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: [ RUN ] NeoRadosReadOps.Read 2026-02-12T04:00:42.794 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: [ OK ] NeoRadosReadOps.Read (6211 ms) 2026-02-12T04:00:42.794 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: [ RUN ] NeoRadosReadOps.Checksum 2026-02-12T04:00:42.794 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: [ OK ] NeoRadosReadOps.Checksum (9475 ms) 2026-02-12T04:00:42.794 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: [ RUN ] NeoRadosReadOps.RWOrderedRead 2026-02-12T04:00:42.794 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: [ OK ] NeoRadosReadOps.RWOrderedRead (9088 ms) 2026-02-12T04:00:42.794 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: [ RUN ] NeoRadosReadOps.ShortRead 2026-02-12T04:00:42.794 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: [ OK ] NeoRadosReadOps.ShortRead (9590 ms) 2026-02-12T04:00:42.794 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: [ RUN ] NeoRadosReadOps.Exec 2026-02-12T04:00:42.795 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: [ OK ] NeoRadosReadOps.Exec (8168 ms) 2026-02-12T04:00:42.795 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: [ RUN ] NeoRadosReadOps.Stat 2026-02-12T04:00:42.795 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: [ OK ] NeoRadosReadOps.Stat (8042 ms) 2026-02-12T04:00:42.795 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: [ RUN ] NeoRadosReadOps.Omap 2026-02-12T04:00:42.795 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: [ OK ] NeoRadosReadOps.Omap (12075 ms) 2026-02-12T04:00:42.795 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: [ RUN ] NeoRadosReadOps.OmapNuls 2026-02-12T04:00:42.795 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: [ OK ] NeoRadosReadOps.OmapNuls (2649 ms) 2026-02-12T04:00:42.795 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: [ RUN ] NeoRadosReadOps.GetXattrs 2026-02-12T04:00:42.795 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: [ OK ] NeoRadosReadOps.GetXattrs (3121 ms) 2026-02-12T04:00:42.795 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpExt 2026-02-12T04:00:42.796 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpExt (2925 ms) 2026-02-12T04:00:42.796 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: [ RUN ] NeoRadosReadOps.Cancel 2026-02-12T04:00:42.796 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: [ OK ] NeoRadosReadOps.Cancel (3174 ms) 2026-02-12T04:00:42.796 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: [----------] 15 tests from NeoRadosReadOps (93420 ms total) 2026-02-12T04:00:42.796 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: 2026-02-12T04:00:42.796 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: [----------] Global test environment tear-down 2026-02-12T04:00:42.796 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: [==========] 15 tests from 1 test suite ran. (93420 ms total) 2026-02-12T04:00:42.796 INFO:tasks.workunit.client.0.trial154.stdout: read_operations: [ PASSED ] 15 tests. 2026-02-12T04:00:51.775 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: Running main() from gmock_main.cc 2026-02-12T04:00:51.775 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [==========] Running 13 tests from 4 test suites. 2026-02-12T04:00:51.776 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [----------] Global test environment set-up. 2026-02-12T04:00:51.776 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots 2026-02-12T04:00:51.776 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapList 2026-02-12T04:00:51.776 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapList (5639 ms) 2026-02-12T04:00:51.776 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapRemove 2026-02-12T04:00:51.776 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapRemove (3209 ms) 2026-02-12T04:00:51.776 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.Rollback 2026-02-12T04:00:51.776 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [ OK ] LibRadosSnapshots.Rollback (2107 ms) 2026-02-12T04:00:51.776 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapGetName 2026-02-12T04:00:51.776 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapGetName (2078 ms) 2026-02-12T04:00:51.777 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots (13034 ms total) 2026-02-12T04:00:51.777 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: 2026-02-12T04:00:51.777 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged 2026-02-12T04:00:51.777 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Snap 2026-02-12T04:00:51.777 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Snap (6192 ms) 2026-02-12T04:00:51.777 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2026-02-12T04:00:51.777 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Rollback (14992 ms) 2026-02-12T04:00:51.777 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2026-02-12T04:00:51.777 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (19414 ms) 2026-02-12T04:00:51.777 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged (40600 ms total) 2026-02-12T04:00:51.777 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: 2026-02-12T04:00:51.777 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC 2026-02-12T04:00:51.777 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapList 2026-02-12T04:00:51.778 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapList (4703 ms) 2026-02-12T04:00:51.778 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapRemove 2026-02-12T04:00:51.778 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapRemove (7156 ms) 2026-02-12T04:00:51.778 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.Rollback 2026-02-12T04:00:51.778 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.Rollback (2032 ms) 2026-02-12T04:00:51.778 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapGetName 2026-02-12T04:00:51.778 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapGetName (1665 ms) 2026-02-12T04:00:51.778 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC (15558 ms total) 2026-02-12T04:00:51.778 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: 2026-02-12T04:00:51.778 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2026-02-12T04:00:51.778 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2026-02-12T04:00:51.778 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Snap (4106 ms) 2026-02-12T04:00:51.779 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2026-02-12T04:00:51.779 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Rollback (3981 ms) 2026-02-12T04:00:51.779 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC (8088 ms total) 2026-02-12T04:00:51.779 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: 2026-02-12T04:00:51.779 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [----------] Global test environment tear-down 2026-02-12T04:00:51.779 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [==========] 13 tests from 4 test suites ran. (102474 ms total) 2026-02-12T04:00:51.779 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots: [ PASSED ] 13 tests. 2026-02-12T04:00:51.781 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T04:00:51.781 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30413 2026-02-12T04:00:51.781 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 30413 2026-02-12T04:00:51.781 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T04:00:51.781 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30185 2026-02-12T04:00:51.781 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 30185 2026-02-12T04:00:51.781 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T04:00:51.781 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30072 2026-02-12T04:00:51.782 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 30072 2026-02-12T04:00:51.782 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T04:00:51.782 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=29929 2026-02-12T04:00:51.782 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 29929 2026-02-12T04:00:51.782 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T04:00:51.782 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30137 2026-02-12T04:00:51.782 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 30137 2026-02-12T04:00:51.782 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T04:00:51.782 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30534 2026-02-12T04:00:51.782 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 30534 2026-02-12T04:00:51.782 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T04:00:51.782 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30562 2026-02-12T04:00:51.783 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 30562 2026-02-12T04:00:51.783 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T04:00:51.783 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=29949 2026-02-12T04:00:51.783 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 29949 2026-02-12T04:00:53.609 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:03:14.493 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:00:53.610 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:03:14.494 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:00:53.637 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:03:14.517 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:00:53.638 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:03:14.484 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:00:53.638 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:03:14.518 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:00:53.639 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:03:14.485 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:00:53.640 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:03:14.524 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:00:53.667 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:03:14.547 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:00:53.668 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:03:14.514 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:01:02.861 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: Running main() from gmock_main.cc 2026-02-12T04:01:02.861 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [==========] Running 21 tests from 5 test suites. 2026-02-12T04:01:02.861 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [----------] Global test environment set-up. 2026-02-12T04:01:02.861 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP 2026-02-12T04:01:02.861 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: seed 30168 2026-02-12T04:01:02.861 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapListPP 2026-02-12T04:01:02.861 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapListPP (5507 ms) 2026-02-12T04:01:02.861 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2026-02-12T04:01:02.861 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapRemovePP (3193 ms) 2026-02-12T04:01:02.862 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.RollbackPP 2026-02-12T04:01:02.862 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.RollbackPP (3109 ms) 2026-02-12T04:01:02.862 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2026-02-12T04:01:02.862 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapGetNamePP (2110 ms) 2026-02-12T04:01:02.862 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2026-02-12T04:01:02.862 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (4626 ms) 2026-02-12T04:01:02.862 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP (18548 ms total) 2026-02-12T04:01:02.862 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: 2026-02-12T04:01:02.862 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2026-02-12T04:01:02.862 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2026-02-12T04:01:02.862 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (11081 ms) 2026-02-12T04:01:02.862 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2026-02-12T04:01:02.863 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (12655 ms) 2026-02-12T04:01:02.863 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2026-02-12T04:01:02.863 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (10141 ms) 2026-02-12T04:01:02.863 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2026-02-12T04:01:02.863 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (6481 ms) 2026-02-12T04:01:02.863 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2026-02-12T04:01:02.863 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (3201 ms) 2026-02-12T04:01:02.863 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2026-02-12T04:01:02.863 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: /ceph/rpmbuild/BUILD/ceph-20.2.0-626-g1279775f/src/test/librados/snapshots_cxx.cc:460: Skipped 2026-02-12T04:01:02.863 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: 2026-02-12T04:01:02.863 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: 2026-02-12T04:01:02.863 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2026-02-12T04:01:02.864 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2026-02-12T04:01:02.864 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: deleting snap 14 in pool LibRadosSnapshotsSelfManagedPP_trial154-30168-7 2026-02-12T04:01:02.864 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: waiting for snaps to purge 2026-02-12T04:01:02.864 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (23070 ms) 2026-02-12T04:01:02.864 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP (66633 ms total) 2026-02-12T04:01:02.864 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: 2026-02-12T04:01:02.864 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2026-02-12T04:01:02.864 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2026-02-12T04:01:02.864 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (2 ms) 2026-02-12T04:01:02.864 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2026-02-12T04:01:02.864 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (5145 ms) 2026-02-12T04:01:02.864 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (5148 ms total) 2026-02-12T04:01:02.864 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: 2026-02-12T04:01:02.865 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP 2026-02-12T04:01:02.865 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapListPP 2026-02-12T04:01:02.865 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapListPP (2672 ms) 2026-02-12T04:01:02.865 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2026-02-12T04:01:02.865 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapRemovePP (2063 ms) 2026-02-12T04:01:02.865 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.RollbackPP 2026-02-12T04:01:11.767 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ snapshots: Running main() from gmock_main.cc 2026-02-12T04:01:11.767 INFO:tasks.workunit.client.0.trial154.stdout: snapshots: [==========] Running 11 tests from 2 test suites. 2026-02-12T04:01:11.767 INFO:tasks.workunit.client.0.trial154.stdout: snapshots: [----------] Global test environment set-up. 2026-02-12T04:01:11.767 INFO:tasks.workunit.client.0.trial154.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots 2026-02-12T04:01:11.767 INFO:tasks.workunit.client.0.trial154.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapList 2026-02-12T04:01:11.767 INFO:tasks.workunit.client.0.trial154.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapList (9832 ms) 2026-02-12T04:01:11.767 INFO:tasks.workunit.client.0.trial154.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapRemove 2026-02-12T04:01:11.767 INFO:tasks.workunit.client.0.trial154.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapRemove (5218 ms) 2026-02-12T04:01:11.768 INFO:tasks.workunit.client.0.trial154.stdout: snapshots: [ RUN ] NeoRadosSnapshots.Rollback 2026-02-12T04:01:11.768 INFO:tasks.workunit.client.0.trial154.stdout: snapshots: [ OK ] NeoRadosSnapshots.Rollback (4864 ms) 2026-02-12T04:01:11.768 INFO:tasks.workunit.client.0.trial154.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapGetName 2026-02-12T04:01:11.768 INFO:tasks.workunit.client.0.trial154.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapGetName (14829 ms) 2026-02-12T04:01:11.768 INFO:tasks.workunit.client.0.trial154.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapCreateRemove 2026-02-12T04:01:11.768 INFO:tasks.workunit.client.0.trial154.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapCreateRemove (24643 ms) 2026-02-12T04:01:11.768 INFO:tasks.workunit.client.0.trial154.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots (59387 ms total) 2026-02-12T04:01:11.768 INFO:tasks.workunit.client.0.trial154.stdout: snapshots: 2026-02-12T04:01:11.768 INFO:tasks.workunit.client.0.trial154.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps 2026-02-12T04:01:11.768 INFO:tasks.workunit.client.0.trial154.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Snap 2026-02-12T04:01:11.768 INFO:tasks.workunit.client.0.trial154.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Snap (12134 ms) 2026-02-12T04:01:11.768 INFO:tasks.workunit.client.0.trial154.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Rollback 2026-02-12T04:01:11.769 INFO:tasks.workunit.client.0.trial154.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Rollback (12674 ms) 2026-02-12T04:01:11.769 INFO:tasks.workunit.client.0.trial154.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.SnapOverlap 2026-02-12T04:01:11.769 INFO:tasks.workunit.client.0.trial154.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.SnapOverlap (8135 ms) 2026-02-12T04:01:11.769 INFO:tasks.workunit.client.0.trial154.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Bug11677 2026-02-12T04:01:11.769 INFO:tasks.workunit.client.0.trial154.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Bug11677 (6062 ms) 2026-02-12T04:01:11.769 INFO:tasks.workunit.client.0.trial154.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.OrderSnap 2026-02-12T04:01:11.769 INFO:tasks.workunit.client.0.trial154.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.OrderSnap (4008 ms) 2026-02-12T04:01:11.769 INFO:tasks.workunit.client.0.trial154.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.ReusePurgedSnap 2026-02-12T04:01:11.769 INFO:tasks.workunit.client.0.trial154.stdout: snapshots: Deleting snap 3 in pool ReusePurgedSnaptrial154-30912-11. 2026-02-12T04:01:11.769 INFO:tasks.workunit.client.0.trial154.stdout: snapshots: Waiting for snaps to purge. 2026-02-12T04:01:11.769 INFO:tasks.workunit.client.0.trial154.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.ReusePurgedSnap (19988 ms) 2026-02-12T04:01:11.769 INFO:tasks.workunit.client.0.trial154.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps (63004 ms total) 2026-02-12T04:01:11.770 INFO:tasks.workunit.client.0.trial154.stdout: snapshots: 2026-02-12T04:01:11.770 INFO:tasks.workunit.client.0.trial154.stdout: snapshots: [----------] Global test environment tear-down 2026-02-12T04:01:11.770 INFO:tasks.workunit.client.0.trial154.stdout: snapshots: [==========] 11 tests from 2 test suites ran. (122392 ms total) 2026-02-12T04:01:11.770 INFO:tasks.workunit.client.0.trial154.stdout: snapshots: [ PASSED ] 11 tests. 2026-02-12T04:01:13.661 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:03:34.545 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:01:13.663 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:03:34.548 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:01:13.689 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:03:34.569 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:01:13.691 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:03:34.571 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:01:13.692 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:03:34.576 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:01:13.692 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:03:34.538 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:01:13.694 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:03:34.540 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:01:13.717 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:03:34.597 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:01:13.719 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:03:34.566 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:01:15.386 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : cursor()=8:de5d7c5f:::12:head expected=8:de5d7c5f:::12:head 2026-02-12T04:01:15.386 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > 8:de5d7c5f:::12:head -> 12 2026-02-12T04:01:15.387 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : entry=12 expected=12 2026-02-12T04:01:15.387 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : seek to 8:566253c9:::13:head 2026-02-12T04:01:15.387 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : cursor()=8:566253c9:::13:head expected=8:566253c9:::13:head 2026-02-12T04:01:15.387 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > 8:566253c9:::13:head -> 13 2026-02-12T04:01:15.387 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : entry=13 expected=13 2026-02-12T04:01:15.387 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : seek to 8:02547ec2:::1:head 2026-02-12T04:01:15.387 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : cursor()=8:02547ec2:::1:head expected=8:02547ec2:::1:head 2026-02-12T04:01:15.387 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > 8:02547ec2:::1:head -> 1 2026-02-12T04:01:15.387 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : entry=1 expected=1 2026-02-12T04:01:15.387 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : seek to 8:d83876eb:::4:head 2026-02-12T04:01:15.387 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : cursor()=8:d83876eb:::4:head expected=8:d83876eb:::4:head 2026-02-12T04:01:15.387 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > 8:d83876eb:::4:head -> 4 2026-02-12T04:01:15.388 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : entry=4 expected=4 2026-02-12T04:01:15.388 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : seek to 8:cfc208b3:::3:head 2026-02-12T04:01:15.388 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : cursor()=8:cfc208b3:::3:head expected=8:cfc208b3:::3:head 2026-02-12T04:01:15.388 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > 8:cfc208b3:::3:head -> 3 2026-02-12T04:01:15.388 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : entry=3 expected=3 2026-02-12T04:01:15.388 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : seek to 8:c4fdafeb:::6:head 2026-02-12T04:01:15.388 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : cursor()=8:c4fdafeb:::6:head expected=8:c4fdafeb:::6:head 2026-02-12T04:01:15.388 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > 8:c4fdafeb:::6:head -> 6 2026-02-12T04:01:15.388 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : entry=6 expected=6 2026-02-12T04:01:15.388 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : seek to 8:bd63b0f1:::8:head 2026-02-12T04:01:15.388 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : cursor()=8:bd63b0f1:::8:head expected=8:bd63b0f1:::8:head 2026-02-12T04:01:15.388 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > 8:bd63b0f1:::8:head -> 8 2026-02-12T04:01:15.389 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : entry=8 expected=8 2026-02-12T04:01:15.389 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : seek to 8:b29083e3:::5:head 2026-02-12T04:01:15.389 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : cursor()=8:b29083e3:::5:head expected=8:b29083e3:::5:head 2026-02-12T04:01:15.389 INFO:tasks.workunit.client.0.trial154.stdout: api_list: > 8:b29083e3:::5:head -> 5 2026-02-12T04:01:15.389 INFO:tasks.workunit.client.0.trial154.stdout: api_list: : entry=5 expected=5 2026-02-12T04:01:15.389 INFO:tasks.workunit.client.0.trial154.stdout: api_list: [ OK ] LibRadosList.ListObjectsCursor (5376 ms) 2026-02-12T04:01:15.389 INFO:tasks.workunit.client.0.trial154.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjects 2026-02-12T04:01:15.389 INFO:tasks.workunit.client.0.trial154.stdout: api_list: [ OK ] LibRadosList.EnumerateObjects (88933 ms) 2026-02-12T04:01:15.389 INFO:tasks.workunit.client.0.trial154.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjectsSplit 2026-02-12T04:01:15.389 INFO:tasks.workunit.client.0.trial154.stdout: api_list: split 0/5 -> MIN 8:33333333::::head 2026-02-12T04:01:15.389 INFO:tasks.workunit.client.0.trial154.stdout: api_list: split 1/5 -> 8:33333333::::head 8:66666666::::head 2026-02-12T04:01:15.389 INFO:tasks.workunit.client.0.trial154.stdout: api_list: split 2/5 -> 8:66666666::::head 8:99999999::::head 2026-02-12T04:01:15.389 INFO:tasks.workunit.client.0.trial154.stdout: api_list: split 3/5 -> 8:99999999::::head 8:cccccccc::::head 2026-02-12T04:01:15.390 INFO:tasks.workunit.client.0.trial154.stdout: api_list: split 4/5 -> 8:cccccccc::::head MAX 2026-02-12T04:01:15.390 INFO:tasks.workunit.client.0.trial154.stdout: api_list: [ OK ] LibRadosList.EnumerateObjectsSplit (6968 ms) 2026-02-12T04:01:15.390 INFO:tasks.workunit.client.0.trial154.stdout: api_list: [----------] 7 tests from LibRadosList (118032 ms total) 2026-02-12T04:01:15.390 INFO:tasks.workunit.client.0.trial154.stdout: api_list: 2026-02-12T04:01:15.390 INFO:tasks.workunit.client.0.trial154.stdout: api_list: [----------] 3 tests from LibRadosListEC 2026-02-12T04:01:15.390 INFO:tasks.workunit.client.0.trial154.stdout: api_list: [ RUN ] LibRadosListEC.ListObjects 2026-02-12T04:01:15.390 INFO:tasks.workunit.client.0.trial154.stdout: api_list: [ OK ] LibRadosListEC.ListObjects (1447 ms) 2026-02-12T04:01:15.390 INFO:tasks.workunit.client.0.trial154.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsNS 2026-02-12T04:01:15.390 INFO:tasks.workunit.client.0.trial154.stdout: api_list: myset foo1,foo2,foo3 2026-02-12T04:01:15.390 INFO:tasks.workunit.client.0.trial154.stdout: api_list: foo1 2026-02-12T04:01:15.390 INFO:tasks.workunit.client.0.trial154.stdout: api_list: foo2 2026-02-12T04:01:15.390 INFO:tasks.workunit.client.0.trial154.stdout: api_list: foo3 2026-02-12T04:01:15.390 INFO:tasks.workunit.client.0.trial154.stdout: api_list: myset foo1,foo4,foo5 2026-02-12T04:01:15.391 INFO:tasks.workunit.client.0.trial154.stdout: api_list: foo4 2026-02-12T04:01:15.391 INFO:tasks.workunit.client.0.trial154.stdout: api_list: foo5 2026-02-12T04:01:15.391 INFO:tasks.workunit.client.0.trial154.stdout: api_list: foo1 2026-02-12T04:01:15.391 INFO:tasks.workunit.client.0.trial154.stdout: api_list: myset foo6,foo7 2026-02-12T04:01:15.391 INFO:tasks.workunit.client.0.trial154.stdout: api_list: foo7 2026-02-12T04:01:15.391 INFO:tasks.workunit.client.0.trial154.stdout: api_list: foo6 2026-02-12T04:01:15.391 INFO:tasks.workunit.client.0.trial154.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2026-02-12T04:01:15.391 INFO:tasks.workunit.client.0.trial154.stdout: api_list: ns1:foo4 2026-02-12T04:01:15.391 INFO:tasks.workunit.client.0.trial154.stdout: api_list: ns1:foo5 2026-02-12T04:01:15.391 INFO:tasks.workunit.client.0.trial154.stdout: api_list: ns2:foo7 2026-02-12T04:01:15.391 INFO:tasks.workunit.client.0.trial154.stdout: api_list: ns2:foo6 2026-02-12T04:01:15.391 INFO:tasks.workunit.client.0.trial154.stdout: api_list: ns1:foo1 2026-02-12T04:01:15.391 INFO:tasks.workunit.client.0.trial154.stdout: api_list: :foo1 2026-02-12T04:01:15.392 INFO:tasks.workunit.client.0.trial154.stdout: api_list: :foo2 2026-02-12T04:01:15.392 INFO:tasks.workunit.client.0.trial154.stdout: api_list: :foo3 2026-02-12T04:01:15.392 INFO:tasks.workunit.client.0.trial154.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsNS (443 ms) 2026-02-12T04:01:15.392 INFO:tasks.workunit.client.0.trial154.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsStart 2026-02-12T04:01:15.392 INFO:tasks.workunit.client.0.trial154.stdout: api_list: 1 0 2026-02-12T04:01:15.392 INFO:tasks.workunit.client.0.trial154.stdout: api_list: 10 0 2026-02-12T04:01:15.392 INFO:tasks.workunit.client.0.trial154.stdout: api_list: 13 0 2026-02-12T04:01:16.998 INFO:tasks.workunit.client.0.trial154.stdout: ap api_misc_pp: [==========] Running 31 tests from 7 test suites. 2026-02-12T04:01:16.998 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [----------] Global test environment set-up. 2026-02-12T04:01:16.998 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion 2026-02-12T04:01:16.999 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ RUN ] LibRadosMiscVersion.VersionPP 2026-02-12T04:01:16.999 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2026-02-12T04:01:16.999 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2026-02-12T04:01:16.999 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: 2026-02-12T04:01:16.999 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP 2026-02-12T04:01:16.999 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: seed 30087 2026-02-12T04:01:16.999 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WaitOSDMapPP 2026-02-12T04:01:16.999 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WaitOSDMapPP (98 ms) 2026-02-12T04:01:16.999 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNamePP 2026-02-12T04:01:16.999 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNamePP (2165 ms) 2026-02-12T04:01:16.999 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongLocatorPP 2026-02-12T04:01:17.000 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongLocatorPP (541 ms) 2026-02-12T04:01:17.000 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNSpacePP 2026-02-12T04:01:17.000 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNSpacePP (178 ms) 2026-02-12T04:01:17.000 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongAttrNamePP 2026-02-12T04:01:17.000 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongAttrNamePP (152 ms) 2026-02-12T04:01:17.000 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.ExecPP 2026-02-12T04:01:17.000 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.ExecPP (33 ms) 2026-02-12T04:01:17.000 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BadFlagsPP 2026-02-12T04:01:17.000 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BadFlagsPP (31 ms) 2026-02-12T04:01:17.000 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate1PP 2026-02-12T04:01:17.000 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate1PP (72 ms) 2026-02-12T04:01:17.000 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate2PP 2026-02-12T04:01:17.001 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate2PP (28 ms) 2026-02-12T04:01:17.001 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigObjectPP 2026-02-12T04:01:17.001 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigObjectPP (113 ms) 2026-02-12T04:01:17.001 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AioOperatePP 2026-02-12T04:01:17.001 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AioOperatePP (131 ms) 2026-02-12T04:01:17.001 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertExistsPP 2026-02-12T04:01:17.001 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertExistsPP (322 ms) 2026-02-12T04:01:17.001 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertVersionPP 2026-02-12T04:01:17.001 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertVersionPP (208 ms) 2026-02-12T04:01:17.001 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigAttrPP 2026-02-12T04:01:17.001 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: osd_max_attr_size = 0 2026-02-12T04:01:17.001 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: osd_max_attr_size == 0; skipping test 2026-02-12T04:01:17.001 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigAttrPP (35522 ms) 2026-02-12T04:01:17.002 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyPP 2026-02-12T04:01:17.002 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyPP (4317 ms) 2026-02-12T04:01:17.002 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyScrubPP 2026-02-12T04:01:17.002 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: waiting for initial deep scrubs... 2026-02-12T04:01:17.002 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: done waiting, doing copies 2026-02-12T04:01:17.002 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: waiting for final deep scrubs... 2026-02-12T04:01:17.002 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: done waiting 2026-02-12T04:01:17.002 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyScrubPP (74258 ms) 2026-02-12T04:01:17.002 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WriteSamePP 2026-02-12T04:01:17.002 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WriteSamePP (168 ms) 2026-02-12T04:01:17.002 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CmpExtPP 2026-02-12T04:01:17.002 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CmpExtPP (49 ms) 2026-02-12T04:01:17.002 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Applications 2026-02-12T04:01:17.003 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Applications (5129 ms) 2026-02-12T04:01:17.003 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatOSD 2026-02-12T04:01:17.003 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2026-02-12T04:01:17.003 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatClient 2026-02-12T04:01:17.003 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2026-02-12T04:01:17.003 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Conf 2026-02-12T04:01:17.003 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Conf (0 ms) 2026-02-12T04:01:20.925 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [----------] 22 test api_aio: Running main() from gmock_main.cc 2026-02-12T04:01:20.925 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [==========] Running 45 tests from 2 test suites. 2026-02-12T04:01:20.925 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [----------] Global test environment set-up. 2026-02-12T04:01:20.925 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [----------] 29 tests from LibRadosAio 2026-02-12T04:01:20.925 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAio.TooBig 2026-02-12T04:01:20.925 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAio.TooBig (3290 ms) 2026-02-12T04:01:20.926 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAio.SimpleWrite 2026-02-12T04:01:20.926 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAio.SimpleWrite (6627 ms) 2026-02-12T04:01:20.926 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAio.WaitForSafe 2026-02-12T04:01:20.926 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAio.WaitForSafe (3144 ms) 2026-02-12T04:01:20.926 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip 2026-02-12T04:01:20.926 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip (4194 ms) 2026-02-12T04:01:20.926 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip2 2026-02-12T04:01:20.926 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip2 (2702 ms) 2026-02-12T04:01:20.926 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip3 2026-02-12T04:01:20.926 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip3 (7121 ms) 2026-02-12T04:01:20.926 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripAppend 2026-02-12T04:01:20.926 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAio.RoundTripAppend (7600 ms) 2026-02-12T04:01:20.927 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAio.RemoveTest 2026-02-12T04:01:20.927 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAio.RemoveTest (13446 ms) 2026-02-12T04:01:20.927 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAio.XattrsRoundTrip 2026-02-12T04:01:20.927 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAio.XattrsRoundTrip (9567 ms) 2026-02-12T04:01:20.927 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAio.RmXattr 2026-02-12T04:01:20.927 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAio.RmXattr (8463 ms) 2026-02-12T04:01:20.927 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAio.XattrIter 2026-02-12T04:01:20.927 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAio.XattrIter (10234 ms) 2026-02-12T04:01:20.927 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAio.IsComplete 2026-02-12T04:01:20.927 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAio.IsComplete (7284 ms) 2026-02-12T04:01:20.927 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAio.IsSafe 2026-02-12T04:01:20.927 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAio.IsSafe (2672 ms) 2026-02-12T04:01:20.928 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAio.ReturnValue 2026-02-12T04:01:20.928 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAio.ReturnValue (2975 ms) 2026-02-12T04:01:20.928 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAio.Flush 2026-02-12T04:01:20.928 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAio.Flush (3105 ms) 2026-02-12T04:01:20.928 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAio.FlushAsync 2026-02-12T04:01:20.928 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAio.FlushAsync (2956 ms) 2026-02-12T04:01:20.928 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteFull 2026-02-12T04:01:20.928 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteFull (3108 ms) 2026-02-12T04:01:20.928 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteSame 2026-02-12T04:01:20.928 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteSame (2949 ms) 2026-02-12T04:01:20.928 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStat 2026-02-12T04:01:20.928 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAio.SimpleStat (3232 ms) 2026-02-12T04:01:20.928 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAio.OperateMtime 2026-02-12T04:01:20.929 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAio.OperateMtime (3109 ms) 2026-02-12T04:01:20.929 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAio.Operate2Mtime 2026-02-12T04:01:20.929 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAio.Operate2Mtime (2593 ms) 2026-02-12T04:01:20.929 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStatNS 2026-02-12T04:01:20.929 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAio.SimpleStatNS (3219 ms) 2026-02-12T04:01:20.929 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAio.StatRemove 2026-02-12T04:01:20.929 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAio.StatRemove (2811 ms) 2026-02-12T04:01:20.929 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAio.ExecuteClass 2026-02-12T04:01:20.929 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAio.ExecuteClass (2985 ms) 2026-02-12T04:01:20.929 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAio.MultiWrite 2026-02-12T04:01:20.929 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAio.MultiWrite (3100 ms) 2026-02-12T04:01:20.929 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAio.AioUnlock 2026-02-12T04:01:20.929 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAio.AioUnlock (3192 ms) 2026-02-12T04:01:20.930 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAio.CancelBeforeSubmit 2026-02-12T04:01:20.930 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAio.CancelBeforeSubmit (3079 ms) 2026-02-12T04:01:20.930 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAio.CancelBeforeComplete 2026-02-12T04:01:20.932 INFO:tasks.workunit.client.0.trial154.stdout: ai_list: 7 0 2026-02-12T04:01:20.932 INFO:tasks.workunit.client.0.trial154.stdout: api_list: 14 0 2026-02-12T04:01:20.932 INFO:tasks.workunit.client.0.trial154.stdout: api_list: 0 0 2026-02-12T04:01:20.932 INFO:tasks.workunit.client.0.trial154.stdout: api_list: 15 0 2026-02-12T04:01:20.932 INFO:tasks.workunit.client.0.trial154.stdout: api_list: 11 0 2026-02-12T04:01:20.932 INFO:tasks.workunit.client.0.trial154.stdout: api_list: 5 0 2026-02-12T04:01:20.932 INFO:tasks.workunit.client.0.trial154.stdout: api_list: 8 0 2026-02-12T04:01:20.932 INFO:tasks.workunit.client.0.trial154.stdout: api_list: 6 0 2026-02-12T04:01:20.932 INFO:tasks.workunit.client.0.trial154.stdout: api_list: 3 0 2026-02-12T04:01:20.933 INFO:tasks.workunit.client.0.trial154.stdout: api_list: 4 0 2026-02-12T04:01:20.933 INFO:tasks.workunit.client.0.trial154.stdout: api_list: 12 0 2026-02-12T04:01:20.933 INFO:tasks.workunit.client.0.trial154.stdout: api_list: 9 0 2026-02-12T04:01:20.933 INFO:tasks.workunit.client.0.trial154.stdout: api_list: 2 0 2026-02-12T04:01:20.933 INFO:tasks.workunit.client.0.trial154.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2026-02-12T04:01:20.933 INFO:tasks.workunit.client.0.trial154.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsStart (991 ms) 2026-02-12T04:01:20.933 INFO:tasks.workunit.client.0.trial154.stdout: api_list: [----------] 3 tests from LibRadosListEC (2882 ms total) 2026-02-12T04:01:20.933 INFO:tasks.workunit.client.0.trial154.stdout: api_list: 2026-02-12T04:01:20.933 INFO:tasks.workunit.client.0.trial154.stdout: api_list: [----------] 1 test from LibRadosListNP 2026-02-12T04:01:20.933 INFO:tasks.workunit.client.0.trial154.stdout: api_list: [ RUN ] LibRadosListNP.ListObjectsError 2026-02-12T04:01:20.933 INFO:tasks.workunit.client.0.trial154.stdout: api_list: [ OK ] LibRadosListNP.ListObjectsError (2911 ms) 2026-02-12T04:01:20.933 INFO:tasks.workunit.client.0.trial154.stdout: api_list: [----------] 1 test from LibRadosListNP (2911 ms total) 2026-02-12T04:01:20.933 INFO:tasks.workunit.client.0.trial154.stdout: api_list: 2026-02-12T04:01:20.934 INFO:tasks.workunit.client.0.trial154.stdout: api_list: [----------] Global test environment tear-down 2026-02-12T04:01:20.934 INFO:tasks.workunit.client.0.trial154.stdout: api_list: [==========] 11 tests from 3 test suites ran. (131639 ms total) 2026-02-12T04:01:20.934 INFO:tasks.workunit.client.0.trial154.stdout: api_list: [ PASSED ] 11 tests. 2026-02-12T04:01:25.770 INFO:tasks.workunit.client.0.trial154.stdout: OK ] LibRadosSnapshotsECPP.RollbackPP (2136 ms) 2026-02-12T04:01:25.770 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2026-02-12T04:01:25.770 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapGetNamePP (1830 ms) 2026-02-12T04:01:25.770 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP (8702 ms total) 2026-02-12T04:01:25.770 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: 2026-02-12T04:01:25.770 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2026-02-12T04:01:25.770 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2026-02-12T04:01:25.770 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.SnapPP (4410 ms) 2026-02-12T04:01:25.770 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2026-02-12T04:01:25.770 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (3577 ms) 2026-02-12T04:01:25.770 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2026-02-12T04:01:25.770 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (4244 ms) 2026-02-12T04:01:25.770 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (12232 ms total) 2026-02-12T04:01:25.770 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: 2026-02-12T04:01:25.770 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [----------] Global test environment tear-down 2026-02-12T04:01:25.770 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [==========] 21 tests from 5 test suites ran. (136464 ms total) 2026-02-12T04:01:25.770 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ PASSED ] 20 tests. 2026-02-12T04:01:25.770 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ SKIPPED ] 1 test, listed below: 2026-02-12T04:01:25.770 INFO:tasks.workunit.client.0.trial154.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2026-02-12T04:01:33.725 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:03:54.609 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:01:33.726 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:03:54.611 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:01:33.752 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:03:54.636 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:01:33.753 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:03:54.633 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:01:33.754 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:03:54.635 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:01:33.755 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:03:54.601 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:01:33.755 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:03:54.602 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:01:33.779 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:03:54.659 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:01:33.781 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:03:54.628 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:01:36.151 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: Running main() from gmock_main.cc 2026-02-12T04:01:36.151 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [==========] Running 63 tests from 5 test suites. 2026-02-12T04:01:36.151 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [----------] Global test environment set-up. 2026-02-12T04:01:36.151 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio 2026-02-12T04:01:36.151 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAio.TooBigPP 2026-02-12T04:01:36.151 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAio.TooBigPP (3151 ms) 2026-02-12T04:01:36.151 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolQuotaPP 2026-02-12T04:01:36.151 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolQuotaPP (27597 ms) 2026-02-12T04:01:36.151 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleWritePP 2026-02-12T04:01:36.151 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleWritePP (25869 ms) 2026-02-12T04:01:36.151 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAio.WaitForSafePP 2026-02-12T04:01:36.151 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAio.WaitForSafePP (9569 ms) 2026-02-12T04:01:36.151 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP 2026-02-12T04:01:36.151 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP (10186 ms) 2026-02-12T04:01:36.151 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP2 2026-02-12T04:01:36.151 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP2 (7302 ms) 2026-02-12T04:01:36.151 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP3 2026-02-12T04:01:36.151 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP3 (2659 ms) 2026-02-12T04:01:36.151 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripSparseReadPP 2026-02-12T04:01:36.152 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripSparseReadPP (2987 ms) 2026-02-12T04:01:36.152 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsCompletePP 2026-02-12T04:01:36.152 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAio.IsCompletePP (3112 ms) 2026-02-12T04:01:36.152 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsSafePP 2026-02-12T04:01:36.152 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAio.IsSafePP (2952 ms) 2026-02-12T04:01:36.152 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAio.ReturnValuePP 2026-02-12T04:01:36.152 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAio.ReturnValuePP (3100 ms) 2026-02-12T04:01:36.152 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushPP 2026-02-12T04:01:36.152 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushPP (2950 ms) 2026-02-12T04:01:36.152 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushAsyncPP 2026-02-12T04:01:36.152 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushAsyncPP (3234 ms) 2026-02-12T04:01:36.152 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP 2026-02-12T04:01:36.152 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP (3102 ms) 2026-02-12T04:01:36.152 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP2 2026-02-12T04:01:36.152 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP2 (2592 ms) 2026-02-12T04:01:36.152 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP 2026-02-12T04:01:36.152 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP (3225 ms) 2026-02-12T04:01:36.152 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP2 2026-02-12T04:01:36.152 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP2 (2806 ms) 2026-02-12T04:01:36.152 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPPNS 2026-02-12T04:01:36.152 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPPNS (2993 ms) 2026-02-12T04:01:36.152 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPP 2026-02-12T04:01:36.152 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPP (3095 ms) 2026-02-12T04:01:36.153 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime 2026-02-12T04:01:36.153 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime (3192 ms) 2026-02-12T04:01:36.153 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime2 2026-02-12T04:01:36.153 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime2 (3049 ms) 2026-02-12T04:01:36.153 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAio.StatRemovePP 2026-02-12T04:01:36.153 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAio.StatRemovePP (2922 ms) 2026-02-12T04:01:36.153 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAio.ExecuteClassPP 2026-02-12T04:01:36.153 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAio.ExecuteClassPP (2788 ms) 2026-02-12T04:01:36.153 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAio.OmapPP 2026-02-12T04:01:36.153 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAio.OmapPP (3041 ms) 2026-02-12T04:01:36.153 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiWritePP 2026-02-12T04:01:36.153 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiWritePP (2997 ms) 2026-02-12T04:01:36.153 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAio.AioUnlockPP 2026-02-12T04:01:36.153 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAio.AioUnlockPP (3210 ms) 2026-02-12T04:01:36.153 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripAppendPP 2026-02-12T04:01:44.089 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAs from LibRadosMiscPP (123524 ms total) 2026-02-12T04:01:44.090 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: 2026-02-12T04:01:44.090 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP 2026-02-12T04:01:44.090 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2026-02-12T04:01:44.090 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ OK ] LibRadosTwoPoolsECPP.CopyFrom (1595 ms) 2026-02-12T04:01:44.090 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP (1595 ms total) 2026-02-12T04:01:44.090 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: 2026-02-12T04:01:44.090 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0,Checksummer::xxhash32,ceph_le > 2026-02-12T04:01:44.090 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Subset 2026-02-12T04:01:44.090 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Subset (258 ms) 2026-02-12T04:01:44.090 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Chunked 2026-02-12T04:01:44.090 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Chunked (17 ms) 2026-02-12T04:01:44.091 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0 (276 ms total) 2026-02-12T04:01:44.091 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: 2026-02-12T04:01:44.091 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1,Checksummer::xxhash64,ceph_le > 2026-02-12T04:01:44.091 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Subset 2026-02-12T04:01:44.091 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Subset (166 ms) 2026-02-12T04:01:44.091 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Chunked 2026-02-12T04:01:44.091 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Chunked (30 ms) 2026-02-12T04:01:44.091 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1 (196 ms total) 2026-02-12T04:01:44.091 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: 2026-02-12T04:01:44.091 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2,Checksummer::crc32c,ceph_le > 2026-02-12T04:01:44.091 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Subset 2026-02-12T04:01:44.091 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Subset (370 ms) 2026-02-12T04:01:44.092 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Chunked 2026-02-12T04:01:44.092 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Chunked (20 ms) 2026-02-12T04:01:44.092 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2 (391 ms total) 2026-02-12T04:01:44.092 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: 2026-02-12T04:01:44.092 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP 2026-02-12T04:01:44.092 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ RUN ] LibRadosMiscECPP.CompareExtentRange 2026-02-12T04:01:44.092 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ OK ] LibRadosMiscECPP.CompareExtentRange (1241 ms) 2026-02-12T04:01:44.092 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP (1241 ms total) 2026-02-12T04:01:44.092 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: 2026-02-12T04:01:44.092 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [----------] Global test environment tear-down 2026-02-12T04:01:44.092 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [==========] 31 tests from 7 test suites ran. (154783 ms total) 2026-02-12T04:01:44.092 INFO:tasks.workunit.client.0.trial154.stdout: api_misc_pp: [ PASSED ] 31 tests. 2026-02-12T04:01:44.094 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T04:01:44.094 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30461 2026-02-12T04:01:44.094 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 30461 2026-02-12T04:01:44.094 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T04:01:44.095 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=29829 2026-02-12T04:01:44.095 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 29829 2026-02-12T04:01:44.095 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T04:01:44.095 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=29891 2026-02-12T04:01:44.095 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 29891 2026-02-12T04:01:44.095 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T04:01:44.095 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30369 2026-02-12T04:01:44.095 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 30369 2026-02-12T04:01:44.095 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T04:01:44.095 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=29818 2026-02-12T04:01:44.095 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 29818 2026-02-12T04:01:53.771 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:04:14.655 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:01:53.772 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:04:14.657 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:01:53.797 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:04:14.681 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:01:53.800 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:04:14.647 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:01:53.801 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:04:14.681 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:01:53.802 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:04:14.648 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:01:53.802 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:04:14.682 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:01:53.825 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:04:14.672 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:01:53.826 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:04:14.706 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:02:33.834 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:04:54.718 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:02:33.862 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:04:54.746 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:02:33.866 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:04:54.746 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:02:33.866 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:04:54.746 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:02:33.890 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:04:54.736 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:02:33.891 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:04:54.738 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:02:33.900 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:04:54.784 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:02:33.901 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:04:54.781 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:02:33.928 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:04:54.774 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:02:53.874 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:05:14.758 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:02:53.902 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:05:14.786 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:02:53.903 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:05:14.749 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:02:53.904 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:05:14.751 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:02:53.923 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:05:14.807 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:02:53.927 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:05:14.773 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:02:53.930 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:05:14.810 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:02:53.930 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:05:14.810 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:02:53.952 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:05:14.832 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:03:13.941 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:05:34.825 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:03:13.942 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:05:34.826 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:03:13.970 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:05:34.850 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:03:13.971 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:05:34.851 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:03:13.973 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:05:34.857 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:03:13.981 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:05:34.827 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:03:13.989 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:05:34.836 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:03:13.997 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:05:34.877 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:03:14.015 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:05:34.861 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:03:16.291 INFO:tasks.workunit.client.0.trial154.stdout:pi_aio: [ OK ] LibRadosAio.CancelBeforeComplete (2885 ms) 2026-02-12T04:03:16.291 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAio.CancelAfterComplete 2026-02-12T04:03:16.291 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAio.CancelAfterComplete (2793 ms) 2026-02-12T04:03:16.291 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [----------] 29 tests from LibRadosAio (134446 ms total) 2026-02-12T04:03:16.291 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: 2026-02-12T04:03:16.291 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [----------] 16 tests from LibRadosAioEC 2026-02-12T04:03:16.292 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleWrite 2026-02-12T04:03:16.292 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleWrite (7126 ms) 2026-02-12T04:03:16.292 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAioEC.WaitForComplete 2026-02-12T04:03:16.292 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAioEC.WaitForComplete (7464 ms) 2026-02-12T04:03:16.292 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip 2026-02-12T04:03:16.292 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip (6729 ms) 2026-02-12T04:03:16.292 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip2 2026-02-12T04:03:16.292 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip2 (6775 ms) 2026-02-12T04:03:16.292 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripAppend 2026-02-12T04:03:16.292 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripAppend (6998 ms) 2026-02-12T04:03:16.292 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAioEC.IsComplete 2026-02-12T04:03:16.292 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAioEC.IsComplete (7422 ms) 2026-02-12T04:03:16.293 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAioEC.IsSafe 2026-02-12T04:03:16.293 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAioEC.IsSafe (6816 ms) 2026-02-12T04:03:16.293 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAioEC.ReturnValue 2026-02-12T04:03:16.293 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAioEC.ReturnValue (6825 ms) 2026-02-12T04:03:16.293 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAioEC.Flush 2026-02-12T04:03:16.293 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAioEC.Flush (7179 ms) 2026-02-12T04:03:16.293 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAioEC.FlushAsync 2026-02-12T04:03:16.293 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAioEC.FlushAsync (6968 ms) 2026-02-12T04:03:16.293 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripWriteFull 2026-02-12T04:03:16.293 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripWriteFull (6958 ms) 2026-02-12T04:03:16.293 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStat 2026-02-12T04:03:16.293 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStat (7289 ms) 2026-02-12T04:03:16.294 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStatNS 2026-02-12T04:03:16.294 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStatNS (7000 ms) 2026-02-12T04:03:16.294 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAioEC.StatRemove 2026-02-12T04:03:16.294 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAioEC.StatRemove (6764 ms) 2026-02-12T04:03:16.294 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAioEC.ExecuteClass 2026-02-12T04:03:16.294 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAioEC.ExecuteClass (6919 ms) 2026-02-12T04:03:16.294 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ RUN ] LibRadosAioEC.MultiWrite 2026-02-12T04:03:16.294 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ OK ] LibRadosAioEC.MultiWrite (7331 ms) 2026-02-12T04:03:16.294 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [----------] 16 tests from LibRadosAioEC (112570 ms total) 2026-02-12T04:03:16.294 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: 2026-02-12T04:03:16.294 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [----------] Global test environment tear-down 2026-02-12T04:03:16.294 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [==========] 45 tests from 2 test suites ran. (247017 ms total) 2026-02-12T04:03:16.294 INFO:tasks.workunit.client.0.trial154.stdout: api_aio: [ PASSED ] 45 tests. 2026-02-12T04:03:33.987 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:05:54.871 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:03:33.993 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:05:54.877 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:03:34.013 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:05:54.897 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:03:34.019 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:05:54.899 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:03:34.021 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:05:54.901 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:03:34.022 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:05:54.868 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:03:34.023 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:05:54.870 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:03:34.041 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:05:54.921 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:03:34.043 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:05:54.890 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:03:54.037 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:06:14.921 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:03:54.039 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:06:14.923 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:03:54.059 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:06:14.943 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:03:54.065 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:06:14.945 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:03:54.066 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:06:14.946 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:03:54.066 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:06:14.913 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:03:54.067 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:06:14.914 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:03:54.085 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:06:14.965 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:03:54.087 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:06:14.934 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:03:57.336 INFO:tasks.workunit.client.0.trial154.stdout:io.RoundTripAppendPP (3183 ms) 2026-02-12T04:03:57.336 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAio.RacingRemovePP 2026-02-12T04:03:57.336 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAio.RacingRemovePP (2613 ms) 2026-02-12T04:03:57.337 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP 2026-02-12T04:03:57.337 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP (3096 ms) 2026-02-12T04:03:57.337 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP2 2026-02-12T04:03:57.337 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP2 (3176 ms) 2026-02-12T04:03:57.337 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolEIOFlag 2026-02-12T04:03:57.337 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: sending pool EIO time: 2026-02-12T04:01:52.149197+0000 2026-02-12T04:03:57.337 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: /ceph/rpmbuild/BUILD/ceph-20.2.0-626-g1279775f/src/test/librados/aio_cxx.cc:2430: Skipped 2026-02-12T04:03:57.337 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: eio flag missed all ios that already completed 2026-02-12T04:03:57.337 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: 2026-02-12T04:03:57.337 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ SKIPPED ] LibRadosAio.PoolEIOFlag (9018 ms) 2026-02-12T04:03:57.338 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiReads 2026-02-12T04:03:57.338 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiReads (3165 ms) 2026-02-12T04:03:57.338 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio (167948 ms total) 2026-02-12T04:03:57.338 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: 2026-02-12T04:03:57.338 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP 2026-02-12T04:03:57.338 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.ReadIntoBufferlist 2026-02-12T04:03:57.338 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAioPP.ReadIntoBufferlist (2583 ms) 2026-02-12T04:03:57.338 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.XattrsRoundTripPP 2026-02-12T04:03:57.338 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAioPP.XattrsRoundTripPP (9014 ms) 2026-02-12T04:03:57.338 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RmXattrPP 2026-02-12T04:03:57.338 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RmXattrPP (15172 ms) 2026-02-12T04:03:57.338 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RemoveTestPP 2026-02-12T04:03:57.339 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RemoveTestPP (3072 ms) 2026-02-12T04:03:57.339 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP (29843 ms total) 2026-02-12T04:03:57.339 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: 2026-02-12T04:03:57.339 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP 2026-02-12T04:03:57.339 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosIoPP.XattrListPP 2026-02-12T04:03:57.339 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosIoPP.XattrListPP (2813 ms) 2026-02-12T04:03:57.339 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP (2813 ms total) 2026-02-12T04:03:57.339 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: 2026-02-12T04:03:57.339 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC 2026-02-12T04:03:57.339 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleWritePP 2026-02-12T04:03:57.339 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleWritePP (14148 ms) 2026-02-12T04:03:57.339 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.WaitForSafePP 2026-02-12T04:03:57.340 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAioEC.WaitForSafePP (6973 ms) 2026-02-12T04:03:57.340 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP 2026-02-12T04:03:57.340 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP (7465 ms) 2026-02-12T04:03:57.340 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP2 2026-02-12T04:03:57.340 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP2 (6740 ms) 2026-02-12T04:03:57.340 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP3 2026-02-12T04:03:57.340 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP3 (3090 ms) 2026-02-12T04:03:57.340 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2026-02-12T04:03:57.340 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripSparseReadPP (6963 ms) 2026-02-12T04:03:57.340 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripAppendPP 2026-02-12T04:03:57.340 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripAppendPP (6835 ms) 2026-02-12T04:03:57.340 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsCompletePP 2026-02-12T04:03:57.340 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsCompletePP (6897 ms) 2026-02-12T04:03:57.341 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsSafePP 2026-02-12T04:03:57.341 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsSafePP (7330 ms) 2026-02-12T04:03:57.341 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ReturnValuePP 2026-02-12T04:03:57.341 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ReturnValuePP (6851 ms) 2026-02-12T04:03:57.341 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushPP 2026-02-12T04:03:57.341 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushPP (6874 ms) 2026-02-12T04:03:57.341 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushAsyncPP 2026-02-12T04:03:57.341 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushAsyncPP (7284 ms) 2026-02-12T04:04:14.078 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:06:34.962 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:04:14.081 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:06:34.965 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:04:14.106 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:06:34.990 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:04:14.109 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:06:34.989 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:04:14.110 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:06:34.956 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:04:14.111 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:06:34.957 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:04:14.111 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:06:34.991 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:04:14.130 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:06:34.977 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:04:14.131 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:06:35.011 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:04:32.322 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:06:53.206 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:04:32.325 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:06:53.209 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:04:32.346 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:06:53.230 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:04:32.354 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:06:53.234 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:04:32.355 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:06:53.202 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:04:32.356 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:06:53.235 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:04:32.356 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:06:53.203 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:04:32.376 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:06:53.256 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:04:32.378 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:06:53.224 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:04:34.097 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:06:54.982 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:04:34.124 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:06:55.009 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:04:34.130 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:06:55.014 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:04:34.150 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:06:54.996 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:04:34.151 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:06:54.997 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:04:34.151 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:06:55.031 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:04:34.152 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:06:55.032 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:04:34.156 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:06:55.003 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:04:34.158 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:06:55.038 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:04:53.321 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2026-02-12T04:04:53.321 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP (6913 ms) 2026-02-12T04:04:53.321 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2026-02-12T04:04:53.322 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP2 (3144 ms) 2026-02-12T04:04:53.322 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPP 2026-02-12T04:04:53.322 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPP (6837 ms) 2026-02-12T04:04:53.322 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPPNS 2026-02-12T04:04:53.322 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPPNS (8006 ms) 2026-02-12T04:04:53.322 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.StatRemovePP 2026-02-12T04:04:53.322 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAioEC.StatRemovePP (6883 ms) 2026-02-12T04:04:53.322 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ExecuteClassPP 2026-02-12T04:04:53.322 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ExecuteClassPP (7338 ms) 2026-02-12T04:04:53.322 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.OmapPP 2026-02-12T04:04:53.322 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAioEC.OmapPP (6867 ms) 2026-02-12T04:04:53.322 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.MultiWritePP 2026-02-12T04:04:53.323 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAioEC.MultiWritePP (6851 ms) 2026-02-12T04:04:53.323 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC (140299 ms total) 2026-02-12T04:04:53.323 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: 2026-02-12T04:04:53.323 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [----------] 6 tests from LibRadosAio/Cancel 2026-02-12T04:04:53.323 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.BeforeSubmit/aio_cancel 2026-02-12T04:04:53.323 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.BeforeSubmit/aio_cancel (0 ms) 2026-02-12T04:04:53.323 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.BeforeSubmit/cancel 2026-02-12T04:04:53.323 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.BeforeSubmit/cancel (0 ms) 2026-02-12T04:04:53.323 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.BeforeComplete/aio_cancel 2026-02-12T04:04:53.323 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.BeforeComplete/aio_cancel (0 ms) 2026-02-12T04:04:53.323 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.BeforeComplete/cancel 2026-02-12T04:04:53.324 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.BeforeComplete/cancel (0 ms) 2026-02-12T04:04:53.324 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.AfterComplete/aio_cancel 2026-02-12T04:04:53.324 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.AfterComplete/aio_cancel (46 ms) 2026-02-12T04:04:53.324 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.AfterComplete/cancel 2026-02-12T04:04:53.324 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.AfterComplete/cancel (3 ms) 2026-02-12T04:04:53.324 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [----------] 6 tests from LibRadosAio/Cancel (50 ms total) 2026-02-12T04:04:53.324 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: 2026-02-12T04:04:53.324 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [----------] Global test environment tear-down 2026-02-12T04:04:53.324 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [==========] 63 tests from 5 test suites ran. (344044 ms total) 2026-02-12T04:04:53.324 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ PASSED ] 62 tests. 2026-02-12T04:04:53.324 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ SKIPPED ] 1 test, listed below: 2026-02-12T04:04:53.324 INFO:tasks.workunit.client.0.trial154.stdout: api_aio_pp: [ SKIPPED ] LibRadosAio.PoolEIOFlag 2026-02-12T04:04:53.329 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T04:04:53.330 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=29840 2026-02-12T04:04:53.330 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 29840 2026-02-12T04:04:53.330 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T04:04:53.330 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30648 2026-02-12T04:04:53.330 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 30648 2026-02-12T04:04:53.330 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T04:04:53.330 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30015 2026-02-12T04:04:53.330 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 30015 2026-02-12T04:04:53.330 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T04:04:53.330 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30716 2026-02-12T04:04:53.330 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 30716 2026-02-12T04:04:53.331 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T04:04:53.331 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30102 2026-02-12T04:04:53.331 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 30102 2026-02-12T04:04:53.331 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T04:04:53.331 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30506 2026-02-12T04:04:53.331 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 30506 2026-02-12T04:04:53.331 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T04:04:53.331 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30798 2026-02-12T04:04:53.331 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 30798 2026-02-12T04:04:53.331 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T04:04:53.331 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30037 2026-02-12T04:04:53.331 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 30037 2026-02-12T04:04:53.332 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T04:04:53.332 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30397 2026-02-12T04:04:53.332 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 30397 2026-02-12T04:04:53.332 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T04:04:53.332 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30618 2026-02-12T04:04:53.332 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 30618 2026-02-12T04:04:53.332 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T04:04:53.332 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30477 2026-02-12T04:04:53.332 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 30477 2026-02-12T04:04:53.332 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T04:04:53.332 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30683 2026-02-12T04:04:53.332 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 30683 2026-02-12T04:04:53.332 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T04:04:53.333 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30324 2026-02-12T04:04:53.333 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 30324 2026-02-12T04:04:53.333 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T04:04:53.333 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=29970 2026-02-12T04:04:53.333 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 29970 2026-02-12T04:04:53.333 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T04:04:53.333 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30742 2026-02-12T04:04:53.333 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 30742 2026-02-12T04:04:53.333 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T04:04:53.333 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30235 2026-02-12T04:04:53.333 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 30235 2026-02-12T04:04:53.333 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T04:04:53.334 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=29811 2026-02-12T04:04:53.334 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 29811 2026-02-12T04:04:53.334 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T04:04:53.334 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=29870 2026-02-12T04:04:53.334 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 29870 2026-02-12T04:04:53.334 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T04:04:53.334 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30160 2026-02-12T04:04:53.334 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 30160 2026-02-12T04:04:53.334 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T04:04:53.334 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=29910 2026-02-12T04:04:53.334 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 29910 2026-02-12T04:04:53.334 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T04:04:53.334 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30259 2026-02-12T04:04:53.335 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 30259 2026-02-12T04:04:53.335 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T04:04:53.335 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30289 2026-02-12T04:04:53.335 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 30289 2026-02-12T04:04:53.335 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T04:04:53.335 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30581 2026-02-12T04:04:53.335 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 30581 2026-02-12T04:04:53.335 INFO:tasks.workunit.client.0.trial154.stderr:+ for t in "${!pids[@]}" 2026-02-12T04:04:53.335 INFO:tasks.workunit.client.0.trial154.stderr:+ pid=30830 2026-02-12T04:04:53.335 INFO:tasks.workunit.client.0.trial154.stderr:+ wait 30830 2026-02-12T04:04:53.335 INFO:tasks.workunit.client.0.trial154.stderr:+ exit 0 2026-02-12T04:04:53.335 INFO:tasks.workunit.client.0.trial154.stderr:+ cleanup 2026-02-12T04:04:53.335 INFO:tasks.workunit.client.0.trial154.stderr:+ pkill -P 29805 2026-02-12T04:04:53.337 INFO:tasks.workunit.client.0.trial154.stderr:+ true 2026-02-12T04:04:53.337 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-12T04:04:53.337 DEBUG:teuthology.orchestra.run.trial154:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-12T04:04:53.366 INFO:tasks.workunit:Stopping ['rados/test.sh'] on client.0... 2026-02-12T04:04:53.366 DEBUG:teuthology.orchestra.run.trial154:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-12T04:04:53.720 DEBUG:teuthology.parallel:result is None 2026-02-12T04:04:53.721 DEBUG:teuthology.orchestra.run.trial154:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-12T04:04:53.745 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-12T04:04:53.745 DEBUG:teuthology.orchestra.run.trial154:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-12T04:04:53.802 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-12T04:04:53.802 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-12T04:04:53.815 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-12T04:04:53.816 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T04:04:53.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.889+0000 7f3b42cf3640 10 monclient: get_monmap_and_config 2026-02-12T04:04:53.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.889+0000 7f3b42cf3640 10 monclient: build_initial_monmap 2026-02-12T04:04:53.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.889+0000 7f3b42cf3640 10 monclient: monmap: 2026-02-12T04:04:53.891 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:53.891 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:53.892 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:04:53.890026+0000 2026-02-12T04:04:53.892 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:04:53.890026+0000 2026-02-12T04:04:53.892 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:53.892 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:53.892 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:53.892 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:53.892 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:53.892 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:53.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.889+0000 7f3b42cf3640 1 Processor -- start 2026-02-12T04:04:53.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.890+0000 7f3b42cf3640 1 -- start start 2026-02-12T04:04:53.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.890+0000 7f3b42cf3640 10 monclient: init 2026-02-12T04:04:53.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.890+0000 7f3b42cf3640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:53.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.890+0000 7f3b42cf3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T04:04:53.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.890+0000 7f3b42cf3640 10 monclient(hunting): picked mon.noname-c con 0x7f3b3c1575d0 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:53.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.890+0000 7f3b42cf3640 10 monclient(hunting): picked mon.noname-a con 0x7f3b3c163310 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:53.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.890+0000 7f3b42cf3640 10 monclient(hunting): picked mon.noname-b con 0x7f3b3c0560d0 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:53.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.890+0000 7f3b42cf3640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b3c0b20b0 con 0x7f3b3c163310 2026-02-12T04:04:53.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.890+0000 7f3b42cf3640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b3c0b2390 con 0x7f3b3c0560d0 2026-02-12T04:04:53.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.890+0000 7f3b42cf3640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b3c0b2670 con 0x7f3b3c1575d0 2026-02-12T04:04:53.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.890+0000 7f3b42cf3640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:53.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.890+0000 7f3b42cf3640 10 monclient(hunting): authenticate will time out at 1496.633542s 2026-02-12T04:04:53.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.890+0000 7f3b33fff640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f3b3c163310 0x7f3b3c0559c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:41278/0 (socket says 10.20.193.91:41278) 2026-02-12T04:04:53.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.890+0000 7f3b33fff640 1 -- 10.20.193.91:0/3558301334 learned_addr learned my addr 10.20.193.91:0/3558301334 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:53.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.892+0000 7f3b337fe640 1 -- 10.20.193.91:0/3558301334 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3030668270 0 0) 0x7f3b3c0b2390 con 0x7f3b3c0560d0 2026-02-12T04:04:53.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.892+0000 7f3b337fe640 10 monclient(hunting): _negotiate 2026-02-12T04:04:53.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.892+0000 7f3b337fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:53.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.892+0000 7f3b337fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:53.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.892+0000 7f3b337fe640 10 monclient(hunting): my global_id is 27739 2026-02-12T04:04:53.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.892+0000 7f3b337fe640 1 -- 10.20.193.91:0/3558301334 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b28003610 con 0x7f3b3c0560d0 2026-02-12T04:04:53.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.892+0000 7f3b337fe640 1 -- 10.20.193.91:0/3558301334 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2610166319 0 0) 0x7f3b3c0b20b0 con 0x7f3b3c163310 2026-02-12T04:04:53.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.892+0000 7f3b337fe640 10 monclient(hunting): _negotiate 2026-02-12T04:04:53.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.892+0000 7f3b337fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:53.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.892+0000 7f3b337fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:53.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.892+0000 7f3b337fe640 10 monclient(hunting): my global_id is 30600 2026-02-12T04:04:53.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.892+0000 7f3b337fe640 1 -- 10.20.193.91:0/3558301334 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b3c0b2390 con 0x7f3b3c163310 2026-02-12T04:04:53.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.892+0000 7f3b337fe640 1 -- 10.20.193.91:0/3558301334 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1730177483 0 0) 0x7f3b3c0b2670 con 0x7f3b3c1575d0 2026-02-12T04:04:53.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.892+0000 7f3b337fe640 10 monclient(hunting): _negotiate 2026-02-12T04:04:53.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.892+0000 7f3b337fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:53.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.892+0000 7f3b337fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:53.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.892+0000 7f3b337fe640 10 monclient(hunting): my global_id is 27434 2026-02-12T04:04:53.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.892+0000 7f3b337fe640 1 -- 10.20.193.91:0/3558301334 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b3c0b20b0 con 0x7f3b3c1575d0 2026-02-12T04:04:53.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.894+0000 7f3b337fe640 1 -- 10.20.193.91:0/3558301334 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3011300185 0 0) 0x7f3b28003610 con 0x7f3b3c0560d0 2026-02-12T04:04:53.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.894+0000 7f3b337fe640 1 -- 10.20.193.91:0/3558301334 >> v1:10.20.193.111:6789/0 conn(0x7f3b3c1575d0 legacy=0x7f3b3c162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:53.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.894+0000 7f3b337fe640 1 -- 10.20.193.91:0/3558301334 >> v1:10.20.193.91:6789/0 conn(0x7f3b3c163310 legacy=0x7f3b3c0559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:53.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.894+0000 7f3b337fe640 10 monclient: _finish_hunting 0 2026-02-12T04:04:53.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.894+0000 7f3b337fe640 1 monclient: found mon.noname-b 2026-02-12T04:04:53.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.894+0000 7f3b337fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:53.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.894+0000 7f3b337fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T04:04:53.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.894+0000 7f3b337fe640 1 -- 10.20.193.91:0/3558301334 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b3c162400 con 0x7f3b3c0560d0 2026-02-12T04:04:53.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.894+0000 7f3b337fe640 10 monclient: _finish_auth 0 2026-02-12T04:04:53.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.894+0000 7f3b337fe640 10 monclient: _check_auth_tickets 2026-02-12T04:04:53.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.894+0000 7f3b337fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:53.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.894+0000 7f3b337fe640 1 -- 10.20.193.91:0/3558301334 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f3b380030a0 con 0x7f3b3c0560d0 2026-02-12T04:04:53.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.894+0000 7f3b337fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:53.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.894+0000 7f3b337fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T04:04:53.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.894+0000 7f3b337fe640 10 monclient: dump: 2026-02-12T04:04:53.903 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:53.903 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:53.903 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:53.904 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:53.904 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:53.904 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:53.904 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:53.904 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:53.904 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:53.904 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:53.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.894+0000 7f3b42cf3640 5 monclient: authenticate success, global_id 27739 2026-02-12T04:04:53.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.894+0000 7f3b42cf3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:04:53.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.895+0000 7f3b337fe640 1 -- 10.20.193.91:0/3558301334 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3b38003270 con 0x7f3b3c0560d0 2026-02-12T04:04:53.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.895+0000 7f3b337fe640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:53.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.895+0000 7f3b337fe640 1 -- 10.20.193.91:0/3558301334 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f3b380036b0 con 0x7f3b3c0560d0 2026-02-12T04:04:53.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.895+0000 7f3b42cf3640 10 monclient: get_monmap_and_config success 2026-02-12T04:04:53.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.895+0000 7f3b42cf3640 4 set_mon_vals no callback set 2026-02-12T04:04:53.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.895+0000 7f3b337fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:53.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.895+0000 7f3b337fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T04:04:53.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.895+0000 7f3b337fe640 10 monclient: dump: 2026-02-12T04:04:53.905 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:53.905 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:53.905 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:53.905 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:53.905 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:53.905 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:53.905 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:53.906 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:53.906 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:53.906 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:53.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.895+0000 7f3b42cf3640 10 monclient: shutdown 2026-02-12T04:04:53.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.895+0000 7f3b42cf3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:53.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.895+0000 7f3b42cf3640 1 -- 10.20.193.91:0/3558301334 >> v1:10.20.193.98:6789/0 conn(0x7f3b3c0560d0 legacy=0x7f3b3c1c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:53.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.895+0000 7f3b42cf3640 1 -- 10.20.193.91:0/3558301334 shutdown_connections 2026-02-12T04:04:53.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.895+0000 7f3b42cf3640 1 -- 10.20.193.91:0/3558301334 >> 10.20.193.91:0/3558301334 conn(0x7f3b3c0b6560 msgr2=0x7f3b3c0b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:53.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.895+0000 7f3b42cf3640 1 -- 10.20.193.91:0/3558301334 shutdown_connections 2026-02-12T04:04:53.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.895+0000 7f3b42cf3640 1 -- 10.20.193.91:0/3558301334 wait complete. 2026-02-12T04:04:53.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.896+0000 7f3b42cf3640 10 monclient: build_initial_monmap 2026-02-12T04:04:53.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.896+0000 7f3b42cf3640 10 monclient: monmap: 2026-02-12T04:04:53.906 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:53.907 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:04:53.907 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:04:53.907 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:04:53.907 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:53.907 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:04:53.907 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:53.907 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:53.907 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:53.907 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:53.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.896+0000 7f3b42cf3640 1 librados: starting msgr at 2026-02-12T04:04:53.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.896+0000 7f3b42cf3640 1 librados: starting objecter 2026-02-12T04:04:53.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.896+0000 7f3b42cf3640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:04:53.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.896+0000 7f3b42cf3640 1 Processor -- start 2026-02-12T04:04:53.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.896+0000 7f3b42cf3640 1 -- start start 2026-02-12T04:04:53.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.896+0000 7f3b42cf3640 1 librados: setting wanted keys 2026-02-12T04:04:53.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.896+0000 7f3b42cf3640 1 librados: calling monclient init 2026-02-12T04:04:53.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.896+0000 7f3b42cf3640 10 monclient: init 2026-02-12T04:04:53.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.896+0000 7f3b42cf3640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:53.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.896+0000 7f3b42cf3640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T04:04:53.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.896+0000 7f3b42cf3640 10 monclient(hunting): picked mon.noname-a con 0x7f3b3c0560d0 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:53.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.896+0000 7f3b42cf3640 10 monclient(hunting): picked mon.noname-c con 0x7f3b3c1575d0 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:53.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.896+0000 7f3b42cf3640 10 monclient(hunting): picked mon.noname-b con 0x7f3b3c163310 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:53.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.896+0000 7f3b42cf3640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b3c142ce0 con 0x7f3b3c0560d0 2026-02-12T04:04:53.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.896+0000 7f3b42cf3640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b3c142fc0 con 0x7f3b3c163310 2026-02-12T04:04:53.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.896+0000 7f3b42cf3640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b3c1432a0 con 0x7f3b3c1575d0 2026-02-12T04:04:53.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.896+0000 7f3b42cf3640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:53.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.896+0000 7f3b42cf3640 10 monclient(hunting): authenticate will time out at 1496.639737s 2026-02-12T04:04:53.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.896+0000 7f3b40a68640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f3b3c0560d0 0x7f3b3c11a050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:41288/0 (socket says 10.20.193.91:41288) 2026-02-12T04:04:53.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.896+0000 7f3b40a68640 1 -- 10.20.193.91:0/1406278138 learned_addr learned my addr 10.20.193.91:0/1406278138 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:53.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.897+0000 7f3b317fa640 10 client.?.objecter ms_handle_connect 0x7f3b3c0560d0 2026-02-12T04:04:53.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.897+0000 7f3b317fa640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:53.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.897+0000 7f3b317fa640 10 client.?.objecter ms_handle_connect 0x7f3b3c163310 2026-02-12T04:04:53.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.897+0000 7f3b317fa640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:53.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.897+0000 7f3b317fa640 10 client.?.objecter ms_handle_connect 0x7f3b3c1575d0 2026-02-12T04:04:53.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.897+0000 7f3b317fa640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:53.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.898+0000 7f3b317fa640 1 -- 10.20.193.91:0/1406278138 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 792414867 0 0) 0x7f3b3c142ce0 con 0x7f3b3c0560d0 2026-02-12T04:04:53.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.898+0000 7f3b317fa640 10 monclient(hunting): _negotiate 2026-02-12T04:04:53.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.898+0000 7f3b317fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:53.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.898+0000 7f3b317fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:53.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.898+0000 7f3b317fa640 10 monclient(hunting): my global_id is 30603 2026-02-12T04:04:53.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.898+0000 7f3b317fa640 1 -- 10.20.193.91:0/1406278138 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b0c003610 con 0x7f3b3c0560d0 2026-02-12T04:04:53.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.898+0000 7f3b317fa640 1 -- 10.20.193.91:0/1406278138 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1192522008 0 0) 0x7f3b3c142fc0 con 0x7f3b3c163310 2026-02-12T04:04:53.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.898+0000 7f3b317fa640 10 monclient(hunting): _negotiate 2026-02-12T04:04:53.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.898+0000 7f3b317fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:53.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.898+0000 7f3b317fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:53.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.898+0000 7f3b317fa640 10 monclient(hunting): my global_id is 27742 2026-02-12T04:04:53.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.898+0000 7f3b317fa640 1 -- 10.20.193.91:0/1406278138 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b3c142ce0 con 0x7f3b3c163310 2026-02-12T04:04:53.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.898+0000 7f3b317fa640 1 -- 10.20.193.91:0/1406278138 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4003956859 0 0) 0x7f3b3c1432a0 con 0x7f3b3c1575d0 2026-02-12T04:04:53.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.898+0000 7f3b317fa640 10 monclient(hunting): _negotiate 2026-02-12T04:04:53.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.898+0000 7f3b317fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:53.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.898+0000 7f3b317fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:53.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.898+0000 7f3b317fa640 10 monclient(hunting): my global_id is 27437 2026-02-12T04:04:53.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.898+0000 7f3b317fa640 1 -- 10.20.193.91:0/1406278138 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b3c142fc0 con 0x7f3b3c1575d0 2026-02-12T04:04:53.914 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.900+0000 7f3b317fa640 1 -- 10.20.193.91:0/1406278138 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3739285737 0 0) 0x7f3b0c003610 con 0x7f3b3c0560d0 2026-02-12T04:04:53.914 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.900+0000 7f3b317fa640 1 -- 10.20.193.91:0/1406278138 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3b3c1432a0 con 0x7f3b3c0560d0 2026-02-12T04:04:53.914 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.900+0000 7f3b317fa640 1 -- 10.20.193.91:0/1406278138 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f3b2c003170 con 0x7f3b3c0560d0 2026-02-12T04:04:53.914 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.900+0000 7f3b317fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:53.914 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.900+0000 7f3b317fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T04:04:53.914 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.900+0000 7f3b317fa640 10 monclient(hunting): dump: 2026-02-12T04:04:53.914 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:53.915 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:53.915 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:53.915 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:53.915 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:53.915 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:53.915 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:53.915 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:53.915 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:53.915 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:53.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.900+0000 7f3b317fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:04:53.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.900+0000 7f3b317fa640 1 -- 10.20.193.91:0/1406278138 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3649100915 0 0) 0x7f3b3c142fc0 con 0x7f3b3c1575d0 2026-02-12T04:04:53.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.901+0000 7f3b317fa640 1 -- 10.20.193.91:0/1406278138 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3b0c003610 con 0x7f3b3c1575d0 2026-02-12T04:04:53.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.901+0000 7f3b317fa640 1 -- 10.20.193.91:0/1406278138 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f3b24002fc0 con 0x7f3b3c1575d0 2026-02-12T04:04:53.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.901+0000 7f3b317fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:53.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.901+0000 7f3b317fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T04:04:53.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.901+0000 7f3b317fa640 10 monclient(hunting): dump: 2026-02-12T04:04:53.916 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:53.916 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:53.916 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:53.916 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:53.916 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:53.916 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:53.916 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:53.916 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:53.917 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:53.917 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:53.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.901+0000 7f3b317fa640 1 -- 10.20.193.91:0/1406278138 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2330948105 0 0) 0x7f3b3c142ce0 con 0x7f3b3c163310 2026-02-12T04:04:53.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.901+0000 7f3b317fa640 1 -- 10.20.193.91:0/1406278138 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3b3c142fc0 con 0x7f3b3c163310 2026-02-12T04:04:53.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.901+0000 7f3b317fa640 1 -- 10.20.193.91:0/1406278138 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f3b380035c0 con 0x7f3b3c163310 2026-02-12T04:04:53.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.901+0000 7f3b317fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:53.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.901+0000 7f3b317fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T04:04:53.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.901+0000 7f3b317fa640 10 monclient(hunting): dump: 2026-02-12T04:04:53.917 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:53.917 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:53.918 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:53.918 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:53.918 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:53.918 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:53.918 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:53.918 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:53.918 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:53.918 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:53.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.902+0000 7f3b317fa640 1 -- 10.20.193.91:0/1406278138 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 435944111 0 0) 0x7f3b3c1432a0 con 0x7f3b3c0560d0 2026-02-12T04:04:53.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.902+0000 7f3b317fa640 1 -- 10.20.193.91:0/1406278138 >> v1:10.20.193.111:6789/0 conn(0x7f3b3c1575d0 legacy=0x7f3b3c152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:53.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.902+0000 7f3b317fa640 1 -- 10.20.193.91:0/1406278138 >> v1:10.20.193.98:6789/0 conn(0x7f3b3c163310 legacy=0x7f3b3c0581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:53.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.902+0000 7f3b317fa640 10 monclient: _finish_hunting 0 2026-02-12T04:04:53.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.902+0000 7f3b317fa640 1 monclient: found mon.a 2026-02-12T04:04:53.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.902+0000 7f3b317fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:53.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.902+0000 7f3b317fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:53.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.902+0000 7f3b317fa640 1 -- 10.20.193.91:0/1406278138 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b3c0579a0 con 0x7f3b3c0560d0 2026-02-12T04:04:53.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.902+0000 7f3b317fa640 10 monclient: _finish_auth 0 2026-02-12T04:04:53.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.902+0000 7f3b317fa640 10 monclient: _check_auth_tickets 2026-02-12T04:04:53.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.902+0000 7f3b317fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:53.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.902+0000 7f3b42cf3640 5 monclient: authenticate success, global_id 30603 2026-02-12T04:04:53.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.902+0000 7f3b42cf3640 10 monclient: _renew_subs 2026-02-12T04:04:53.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.902+0000 7f3b42cf3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:53.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.902+0000 7f3b42cf3640 1 -- 10.20.193.91:0/1406278138 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3b3c153610 con 0x7f3b3c0560d0 2026-02-12T04:04:53.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.902+0000 7f3b42cf3640 10 client.30603.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:04:53.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.902+0000 7f3b42cf3640 10 monclient: _renew_subs 2026-02-12T04:04:53.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.902+0000 7f3b42cf3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:53.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.902+0000 7f3b42cf3640 1 -- 10.20.193.91:0/1406278138 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3b3c058a90 con 0x7f3b3c0560d0 2026-02-12T04:04:53.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.902+0000 7f3b42cf3640 1 librados: init done 2026-02-12T04:04:53.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.903+0000 7f3b42cf3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:53.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.903+0000 7f3b42cf3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:53.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.903+0000 7f3b42cf3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:53.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.903+0000 7f3b42cf3640 1 -- 10.20.193.91:0/1406278138 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b3c0b7290 con 0x7f3b3c0560d0 2026-02-12T04:04:53.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.911+0000 7f3b317fa640 1 -- 10.20.193.91:0/1406278138 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3b2c003310 con 0x7f3b3c0560d0 2026-02-12T04:04:53.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.911+0000 7f3b317fa640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:53.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.911+0000 7f3b317fa640 1 -- 10.20.193.91:0/1406278138 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f3b2c003b50 con 0x7f3b3c0560d0 2026-02-12T04:04:53.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.911+0000 7f3b317fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:53.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.911+0000 7f3b317fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T04:04:53.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.911+0000 7f3b317fa640 10 monclient: dump: 2026-02-12T04:04:53.921 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:53.921 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:53.921 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:53.921 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:53.921 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:53.921 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:53.921 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:53.921 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:53.921 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:53.921 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:53.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.911+0000 7f3b32ffd640 4 set_mon_vals no callback set 2026-02-12T04:04:53.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.911+0000 7f3b317fa640 1 -- 10.20.193.91:0/1406278138 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f3b2c003d30 con 0x7f3b3c0560d0 2026-02-12T04:04:53.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.912+0000 7f3b33fff640 10 monclient: get_auth_request con 0x7f3b0c07a090 auth_method 0 2026-02-12T04:04:53.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.912+0000 7f3b317fa640 10 client.30603.objecter ms_handle_connect 0x7f3b0c07a090 2026-02-12T04:04:53.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.913+0000 7f3b317fa640 1 -- 10.20.193.91:0/1406278138 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7f3b2c095b50 con 0x7f3b3c0560d0 2026-02-12T04:04:53.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.913+0000 7f3b317fa640 10 client.30603.objecter ms_dispatch2 0x7f3b3c000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:04:53.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.913+0000 7f3b317fa640 3 client.30603.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:04:53.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.913+0000 7f3b317fa640 3 client.30603.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:04:53.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:53.913+0000 7f3b317fa640 20 client.30603.objecter dump_active .. 0 homeless 2026-02-12T04:04:54.008 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.006+0000 7f3b317fa640 1 -- 10.20.193.91:0/1406278138 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f3b2c05f4b0 con 0x7f3b3c0560d0 2026-02-12T04:04:54.008 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.006+0000 7f3b317fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:54.009 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.006+0000 7f3b317fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T04:04:54.117 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.115+0000 7f3b42cf3640 1 -- 10.20.193.91:0/1406278138 --> v1:10.20.193.91:6800/2929217192 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3b3c1434e0 con 0x7f3b0c07a090 2026-02-12T04:04:54.118 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.116+0000 7f3b317fa640 1 -- 10.20.193.91:0/1406278138 <== mgr.4113 v1:10.20.193.91:6800/2929217192 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+125705 (unknown 2965378022 0 309643137) 0x7f3b3c1434e0 con 0x7f3b0c07a090 2026-02-12T04:04:54.119 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T04:04:54.120 INFO:teuthology.orchestra.run.trial091.stderr:dumped all 2026-02-12T04:04:54.121 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.118+0000 7f3b42cf3640 10 librados: watch_flush enter 2026-02-12T04:04:54.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.118+0000 7f3b42cf3640 10 librados: watch_flush exit 2026-02-12T04:04:54.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.118+0000 7f3b42cf3640 20 client.30603.objecter shutdown clearing up homeless session... 2026-02-12T04:04:54.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.118+0000 7f3b42cf3640 10 client.30603.objecter successfully canceled tick 2026-02-12T04:04:54.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.118+0000 7f3b42cf3640 1 -- 10.20.193.91:0/1406278138 >> v1:10.20.193.91:6800/2929217192 conn(0x7f3b0c07a090 legacy=0x7f3b0c09a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:54.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.118+0000 7f3b42cf3640 10 monclient: shutdown 2026-02-12T04:04:54.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.118+0000 7f3b42cf3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:54.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.118+0000 7f3b42cf3640 1 -- 10.20.193.91:0/1406278138 >> v1:10.20.193.91:6789/0 conn(0x7f3b3c0560d0 legacy=0x7f3b3c11a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:54.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.118+0000 7f3b42cf3640 1 -- 10.20.193.91:0/1406278138 shutdown_connections 2026-02-12T04:04:54.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.118+0000 7f3b42cf3640 1 -- 10.20.193.91:0/1406278138 >> 10.20.193.91:0/1406278138 conn(0x7f3b3c0b6560 msgr2=0x7f3b3c155ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:54.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.118+0000 7f3b42cf3640 1 -- 10.20.193.91:0/1406278138 shutdown_connections 2026-02-12T04:04:54.123 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.118+0000 7f3b42cf3640 1 -- 10.20.193.91:0/1406278138 wait complete. 2026-02-12T04:04:54.123 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.118+0000 7f3b42cf3640 1 librados: shutdown 2026-02-12T04:04:54.128 INFO:teuthology.orchestra.run.trial091.stdout:{"pg_ready":true,"pg_map":{"version":537,"stamp":"2026-02-12T04:04:54.088738+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":56,"num_read_kb":47,"num_write":70,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":492256,"kb_used_data":60896,"kb_used_omap":24486,"kb_used_meta":406617,"kb_avail":1509457184,"statfs":{"total":1546188226560,"available":1545684156416,"internally_reserved":0,"allocated":62357504,"data_stored":69830166,"data_compressed":12764925,"data_compressed_allocated":23138304,"data_compressed_original":59803128,"omap_allocated":25074406,"internal_metadata":416376090},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":98,"apply_latency_ms":98,"commit_latency_ns":98000000,"apply_latency_ns":98000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000587"},"pg_stats":[{"pgid":"10.1a","version":"0'0","reported_seq":624,"reported_epoch":340,"state":"active+clean","last_fresh":"2026-02-12T04:04:49.307423+0000","last_change":"2026-02-12T03:59:14.506367+0000","last_active":"2026-02-12T04:04:49.307423+0000","last_peered":"2026-02-12T04:04:49.307423+0000","last_clean":"2026-02-12T04:04:49.307423+0000","last_became_active":"2026-02-12T03:59:14.484825+0000","last_became_peered":"2026-02-12T03:59:14.484825+0000","last_unstale":"2026-02-12T04:04:49.307423+0000","last_undegraded":"2026-02-12T04:04:49.307423+0000","last_fullsized":"2026-02-12T04:04:49.307423+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T13:39:56.222964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6],"acting":[11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":626,"reported_epoch":339,"state":"active+clean","last_fresh":"2026-02-12T04:04:48.931287+0000","last_change":"2026-02-12T03:59:13.271129+0000","last_active":"2026-02-12T04:04:48.931287+0000","last_peered":"2026-02-12T04:04:48.931287+0000","last_clean":"2026-02-12T04:04:48.931287+0000","last_became_active":"2026-02-12T03:59:13.250886+0000","last_became_peered":"2026-02-12T03:59:13.250886+0000","last_unstale":"2026-02-12T04:04:48.931287+0000","last_undegraded":"2026-02-12T04:04:48.931287+0000","last_fullsized":"2026-02-12T04:04:48.931287+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:56:54.392976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,0],"acting":[15,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":628,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.274187+0000","last_change":"2026-02-12T03:59:13.542338+0000","last_active":"2026-02-12T04:04:52.274187+0000","last_peered":"2026-02-12T04:04:52.274187+0000","last_clean":"2026-02-12T04:04:52.274187+0000","last_became_active":"2026-02-12T03:59:13.540079+0000","last_became_peered":"2026-02-12T03:59:13.540079+0000","last_unstale":"2026-02-12T04:04:52.274187+0000","last_undegraded":"2026-02-12T04:04:52.274187+0000","last_fullsized":"2026-02-12T04:04:52.274187+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T06:07:29.122582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,14],"acting":[4,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":632,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.319636+0000","last_change":"2026-02-12T03:59:13.067079+0000","last_active":"2026-02-12T04:04:53.319636+0000","last_peered":"2026-02-12T04:04:53.319636+0000","last_clean":"2026-02-12T04:04:53.319636+0000","last_became_active":"2026-02-12T03:59:13.054800+0000","last_became_peered":"2026-02-12T03:59:13.054800+0000","last_unstale":"2026-02-12T04:04:53.319636+0000","last_undegraded":"2026-02-12T04:04:53.319636+0000","last_fullsized":"2026-02-12T04:04:53.319636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T08:49:22.540651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":626,"reported_epoch":339,"state":"active+clean","last_fresh":"2026-02-12T04:04:48.933438+0000","last_change":"2026-02-12T03:59:13.308993+0000","last_active":"2026-02-12T04:04:48.933438+0000","last_peered":"2026-02-12T04:04:48.933438+0000","last_clean":"2026-02-12T04:04:48.933438+0000","last_became_active":"2026-02-12T03:59:13.246053+0000","last_became_peered":"2026-02-12T03:59:13.246053+0000","last_unstale":"2026-02-12T04:04:48.933438+0000","last_undegraded":"2026-02-12T04:04:48.933438+0000","last_fullsized":"2026-02-12T04:04:48.933438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T12:53:48.331317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,7],"acting":[15,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":632,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.347759+0000","last_change":"2026-02-12T03:59:13.329534+0000","last_active":"2026-02-12T04:04:53.347759+0000","last_peered":"2026-02-12T04:04:53.347759+0000","last_clean":"2026-02-12T04:04:53.347759+0000","last_became_active":"2026-02-12T03:59:13.325110+0000","last_became_peered":"2026-02-12T03:59:13.325110+0000","last_unstale":"2026-02-12T04:04:53.347759+0000","last_undegraded":"2026-02-12T04:04:53.347759+0000","last_fullsized":"2026-02-12T04:04:53.347759+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T13:01:51.962329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":627,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-12T04:04:51.221968+0000","last_change":"2026-02-12T03:59:13.470926+0000","last_active":"2026-02-12T04:04:51.221968+0000","last_peered":"2026-02-12T04:04:51.221968+0000","last_clean":"2026-02-12T04:04:51.221968+0000","last_became_active":"2026-02-12T03:59:13.466259+0000","last_became_peered":"2026-02-12T03:59:13.466259+0000","last_unstale":"2026-02-12T04:04:51.221968+0000","last_undegraded":"2026-02-12T04:04:51.221968+0000","last_fullsized":"2026-02-12T04:04:51.221968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:30:59.565179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":627,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-12T04:04:51.233689+0000","last_change":"2026-02-12T03:59:13.501116+0000","last_active":"2026-02-12T04:04:51.233689+0000","last_peered":"2026-02-12T04:04:51.233689+0000","last_clean":"2026-02-12T04:04:51.233689+0000","last_became_active":"2026-02-12T03:59:13.497818+0000","last_became_peered":"2026-02-12T03:59:13.497818+0000","last_unstale":"2026-02-12T04:04:51.233689+0000","last_undegraded":"2026-02-12T04:04:51.233689+0000","last_fullsized":"2026-02-12T04:04:51.233689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T07:00:27.016290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":632,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.367366+0000","last_change":"2026-02-12T03:59:13.134257+0000","last_active":"2026-02-12T04:04:53.367366+0000","last_peered":"2026-02-12T04:04:53.367366+0000","last_clean":"2026-02-12T04:04:53.367366+0000","last_became_active":"2026-02-12T03:59:13.116472+0000","last_became_peered":"2026-02-12T03:59:13.116472+0000","last_unstale":"2026-02-12T04:04:53.367366+0000","last_undegraded":"2026-02-12T04:04:53.367366+0000","last_fullsized":"2026-02-12T04:04:53.367366+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T10:34:46.392533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,3],"acting":[14,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":632,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.320753+0000","last_change":"2026-02-12T03:59:13.090778+0000","last_active":"2026-02-12T04:04:53.320753+0000","last_peered":"2026-02-12T04:04:53.320753+0000","last_clean":"2026-02-12T04:04:53.320753+0000","last_became_active":"2026-02-12T03:59:13.088475+0000","last_became_peered":"2026-02-12T03:59:13.088475+0000","last_unstale":"2026-02-12T04:04:53.320753+0000","last_undegraded":"2026-02-12T04:04:53.320753+0000","last_fullsized":"2026-02-12T04:04:53.320753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T04:11:16.331392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":630,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.270957+0000","last_change":"2026-02-12T03:59:14.956219+0000","last_active":"2026-02-12T04:04:52.270957+0000","last_peered":"2026-02-12T04:04:52.270957+0000","last_clean":"2026-02-12T04:04:52.270957+0000","last_became_active":"2026-02-12T03:59:14.947424+0000","last_became_peered":"2026-02-12T03:59:14.947424+0000","last_unstale":"2026-02-12T04:04:52.270957+0000","last_undegraded":"2026-02-12T04:04:52.270957+0000","last_fullsized":"2026-02-12T04:04:52.270957+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T11:01:54.553548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,11],"acting":[12,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"10.1","version":"33'11","reported_seq":658,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.264604+0000","last_change":"2026-02-12T03:59:13.848583+0000","last_active":"2026-02-12T04:04:52.264604+0000","last_peered":"2026-02-12T04:04:52.264604+0000","last_clean":"2026-02-12T04:04:52.264604+0000","last_became_active":"2026-02-12T03:59:13.846131+0000","last_became_peered":"2026-02-12T03:59:13.846131+0000","last_unstale":"2026-02-12T04:04:52.264604+0000","last_undegraded":"2026-02-12T04:04:52.264604+0000","last_fullsized":"2026-02-12T04:04:52.264604+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T04:28:11.002392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,7],"acting":[10,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"1.0","version":"24'32","reported_seq":689,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.314113+0000","last_change":"2026-02-12T03:58:33.836000+0000","last_active":"2026-02-12T04:04:52.314113+0000","last_peered":"2026-02-12T04:04:52.314113+0000","last_clean":"2026-02-12T04:04:52.314113+0000","last_became_active":"2026-02-12T03:58:33.819911+0000","last_became_peered":"2026-02-12T03:58:33.819911+0000","last_unstale":"2026-02-12T04:04:52.314113+0000","last_undegraded":"2026-02-12T04:04:52.314113+0000","last_fullsized":"2026-02-12T04:04:52.314113+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:32.372907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:32.372907+0000","last_clean_scrub_stamp":"2026-02-12T03:58:32.372907+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T08:01:25.009200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,15],"acting":[2,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"26'1","reported_seq":650,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.243780+0000","last_change":"2026-02-12T03:58:44.065350+0000","last_active":"2026-02-12T04:04:52.243780+0000","last_peered":"2026-02-12T04:04:52.243780+0000","last_clean":"2026-02-12T04:04:52.243780+0000","last_became_active":"2026-02-12T03:58:42.128882+0000","last_became_peered":"2026-02-12T03:58:42.128882+0000","last_unstale":"2026-02-12T04:04:52.243780+0000","last_undegraded":"2026-02-12T04:04:52.243780+0000","last_fullsized":"2026-02-12T04:04:52.243780+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T08:20:23.062411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058002405,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6],"acting":[8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":632,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.260835+0000","last_change":"2026-02-12T03:59:13.938696+0000","last_active":"2026-02-12T04:04:52.260835+0000","last_peered":"2026-02-12T04:04:52.260835+0000","last_clean":"2026-02-12T04:04:52.260835+0000","last_became_active":"2026-02-12T03:59:13.918494+0000","last_became_peered":"2026-02-12T03:59:13.918494+0000","last_unstale":"2026-02-12T04:04:52.260835+0000","last_undegraded":"2026-02-12T04:04:52.260835+0000","last_fullsized":"2026-02-12T04:04:52.260835+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T05:10:10.233810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":644,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-12T04:04:51.223333+0000","last_change":"2026-02-12T03:58:44.008038+0000","last_active":"2026-02-12T04:04:51.223333+0000","last_peered":"2026-02-12T04:04:51.223333+0000","last_clean":"2026-02-12T04:04:51.223333+0000","last_became_active":"2026-02-12T03:58:42.530615+0000","last_became_peered":"2026-02-12T03:58:42.530615+0000","last_unstale":"2026-02-12T04:04:51.223333+0000","last_undegraded":"2026-02-12T04:04:51.223333+0000","last_fullsized":"2026-02-12T04:04:51.223333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T12:12:39.355846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030042276999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":632,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.318115+0000","last_change":"2026-02-12T03:59:12.994781+0000","last_active":"2026-02-12T04:04:53.318115+0000","last_peered":"2026-02-12T04:04:53.318115+0000","last_clean":"2026-02-12T04:04:53.318115+0000","last_became_active":"2026-02-12T03:59:12.992488+0000","last_became_peered":"2026-02-12T03:59:12.992488+0000","last_unstale":"2026-02-12T04:04:53.318115+0000","last_undegraded":"2026-02-12T04:04:53.318115+0000","last_fullsized":"2026-02-12T04:04:53.318115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:28:37.264382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,13],"acting":[7,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":650,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.232893+0000","last_change":"2026-02-12T03:58:44.019395+0000","last_active":"2026-02-12T04:04:52.232893+0000","last_peered":"2026-02-12T04:04:52.232893+0000","last_clean":"2026-02-12T04:04:52.232893+0000","last_became_active":"2026-02-12T03:58:42.143466+0000","last_became_peered":"2026-02-12T03:58:42.143466+0000","last_unstale":"2026-02-12T04:04:52.232893+0000","last_undegraded":"2026-02-12T04:04:52.232893+0000","last_fullsized":"2026-02-12T04:04:52.232893+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T08:05:12.033817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030228985,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":626,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-12T04:04:51.225699+0000","last_change":"2026-02-12T03:59:13.213383+0000","last_active":"2026-02-12T04:04:51.225699+0000","last_peered":"2026-02-12T04:04:51.225699+0000","last_clean":"2026-02-12T04:04:51.225699+0000","last_became_active":"2026-02-12T03:59:13.207238+0000","last_became_peered":"2026-02-12T03:59:13.207238+0000","last_unstale":"2026-02-12T04:04:51.225699+0000","last_undegraded":"2026-02-12T04:04:51.225699+0000","last_fullsized":"2026-02-12T04:04:51.225699+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T06:27:24.872444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"28'2","reported_seq":651,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.242142+0000","last_change":"2026-02-12T03:58:44.064995+0000","last_active":"2026-02-12T04:04:52.242142+0000","last_peered":"2026-02-12T04:04:52.242142+0000","last_clean":"2026-02-12T04:04:52.242142+0000","last_became_active":"2026-02-12T03:58:42.443435+0000","last_became_peered":"2026-02-12T03:58:42.443435+0000","last_unstale":"2026-02-12T04:04:52.242142+0000","last_undegraded":"2026-02-12T04:04:52.242142+0000","last_fullsized":"2026-02-12T04:04:52.242142+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T11:15:40.933288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.069533228000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":616,"reported_epoch":339,"state":"active+clean","last_fresh":"2026-02-12T04:04:48.816793+0000","last_change":"2026-02-12T03:59:13.223551+0000","last_active":"2026-02-12T04:04:48.816793+0000","last_peered":"2026-02-12T04:04:48.816793+0000","last_clean":"2026-02-12T04:04:48.816793+0000","last_became_active":"2026-02-12T03:59:13.221176+0000","last_became_peered":"2026-02-12T03:59:13.221176+0000","last_unstale":"2026-02-12T04:04:48.816793+0000","last_undegraded":"2026-02-12T04:04:48.816793+0000","last_fullsized":"2026-02-12T04:04:48.816793+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T11:13:27.835565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11],"acting":[1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":645,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.448369+0000","last_change":"2026-02-12T03:58:44.390979+0000","last_active":"2026-02-12T04:04:53.448369+0000","last_peered":"2026-02-12T04:04:53.448369+0000","last_clean":"2026-02-12T04:04:53.448369+0000","last_became_active":"2026-02-12T03:58:42.128705+0000","last_became_peered":"2026-02-12T03:58:42.128705+0000","last_unstale":"2026-02-12T04:04:53.448369+0000","last_undegraded":"2026-02-12T04:04:53.448369+0000","last_fullsized":"2026-02-12T04:04:53.448369+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T04:06:44.956414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.043458169999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":626,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-12T04:04:51.227672+0000","last_change":"2026-02-12T03:59:13.662145+0000","last_active":"2026-02-12T04:04:51.227672+0000","last_peered":"2026-02-12T04:04:51.227672+0000","last_clean":"2026-02-12T04:04:51.227672+0000","last_became_active":"2026-02-12T03:59:13.639048+0000","last_became_peered":"2026-02-12T03:59:13.639048+0000","last_unstale":"2026-02-12T04:04:51.227672+0000","last_undegraded":"2026-02-12T04:04:51.227672+0000","last_fullsized":"2026-02-12T04:04:51.227672+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T14:17:15.031582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,14],"acting":[0,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":645,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.452474+0000","last_change":"2026-02-12T03:58:44.393932+0000","last_active":"2026-02-12T04:04:53.452474+0000","last_peered":"2026-02-12T04:04:53.452474+0000","last_clean":"2026-02-12T04:04:53.452474+0000","last_became_active":"2026-02-12T03:58:42.477478+0000","last_became_peered":"2026-02-12T03:58:42.477478+0000","last_unstale":"2026-02-12T04:04:53.452474+0000","last_undegraded":"2026-02-12T04:04:53.452474+0000","last_fullsized":"2026-02-12T04:04:53.452474+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:13:02.779200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.042443649,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":626,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-12T04:04:51.229644+0000","last_change":"2026-02-12T03:59:13.153999+0000","last_active":"2026-02-12T04:04:51.229644+0000","last_peered":"2026-02-12T04:04:51.229644+0000","last_clean":"2026-02-12T04:04:51.229644+0000","last_became_active":"2026-02-12T03:59:13.151732+0000","last_became_peered":"2026-02-12T03:59:13.151732+0000","last_unstale":"2026-02-12T04:04:51.229644+0000","last_undegraded":"2026-02-12T04:04:51.229644+0000","last_fullsized":"2026-02-12T04:04:51.229644+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T14:04:35.028100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":649,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.266913+0000","last_change":"2026-02-12T03:58:44.186869+0000","last_active":"2026-02-12T04:04:52.266913+0000","last_peered":"2026-02-12T04:04:52.266913+0000","last_clean":"2026-02-12T04:04:52.266913+0000","last_became_active":"2026-02-12T03:58:41.959956+0000","last_became_peered":"2026-02-12T03:58:41.959956+0000","last_unstale":"2026-02-12T04:04:52.266913+0000","last_undegraded":"2026-02-12T04:04:52.266913+0000","last_fullsized":"2026-02-12T04:04:52.266913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T10:02:09.820740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032971485000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,15],"acting":[10,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":626,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-12T04:04:51.231927+0000","last_change":"2026-02-12T03:59:13.349359+0000","last_active":"2026-02-12T04:04:51.231927+0000","last_peered":"2026-02-12T04:04:51.231927+0000","last_clean":"2026-02-12T04:04:51.231927+0000","last_became_active":"2026-02-12T03:59:13.347203+0000","last_became_peered":"2026-02-12T03:59:13.347203+0000","last_unstale":"2026-02-12T04:04:51.231927+0000","last_undegraded":"2026-02-12T04:04:51.231927+0000","last_fullsized":"2026-02-12T04:04:51.231927+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T05:50:59.198319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":649,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.256260+0000","last_change":"2026-02-12T03:58:44.073484+0000","last_active":"2026-02-12T04:04:52.256260+0000","last_peered":"2026-02-12T04:04:52.256260+0000","last_clean":"2026-02-12T04:04:52.256260+0000","last_became_active":"2026-02-12T03:58:42.327696+0000","last_became_peered":"2026-02-12T03:58:42.327696+0000","last_unstale":"2026-02-12T04:04:52.256260+0000","last_undegraded":"2026-02-12T04:04:52.256260+0000","last_fullsized":"2026-02-12T04:04:52.256260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T07:45:24.713381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.065547275000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,14],"acting":[8,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":632,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.390570+0000","last_change":"2026-02-12T03:59:14.920383+0000","last_active":"2026-02-12T04:04:53.390570+0000","last_peered":"2026-02-12T04:04:53.390570+0000","last_clean":"2026-02-12T04:04:53.390570+0000","last_became_active":"2026-02-12T03:59:14.917311+0000","last_became_peered":"2026-02-12T03:59:14.917311+0000","last_unstale":"2026-02-12T04:04:53.390570+0000","last_undegraded":"2026-02-12T04:04:53.390570+0000","last_fullsized":"2026-02-12T04:04:53.390570+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:47:34.135464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,2],"acting":[14,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":624,"reported_epoch":340,"state":"active+clean","last_fresh":"2026-02-12T04:04:49.311415+0000","last_change":"2026-02-12T03:59:14.922629+0000","last_active":"2026-02-12T04:04:49.311415+0000","last_peered":"2026-02-12T04:04:49.311415+0000","last_clean":"2026-02-12T04:04:49.311415+0000","last_became_active":"2026-02-12T03:59:14.899726+0000","last_became_peered":"2026-02-12T03:59:14.899726+0000","last_unstale":"2026-02-12T04:04:49.311415+0000","last_undegraded":"2026-02-12T04:04:49.311415+0000","last_fullsized":"2026-02-12T04:04:49.311415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T06:41:07.216123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":633,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.235239+0000","last_change":"2026-02-12T03:59:13.261070+0000","last_active":"2026-02-12T04:04:52.235239+0000","last_peered":"2026-02-12T04:04:52.235239+0000","last_clean":"2026-02-12T04:04:52.235239+0000","last_became_active":"2026-02-12T03:59:13.258353+0000","last_became_peered":"2026-02-12T03:59:13.258353+0000","last_unstale":"2026-02-12T04:04:52.235239+0000","last_undegraded":"2026-02-12T04:04:52.235239+0000","last_fullsized":"2026-02-12T04:04:52.235239+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T04:31:20.008810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":627,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-12T04:04:51.229832+0000","last_change":"2026-02-12T03:59:13.222666+0000","last_active":"2026-02-12T04:04:51.229832+0000","last_peered":"2026-02-12T04:04:51.229832+0000","last_clean":"2026-02-12T04:04:51.229832+0000","last_became_active":"2026-02-12T03:59:13.219996+0000","last_became_peered":"2026-02-12T03:59:13.219996+0000","last_unstale":"2026-02-12T04:04:51.229832+0000","last_undegraded":"2026-02-12T04:04:51.229832+0000","last_fullsized":"2026-02-12T04:04:51.229832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T14:24:56.118560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,8],"acting":[6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":631,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.276036+0000","last_change":"2026-02-12T03:59:14.179968+0000","last_active":"2026-02-12T04:04:52.276036+0000","last_peered":"2026-02-12T04:04:52.276036+0000","last_clean":"2026-02-12T04:04:52.276036+0000","last_became_active":"2026-02-12T03:59:14.177484+0000","last_became_peered":"2026-02-12T03:59:14.177484+0000","last_unstale":"2026-02-12T04:04:52.276036+0000","last_undegraded":"2026-02-12T04:04:52.276036+0000","last_fullsized":"2026-02-12T04:04:52.276036+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T12:21:26.417548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,9],"acting":[13,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":631,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.280656+0000","last_change":"2026-02-12T03:59:13.723128+0000","last_active":"2026-02-12T04:04:52.280656+0000","last_peered":"2026-02-12T04:04:52.280656+0000","last_clean":"2026-02-12T04:04:52.280656+0000","last_became_active":"2026-02-12T03:59:13.720549+0000","last_became_peered":"2026-02-12T03:59:13.720549+0000","last_unstale":"2026-02-12T04:04:52.280656+0000","last_undegraded":"2026-02-12T04:04:52.280656+0000","last_fullsized":"2026-02-12T04:04:52.280656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T04:30:20.689176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,15],"acting":[5,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":626,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.315069+0000","last_change":"2026-02-12T03:59:13.863936+0000","last_active":"2026-02-12T04:04:52.315069+0000","last_peered":"2026-02-12T04:04:52.315069+0000","last_clean":"2026-02-12T04:04:52.315069+0000","last_became_active":"2026-02-12T03:59:13.846922+0000","last_became_peered":"2026-02-12T03:59:13.846922+0000","last_unstale":"2026-02-12T04:04:52.315069+0000","last_undegraded":"2026-02-12T04:04:52.315069+0000","last_fullsized":"2026-02-12T04:04:52.315069+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:17:54.924916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":624,"reported_epoch":340,"state":"active+clean","last_fresh":"2026-02-12T04:04:49.309230+0000","last_change":"2026-02-12T03:59:14.860387+0000","last_active":"2026-02-12T04:04:49.309230+0000","last_peered":"2026-02-12T04:04:49.309230+0000","last_clean":"2026-02-12T04:04:49.309230+0000","last_became_active":"2026-02-12T03:59:14.858194+0000","last_became_peered":"2026-02-12T03:59:14.858194+0000","last_unstale":"2026-02-12T04:04:49.309230+0000","last_undegraded":"2026-02-12T04:04:49.309230+0000","last_fullsized":"2026-02-12T04:04:49.309230+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:17:18.432397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":624,"reported_epoch":340,"state":"active+clean","last_fresh":"2026-02-12T04:04:49.306663+0000","last_change":"2026-02-12T03:59:14.314170+0000","last_active":"2026-02-12T04:04:49.306663+0000","last_peered":"2026-02-12T04:04:49.306663+0000","last_clean":"2026-02-12T04:04:49.306663+0000","last_became_active":"2026-02-12T03:59:14.311690+0000","last_became_peered":"2026-02-12T03:59:14.311690+0000","last_unstale":"2026-02-12T04:04:49.306663+0000","last_undegraded":"2026-02-12T04:04:49.306663+0000","last_fullsized":"2026-02-12T04:04:49.306663+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T11:08:54.179415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,13],"acting":[11,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":630,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.279487+0000","last_change":"2026-02-12T03:59:13.474307+0000","last_active":"2026-02-12T04:04:52.279487+0000","last_peered":"2026-02-12T04:04:52.279487+0000","last_clean":"2026-02-12T04:04:52.279487+0000","last_became_active":"2026-02-12T03:59:13.469019+0000","last_became_peered":"2026-02-12T03:59:13.469019+0000","last_unstale":"2026-02-12T04:04:52.279487+0000","last_undegraded":"2026-02-12T04:04:52.279487+0000","last_fullsized":"2026-02-12T04:04:52.279487+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:39:25.438275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,2],"acting":[12,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":628,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.449552+0000","last_change":"2026-02-12T03:59:13.092892+0000","last_active":"2026-02-12T04:04:53.449552+0000","last_peered":"2026-02-12T04:04:53.449552+0000","last_clean":"2026-02-12T04:04:53.449552+0000","last_became_active":"2026-02-12T03:59:13.075804+0000","last_became_peered":"2026-02-12T03:59:13.075804+0000","last_unstale":"2026-02-12T04:04:53.449552+0000","last_undegraded":"2026-02-12T04:04:53.449552+0000","last_fullsized":"2026-02-12T04:04:53.449552+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T05:40:29.002904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,13],"acting":[3,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":627,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-12T04:04:51.230779+0000","last_change":"2026-02-12T03:59:13.511621+0000","last_active":"2026-02-12T04:04:51.230779+0000","last_peered":"2026-02-12T04:04:51.230779+0000","last_clean":"2026-02-12T04:04:51.230779+0000","last_became_active":"2026-02-12T03:59:13.509387+0000","last_became_peered":"2026-02-12T03:59:13.509387+0000","last_unstale":"2026-02-12T04:04:51.230779+0000","last_undegraded":"2026-02-12T04:04:51.230779+0000","last_fullsized":"2026-02-12T04:04:51.230779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:19:12.104502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":633,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.238120+0000","last_change":"2026-02-12T03:59:13.135837+0000","last_active":"2026-02-12T04:04:52.238120+0000","last_peered":"2026-02-12T04:04:52.238120+0000","last_clean":"2026-02-12T04:04:52.238120+0000","last_became_active":"2026-02-12T03:59:13.130685+0000","last_became_peered":"2026-02-12T03:59:13.130685+0000","last_unstale":"2026-02-12T04:04:52.238120+0000","last_undegraded":"2026-02-12T04:04:52.238120+0000","last_fullsized":"2026-02-12T04:04:52.238120+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T05:20:55.632623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":918560,"data_compressed":2320,"data_compressed_allocated":65536,"data_compressed_original":917504,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":22,"seq":94489280590,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30728,"kb_used_data":3768,"kb_used_omap":3011,"kb_used_meta":23932,"kb_avail":94341112,"statfs":{"total":96636764160,"available":96605298688,"internally_reserved":0,"allocated":3858432,"data_stored":4264916,"data_compressed":788959,"data_compressed_allocated":1425408,"data_compressed_original":3643151,"omap_allocated":3083681,"internal_metadata":24506975},"hb_peers":[0,1,2,4,5,6,7,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280589,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30724,"kb_used_data":3764,"kb_used_omap":201,"kb_used_meta":26742,"kb_avail":94341116,"statfs":{"total":96636764160,"available":96605302784,"internally_reserved":0,"allocated":3854336,"data_stored":4264897,"data_compressed":788959,"data_compressed_allocated":1425408,"data_compressed_original":3643151,"omap_allocated":206636,"internal_metadata":27384020},"hb_peers":[0,2,3,4,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280591,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30764,"kb_used_data":3804,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94341076,"statfs":{"total":96636764160,"available":96605261824,"internally_reserved":0,"allocated":3895296,"data_stored":4728273,"data_compressed":790119,"data_compressed_allocated":1458176,"data_compressed_original":4101903,"omap_allocated":214030,"internal_metadata":27376626},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313294,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30760,"kb_used_data":3800,"kb_used_omap":3017,"kb_used_meta":23926,"kb_avail":94341080,"statfs":{"total":96636764160,"available":96605265920,"internally_reserved":0,"allocated":3891200,"data_stored":4306425,"data_compressed":797549,"data_compressed_allocated":1441792,"data_compressed_original":3679690,"omap_allocated":3089836,"internal_metadata":24500820},"hb_peers":[1,2,3,4,5,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313294,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30768,"kb_used_data":3808,"kb_used_omap":3016,"kb_used_meta":23927,"kb_avail":94341072,"statfs":{"total":96636764160,"available":96605257728,"internally_reserved":0,"allocated":3899392,"data_stored":4316437,"data_compressed":799680,"data_compressed_allocated":1445888,"data_compressed_original":3688995,"omap_allocated":3089334,"internal_metadata":24501322},"hb_peers":[0,1,3,4,5,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":21,"seq":90194313295,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30760,"kb_used_data":3800,"kb_used_omap":3018,"kb_used_meta":23925,"kb_avail":94341080,"statfs":{"total":96636764160,"available":96605265920,"internally_reserved":0,"allocated":3891200,"data_stored":4306425,"data_compressed":797549,"data_compressed_allocated":1441792,"data_compressed_original":3679690,"omap_allocated":3090649,"internal_metadata":24500007},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313295,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30804,"kb_used_data":3844,"kb_used_omap":208,"kb_used_meta":26735,"kb_avail":94341036,"statfs":{"total":96636764160,"available":96605220864,"internally_reserved":0,"allocated":3936256,"data_stored":4775717,"data_compressed":800840,"data_compressed_allocated":1478656,"data_compressed_original":4147747,"omap_allocated":213241,"internal_metadata":27377415},"hb_peers":[0,1,3,4,5,7,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313294,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30768,"kb_used_data":3808,"kb_used_omap":1740,"kb_used_meta":25203,"kb_avail":94341072,"statfs":{"total":96636764160,"available":96605257728,"internally_reserved":0,"allocated":3899392,"data_stored":4316437,"data_compressed":799680,"data_compressed_allocated":1445888,"data_compressed_original":3688995,"omap_allocated":1782034,"internal_metadata":25808622},"hb_peers":[1,2,3,5,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313295,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30768,"kb_used_data":3808,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94341072,"statfs":{"total":96636764160,"available":96605257728,"internally_reserved":0,"allocated":3899392,"data_stored":4316437,"data_compressed":799680,"data_compressed_allocated":1445888,"data_compressed_original":3688995,"omap_allocated":214180,"internal_metadata":27376476},"hb_peers":[0,1,3,4,6,7,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313294,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30772,"kb_used_data":3812,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94341068,"statfs":{"total":96636764160,"available":96605253632,"internally_reserved":0,"allocated":3903488,"data_stored":4316456,"data_compressed":799680,"data_compressed_allocated":1445888,"data_compressed_original":3688995,"omap_allocated":214589,"internal_metadata":27376067},"hb_peers":[0,1,2,3,4,6,7,9,10,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313296,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30768,"kb_used_data":3808,"kb_used_omap":175,"kb_used_meta":26768,"kb_avail":94341072,"statfs":{"total":96636764160,"available":96605257728,"internally_reserved":0,"allocated":3899392,"data_stored":4316437,"data_compressed":799680,"data_compressed_allocated":1445888,"data_compressed_original":3688995,"omap_allocated":179988,"internal_metadata":27410668},"hb_peers":[0,1,2,3,4,5,6,7,8,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":10,"up_from":21,"seq":90194313295,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30772,"kb_used_data":3812,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94341068,"statfs":{"total":96636764160,"available":96605253632,"internally_reserved":0,"allocated":3903488,"data_stored":4316442,"data_compressed":799680,"data_compressed_allocated":1445888,"data_compressed_original":3688995,"omap_allocated":214097,"internal_metadata":27376559},"hb_peers":[0,1,2,3,4,5,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313296,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30768,"kb_used_data":3808,"kb_used_omap":208,"kb_used_meta":26735,"kb_avail":94341072,"statfs":{"total":96636764160,"available":96605257728,"internally_reserved":0,"allocated":3899392,"data_stored":4316437,"data_compressed":799680,"data_compressed_allocated":1445888,"data_compressed_original":3688995,"omap_allocated":213671,"internal_metadata":27376985},"hb_peers":[0,2,3,5,6,7,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":14,"up_from":21,"seq":90194313295,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30768,"kb_used_data":3808,"kb_used_omap":3019,"kb_used_meta":23924,"kb_avail":94341072,"statfs":{"total":96636764160,"available":96605257728,"internally_reserved":0,"allocated":3899392,"data_stored":4316437,"data_compressed":799680,"data_compressed_allocated":1445888,"data_compressed_original":3688995,"omap_allocated":3091722,"internal_metadata":24498934},"hb_peers":[0,2,3,4,5,6,7,8,9,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280592,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30780,"kb_used_data":3820,"kb_used_omap":3012,"kb_used_meta":23931,"kb_avail":94341060,"statfs":{"total":96636764160,"available":96605245440,"internally_reserved":0,"allocated":3911680,"data_stored":4325994,"data_compressed":801755,"data_compressed_allocated":1449984,"data_compressed_original":3697918,"omap_allocated":3085203,"internal_metadata":24505453},"hb_peers":[0,1,2,4,5,6,7,9,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280592,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30784,"kb_used_data":3824,"kb_used_omap":3019,"kb_used_meta":23924,"kb_avail":94341056,"statfs":{"total":96636764160,"available":96605241344,"internally_reserved":0,"allocated":3915776,"data_stored":4325999,"data_compressed":801755,"data_compressed_allocated":1449984,"data_compressed_original":3697918,"omap_allocated":3091515,"internal_metadata":24499141},"hb_peers":[0,3,4,5,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":459280,"data_compressed":1160,"data_compressed_allocated":32768,"data_compressed_original":458752,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":459280,"data_compressed":1160,"data_compressed_allocated":32768,"data_compressed_original":458752,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T04:04:54.132 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T04:04:54.154 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:07:15.039 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:04:54.156 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:07:15.040 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:04:54.177 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:07:15.061 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:04:54.183 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:07:15.063 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:04:54.184 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:07:15.030 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:04:54.184 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:07:15.031 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:04:54.185 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:07:15.065 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:04:54.202 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.200+0000 7f2b980c0640 10 monclient: get_monmap_and_config 2026-02-12T04:04:54.202 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.200+0000 7f2b980c0640 10 monclient: build_initial_monmap 2026-02-12T04:04:54.202 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.200+0000 7f2b980c0640 10 monclient: monmap: 2026-02-12T04:04:54.202 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:54.202 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:54.203 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:04:54.201204+0000 2026-02-12T04:04:54.203 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:04:54.201204+0000 2026-02-12T04:04:54.203 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:54.203 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:54.203 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:54.203 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:54.203 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:54.203 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:54.204 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.201+0000 7f2b980c0640 1 Processor -- start 2026-02-12T04:04:54.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.201+0000 7f2b980c0640 1 -- start start 2026-02-12T04:04:54.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.201+0000 7f2b980c0640 10 monclient: init 2026-02-12T04:04:54.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.201+0000 7f2b980c0640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:54.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.201+0000 7f2b980c0640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T04:04:54.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.201+0000 7f2b980c0640 10 monclient(hunting): picked mon.noname-c con 0x7f2b901575d0 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:54.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.201+0000 7f2b980c0640 10 monclient(hunting): picked mon.noname-b con 0x7f2b90163310 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:54.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.201+0000 7f2b980c0640 10 monclient(hunting): picked mon.noname-a con 0x7f2b900560d0 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:54.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.201+0000 7f2b980c0640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b900b20b0 con 0x7f2b900560d0 2026-02-12T04:04:54.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.201+0000 7f2b980c0640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b900b2390 con 0x7f2b90163310 2026-02-12T04:04:54.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.201+0000 7f2b980c0640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b900b2670 con 0x7f2b901575d0 2026-02-12T04:04:54.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.201+0000 7f2b980c0640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:54.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.201+0000 7f2b980c0640 10 monclient(hunting): authenticate will time out at 1496.944588s 2026-02-12T04:04:54.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.202+0000 7f2b95e35640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f2b901575d0 0x7f2b90162c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:44076/0 (socket says 10.20.193.91:44076) 2026-02-12T04:04:54.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.202+0000 7f2b95e35640 1 -- 10.20.193.91:0/710663185 learned_addr learned my addr 10.20.193.91:0/710663185 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:54.206 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:07:15.053 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:04:54.207 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:07:15.084 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:04:54.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.205+0000 7f2b94e33640 1 -- 10.20.193.91:0/710663185 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1788997222 0 0) 0x7f2b900b2670 con 0x7f2b901575d0 2026-02-12T04:04:54.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.205+0000 7f2b94e33640 10 monclient(hunting): _negotiate 2026-02-12T04:04:54.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.205+0000 7f2b94e33640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:54.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.205+0000 7f2b94e33640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:54.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.205+0000 7f2b94e33640 10 monclient(hunting): my global_id is 27440 2026-02-12T04:04:54.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.205+0000 7f2b94e33640 1 -- 10.20.193.91:0/710663185 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b78003610 con 0x7f2b901575d0 2026-02-12T04:04:54.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.207+0000 7f2b94e33640 1 -- 10.20.193.91:0/710663185 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3293019591 0 0) 0x7f2b900b2390 con 0x7f2b90163310 2026-02-12T04:04:54.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.207+0000 7f2b94e33640 10 monclient(hunting): _negotiate 2026-02-12T04:04:54.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.207+0000 7f2b94e33640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:54.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.207+0000 7f2b94e33640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:54.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.207+0000 7f2b94e33640 10 monclient(hunting): my global_id is 27745 2026-02-12T04:04:54.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.207+0000 7f2b94e33640 1 -- 10.20.193.91:0/710663185 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b900b2670 con 0x7f2b90163310 2026-02-12T04:04:54.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.207+0000 7f2b94e33640 1 -- 10.20.193.91:0/710663185 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 578568142 0 0) 0x7f2b900b20b0 con 0x7f2b900560d0 2026-02-12T04:04:54.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.207+0000 7f2b94e33640 10 monclient(hunting): _negotiate 2026-02-12T04:04:54.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.207+0000 7f2b94e33640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:54.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.207+0000 7f2b94e33640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:54.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.207+0000 7f2b94e33640 10 monclient(hunting): my global_id is 30606 2026-02-12T04:04:54.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.207+0000 7f2b94e33640 1 -- 10.20.193.91:0/710663185 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b900b2390 con 0x7f2b900560d0 2026-02-12T04:04:54.211 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.209+0000 7f2b94e33640 1 -- 10.20.193.91:0/710663185 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3796270108 0 0) 0x7f2b78003610 con 0x7f2b901575d0 2026-02-12T04:04:54.211 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.209+0000 7f2b94e33640 1 -- 10.20.193.91:0/710663185 >> v1:10.20.193.98:6789/0 conn(0x7f2b90163310 legacy=0x7f2b900559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:54.211 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.209+0000 7f2b94e33640 1 -- 10.20.193.91:0/710663185 >> v1:10.20.193.91:6789/0 conn(0x7f2b900560d0 legacy=0x7f2b901c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:54.211 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.209+0000 7f2b94e33640 10 monclient: _finish_hunting 0 2026-02-12T04:04:54.212 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.209+0000 7f2b94e33640 1 monclient: found mon.noname-c 2026-02-12T04:04:54.212 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.209+0000 7f2b94e33640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:54.212 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.209+0000 7f2b94e33640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.111:6789/0 2026-02-12T04:04:54.212 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.209+0000 7f2b94e33640 1 -- 10.20.193.91:0/710663185 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b90162400 con 0x7f2b901575d0 2026-02-12T04:04:54.212 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.209+0000 7f2b94e33640 10 monclient: _finish_auth 0 2026-02-12T04:04:54.212 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.209+0000 7f2b94e33640 10 monclient: _check_auth_tickets 2026-02-12T04:04:54.212 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.209+0000 7f2b94e33640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:54.212 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.209+0000 7f2b980c0640 5 monclient: authenticate success, global_id 27440 2026-02-12T04:04:54.212 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.209+0000 7f2b94e33640 1 -- 10.20.193.91:0/710663185 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f2b80002df0 con 0x7f2b901575d0 2026-02-12T04:04:54.212 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.209+0000 7f2b980c0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:04:54.212 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.209+0000 7f2b94e33640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:54.212 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.209+0000 7f2b94e33640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T04:04:54.213 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.209+0000 7f2b94e33640 10 monclient: dump: 2026-02-12T04:04:54.213 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:54.213 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:54.213 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:54.213 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:54.213 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:54.213 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:54.213 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:54.213 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:54.213 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:54.213 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:54.213 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.209+0000 7f2b980c0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:04:54.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.212+0000 7f2b94e33640 1 -- 10.20.193.91:0/710663185 <== mon.2 v1:10.20.193.111:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2b80002fc0 con 0x7f2b901575d0 2026-02-12T04:04:54.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.212+0000 7f2b94e33640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:54.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.212+0000 7f2b94e33640 1 -- 10.20.193.91:0/710663185 <== mon.2 v1:10.20.193.111:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f2b80003400 con 0x7f2b901575d0 2026-02-12T04:04:54.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.212+0000 7f2b94e33640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:54.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.212+0000 7f2b94e33640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T04:04:54.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.212+0000 7f2b94e33640 10 monclient: dump: 2026-02-12T04:04:54.217 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:54.217 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:54.217 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:54.217 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:54.217 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:54.217 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:54.217 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:54.217 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:54.217 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:54.217 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:54.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.212+0000 7f2b980c0640 10 monclient: get_monmap_and_config success 2026-02-12T04:04:54.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.212+0000 7f2b980c0640 4 set_mon_vals no callback set 2026-02-12T04:04:54.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.212+0000 7f2b980c0640 10 monclient: shutdown 2026-02-12T04:04:54.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.212+0000 7f2b980c0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:54.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.212+0000 7f2b980c0640 1 -- 10.20.193.91:0/710663185 >> v1:10.20.193.111:6789/0 conn(0x7f2b901575d0 legacy=0x7f2b90162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:54.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.212+0000 7f2b980c0640 1 -- 10.20.193.91:0/710663185 shutdown_connections 2026-02-12T04:04:54.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.212+0000 7f2b980c0640 1 -- 10.20.193.91:0/710663185 >> 10.20.193.91:0/710663185 conn(0x7f2b900b6560 msgr2=0x7f2b900b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:54.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.212+0000 7f2b980c0640 1 -- 10.20.193.91:0/710663185 shutdown_connections 2026-02-12T04:04:54.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.212+0000 7f2b980c0640 1 -- 10.20.193.91:0/710663185 wait complete. 2026-02-12T04:04:54.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.213+0000 7f2b980c0640 10 monclient: build_initial_monmap 2026-02-12T04:04:54.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.213+0000 7f2b980c0640 10 monclient: monmap: 2026-02-12T04:04:54.219 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:54.219 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:04:54.219 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:04:54.219 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:04:54.219 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:54.219 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:04:54.219 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:54.219 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:54.219 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:54.219 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:54.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.213+0000 7f2b980c0640 1 librados: starting msgr at 2026-02-12T04:04:54.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.213+0000 7f2b980c0640 1 librados: starting objecter 2026-02-12T04:04:54.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.213+0000 7f2b980c0640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:04:54.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.213+0000 7f2b980c0640 1 Processor -- start 2026-02-12T04:04:54.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.213+0000 7f2b980c0640 1 -- start start 2026-02-12T04:04:54.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.213+0000 7f2b980c0640 1 librados: setting wanted keys 2026-02-12T04:04:54.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.213+0000 7f2b980c0640 1 librados: calling monclient init 2026-02-12T04:04:54.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.213+0000 7f2b980c0640 10 monclient: init 2026-02-12T04:04:54.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.214+0000 7f2b980c0640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:54.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.214+0000 7f2b980c0640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T04:04:54.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.214+0000 7f2b980c0640 10 monclient(hunting): picked mon.noname-a con 0x7f2b900560d0 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:54.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.214+0000 7f2b980c0640 10 monclient(hunting): picked mon.noname-c con 0x7f2b901575d0 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:54.220 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.214+0000 7f2b980c0640 10 monclient(hunting): picked mon.noname-b con 0x7f2b90163310 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:54.221 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.214+0000 7f2b980c0640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b901389c0 con 0x7f2b900560d0 2026-02-12T04:04:54.221 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.214+0000 7f2b980c0640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b901f96d0 con 0x7f2b90163310 2026-02-12T04:04:54.221 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.214+0000 7f2b980c0640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b901f99b0 con 0x7f2b901575d0 2026-02-12T04:04:54.221 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.214+0000 7f2b980c0640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:54.221 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.214+0000 7f2b980c0640 10 monclient(hunting): authenticate will time out at 1496.957084s 2026-02-12T04:04:54.222 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.215+0000 7f2b96636640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f2b90163310 0x7f2b90059490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:45340/0 (socket says 10.20.193.91:45340) 2026-02-12T04:04:54.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.215+0000 7f2b96636640 1 -- 10.20.193.91:0/2353742794 learned_addr learned my addr 10.20.193.91:0/2353742794 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:54.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.216+0000 7f2b7e7fc640 10 client.?.objecter ms_handle_connect 0x7f2b90163310 2026-02-12T04:04:54.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.216+0000 7f2b7e7fc640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:54.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.216+0000 7f2b7e7fc640 10 client.?.objecter ms_handle_connect 0x7f2b900560d0 2026-02-12T04:04:54.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.216+0000 7f2b7e7fc640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:54.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.217+0000 7f2b7e7fc640 10 client.?.objecter ms_handle_connect 0x7f2b901575d0 2026-02-12T04:04:54.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.217+0000 7f2b7e7fc640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:54.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.219+0000 7f2b7e7fc640 1 -- 10.20.193.91:0/2353742794 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 971405278 0 0) 0x7f2b901f96d0 con 0x7f2b90163310 2026-02-12T04:04:54.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.219+0000 7f2b7e7fc640 10 monclient(hunting): _negotiate 2026-02-12T04:04:54.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.219+0000 7f2b7e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:54.223 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.219+0000 7f2b7e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:54.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.219+0000 7f2b7e7fc640 10 monclient(hunting): my global_id is 27748 2026-02-12T04:04:54.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.219+0000 7f2b7e7fc640 1 -- 10.20.193.91:0/2353742794 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b60003610 con 0x7f2b90163310 2026-02-12T04:04:54.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.219+0000 7f2b7e7fc640 1 -- 10.20.193.91:0/2353742794 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 669995782 0 0) 0x7f2b901389c0 con 0x7f2b900560d0 2026-02-12T04:04:54.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.219+0000 7f2b7e7fc640 10 monclient(hunting): _negotiate 2026-02-12T04:04:54.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.219+0000 7f2b7e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:54.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.219+0000 7f2b7e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:54.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.219+0000 7f2b7e7fc640 10 monclient(hunting): my global_id is 30609 2026-02-12T04:04:54.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.219+0000 7f2b7e7fc640 1 -- 10.20.193.91:0/2353742794 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b901f96d0 con 0x7f2b900560d0 2026-02-12T04:04:54.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.219+0000 7f2b7e7fc640 1 -- 10.20.193.91:0/2353742794 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1077290379 0 0) 0x7f2b901f99b0 con 0x7f2b901575d0 2026-02-12T04:04:54.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.219+0000 7f2b7e7fc640 10 monclient(hunting): _negotiate 2026-02-12T04:04:54.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.219+0000 7f2b7e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:54.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.219+0000 7f2b7e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:54.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.219+0000 7f2b7e7fc640 10 monclient(hunting): my global_id is 27443 2026-02-12T04:04:54.225 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.219+0000 7f2b7e7fc640 1 -- 10.20.193.91:0/2353742794 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b901389c0 con 0x7f2b901575d0 2026-02-12T04:04:54.226 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.223+0000 7f2b7e7fc640 1 -- 10.20.193.91:0/2353742794 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 821450179 0 0) 0x7f2b60003610 con 0x7f2b90163310 2026-02-12T04:04:54.226 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.223+0000 7f2b7e7fc640 1 -- 10.20.193.91:0/2353742794 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2b901f99b0 con 0x7f2b90163310 2026-02-12T04:04:54.226 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.223+0000 7f2b7e7fc640 1 -- 10.20.193.91:0/2353742794 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f2b8c003470 con 0x7f2b90163310 2026-02-12T04:04:54.226 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.223+0000 7f2b7e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:54.226 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.223+0000 7f2b7e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T04:04:54.226 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.223+0000 7f2b7e7fc640 10 monclient(hunting): dump: 2026-02-12T04:04:54.226 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:54.226 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:54.227 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:54.227 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:54.227 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:54.227 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:54.227 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:54.227 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:54.227 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:54.227 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:54.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.223+0000 7f2b7e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:04:54.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.224+0000 7f2b7e7fc640 1 -- 10.20.193.91:0/2353742794 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3468667819 0 0) 0x7f2b901f96d0 con 0x7f2b900560d0 2026-02-12T04:04:54.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.224+0000 7f2b7e7fc640 1 -- 10.20.193.91:0/2353742794 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2b60003610 con 0x7f2b900560d0 2026-02-12T04:04:54.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.224+0000 7f2b7e7fc640 1 -- 10.20.193.91:0/2353742794 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f2b80003310 con 0x7f2b900560d0 2026-02-12T04:04:54.228 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.224+0000 7f2b7e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:54.228 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.224+0000 7f2b7e7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T04:04:54.228 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.224+0000 7f2b7e7fc640 10 monclient(hunting): dump: 2026-02-12T04:04:54.228 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:54.228 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:54.228 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:54.228 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:54.228 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:54.228 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:54.228 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:54.228 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:54.228 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:54.228 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:54.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.225+0000 7f2b7e7fc640 1 -- 10.20.193.91:0/2353742794 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2232312955 0 0) 0x7f2b901389c0 con 0x7f2b901575d0 2026-02-12T04:04:54.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.225+0000 7f2b7e7fc640 1 -- 10.20.193.91:0/2353742794 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2b901f96d0 con 0x7f2b901575d0 2026-02-12T04:04:54.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.225+0000 7f2b7e7fc640 1 -- 10.20.193.91:0/2353742794 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f2b84002fc0 con 0x7f2b901575d0 2026-02-12T04:04:54.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.225+0000 7f2b7e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:54.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.225+0000 7f2b7e7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T04:04:54.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.225+0000 7f2b7e7fc640 10 monclient(hunting): dump: 2026-02-12T04:04:54.231 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:54.231 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:54.231 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:54.231 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:54.231 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:54.231 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:54.231 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:54.231 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:54.231 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:54.231 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:54.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.227+0000 7f2b7e7fc640 1 -- 10.20.193.91:0/2353742794 <== mon.1 v1:10.20.193.98:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 974284192 0 0) 0x7f2b901f99b0 con 0x7f2b90163310 2026-02-12T04:04:54.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.227+0000 7f2b7e7fc640 1 -- 10.20.193.91:0/2353742794 >> v1:10.20.193.111:6789/0 conn(0x7f2b901575d0 legacy=0x7f2b901382b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:54.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.227+0000 7f2b7e7fc640 1 -- 10.20.193.91:0/2353742794 >> v1:10.20.193.91:6789/0 conn(0x7f2b900560d0 legacy=0x7f2b901f8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:54.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.227+0000 7f2b7e7fc640 10 monclient: _finish_hunting 0 2026-02-12T04:04:54.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.227+0000 7f2b7e7fc640 1 monclient: found mon.b 2026-02-12T04:04:54.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.227+0000 7f2b7e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:54.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.227+0000 7f2b7e7fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:04:54.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.227+0000 7f2b7e7fc640 1 -- 10.20.193.91:0/2353742794 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b900589d0 con 0x7f2b90163310 2026-02-12T04:04:54.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.227+0000 7f2b7e7fc640 10 monclient: _finish_auth 0 2026-02-12T04:04:54.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.227+0000 7f2b7e7fc640 10 monclient: _check_auth_tickets 2026-02-12T04:04:54.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.227+0000 7f2b7e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:54.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.227+0000 7f2b980c0640 5 monclient: authenticate success, global_id 27748 2026-02-12T04:04:54.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.227+0000 7f2b980c0640 10 monclient: _renew_subs 2026-02-12T04:04:54.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.227+0000 7f2b980c0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:04:54.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.227+0000 7f2b980c0640 1 -- 10.20.193.91:0/2353742794 --> v1:10.20.193.98:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2b90058cb0 con 0x7f2b90163310 2026-02-12T04:04:54.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.227+0000 7f2b980c0640 10 client.27748.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:04:54.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.227+0000 7f2b980c0640 10 monclient: _renew_subs 2026-02-12T04:04:54.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.227+0000 7f2b980c0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:04:54.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.227+0000 7f2b980c0640 1 -- 10.20.193.91:0/2353742794 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2b901f9c90 con 0x7f2b90163310 2026-02-12T04:04:54.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.227+0000 7f2b980c0640 1 librados: init done 2026-02-12T04:04:54.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.228+0000 7f2b980c0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:54.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.228+0000 7f2b980c0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:54.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.228+0000 7f2b980c0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:04:54.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.228+0000 7f2b980c0640 1 -- 10.20.193.91:0/2353742794 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b90057230 con 0x7f2b90163310 2026-02-12T04:04:54.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.324+0000 7f2b7e7fc640 1 -- 10.20.193.91:0/2353742794 <== mon.1 v1:10.20.193.98:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2b8c003820 con 0x7f2b90163310 2026-02-12T04:04:54.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.324+0000 7f2b7e7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:54.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.324+0000 7f2b7e7fc640 1 -- 10.20.193.91:0/2353742794 <== mon.1 v1:10.20.193.98:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f2b8c003ed0 con 0x7f2b90163310 2026-02-12T04:04:54.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.324+0000 7f2b7e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:54.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.324+0000 7f2b7ffff640 4 set_mon_vals no callback set 2026-02-12T04:04:54.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.324+0000 7f2b7e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T04:04:54.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.324+0000 7f2b7e7fc640 10 monclient: dump: 2026-02-12T04:04:54.327 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:54.327 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:54.327 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:54.328 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:54.328 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:54.328 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:54.328 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:54.328 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:54.328 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:54.328 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:54.329 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.325+0000 7f2b7e7fc640 1 -- 10.20.193.91:0/2353742794 <== mon.1 v1:10.20.193.98:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f2b8c0040b0 con 0x7f2b90163310 2026-02-12T04:04:54.329 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.326+0000 7f2b95e35640 10 monclient: get_auth_request con 0x7f2b6007a090 auth_method 0 2026-02-12T04:04:54.329 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.326+0000 7f2b7e7fc640 10 client.27748.objecter ms_handle_connect 0x7f2b6007a090 2026-02-12T04:04:54.329 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.327+0000 7f2b7e7fc640 1 -- 10.20.193.91:0/2353742794 <== mon.1 v1:10.20.193.98:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7f2b8c095e30 con 0x7f2b90163310 2026-02-12T04:04:54.329 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.327+0000 7f2b7e7fc640 10 client.27748.objecter ms_dispatch2 0x7f2b90000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:04:54.330 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.327+0000 7f2b7e7fc640 3 client.27748.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:04:54.330 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.327+0000 7f2b7e7fc640 3 client.27748.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:04:54.330 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.327+0000 7f2b7e7fc640 20 client.27748.objecter dump_active .. 0 homeless 2026-02-12T04:04:54.332 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.330+0000 7f2b7e7fc640 1 -- 10.20.193.91:0/2353742794 <== mon.1 v1:10.20.193.98:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f2b8c05f790 con 0x7f2b90163310 2026-02-12T04:04:54.332 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.330+0000 7f2b7e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:54.332 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.330+0000 7f2b7e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T04:04:54.439 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.437+0000 7f2b980c0640 1 -- 10.20.193.91:0/2353742794 --> v1:10.20.193.91:6800/2929217192 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2b900b7290 con 0x7f2b6007a090 2026-02-12T04:04:54.441 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.439+0000 7f2b7e7fc640 1 -- 10.20.193.91:0/2353742794 <== mgr.4113 v1:10.20.193.91:6800/2929217192 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+125705 (unknown 2965378022 0 309643137) 0x7f2b900b7290 con 0x7f2b6007a090 2026-02-12T04:04:54.442 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T04:04:54.443 INFO:teuthology.orchestra.run.trial091.stderr:dumped all 2026-02-12T04:04:54.444 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.441+0000 7f2b980c0640 10 librados: watch_flush enter 2026-02-12T04:04:54.444 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.441+0000 7f2b980c0640 10 librados: watch_flush exit 2026-02-12T04:04:54.444 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.441+0000 7f2b980c0640 20 client.27748.objecter shutdown clearing up homeless session... 2026-02-12T04:04:54.445 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.441+0000 7f2b980c0640 10 client.27748.objecter successfully canceled tick 2026-02-12T04:04:54.445 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.441+0000 7f2b980c0640 1 -- 10.20.193.91:0/2353742794 >> v1:10.20.193.91:6800/2929217192 conn(0x7f2b6007a090 legacy=0x7f2b6009a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:54.445 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.441+0000 7f2b980c0640 10 monclient: shutdown 2026-02-12T04:04:54.445 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.441+0000 7f2b980c0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:54.445 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.441+0000 7f2b980c0640 1 -- 10.20.193.91:0/2353742794 >> v1:10.20.193.98:6789/0 conn(0x7f2b90163310 legacy=0x7f2b90059490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:54.445 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.441+0000 7f2b980c0640 1 -- 10.20.193.91:0/2353742794 shutdown_connections 2026-02-12T04:04:54.445 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.441+0000 7f2b980c0640 1 -- 10.20.193.91:0/2353742794 >> 10.20.193.91:0/2353742794 conn(0x7f2b900b6560 msgr2=0x7f2b90160390 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:54.445 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.441+0000 7f2b980c0640 1 -- 10.20.193.91:0/2353742794 shutdown_connections 2026-02-12T04:04:54.445 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.441+0000 7f2b980c0640 1 -- 10.20.193.91:0/2353742794 wait complete. 2026-02-12T04:04:54.445 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.441+0000 7f2b980c0640 1 librados: shutdown 2026-02-12T04:04:54.452 INFO:teuthology.orchestra.run.trial091.stdout:{"pg_ready":true,"pg_map":{"version":537,"stamp":"2026-02-12T04:04:54.088738+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":56,"num_read_kb":47,"num_write":70,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":492256,"kb_used_data":60896,"kb_used_omap":24486,"kb_used_meta":406617,"kb_avail":1509457184,"statfs":{"total":1546188226560,"available":1545684156416,"internally_reserved":0,"allocated":62357504,"data_stored":69830166,"data_compressed":12764925,"data_compressed_allocated":23138304,"data_compressed_original":59803128,"omap_allocated":25074406,"internal_metadata":416376090},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":98,"apply_latency_ms":98,"commit_latency_ns":98000000,"apply_latency_ns":98000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000587"},"pg_stats":[{"pgid":"10.1a","version":"0'0","reported_seq":624,"reported_epoch":340,"state":"active+clean","last_fresh":"2026-02-12T04:04:49.307423+0000","last_change":"2026-02-12T03:59:14.506367+0000","last_active":"2026-02-12T04:04:49.307423+0000","last_peered":"2026-02-12T04:04:49.307423+0000","last_clean":"2026-02-12T04:04:49.307423+0000","last_became_active":"2026-02-12T03:59:14.484825+0000","last_became_peered":"2026-02-12T03:59:14.484825+0000","last_unstale":"2026-02-12T04:04:49.307423+0000","last_undegraded":"2026-02-12T04:04:49.307423+0000","last_fullsized":"2026-02-12T04:04:49.307423+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T13:39:56.222964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6],"acting":[11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":626,"reported_epoch":339,"state":"active+clean","last_fresh":"2026-02-12T04:04:48.931287+0000","last_change":"2026-02-12T03:59:13.271129+0000","last_active":"2026-02-12T04:04:48.931287+0000","last_peered":"2026-02-12T04:04:48.931287+0000","last_clean":"2026-02-12T04:04:48.931287+0000","last_became_active":"2026-02-12T03:59:13.250886+0000","last_became_peered":"2026-02-12T03:59:13.250886+0000","last_unstale":"2026-02-12T04:04:48.931287+0000","last_undegraded":"2026-02-12T04:04:48.931287+0000","last_fullsized":"2026-02-12T04:04:48.931287+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:56:54.392976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,0],"acting":[15,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":628,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.274187+0000","last_change":"2026-02-12T03:59:13.542338+0000","last_active":"2026-02-12T04:04:52.274187+0000","last_peered":"2026-02-12T04:04:52.274187+0000","last_clean":"2026-02-12T04:04:52.274187+0000","last_became_active":"2026-02-12T03:59:13.540079+0000","last_became_peered":"2026-02-12T03:59:13.540079+0000","last_unstale":"2026-02-12T04:04:52.274187+0000","last_undegraded":"2026-02-12T04:04:52.274187+0000","last_fullsized":"2026-02-12T04:04:52.274187+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T06:07:29.122582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,14],"acting":[4,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":632,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.319636+0000","last_change":"2026-02-12T03:59:13.067079+0000","last_active":"2026-02-12T04:04:53.319636+0000","last_peered":"2026-02-12T04:04:53.319636+0000","last_clean":"2026-02-12T04:04:53.319636+0000","last_became_active":"2026-02-12T03:59:13.054800+0000","last_became_peered":"2026-02-12T03:59:13.054800+0000","last_unstale":"2026-02-12T04:04:53.319636+0000","last_undegraded":"2026-02-12T04:04:53.319636+0000","last_fullsized":"2026-02-12T04:04:53.319636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T08:49:22.540651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":626,"reported_epoch":339,"state":"active+clean","last_fresh":"2026-02-12T04:04:48.933438+0000","last_change":"2026-02-12T03:59:13.308993+0000","last_active":"2026-02-12T04:04:48.933438+0000","last_peered":"2026-02-12T04:04:48.933438+0000","last_clean":"2026-02-12T04:04:48.933438+0000","last_became_active":"2026-02-12T03:59:13.246053+0000","last_became_peered":"2026-02-12T03:59:13.246053+0000","last_unstale":"2026-02-12T04:04:48.933438+0000","last_undegraded":"2026-02-12T04:04:48.933438+0000","last_fullsized":"2026-02-12T04:04:48.933438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T12:53:48.331317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,7],"acting":[15,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":632,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.347759+0000","last_change":"2026-02-12T03:59:13.329534+0000","last_active":"2026-02-12T04:04:53.347759+0000","last_peered":"2026-02-12T04:04:53.347759+0000","last_clean":"2026-02-12T04:04:53.347759+0000","last_became_active":"2026-02-12T03:59:13.325110+0000","last_became_peered":"2026-02-12T03:59:13.325110+0000","last_unstale":"2026-02-12T04:04:53.347759+0000","last_undegraded":"2026-02-12T04:04:53.347759+0000","last_fullsized":"2026-02-12T04:04:53.347759+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T13:01:51.962329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":627,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-12T04:04:51.221968+0000","last_change":"2026-02-12T03:59:13.470926+0000","last_active":"2026-02-12T04:04:51.221968+0000","last_peered":"2026-02-12T04:04:51.221968+0000","last_clean":"2026-02-12T04:04:51.221968+0000","last_became_active":"2026-02-12T03:59:13.466259+0000","last_became_peered":"2026-02-12T03:59:13.466259+0000","last_unstale":"2026-02-12T04:04:51.221968+0000","last_undegraded":"2026-02-12T04:04:51.221968+0000","last_fullsized":"2026-02-12T04:04:51.221968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:30:59.565179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":627,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-12T04:04:51.233689+0000","last_change":"2026-02-12T03:59:13.501116+0000","last_active":"2026-02-12T04:04:51.233689+0000","last_peered":"2026-02-12T04:04:51.233689+0000","last_clean":"2026-02-12T04:04:51.233689+0000","last_became_active":"2026-02-12T03:59:13.497818+0000","last_became_peered":"2026-02-12T03:59:13.497818+0000","last_unstale":"2026-02-12T04:04:51.233689+0000","last_undegraded":"2026-02-12T04:04:51.233689+0000","last_fullsized":"2026-02-12T04:04:51.233689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T07:00:27.016290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":632,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.367366+0000","last_change":"2026-02-12T03:59:13.134257+0000","last_active":"2026-02-12T04:04:53.367366+0000","last_peered":"2026-02-12T04:04:53.367366+0000","last_clean":"2026-02-12T04:04:53.367366+0000","last_became_active":"2026-02-12T03:59:13.116472+0000","last_became_peered":"2026-02-12T03:59:13.116472+0000","last_unstale":"2026-02-12T04:04:53.367366+0000","last_undegraded":"2026-02-12T04:04:53.367366+0000","last_fullsized":"2026-02-12T04:04:53.367366+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T10:34:46.392533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,3],"acting":[14,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":632,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.320753+0000","last_change":"2026-02-12T03:59:13.090778+0000","last_active":"2026-02-12T04:04:53.320753+0000","last_peered":"2026-02-12T04:04:53.320753+0000","last_clean":"2026-02-12T04:04:53.320753+0000","last_became_active":"2026-02-12T03:59:13.088475+0000","last_became_peered":"2026-02-12T03:59:13.088475+0000","last_unstale":"2026-02-12T04:04:53.320753+0000","last_undegraded":"2026-02-12T04:04:53.320753+0000","last_fullsized":"2026-02-12T04:04:53.320753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T04:11:16.331392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":630,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.270957+0000","last_change":"2026-02-12T03:59:14.956219+0000","last_active":"2026-02-12T04:04:52.270957+0000","last_peered":"2026-02-12T04:04:52.270957+0000","last_clean":"2026-02-12T04:04:52.270957+0000","last_became_active":"2026-02-12T03:59:14.947424+0000","last_became_peered":"2026-02-12T03:59:14.947424+0000","last_unstale":"2026-02-12T04:04:52.270957+0000","last_undegraded":"2026-02-12T04:04:52.270957+0000","last_fullsized":"2026-02-12T04:04:52.270957+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T11:01:54.553548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,11],"acting":[12,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"10.1","version":"33'11","reported_seq":658,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.264604+0000","last_change":"2026-02-12T03:59:13.848583+0000","last_active":"2026-02-12T04:04:52.264604+0000","last_peered":"2026-02-12T04:04:52.264604+0000","last_clean":"2026-02-12T04:04:52.264604+0000","last_became_active":"2026-02-12T03:59:13.846131+0000","last_became_peered":"2026-02-12T03:59:13.846131+0000","last_unstale":"2026-02-12T04:04:52.264604+0000","last_undegraded":"2026-02-12T04:04:52.264604+0000","last_fullsized":"2026-02-12T04:04:52.264604+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T04:28:11.002392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,7],"acting":[10,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"1.0","version":"24'32","reported_seq":689,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.314113+0000","last_change":"2026-02-12T03:58:33.836000+0000","last_active":"2026-02-12T04:04:52.314113+0000","last_peered":"2026-02-12T04:04:52.314113+0000","last_clean":"2026-02-12T04:04:52.314113+0000","last_became_active":"2026-02-12T03:58:33.819911+0000","last_became_peered":"2026-02-12T03:58:33.819911+0000","last_unstale":"2026-02-12T04:04:52.314113+0000","last_undegraded":"2026-02-12T04:04:52.314113+0000","last_fullsized":"2026-02-12T04:04:52.314113+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:32.372907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:32.372907+0000","last_clean_scrub_stamp":"2026-02-12T03:58:32.372907+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T08:01:25.009200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,15],"acting":[2,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"26'1","reported_seq":650,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.243780+0000","last_change":"2026-02-12T03:58:44.065350+0000","last_active":"2026-02-12T04:04:52.243780+0000","last_peered":"2026-02-12T04:04:52.243780+0000","last_clean":"2026-02-12T04:04:52.243780+0000","last_became_active":"2026-02-12T03:58:42.128882+0000","last_became_peered":"2026-02-12T03:58:42.128882+0000","last_unstale":"2026-02-12T04:04:52.243780+0000","last_undegraded":"2026-02-12T04:04:52.243780+0000","last_fullsized":"2026-02-12T04:04:52.243780+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T08:20:23.062411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058002405,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6],"acting":[8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":632,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.260835+0000","last_change":"2026-02-12T03:59:13.938696+0000","last_active":"2026-02-12T04:04:52.260835+0000","last_peered":"2026-02-12T04:04:52.260835+0000","last_clean":"2026-02-12T04:04:52.260835+0000","last_became_active":"2026-02-12T03:59:13.918494+0000","last_became_peered":"2026-02-12T03:59:13.918494+0000","last_unstale":"2026-02-12T04:04:52.260835+0000","last_undegraded":"2026-02-12T04:04:52.260835+0000","last_fullsized":"2026-02-12T04:04:52.260835+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T05:10:10.233810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":644,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-12T04:04:51.223333+0000","last_change":"2026-02-12T03:58:44.008038+0000","last_active":"2026-02-12T04:04:51.223333+0000","last_peered":"2026-02-12T04:04:51.223333+0000","last_clean":"2026-02-12T04:04:51.223333+0000","last_became_active":"2026-02-12T03:58:42.530615+0000","last_became_peered":"2026-02-12T03:58:42.530615+0000","last_unstale":"2026-02-12T04:04:51.223333+0000","last_undegraded":"2026-02-12T04:04:51.223333+0000","last_fullsized":"2026-02-12T04:04:51.223333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T12:12:39.355846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030042276999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":632,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.318115+0000","last_change":"2026-02-12T03:59:12.994781+0000","last_active":"2026-02-12T04:04:53.318115+0000","last_peered":"2026-02-12T04:04:53.318115+0000","last_clean":"2026-02-12T04:04:53.318115+0000","last_became_active":"2026-02-12T03:59:12.992488+0000","last_became_peered":"2026-02-12T03:59:12.992488+0000","last_unstale":"2026-02-12T04:04:53.318115+0000","last_undegraded":"2026-02-12T04:04:53.318115+0000","last_fullsized":"2026-02-12T04:04:53.318115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:28:37.264382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,13],"acting":[7,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":650,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.232893+0000","last_change":"2026-02-12T03:58:44.019395+0000","last_active":"2026-02-12T04:04:52.232893+0000","last_peered":"2026-02-12T04:04:52.232893+0000","last_clean":"2026-02-12T04:04:52.232893+0000","last_became_active":"2026-02-12T03:58:42.143466+0000","last_became_peered":"2026-02-12T03:58:42.143466+0000","last_unstale":"2026-02-12T04:04:52.232893+0000","last_undegraded":"2026-02-12T04:04:52.232893+0000","last_fullsized":"2026-02-12T04:04:52.232893+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T08:05:12.033817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030228985,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":626,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-12T04:04:51.225699+0000","last_change":"2026-02-12T03:59:13.213383+0000","last_active":"2026-02-12T04:04:51.225699+0000","last_peered":"2026-02-12T04:04:51.225699+0000","last_clean":"2026-02-12T04:04:51.225699+0000","last_became_active":"2026-02-12T03:59:13.207238+0000","last_became_peered":"2026-02-12T03:59:13.207238+0000","last_unstale":"2026-02-12T04:04:51.225699+0000","last_undegraded":"2026-02-12T04:04:51.225699+0000","last_fullsized":"2026-02-12T04:04:51.225699+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T06:27:24.872444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"28'2","reported_seq":651,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.242142+0000","last_change":"2026-02-12T03:58:44.064995+0000","last_active":"2026-02-12T04:04:52.242142+0000","last_peered":"2026-02-12T04:04:52.242142+0000","last_clean":"2026-02-12T04:04:52.242142+0000","last_became_active":"2026-02-12T03:58:42.443435+0000","last_became_peered":"2026-02-12T03:58:42.443435+0000","last_unstale":"2026-02-12T04:04:52.242142+0000","last_undegraded":"2026-02-12T04:04:52.242142+0000","last_fullsized":"2026-02-12T04:04:52.242142+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T11:15:40.933288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.069533228000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":616,"reported_epoch":339,"state":"active+clean","last_fresh":"2026-02-12T04:04:48.816793+0000","last_change":"2026-02-12T03:59:13.223551+0000","last_active":"2026-02-12T04:04:48.816793+0000","last_peered":"2026-02-12T04:04:48.816793+0000","last_clean":"2026-02-12T04:04:48.816793+0000","last_became_active":"2026-02-12T03:59:13.221176+0000","last_became_peered":"2026-02-12T03:59:13.221176+0000","last_unstale":"2026-02-12T04:04:48.816793+0000","last_undegraded":"2026-02-12T04:04:48.816793+0000","last_fullsized":"2026-02-12T04:04:48.816793+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T11:13:27.835565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11],"acting":[1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":645,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.448369+0000","last_change":"2026-02-12T03:58:44.390979+0000","last_active":"2026-02-12T04:04:53.448369+0000","last_peered":"2026-02-12T04:04:53.448369+0000","last_clean":"2026-02-12T04:04:53.448369+0000","last_became_active":"2026-02-12T03:58:42.128705+0000","last_became_peered":"2026-02-12T03:58:42.128705+0000","last_unstale":"2026-02-12T04:04:53.448369+0000","last_undegraded":"2026-02-12T04:04:53.448369+0000","last_fullsized":"2026-02-12T04:04:53.448369+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T04:06:44.956414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.043458169999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":626,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-12T04:04:51.227672+0000","last_change":"2026-02-12T03:59:13.662145+0000","last_active":"2026-02-12T04:04:51.227672+0000","last_peered":"2026-02-12T04:04:51.227672+0000","last_clean":"2026-02-12T04:04:51.227672+0000","last_became_active":"2026-02-12T03:59:13.639048+0000","last_became_peered":"2026-02-12T03:59:13.639048+0000","last_unstale":"2026-02-12T04:04:51.227672+0000","last_undegraded":"2026-02-12T04:04:51.227672+0000","last_fullsized":"2026-02-12T04:04:51.227672+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T14:17:15.031582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,14],"acting":[0,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":645,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.452474+0000","last_change":"2026-02-12T03:58:44.393932+0000","last_active":"2026-02-12T04:04:53.452474+0000","last_peered":"2026-02-12T04:04:53.452474+0000","last_clean":"2026-02-12T04:04:53.452474+0000","last_became_active":"2026-02-12T03:58:42.477478+0000","last_became_peered":"2026-02-12T03:58:42.477478+0000","last_unstale":"2026-02-12T04:04:53.452474+0000","last_undegraded":"2026-02-12T04:04:53.452474+0000","last_fullsized":"2026-02-12T04:04:53.452474+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:13:02.779200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.042443649,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":626,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-12T04:04:51.229644+0000","last_change":"2026-02-12T03:59:13.153999+0000","last_active":"2026-02-12T04:04:51.229644+0000","last_peered":"2026-02-12T04:04:51.229644+0000","last_clean":"2026-02-12T04:04:51.229644+0000","last_became_active":"2026-02-12T03:59:13.151732+0000","last_became_peered":"2026-02-12T03:59:13.151732+0000","last_unstale":"2026-02-12T04:04:51.229644+0000","last_undegraded":"2026-02-12T04:04:51.229644+0000","last_fullsized":"2026-02-12T04:04:51.229644+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T14:04:35.028100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":649,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.266913+0000","last_change":"2026-02-12T03:58:44.186869+0000","last_active":"2026-02-12T04:04:52.266913+0000","last_peered":"2026-02-12T04:04:52.266913+0000","last_clean":"2026-02-12T04:04:52.266913+0000","last_became_active":"2026-02-12T03:58:41.959956+0000","last_became_peered":"2026-02-12T03:58:41.959956+0000","last_unstale":"2026-02-12T04:04:52.266913+0000","last_undegraded":"2026-02-12T04:04:52.266913+0000","last_fullsized":"2026-02-12T04:04:52.266913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T10:02:09.820740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032971485000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,15],"acting":[10,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":626,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-12T04:04:51.231927+0000","last_change":"2026-02-12T03:59:13.349359+0000","last_active":"2026-02-12T04:04:51.231927+0000","last_peered":"2026-02-12T04:04:51.231927+0000","last_clean":"2026-02-12T04:04:51.231927+0000","last_became_active":"2026-02-12T03:59:13.347203+0000","last_became_peered":"2026-02-12T03:59:13.347203+0000","last_unstale":"2026-02-12T04:04:51.231927+0000","last_undegraded":"2026-02-12T04:04:51.231927+0000","last_fullsized":"2026-02-12T04:04:51.231927+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T05:50:59.198319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":649,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.256260+0000","last_change":"2026-02-12T03:58:44.073484+0000","last_active":"2026-02-12T04:04:52.256260+0000","last_peered":"2026-02-12T04:04:52.256260+0000","last_clean":"2026-02-12T04:04:52.256260+0000","last_became_active":"2026-02-12T03:58:42.327696+0000","last_became_peered":"2026-02-12T03:58:42.327696+0000","last_unstale":"2026-02-12T04:04:52.256260+0000","last_undegraded":"2026-02-12T04:04:52.256260+0000","last_fullsized":"2026-02-12T04:04:52.256260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T07:45:24.713381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.065547275000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,14],"acting":[8,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":632,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.390570+0000","last_change":"2026-02-12T03:59:14.920383+0000","last_active":"2026-02-12T04:04:53.390570+0000","last_peered":"2026-02-12T04:04:53.390570+0000","last_clean":"2026-02-12T04:04:53.390570+0000","last_became_active":"2026-02-12T03:59:14.917311+0000","last_became_peered":"2026-02-12T03:59:14.917311+0000","last_unstale":"2026-02-12T04:04:53.390570+0000","last_undegraded":"2026-02-12T04:04:53.390570+0000","last_fullsized":"2026-02-12T04:04:53.390570+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:47:34.135464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,2],"acting":[14,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":624,"reported_epoch":340,"state":"active+clean","last_fresh":"2026-02-12T04:04:49.311415+0000","last_change":"2026-02-12T03:59:14.922629+0000","last_active":"2026-02-12T04:04:49.311415+0000","last_peered":"2026-02-12T04:04:49.311415+0000","last_clean":"2026-02-12T04:04:49.311415+0000","last_became_active":"2026-02-12T03:59:14.899726+0000","last_became_peered":"2026-02-12T03:59:14.899726+0000","last_unstale":"2026-02-12T04:04:49.311415+0000","last_undegraded":"2026-02-12T04:04:49.311415+0000","last_fullsized":"2026-02-12T04:04:49.311415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T06:41:07.216123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":633,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.235239+0000","last_change":"2026-02-12T03:59:13.261070+0000","last_active":"2026-02-12T04:04:52.235239+0000","last_peered":"2026-02-12T04:04:52.235239+0000","last_clean":"2026-02-12T04:04:52.235239+0000","last_became_active":"2026-02-12T03:59:13.258353+0000","last_became_peered":"2026-02-12T03:59:13.258353+0000","last_unstale":"2026-02-12T04:04:52.235239+0000","last_undegraded":"2026-02-12T04:04:52.235239+0000","last_fullsized":"2026-02-12T04:04:52.235239+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T04:31:20.008810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":627,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-12T04:04:51.229832+0000","last_change":"2026-02-12T03:59:13.222666+0000","last_active":"2026-02-12T04:04:51.229832+0000","last_peered":"2026-02-12T04:04:51.229832+0000","last_clean":"2026-02-12T04:04:51.229832+0000","last_became_active":"2026-02-12T03:59:13.219996+0000","last_became_peered":"2026-02-12T03:59:13.219996+0000","last_unstale":"2026-02-12T04:04:51.229832+0000","last_undegraded":"2026-02-12T04:04:51.229832+0000","last_fullsized":"2026-02-12T04:04:51.229832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T14:24:56.118560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,8],"acting":[6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":631,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.276036+0000","last_change":"2026-02-12T03:59:14.179968+0000","last_active":"2026-02-12T04:04:52.276036+0000","last_peered":"2026-02-12T04:04:52.276036+0000","last_clean":"2026-02-12T04:04:52.276036+0000","last_became_active":"2026-02-12T03:59:14.177484+0000","last_became_peered":"2026-02-12T03:59:14.177484+0000","last_unstale":"2026-02-12T04:04:52.276036+0000","last_undegraded":"2026-02-12T04:04:52.276036+0000","last_fullsized":"2026-02-12T04:04:52.276036+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T12:21:26.417548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,9],"acting":[13,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":631,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.280656+0000","last_change":"2026-02-12T03:59:13.723128+0000","last_active":"2026-02-12T04:04:52.280656+0000","last_peered":"2026-02-12T04:04:52.280656+0000","last_clean":"2026-02-12T04:04:52.280656+0000","last_became_active":"2026-02-12T03:59:13.720549+0000","last_became_peered":"2026-02-12T03:59:13.720549+0000","last_unstale":"2026-02-12T04:04:52.280656+0000","last_undegraded":"2026-02-12T04:04:52.280656+0000","last_fullsized":"2026-02-12T04:04:52.280656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T04:30:20.689176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,15],"acting":[5,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":626,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.315069+0000","last_change":"2026-02-12T03:59:13.863936+0000","last_active":"2026-02-12T04:04:52.315069+0000","last_peered":"2026-02-12T04:04:52.315069+0000","last_clean":"2026-02-12T04:04:52.315069+0000","last_became_active":"2026-02-12T03:59:13.846922+0000","last_became_peered":"2026-02-12T03:59:13.846922+0000","last_unstale":"2026-02-12T04:04:52.315069+0000","last_undegraded":"2026-02-12T04:04:52.315069+0000","last_fullsized":"2026-02-12T04:04:52.315069+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:17:54.924916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":624,"reported_epoch":340,"state":"active+clean","last_fresh":"2026-02-12T04:04:49.309230+0000","last_change":"2026-02-12T03:59:14.860387+0000","last_active":"2026-02-12T04:04:49.309230+0000","last_peered":"2026-02-12T04:04:49.309230+0000","last_clean":"2026-02-12T04:04:49.309230+0000","last_became_active":"2026-02-12T03:59:14.858194+0000","last_became_peered":"2026-02-12T03:59:14.858194+0000","last_unstale":"2026-02-12T04:04:49.309230+0000","last_undegraded":"2026-02-12T04:04:49.309230+0000","last_fullsized":"2026-02-12T04:04:49.309230+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:17:18.432397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":624,"reported_epoch":340,"state":"active+clean","last_fresh":"2026-02-12T04:04:49.306663+0000","last_change":"2026-02-12T03:59:14.314170+0000","last_active":"2026-02-12T04:04:49.306663+0000","last_peered":"2026-02-12T04:04:49.306663+0000","last_clean":"2026-02-12T04:04:49.306663+0000","last_became_active":"2026-02-12T03:59:14.311690+0000","last_became_peered":"2026-02-12T03:59:14.311690+0000","last_unstale":"2026-02-12T04:04:49.306663+0000","last_undegraded":"2026-02-12T04:04:49.306663+0000","last_fullsized":"2026-02-12T04:04:49.306663+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T11:08:54.179415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,13],"acting":[11,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":630,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.279487+0000","last_change":"2026-02-12T03:59:13.474307+0000","last_active":"2026-02-12T04:04:52.279487+0000","last_peered":"2026-02-12T04:04:52.279487+0000","last_clean":"2026-02-12T04:04:52.279487+0000","last_became_active":"2026-02-12T03:59:13.469019+0000","last_became_peered":"2026-02-12T03:59:13.469019+0000","last_unstale":"2026-02-12T04:04:52.279487+0000","last_undegraded":"2026-02-12T04:04:52.279487+0000","last_fullsized":"2026-02-12T04:04:52.279487+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:39:25.438275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,2],"acting":[12,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":628,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.449552+0000","last_change":"2026-02-12T03:59:13.092892+0000","last_active":"2026-02-12T04:04:53.449552+0000","last_peered":"2026-02-12T04:04:53.449552+0000","last_clean":"2026-02-12T04:04:53.449552+0000","last_became_active":"2026-02-12T03:59:13.075804+0000","last_became_peered":"2026-02-12T03:59:13.075804+0000","last_unstale":"2026-02-12T04:04:53.449552+0000","last_undegraded":"2026-02-12T04:04:53.449552+0000","last_fullsized":"2026-02-12T04:04:53.449552+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T05:40:29.002904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,13],"acting":[3,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":627,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-12T04:04:51.230779+0000","last_change":"2026-02-12T03:59:13.511621+0000","last_active":"2026-02-12T04:04:51.230779+0000","last_peered":"2026-02-12T04:04:51.230779+0000","last_clean":"2026-02-12T04:04:51.230779+0000","last_became_active":"2026-02-12T03:59:13.509387+0000","last_became_peered":"2026-02-12T03:59:13.509387+0000","last_unstale":"2026-02-12T04:04:51.230779+0000","last_undegraded":"2026-02-12T04:04:51.230779+0000","last_fullsized":"2026-02-12T04:04:51.230779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:19:12.104502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":633,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.238120+0000","last_change":"2026-02-12T03:59:13.135837+0000","last_active":"2026-02-12T04:04:52.238120+0000","last_peered":"2026-02-12T04:04:52.238120+0000","last_clean":"2026-02-12T04:04:52.238120+0000","last_became_active":"2026-02-12T03:59:13.130685+0000","last_became_peered":"2026-02-12T03:59:13.130685+0000","last_unstale":"2026-02-12T04:04:52.238120+0000","last_undegraded":"2026-02-12T04:04:52.238120+0000","last_fullsized":"2026-02-12T04:04:52.238120+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T05:20:55.632623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":918560,"data_compressed":2320,"data_compressed_allocated":65536,"data_compressed_original":917504,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":22,"seq":94489280590,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30728,"kb_used_data":3768,"kb_used_omap":3011,"kb_used_meta":23932,"kb_avail":94341112,"statfs":{"total":96636764160,"available":96605298688,"internally_reserved":0,"allocated":3858432,"data_stored":4264916,"data_compressed":788959,"data_compressed_allocated":1425408,"data_compressed_original":3643151,"omap_allocated":3083681,"internal_metadata":24506975},"hb_peers":[0,1,2,4,5,6,7,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280589,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30724,"kb_used_data":3764,"kb_used_omap":201,"kb_used_meta":26742,"kb_avail":94341116,"statfs":{"total":96636764160,"available":96605302784,"internally_reserved":0,"allocated":3854336,"data_stored":4264897,"data_compressed":788959,"data_compressed_allocated":1425408,"data_compressed_original":3643151,"omap_allocated":206636,"internal_metadata":27384020},"hb_peers":[0,2,3,4,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280591,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30764,"kb_used_data":3804,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94341076,"statfs":{"total":96636764160,"available":96605261824,"internally_reserved":0,"allocated":3895296,"data_stored":4728273,"data_compressed":790119,"data_compressed_allocated":1458176,"data_compressed_original":4101903,"omap_allocated":214030,"internal_metadata":27376626},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313294,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30760,"kb_used_data":3800,"kb_used_omap":3017,"kb_used_meta":23926,"kb_avail":94341080,"statfs":{"total":96636764160,"available":96605265920,"internally_reserved":0,"allocated":3891200,"data_stored":4306425,"data_compressed":797549,"data_compressed_allocated":1441792,"data_compressed_original":3679690,"omap_allocated":3089836,"internal_metadata":24500820},"hb_peers":[1,2,3,4,5,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313294,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30768,"kb_used_data":3808,"kb_used_omap":3016,"kb_used_meta":23927,"kb_avail":94341072,"statfs":{"total":96636764160,"available":96605257728,"internally_reserved":0,"allocated":3899392,"data_stored":4316437,"data_compressed":799680,"data_compressed_allocated":1445888,"data_compressed_original":3688995,"omap_allocated":3089334,"internal_metadata":24501322},"hb_peers":[0,1,3,4,5,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":21,"seq":90194313295,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30760,"kb_used_data":3800,"kb_used_omap":3018,"kb_used_meta":23925,"kb_avail":94341080,"statfs":{"total":96636764160,"available":96605265920,"internally_reserved":0,"allocated":3891200,"data_stored":4306425,"data_compressed":797549,"data_compressed_allocated":1441792,"data_compressed_original":3679690,"omap_allocated":3090649,"internal_metadata":24500007},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313295,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30804,"kb_used_data":3844,"kb_used_omap":208,"kb_used_meta":26735,"kb_avail":94341036,"statfs":{"total":96636764160,"available":96605220864,"internally_reserved":0,"allocated":3936256,"data_stored":4775717,"data_compressed":800840,"data_compressed_allocated":1478656,"data_compressed_original":4147747,"omap_allocated":213241,"internal_metadata":27377415},"hb_peers":[0,1,3,4,5,7,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313294,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30768,"kb_used_data":3808,"kb_used_omap":1740,"kb_used_meta":25203,"kb_avail":94341072,"statfs":{"total":96636764160,"available":96605257728,"internally_reserved":0,"allocated":3899392,"data_stored":4316437,"data_compressed":799680,"data_compressed_allocated":1445888,"data_compressed_original":3688995,"omap_allocated":1782034,"internal_metadata":25808622},"hb_peers":[1,2,3,5,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313295,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30768,"kb_used_data":3808,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94341072,"statfs":{"total":96636764160,"available":96605257728,"internally_reserved":0,"allocated":3899392,"data_stored":4316437,"data_compressed":799680,"data_compressed_allocated":1445888,"data_compressed_original":3688995,"omap_allocated":214180,"internal_metadata":27376476},"hb_peers":[0,1,3,4,6,7,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313294,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30772,"kb_used_data":3812,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94341068,"statfs":{"total":96636764160,"available":96605253632,"internally_reserved":0,"allocated":3903488,"data_stored":4316456,"data_compressed":799680,"data_compressed_allocated":1445888,"data_compressed_original":3688995,"omap_allocated":214589,"internal_metadata":27376067},"hb_peers":[0,1,2,3,4,6,7,9,10,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313296,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30768,"kb_used_data":3808,"kb_used_omap":175,"kb_used_meta":26768,"kb_avail":94341072,"statfs":{"total":96636764160,"available":96605257728,"internally_reserved":0,"allocated":3899392,"data_stored":4316437,"data_compressed":799680,"data_compressed_allocated":1445888,"data_compressed_original":3688995,"omap_allocated":179988,"internal_metadata":27410668},"hb_peers":[0,1,2,3,4,5,6,7,8,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":10,"up_from":21,"seq":90194313295,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30772,"kb_used_data":3812,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94341068,"statfs":{"total":96636764160,"available":96605253632,"internally_reserved":0,"allocated":3903488,"data_stored":4316442,"data_compressed":799680,"data_compressed_allocated":1445888,"data_compressed_original":3688995,"omap_allocated":214097,"internal_metadata":27376559},"hb_peers":[0,1,2,3,4,5,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313296,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30768,"kb_used_data":3808,"kb_used_omap":208,"kb_used_meta":26735,"kb_avail":94341072,"statfs":{"total":96636764160,"available":96605257728,"internally_reserved":0,"allocated":3899392,"data_stored":4316437,"data_compressed":799680,"data_compressed_allocated":1445888,"data_compressed_original":3688995,"omap_allocated":213671,"internal_metadata":27376985},"hb_peers":[0,2,3,5,6,7,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":14,"up_from":21,"seq":90194313295,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30768,"kb_used_data":3808,"kb_used_omap":3019,"kb_used_meta":23924,"kb_avail":94341072,"statfs":{"total":96636764160,"available":96605257728,"internally_reserved":0,"allocated":3899392,"data_stored":4316437,"data_compressed":799680,"data_compressed_allocated":1445888,"data_compressed_original":3688995,"omap_allocated":3091722,"internal_metadata":24498934},"hb_peers":[0,2,3,4,5,6,7,8,9,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280592,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30780,"kb_used_data":3820,"kb_used_omap":3012,"kb_used_meta":23931,"kb_avail":94341060,"statfs":{"total":96636764160,"available":96605245440,"internally_reserved":0,"allocated":3911680,"data_stored":4325994,"data_compressed":801755,"data_compressed_allocated":1449984,"data_compressed_original":3697918,"omap_allocated":3085203,"internal_metadata":24505453},"hb_peers":[0,1,2,4,5,6,7,9,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280592,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30784,"kb_used_data":3824,"kb_used_omap":3019,"kb_used_meta":23924,"kb_avail":94341056,"statfs":{"total":96636764160,"available":96605241344,"internally_reserved":0,"allocated":3915776,"data_stored":4325999,"data_compressed":801755,"data_compressed_allocated":1449984,"data_compressed_original":3697918,"omap_allocated":3091515,"internal_metadata":24499141},"hb_peers":[0,3,4,5,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":459280,"data_compressed":1160,"data_compressed_allocated":32768,"data_compressed_original":458752,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":459280,"data_compressed":1160,"data_compressed_allocated":32768,"data_compressed_original":458752,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T04:04:54.456 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-12T04:04:54.456 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T04:04:54.560 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.558+0000 7f538c9ed640 10 monclient: get_monmap_and_config 2026-02-12T04:04:54.560 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.558+0000 7f538c9ed640 10 monclient: build_initial_monmap 2026-02-12T04:04:54.560 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.558+0000 7f538c9ed640 10 monclient: monmap: 2026-02-12T04:04:54.561 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:54.561 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:54.561 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:04:54.559344+0000 2026-02-12T04:04:54.561 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:04:54.559344+0000 2026-02-12T04:04:54.561 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:54.561 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:54.561 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:54.561 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:54.561 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:54.561 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:54.563 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.559+0000 7f538c9ed640 1 Processor -- start 2026-02-12T04:04:54.564 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.559+0000 7f538c9ed640 1 -- start start 2026-02-12T04:04:54.564 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.559+0000 7f538c9ed640 10 monclient: init 2026-02-12T04:04:54.564 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.559+0000 7f538c9ed640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:54.564 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.559+0000 7f538c9ed640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T04:04:54.564 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.559+0000 7f538c9ed640 10 monclient(hunting): picked mon.noname-c con 0x7f53841575d0 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:54.564 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.559+0000 7f538c9ed640 10 monclient(hunting): picked mon.noname-b con 0x7f5384163310 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:54.564 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.559+0000 7f538c9ed640 10 monclient(hunting): picked mon.noname-a con 0x7f53840560d0 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:54.564 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.559+0000 7f538c9ed640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53840b20b0 con 0x7f53840560d0 2026-02-12T04:04:54.564 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.559+0000 7f538c9ed640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53840b2390 con 0x7f5384163310 2026-02-12T04:04:54.564 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.559+0000 7f538c9ed640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53840b2670 con 0x7f53841575d0 2026-02-12T04:04:54.565 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.559+0000 7f538c9ed640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:54.565 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.559+0000 7f538c9ed640 10 monclient(hunting): authenticate will time out at 1497.302778s 2026-02-12T04:04:54.565 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.560+0000 7f538af63640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f53840560d0 0x7f53841c56f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:41324/0 (socket says 10.20.193.91:41324) 2026-02-12T04:04:54.565 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.560+0000 7f538af63640 1 -- 10.20.193.91:0/1827106452 learned_addr learned my addr 10.20.193.91:0/1827106452 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:54.565 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.561+0000 7f5389760640 1 -- 10.20.193.91:0/1827106452 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3609018072 0 0) 0x7f53840b20b0 con 0x7f53840560d0 2026-02-12T04:04:54.565 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.561+0000 7f5389760640 10 monclient(hunting): _negotiate 2026-02-12T04:04:54.565 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.561+0000 7f5389760640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:54.565 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.561+0000 7f5389760640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:54.565 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.561+0000 7f5389760640 10 monclient(hunting): my global_id is 30612 2026-02-12T04:04:54.565 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.561+0000 7f5389760640 1 -- 10.20.193.91:0/1827106452 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5374003610 con 0x7f53840560d0 2026-02-12T04:04:54.565 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.561+0000 7f5389760640 1 -- 10.20.193.91:0/1827106452 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 320598943 0 0) 0x7f53840b2670 con 0x7f53841575d0 2026-02-12T04:04:54.566 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.561+0000 7f5389760640 10 monclient(hunting): _negotiate 2026-02-12T04:04:54.566 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.561+0000 7f5389760640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:54.566 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.561+0000 7f5389760640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:54.566 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.561+0000 7f5389760640 10 monclient(hunting): my global_id is 27446 2026-02-12T04:04:54.566 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.561+0000 7f5389760640 1 -- 10.20.193.91:0/1827106452 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53840b20b0 con 0x7f53841575d0 2026-02-12T04:04:54.571 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.563+0000 7f5389760640 1 -- 10.20.193.91:0/1827106452 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 394572941 0 0) 0x7f5374003610 con 0x7f53840560d0 2026-02-12T04:04:54.571 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.563+0000 7f5389760640 1 -- 10.20.193.91:0/1827106452 >> v1:10.20.193.111:6789/0 conn(0x7f53841575d0 legacy=0x7f5384162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:54.571 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.563+0000 7f5389760640 1 -- 10.20.193.91:0/1827106452 >> v1:10.20.193.98:6789/0 conn(0x7f5384163310 legacy=0x7f53840559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:54.571 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.563+0000 7f5389760640 10 monclient: _finish_hunting 0 2026-02-12T04:04:54.571 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.563+0000 7f5389760640 1 monclient: found mon.noname-a 2026-02-12T04:04:54.571 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.563+0000 7f5389760640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:54.571 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.563+0000 7f5389760640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.91:6789/0 2026-02-12T04:04:54.571 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.563+0000 7f5389760640 1 -- 10.20.193.91:0/1827106452 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5384162400 con 0x7f53840560d0 2026-02-12T04:04:54.571 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.563+0000 7f5389760640 10 monclient: _finish_auth 0 2026-02-12T04:04:54.572 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.563+0000 7f5389760640 10 monclient: _check_auth_tickets 2026-02-12T04:04:54.572 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.563+0000 7f5389760640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:54.572 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.563+0000 7f5389760640 1 -- 10.20.193.91:0/1827106452 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f5378003170 con 0x7f53840560d0 2026-02-12T04:04:54.572 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.563+0000 7f5389760640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:54.572 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.563+0000 7f5389760640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T04:04:54.572 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.563+0000 7f5389760640 10 monclient: dump: 2026-02-12T04:04:54.572 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:54.572 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:54.572 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:54.572 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:54.572 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:54.572 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:54.573 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:54.573 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:54.573 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:54.573 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:54.573 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.563+0000 7f538c9ed640 5 monclient: authenticate success, global_id 30612 2026-02-12T04:04:54.573 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.563+0000 7f538c9ed640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:04:54.573 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.564+0000 7f5389760640 1 -- 10.20.193.91:0/1827106452 <== mon.0 v1:10.20.193.91:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5378003380 con 0x7f53840560d0 2026-02-12T04:04:54.573 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.564+0000 7f5389760640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:54.573 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.564+0000 7f5389760640 1 -- 10.20.193.91:0/1827106452 <== mon.0 v1:10.20.193.91:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f53780037c0 con 0x7f53840560d0 2026-02-12T04:04:54.573 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.564+0000 7f5389760640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:54.573 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.564+0000 7f5389760640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T04:04:54.574 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.564+0000 7f5389760640 10 monclient: dump: 2026-02-12T04:04:54.574 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:54.574 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:54.574 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:54.574 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:54.574 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:54.574 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:54.574 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:54.574 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:54.574 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:54.574 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:54.574 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.564+0000 7f538c9ed640 10 monclient: get_monmap_and_config success 2026-02-12T04:04:54.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.564+0000 7f538c9ed640 4 set_mon_vals no callback set 2026-02-12T04:04:54.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.564+0000 7f538c9ed640 10 monclient: shutdown 2026-02-12T04:04:54.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.564+0000 7f538c9ed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:54.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.564+0000 7f538c9ed640 1 -- 10.20.193.91:0/1827106452 >> v1:10.20.193.91:6789/0 conn(0x7f53840560d0 legacy=0x7f53841c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:54.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.564+0000 7f538c9ed640 1 -- 10.20.193.91:0/1827106452 shutdown_connections 2026-02-12T04:04:54.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.564+0000 7f538c9ed640 1 -- 10.20.193.91:0/1827106452 >> 10.20.193.91:0/1827106452 conn(0x7f53840b6560 msgr2=0x7f53840b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:54.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.564+0000 7f538c9ed640 1 -- 10.20.193.91:0/1827106452 shutdown_connections 2026-02-12T04:04:54.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.564+0000 7f538c9ed640 1 -- 10.20.193.91:0/1827106452 wait complete. 2026-02-12T04:04:54.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.564+0000 7f538c9ed640 10 monclient: build_initial_monmap 2026-02-12T04:04:54.575 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.564+0000 7f538c9ed640 10 monclient: monmap: 2026-02-12T04:04:54.575 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:54.575 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:04:54.576 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:04:54.576 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:04:54.576 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:54.576 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:04:54.576 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:54.576 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:54.576 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:54.576 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:54.576 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.565+0000 7f538c9ed640 1 librados: starting msgr at 2026-02-12T04:04:54.576 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.565+0000 7f538c9ed640 1 librados: starting objecter 2026-02-12T04:04:54.576 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.565+0000 7f538c9ed640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:04:54.576 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.565+0000 7f538c9ed640 1 Processor -- start 2026-02-12T04:04:54.577 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.565+0000 7f538c9ed640 1 -- start start 2026-02-12T04:04:54.577 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.565+0000 7f538c9ed640 1 librados: setting wanted keys 2026-02-12T04:04:54.577 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.565+0000 7f538c9ed640 1 librados: calling monclient init 2026-02-12T04:04:54.577 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.565+0000 7f538c9ed640 10 monclient: init 2026-02-12T04:04:54.577 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.565+0000 7f538c9ed640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:54.577 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.565+0000 7f538c9ed640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T04:04:54.577 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.565+0000 7f538c9ed640 10 monclient(hunting): picked mon.noname-c con 0x7f53840560d0 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:54.577 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.565+0000 7f538c9ed640 10 monclient(hunting): picked mon.noname-b con 0x7f53841575d0 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:54.577 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.565+0000 7f538c9ed640 10 monclient(hunting): picked mon.noname-a con 0x7f5384163310 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:54.577 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.565+0000 7f538c9ed640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53840af320 con 0x7f5384163310 2026-02-12T04:04:54.577 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.565+0000 7f538c9ed640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53841fec30 con 0x7f53841575d0 2026-02-12T04:04:54.577 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.565+0000 7f538c9ed640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53841fef10 con 0x7f53840560d0 2026-02-12T04:04:54.577 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.565+0000 7f538c9ed640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:54.578 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.565+0000 7f538c9ed640 10 monclient(hunting): authenticate will time out at 1497.308712s 2026-02-12T04:04:54.578 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.566+0000 7f538a762640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f53840560d0 0x7f53841fe390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:44110/0 (socket says 10.20.193.91:44110) 2026-02-12T04:04:54.578 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.566+0000 7f538a762640 1 -- 10.20.193.91:0/3419821952 learned_addr learned my addr 10.20.193.91:0/3419821952 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:54.578 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.566+0000 7f536effd640 10 client.?.objecter ms_handle_connect 0x7f53840560d0 2026-02-12T04:04:54.578 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.566+0000 7f536effd640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:54.578 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.566+0000 7f536effd640 10 client.?.objecter ms_handle_connect 0x7f5384163310 2026-02-12T04:04:54.578 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.566+0000 7f536effd640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:54.578 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.567+0000 7f536effd640 1 -- 10.20.193.91:0/3419821952 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1187706880 0 0) 0x7f53841fef10 con 0x7f53840560d0 2026-02-12T04:04:54.578 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.567+0000 7f536effd640 10 monclient(hunting): _negotiate 2026-02-12T04:04:54.578 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.567+0000 7f536effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:54.578 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.567+0000 7f536effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:54.579 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.567+0000 7f536effd640 10 monclient(hunting): my global_id is 27449 2026-02-12T04:04:54.579 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.567+0000 7f536effd640 1 -- 10.20.193.91:0/3419821952 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5354003610 con 0x7f53840560d0 2026-02-12T04:04:54.579 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.567+0000 7f536effd640 1 -- 10.20.193.91:0/3419821952 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1132275153 0 0) 0x7f53840af320 con 0x7f5384163310 2026-02-12T04:04:54.579 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.567+0000 7f536effd640 10 monclient(hunting): _negotiate 2026-02-12T04:04:54.579 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.567+0000 7f536effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:54.579 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.567+0000 7f536effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:54.579 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.567+0000 7f536effd640 10 monclient(hunting): my global_id is 30615 2026-02-12T04:04:54.579 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.567+0000 7f536effd640 1 -- 10.20.193.91:0/3419821952 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53841fef10 con 0x7f5384163310 2026-02-12T04:04:54.579 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.568+0000 7f536effd640 10 client.?.objecter ms_handle_connect 0x7f53841575d0 2026-02-12T04:04:54.579 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.568+0000 7f536effd640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:54.581 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.569+0000 7f536effd640 1 -- 10.20.193.91:0/3419821952 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2582080655 0 0) 0x7f5354003610 con 0x7f53840560d0 2026-02-12T04:04:54.581 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.569+0000 7f536effd640 1 -- 10.20.193.91:0/3419821952 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f53840af320 con 0x7f53840560d0 2026-02-12T04:04:54.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.569+0000 7f536effd640 1 -- 10.20.193.91:0/3419821952 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f537c003170 con 0x7f53840560d0 2026-02-12T04:04:54.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.569+0000 7f536effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:54.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.569+0000 7f536effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T04:04:54.582 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.569+0000 7f536effd640 10 monclient(hunting): dump: 2026-02-12T04:04:54.582 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:54.582 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:54.582 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:54.582 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:54.582 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:54.582 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:54.582 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:54.583 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:54.583 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:54.583 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:54.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.569+0000 7f536effd640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:04:54.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.570+0000 7f536effd640 1 -- 10.20.193.91:0/3419821952 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1435762308 0 0) 0x7f53841fef10 con 0x7f5384163310 2026-02-12T04:04:54.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.570+0000 7f536effd640 1 -- 10.20.193.91:0/3419821952 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5354003610 con 0x7f5384163310 2026-02-12T04:04:54.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.570+0000 7f536effd640 1 -- 10.20.193.91:0/3419821952 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f5378003530 con 0x7f5384163310 2026-02-12T04:04:54.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.570+0000 7f536effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:54.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.570+0000 7f536effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T04:04:54.583 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.570+0000 7f536effd640 10 monclient(hunting): dump: 2026-02-12T04:04:54.583 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:54.583 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:54.584 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:54.584 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:54.584 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:54.584 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:54.584 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:54.584 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:54.584 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:54.584 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:54.584 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.571+0000 7f536effd640 1 -- 10.20.193.91:0/3419821952 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 737489718 0 0) 0x7f53841fec30 con 0x7f53841575d0 2026-02-12T04:04:54.584 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.571+0000 7f536effd640 10 monclient(hunting): _negotiate 2026-02-12T04:04:54.584 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.571+0000 7f536effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:54.584 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.571+0000 7f536effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:54.585 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.571+0000 7f536effd640 10 monclient(hunting): my global_id is 27754 2026-02-12T04:04:54.585 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.571+0000 7f536effd640 1 -- 10.20.193.91:0/3419821952 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53841fef10 con 0x7f53841575d0 2026-02-12T04:04:54.585 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.571+0000 7f536effd640 1 -- 10.20.193.91:0/3419821952 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2627789040 0 0) 0x7f5354003610 con 0x7f5384163310 2026-02-12T04:04:54.585 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.571+0000 7f536effd640 1 -- 10.20.193.91:0/3419821952 >> v1:10.20.193.111:6789/0 conn(0x7f53840560d0 legacy=0x7f53841fe390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:54.585 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.571+0000 7f536effd640 1 -- 10.20.193.91:0/3419821952 >> v1:10.20.193.98:6789/0 conn(0x7f53841575d0 legacy=0x7f53840aec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:54.585 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.571+0000 7f536effd640 10 monclient: _finish_hunting 0 2026-02-12T04:04:54.585 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.571+0000 7f536effd640 1 monclient: found mon.a 2026-02-12T04:04:54.585 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.571+0000 7f536effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:54.585 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.571+0000 7f536effd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:54.585 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.571+0000 7f536effd640 1 -- 10.20.193.91:0/3419821952 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53841ff1f0 con 0x7f5384163310 2026-02-12T04:04:54.585 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.571+0000 7f536effd640 10 monclient: _finish_auth 0 2026-02-12T04:04:54.585 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.571+0000 7f536effd640 10 monclient: _check_auth_tickets 2026-02-12T04:04:54.585 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.571+0000 7f536effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:54.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.571+0000 7f538c9ed640 5 monclient: authenticate success, global_id 30615 2026-02-12T04:04:54.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.571+0000 7f538c9ed640 10 monclient: _renew_subs 2026-02-12T04:04:54.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.571+0000 7f538c9ed640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:54.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.571+0000 7f538c9ed640 1 -- 10.20.193.91:0/3419821952 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f53840ade50 con 0x7f5384163310 2026-02-12T04:04:54.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.571+0000 7f538c9ed640 10 client.30615.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:04:54.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.571+0000 7f538c9ed640 10 monclient: _renew_subs 2026-02-12T04:04:54.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.571+0000 7f538c9ed640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:54.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.571+0000 7f538c9ed640 1 -- 10.20.193.91:0/3419821952 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f53840ae410 con 0x7f5384163310 2026-02-12T04:04:54.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.571+0000 7f538c9ed640 1 librados: init done 2026-02-12T04:04:54.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.572+0000 7f538c9ed640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:54.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.572+0000 7f538c9ed640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:54.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.572+0000 7f538c9ed640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:54.586 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.572+0000 7f538c9ed640 1 -- 10.20.193.91:0/3419821952 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53840b7290 con 0x7f5384163310 2026-02-12T04:04:54.669 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.667+0000 7f536effd640 1 -- 10.20.193.91:0/3419821952 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f53780032c0 con 0x7f5384163310 2026-02-12T04:04:54.669 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.667+0000 7f536effd640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:54.669 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.667+0000 7f536effd640 1 -- 10.20.193.91:0/3419821952 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f5378004db0 con 0x7f5384163310 2026-02-12T04:04:54.669 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.667+0000 7f536effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:54.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.667+0000 7f536effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T04:04:54.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.667+0000 7f5388f5f640 4 set_mon_vals no callback set 2026-02-12T04:04:54.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.667+0000 7f536effd640 10 monclient: dump: 2026-02-12T04:04:54.670 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:54.670 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:54.670 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:54.670 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:54.670 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:54.670 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:54.670 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:54.670 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:54.670 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:54.671 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:54.671 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.668+0000 7f536effd640 1 -- 10.20.193.91:0/3419821952 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f537801e290 con 0x7f5384163310 2026-02-12T04:04:54.671 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.668+0000 7f538a762640 10 monclient: get_auth_request con 0x7f5354079f20 auth_method 0 2026-02-12T04:04:54.672 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.668+0000 7f536effd640 10 client.30615.objecter ms_handle_connect 0x7f5354079f20 2026-02-12T04:04:54.672 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.670+0000 7f536effd640 1 -- 10.20.193.91:0/3419821952 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7f5378095d50 con 0x7f5384163310 2026-02-12T04:04:54.672 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.670+0000 7f536effd640 10 client.30615.objecter ms_dispatch2 0x7f5384000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:04:54.672 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.670+0000 7f536effd640 3 client.30615.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:04:54.673 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.670+0000 7f536effd640 3 client.30615.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:04:54.673 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.670+0000 7f536effd640 20 client.30615.objecter dump_active .. 0 homeless 2026-02-12T04:04:54.673 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.670+0000 7f536effd640 1 -- 10.20.193.91:0/3419821952 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f537805f6b0 con 0x7f5384163310 2026-02-12T04:04:54.673 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.670+0000 7f536effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:54.673 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.670+0000 7f536effd640 10 monclient: _finish_command 1 = system:0 2026-02-12T04:04:54.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.775+0000 7f538c9ed640 1 -- 10.20.193.91:0/3419821952 --> v1:10.20.193.91:6800/2929217192 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f53841556c0 con 0x7f5354079f20 2026-02-12T04:04:54.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.776+0000 7f536effd640 1 -- 10.20.193.91:0/3419821952 <== mgr.4113 v1:10.20.193.91:6800/2929217192 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+125705 (unknown 2965378022 0 309643137) 0x7f53841556c0 con 0x7f5354079f20 2026-02-12T04:04:54.779 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T04:04:54.780 INFO:teuthology.orchestra.run.trial091.stderr:dumped all 2026-02-12T04:04:54.781 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.777+0000 7f538c9ed640 10 librados: watch_flush enter 2026-02-12T04:04:54.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.777+0000 7f538c9ed640 10 librados: watch_flush exit 2026-02-12T04:04:54.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.777+0000 7f538c9ed640 20 client.30615.objecter shutdown clearing up homeless session... 2026-02-12T04:04:54.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.777+0000 7f538c9ed640 10 client.30615.objecter successfully canceled tick 2026-02-12T04:04:54.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.777+0000 7f538c9ed640 1 -- 10.20.193.91:0/3419821952 >> v1:10.20.193.91:6800/2929217192 conn(0x7f5354079f20 legacy=0x7f535409a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:54.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.777+0000 7f538c9ed640 10 monclient: shutdown 2026-02-12T04:04:54.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.777+0000 7f538c9ed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:54.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.777+0000 7f538c9ed640 1 -- 10.20.193.91:0/3419821952 >> v1:10.20.193.91:6789/0 conn(0x7f5384163310 legacy=0x7f53841fd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:54.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.777+0000 7f538c9ed640 1 -- 10.20.193.91:0/3419821952 shutdown_connections 2026-02-12T04:04:54.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.777+0000 7f538c9ed640 1 -- 10.20.193.91:0/3419821952 >> 10.20.193.91:0/3419821952 conn(0x7f53840b6560 msgr2=0x7f53840ad120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:54.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.777+0000 7f538c9ed640 1 -- 10.20.193.91:0/3419821952 shutdown_connections 2026-02-12T04:04:54.783 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.777+0000 7f538c9ed640 1 -- 10.20.193.91:0/3419821952 wait complete. 2026-02-12T04:04:54.783 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.777+0000 7f538c9ed640 1 librados: shutdown 2026-02-12T04:04:54.787 INFO:teuthology.orchestra.run.trial091.stdout:{"pg_ready":true,"pg_map":{"version":537,"stamp":"2026-02-12T04:04:54.088738+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":56,"num_read_kb":47,"num_write":70,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":492256,"kb_used_data":60896,"kb_used_omap":24486,"kb_used_meta":406617,"kb_avail":1509457184,"statfs":{"total":1546188226560,"available":1545684156416,"internally_reserved":0,"allocated":62357504,"data_stored":69830166,"data_compressed":12764925,"data_compressed_allocated":23138304,"data_compressed_original":59803128,"omap_allocated":25074406,"internal_metadata":416376090},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":98,"apply_latency_ms":98,"commit_latency_ns":98000000,"apply_latency_ns":98000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000587"},"pg_stats":[{"pgid":"10.1a","version":"0'0","reported_seq":624,"reported_epoch":340,"state":"active+clean","last_fresh":"2026-02-12T04:04:49.307423+0000","last_change":"2026-02-12T03:59:14.506367+0000","last_active":"2026-02-12T04:04:49.307423+0000","last_peered":"2026-02-12T04:04:49.307423+0000","last_clean":"2026-02-12T04:04:49.307423+0000","last_became_active":"2026-02-12T03:59:14.484825+0000","last_became_peered":"2026-02-12T03:59:14.484825+0000","last_unstale":"2026-02-12T04:04:49.307423+0000","last_undegraded":"2026-02-12T04:04:49.307423+0000","last_fullsized":"2026-02-12T04:04:49.307423+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T13:39:56.222964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6],"acting":[11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":626,"reported_epoch":339,"state":"active+clean","last_fresh":"2026-02-12T04:04:48.931287+0000","last_change":"2026-02-12T03:59:13.271129+0000","last_active":"2026-02-12T04:04:48.931287+0000","last_peered":"2026-02-12T04:04:48.931287+0000","last_clean":"2026-02-12T04:04:48.931287+0000","last_became_active":"2026-02-12T03:59:13.250886+0000","last_became_peered":"2026-02-12T03:59:13.250886+0000","last_unstale":"2026-02-12T04:04:48.931287+0000","last_undegraded":"2026-02-12T04:04:48.931287+0000","last_fullsized":"2026-02-12T04:04:48.931287+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:56:54.392976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,0],"acting":[15,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":628,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.274187+0000","last_change":"2026-02-12T03:59:13.542338+0000","last_active":"2026-02-12T04:04:52.274187+0000","last_peered":"2026-02-12T04:04:52.274187+0000","last_clean":"2026-02-12T04:04:52.274187+0000","last_became_active":"2026-02-12T03:59:13.540079+0000","last_became_peered":"2026-02-12T03:59:13.540079+0000","last_unstale":"2026-02-12T04:04:52.274187+0000","last_undegraded":"2026-02-12T04:04:52.274187+0000","last_fullsized":"2026-02-12T04:04:52.274187+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T06:07:29.122582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,14],"acting":[4,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":632,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.319636+0000","last_change":"2026-02-12T03:59:13.067079+0000","last_active":"2026-02-12T04:04:53.319636+0000","last_peered":"2026-02-12T04:04:53.319636+0000","last_clean":"2026-02-12T04:04:53.319636+0000","last_became_active":"2026-02-12T03:59:13.054800+0000","last_became_peered":"2026-02-12T03:59:13.054800+0000","last_unstale":"2026-02-12T04:04:53.319636+0000","last_undegraded":"2026-02-12T04:04:53.319636+0000","last_fullsized":"2026-02-12T04:04:53.319636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T08:49:22.540651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":626,"reported_epoch":339,"state":"active+clean","last_fresh":"2026-02-12T04:04:48.933438+0000","last_change":"2026-02-12T03:59:13.308993+0000","last_active":"2026-02-12T04:04:48.933438+0000","last_peered":"2026-02-12T04:04:48.933438+0000","last_clean":"2026-02-12T04:04:48.933438+0000","last_became_active":"2026-02-12T03:59:13.246053+0000","last_became_peered":"2026-02-12T03:59:13.246053+0000","last_unstale":"2026-02-12T04:04:48.933438+0000","last_undegraded":"2026-02-12T04:04:48.933438+0000","last_fullsized":"2026-02-12T04:04:48.933438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T12:53:48.331317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,7],"acting":[15,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":632,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.347759+0000","last_change":"2026-02-12T03:59:13.329534+0000","last_active":"2026-02-12T04:04:53.347759+0000","last_peered":"2026-02-12T04:04:53.347759+0000","last_clean":"2026-02-12T04:04:53.347759+0000","last_became_active":"2026-02-12T03:59:13.325110+0000","last_became_peered":"2026-02-12T03:59:13.325110+0000","last_unstale":"2026-02-12T04:04:53.347759+0000","last_undegraded":"2026-02-12T04:04:53.347759+0000","last_fullsized":"2026-02-12T04:04:53.347759+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T13:01:51.962329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":627,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-12T04:04:51.221968+0000","last_change":"2026-02-12T03:59:13.470926+0000","last_active":"2026-02-12T04:04:51.221968+0000","last_peered":"2026-02-12T04:04:51.221968+0000","last_clean":"2026-02-12T04:04:51.221968+0000","last_became_active":"2026-02-12T03:59:13.466259+0000","last_became_peered":"2026-02-12T03:59:13.466259+0000","last_unstale":"2026-02-12T04:04:51.221968+0000","last_undegraded":"2026-02-12T04:04:51.221968+0000","last_fullsized":"2026-02-12T04:04:51.221968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:30:59.565179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":627,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-12T04:04:51.233689+0000","last_change":"2026-02-12T03:59:13.501116+0000","last_active":"2026-02-12T04:04:51.233689+0000","last_peered":"2026-02-12T04:04:51.233689+0000","last_clean":"2026-02-12T04:04:51.233689+0000","last_became_active":"2026-02-12T03:59:13.497818+0000","last_became_peered":"2026-02-12T03:59:13.497818+0000","last_unstale":"2026-02-12T04:04:51.233689+0000","last_undegraded":"2026-02-12T04:04:51.233689+0000","last_fullsized":"2026-02-12T04:04:51.233689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T07:00:27.016290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":632,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.367366+0000","last_change":"2026-02-12T03:59:13.134257+0000","last_active":"2026-02-12T04:04:53.367366+0000","last_peered":"2026-02-12T04:04:53.367366+0000","last_clean":"2026-02-12T04:04:53.367366+0000","last_became_active":"2026-02-12T03:59:13.116472+0000","last_became_peered":"2026-02-12T03:59:13.116472+0000","last_unstale":"2026-02-12T04:04:53.367366+0000","last_undegraded":"2026-02-12T04:04:53.367366+0000","last_fullsized":"2026-02-12T04:04:53.367366+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T10:34:46.392533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,3],"acting":[14,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":632,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.320753+0000","last_change":"2026-02-12T03:59:13.090778+0000","last_active":"2026-02-12T04:04:53.320753+0000","last_peered":"2026-02-12T04:04:53.320753+0000","last_clean":"2026-02-12T04:04:53.320753+0000","last_became_active":"2026-02-12T03:59:13.088475+0000","last_became_peered":"2026-02-12T03:59:13.088475+0000","last_unstale":"2026-02-12T04:04:53.320753+0000","last_undegraded":"2026-02-12T04:04:53.320753+0000","last_fullsized":"2026-02-12T04:04:53.320753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T04:11:16.331392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":630,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.270957+0000","last_change":"2026-02-12T03:59:14.956219+0000","last_active":"2026-02-12T04:04:52.270957+0000","last_peered":"2026-02-12T04:04:52.270957+0000","last_clean":"2026-02-12T04:04:52.270957+0000","last_became_active":"2026-02-12T03:59:14.947424+0000","last_became_peered":"2026-02-12T03:59:14.947424+0000","last_unstale":"2026-02-12T04:04:52.270957+0000","last_undegraded":"2026-02-12T04:04:52.270957+0000","last_fullsized":"2026-02-12T04:04:52.270957+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T11:01:54.553548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,11],"acting":[12,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"10.1","version":"33'11","reported_seq":658,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.264604+0000","last_change":"2026-02-12T03:59:13.848583+0000","last_active":"2026-02-12T04:04:52.264604+0000","last_peered":"2026-02-12T04:04:52.264604+0000","last_clean":"2026-02-12T04:04:52.264604+0000","last_became_active":"2026-02-12T03:59:13.846131+0000","last_became_peered":"2026-02-12T03:59:13.846131+0000","last_unstale":"2026-02-12T04:04:52.264604+0000","last_undegraded":"2026-02-12T04:04:52.264604+0000","last_fullsized":"2026-02-12T04:04:52.264604+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T04:28:11.002392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,7],"acting":[10,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"1.0","version":"24'32","reported_seq":689,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.314113+0000","last_change":"2026-02-12T03:58:33.836000+0000","last_active":"2026-02-12T04:04:52.314113+0000","last_peered":"2026-02-12T04:04:52.314113+0000","last_clean":"2026-02-12T04:04:52.314113+0000","last_became_active":"2026-02-12T03:58:33.819911+0000","last_became_peered":"2026-02-12T03:58:33.819911+0000","last_unstale":"2026-02-12T04:04:52.314113+0000","last_undegraded":"2026-02-12T04:04:52.314113+0000","last_fullsized":"2026-02-12T04:04:52.314113+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:32.372907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:32.372907+0000","last_clean_scrub_stamp":"2026-02-12T03:58:32.372907+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T08:01:25.009200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,15],"acting":[2,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"26'1","reported_seq":650,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.243780+0000","last_change":"2026-02-12T03:58:44.065350+0000","last_active":"2026-02-12T04:04:52.243780+0000","last_peered":"2026-02-12T04:04:52.243780+0000","last_clean":"2026-02-12T04:04:52.243780+0000","last_became_active":"2026-02-12T03:58:42.128882+0000","last_became_peered":"2026-02-12T03:58:42.128882+0000","last_unstale":"2026-02-12T04:04:52.243780+0000","last_undegraded":"2026-02-12T04:04:52.243780+0000","last_fullsized":"2026-02-12T04:04:52.243780+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T08:20:23.062411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058002405,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6],"acting":[8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":632,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.260835+0000","last_change":"2026-02-12T03:59:13.938696+0000","last_active":"2026-02-12T04:04:52.260835+0000","last_peered":"2026-02-12T04:04:52.260835+0000","last_clean":"2026-02-12T04:04:52.260835+0000","last_became_active":"2026-02-12T03:59:13.918494+0000","last_became_peered":"2026-02-12T03:59:13.918494+0000","last_unstale":"2026-02-12T04:04:52.260835+0000","last_undegraded":"2026-02-12T04:04:52.260835+0000","last_fullsized":"2026-02-12T04:04:52.260835+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T05:10:10.233810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":644,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-12T04:04:51.223333+0000","last_change":"2026-02-12T03:58:44.008038+0000","last_active":"2026-02-12T04:04:51.223333+0000","last_peered":"2026-02-12T04:04:51.223333+0000","last_clean":"2026-02-12T04:04:51.223333+0000","last_became_active":"2026-02-12T03:58:42.530615+0000","last_became_peered":"2026-02-12T03:58:42.530615+0000","last_unstale":"2026-02-12T04:04:51.223333+0000","last_undegraded":"2026-02-12T04:04:51.223333+0000","last_fullsized":"2026-02-12T04:04:51.223333+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T12:12:39.355846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030042276999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":632,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.318115+0000","last_change":"2026-02-12T03:59:12.994781+0000","last_active":"2026-02-12T04:04:53.318115+0000","last_peered":"2026-02-12T04:04:53.318115+0000","last_clean":"2026-02-12T04:04:53.318115+0000","last_became_active":"2026-02-12T03:59:12.992488+0000","last_became_peered":"2026-02-12T03:59:12.992488+0000","last_unstale":"2026-02-12T04:04:53.318115+0000","last_undegraded":"2026-02-12T04:04:53.318115+0000","last_fullsized":"2026-02-12T04:04:53.318115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:28:37.264382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,13],"acting":[7,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":650,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.232893+0000","last_change":"2026-02-12T03:58:44.019395+0000","last_active":"2026-02-12T04:04:52.232893+0000","last_peered":"2026-02-12T04:04:52.232893+0000","last_clean":"2026-02-12T04:04:52.232893+0000","last_became_active":"2026-02-12T03:58:42.143466+0000","last_became_peered":"2026-02-12T03:58:42.143466+0000","last_unstale":"2026-02-12T04:04:52.232893+0000","last_undegraded":"2026-02-12T04:04:52.232893+0000","last_fullsized":"2026-02-12T04:04:52.232893+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T08:05:12.033817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030228985,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":626,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-12T04:04:51.225699+0000","last_change":"2026-02-12T03:59:13.213383+0000","last_active":"2026-02-12T04:04:51.225699+0000","last_peered":"2026-02-12T04:04:51.225699+0000","last_clean":"2026-02-12T04:04:51.225699+0000","last_became_active":"2026-02-12T03:59:13.207238+0000","last_became_peered":"2026-02-12T03:59:13.207238+0000","last_unstale":"2026-02-12T04:04:51.225699+0000","last_undegraded":"2026-02-12T04:04:51.225699+0000","last_fullsized":"2026-02-12T04:04:51.225699+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T06:27:24.872444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"28'2","reported_seq":651,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.242142+0000","last_change":"2026-02-12T03:58:44.064995+0000","last_active":"2026-02-12T04:04:52.242142+0000","last_peered":"2026-02-12T04:04:52.242142+0000","last_clean":"2026-02-12T04:04:52.242142+0000","last_became_active":"2026-02-12T03:58:42.443435+0000","last_became_peered":"2026-02-12T03:58:42.443435+0000","last_unstale":"2026-02-12T04:04:52.242142+0000","last_undegraded":"2026-02-12T04:04:52.242142+0000","last_fullsized":"2026-02-12T04:04:52.242142+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T11:15:40.933288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.069533228000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":616,"reported_epoch":339,"state":"active+clean","last_fresh":"2026-02-12T04:04:48.816793+0000","last_change":"2026-02-12T03:59:13.223551+0000","last_active":"2026-02-12T04:04:48.816793+0000","last_peered":"2026-02-12T04:04:48.816793+0000","last_clean":"2026-02-12T04:04:48.816793+0000","last_became_active":"2026-02-12T03:59:13.221176+0000","last_became_peered":"2026-02-12T03:59:13.221176+0000","last_unstale":"2026-02-12T04:04:48.816793+0000","last_undegraded":"2026-02-12T04:04:48.816793+0000","last_fullsized":"2026-02-12T04:04:48.816793+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T11:13:27.835565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11],"acting":[1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":645,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.448369+0000","last_change":"2026-02-12T03:58:44.390979+0000","last_active":"2026-02-12T04:04:53.448369+0000","last_peered":"2026-02-12T04:04:53.448369+0000","last_clean":"2026-02-12T04:04:53.448369+0000","last_became_active":"2026-02-12T03:58:42.128705+0000","last_became_peered":"2026-02-12T03:58:42.128705+0000","last_unstale":"2026-02-12T04:04:53.448369+0000","last_undegraded":"2026-02-12T04:04:53.448369+0000","last_fullsized":"2026-02-12T04:04:53.448369+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T04:06:44.956414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.043458169999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":626,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-12T04:04:51.227672+0000","last_change":"2026-02-12T03:59:13.662145+0000","last_active":"2026-02-12T04:04:51.227672+0000","last_peered":"2026-02-12T04:04:51.227672+0000","last_clean":"2026-02-12T04:04:51.227672+0000","last_became_active":"2026-02-12T03:59:13.639048+0000","last_became_peered":"2026-02-12T03:59:13.639048+0000","last_unstale":"2026-02-12T04:04:51.227672+0000","last_undegraded":"2026-02-12T04:04:51.227672+0000","last_fullsized":"2026-02-12T04:04:51.227672+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T14:17:15.031582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,14],"acting":[0,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":645,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.452474+0000","last_change":"2026-02-12T03:58:44.393932+0000","last_active":"2026-02-12T04:04:53.452474+0000","last_peered":"2026-02-12T04:04:53.452474+0000","last_clean":"2026-02-12T04:04:53.452474+0000","last_became_active":"2026-02-12T03:58:42.477478+0000","last_became_peered":"2026-02-12T03:58:42.477478+0000","last_unstale":"2026-02-12T04:04:53.452474+0000","last_undegraded":"2026-02-12T04:04:53.452474+0000","last_fullsized":"2026-02-12T04:04:53.452474+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:13:02.779200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.042443649,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":626,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-12T04:04:51.229644+0000","last_change":"2026-02-12T03:59:13.153999+0000","last_active":"2026-02-12T04:04:51.229644+0000","last_peered":"2026-02-12T04:04:51.229644+0000","last_clean":"2026-02-12T04:04:51.229644+0000","last_became_active":"2026-02-12T03:59:13.151732+0000","last_became_peered":"2026-02-12T03:59:13.151732+0000","last_unstale":"2026-02-12T04:04:51.229644+0000","last_undegraded":"2026-02-12T04:04:51.229644+0000","last_fullsized":"2026-02-12T04:04:51.229644+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T14:04:35.028100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":649,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.266913+0000","last_change":"2026-02-12T03:58:44.186869+0000","last_active":"2026-02-12T04:04:52.266913+0000","last_peered":"2026-02-12T04:04:52.266913+0000","last_clean":"2026-02-12T04:04:52.266913+0000","last_became_active":"2026-02-12T03:58:41.959956+0000","last_became_peered":"2026-02-12T03:58:41.959956+0000","last_unstale":"2026-02-12T04:04:52.266913+0000","last_undegraded":"2026-02-12T04:04:52.266913+0000","last_fullsized":"2026-02-12T04:04:52.266913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T10:02:09.820740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032971485000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,15],"acting":[10,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":626,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-12T04:04:51.231927+0000","last_change":"2026-02-12T03:59:13.349359+0000","last_active":"2026-02-12T04:04:51.231927+0000","last_peered":"2026-02-12T04:04:51.231927+0000","last_clean":"2026-02-12T04:04:51.231927+0000","last_became_active":"2026-02-12T03:59:13.347203+0000","last_became_peered":"2026-02-12T03:59:13.347203+0000","last_unstale":"2026-02-12T04:04:51.231927+0000","last_undegraded":"2026-02-12T04:04:51.231927+0000","last_fullsized":"2026-02-12T04:04:51.231927+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T05:50:59.198319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":649,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.256260+0000","last_change":"2026-02-12T03:58:44.073484+0000","last_active":"2026-02-12T04:04:52.256260+0000","last_peered":"2026-02-12T04:04:52.256260+0000","last_clean":"2026-02-12T04:04:52.256260+0000","last_became_active":"2026-02-12T03:58:42.327696+0000","last_became_peered":"2026-02-12T03:58:42.327696+0000","last_unstale":"2026-02-12T04:04:52.256260+0000","last_undegraded":"2026-02-12T04:04:52.256260+0000","last_fullsized":"2026-02-12T04:04:52.256260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T07:45:24.713381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.065547275000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,14],"acting":[8,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":632,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.390570+0000","last_change":"2026-02-12T03:59:14.920383+0000","last_active":"2026-02-12T04:04:53.390570+0000","last_peered":"2026-02-12T04:04:53.390570+0000","last_clean":"2026-02-12T04:04:53.390570+0000","last_became_active":"2026-02-12T03:59:14.917311+0000","last_became_peered":"2026-02-12T03:59:14.917311+0000","last_unstale":"2026-02-12T04:04:53.390570+0000","last_undegraded":"2026-02-12T04:04:53.390570+0000","last_fullsized":"2026-02-12T04:04:53.390570+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:47:34.135464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,2],"acting":[14,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":624,"reported_epoch":340,"state":"active+clean","last_fresh":"2026-02-12T04:04:49.311415+0000","last_change":"2026-02-12T03:59:14.922629+0000","last_active":"2026-02-12T04:04:49.311415+0000","last_peered":"2026-02-12T04:04:49.311415+0000","last_clean":"2026-02-12T04:04:49.311415+0000","last_became_active":"2026-02-12T03:59:14.899726+0000","last_became_peered":"2026-02-12T03:59:14.899726+0000","last_unstale":"2026-02-12T04:04:49.311415+0000","last_undegraded":"2026-02-12T04:04:49.311415+0000","last_fullsized":"2026-02-12T04:04:49.311415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T06:41:07.216123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":633,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.235239+0000","last_change":"2026-02-12T03:59:13.261070+0000","last_active":"2026-02-12T04:04:52.235239+0000","last_peered":"2026-02-12T04:04:52.235239+0000","last_clean":"2026-02-12T04:04:52.235239+0000","last_became_active":"2026-02-12T03:59:13.258353+0000","last_became_peered":"2026-02-12T03:59:13.258353+0000","last_unstale":"2026-02-12T04:04:52.235239+0000","last_undegraded":"2026-02-12T04:04:52.235239+0000","last_fullsized":"2026-02-12T04:04:52.235239+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T04:31:20.008810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":627,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-12T04:04:51.229832+0000","last_change":"2026-02-12T03:59:13.222666+0000","last_active":"2026-02-12T04:04:51.229832+0000","last_peered":"2026-02-12T04:04:51.229832+0000","last_clean":"2026-02-12T04:04:51.229832+0000","last_became_active":"2026-02-12T03:59:13.219996+0000","last_became_peered":"2026-02-12T03:59:13.219996+0000","last_unstale":"2026-02-12T04:04:51.229832+0000","last_undegraded":"2026-02-12T04:04:51.229832+0000","last_fullsized":"2026-02-12T04:04:51.229832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T14:24:56.118560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,8],"acting":[6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":631,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.276036+0000","last_change":"2026-02-12T03:59:14.179968+0000","last_active":"2026-02-12T04:04:52.276036+0000","last_peered":"2026-02-12T04:04:52.276036+0000","last_clean":"2026-02-12T04:04:52.276036+0000","last_became_active":"2026-02-12T03:59:14.177484+0000","last_became_peered":"2026-02-12T03:59:14.177484+0000","last_unstale":"2026-02-12T04:04:52.276036+0000","last_undegraded":"2026-02-12T04:04:52.276036+0000","last_fullsized":"2026-02-12T04:04:52.276036+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T12:21:26.417548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,9],"acting":[13,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":631,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.280656+0000","last_change":"2026-02-12T03:59:13.723128+0000","last_active":"2026-02-12T04:04:52.280656+0000","last_peered":"2026-02-12T04:04:52.280656+0000","last_clean":"2026-02-12T04:04:52.280656+0000","last_became_active":"2026-02-12T03:59:13.720549+0000","last_became_peered":"2026-02-12T03:59:13.720549+0000","last_unstale":"2026-02-12T04:04:52.280656+0000","last_undegraded":"2026-02-12T04:04:52.280656+0000","last_fullsized":"2026-02-12T04:04:52.280656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T04:30:20.689176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,15],"acting":[5,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":626,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.315069+0000","last_change":"2026-02-12T03:59:13.863936+0000","last_active":"2026-02-12T04:04:52.315069+0000","last_peered":"2026-02-12T04:04:52.315069+0000","last_clean":"2026-02-12T04:04:52.315069+0000","last_became_active":"2026-02-12T03:59:13.846922+0000","last_became_peered":"2026-02-12T03:59:13.846922+0000","last_unstale":"2026-02-12T04:04:52.315069+0000","last_undegraded":"2026-02-12T04:04:52.315069+0000","last_fullsized":"2026-02-12T04:04:52.315069+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:17:54.924916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":624,"reported_epoch":340,"state":"active+clean","last_fresh":"2026-02-12T04:04:49.309230+0000","last_change":"2026-02-12T03:59:14.860387+0000","last_active":"2026-02-12T04:04:49.309230+0000","last_peered":"2026-02-12T04:04:49.309230+0000","last_clean":"2026-02-12T04:04:49.309230+0000","last_became_active":"2026-02-12T03:59:14.858194+0000","last_became_peered":"2026-02-12T03:59:14.858194+0000","last_unstale":"2026-02-12T04:04:49.309230+0000","last_undegraded":"2026-02-12T04:04:49.309230+0000","last_fullsized":"2026-02-12T04:04:49.309230+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:17:18.432397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":624,"reported_epoch":340,"state":"active+clean","last_fresh":"2026-02-12T04:04:49.306663+0000","last_change":"2026-02-12T03:59:14.314170+0000","last_active":"2026-02-12T04:04:49.306663+0000","last_peered":"2026-02-12T04:04:49.306663+0000","last_clean":"2026-02-12T04:04:49.306663+0000","last_became_active":"2026-02-12T03:59:14.311690+0000","last_became_peered":"2026-02-12T03:59:14.311690+0000","last_unstale":"2026-02-12T04:04:49.306663+0000","last_undegraded":"2026-02-12T04:04:49.306663+0000","last_fullsized":"2026-02-12T04:04:49.306663+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T11:08:54.179415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,13],"acting":[11,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":630,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.279487+0000","last_change":"2026-02-12T03:59:13.474307+0000","last_active":"2026-02-12T04:04:52.279487+0000","last_peered":"2026-02-12T04:04:52.279487+0000","last_clean":"2026-02-12T04:04:52.279487+0000","last_became_active":"2026-02-12T03:59:13.469019+0000","last_became_peered":"2026-02-12T03:59:13.469019+0000","last_unstale":"2026-02-12T04:04:52.279487+0000","last_undegraded":"2026-02-12T04:04:52.279487+0000","last_fullsized":"2026-02-12T04:04:52.279487+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:39:25.438275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,2],"acting":[12,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":628,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.449552+0000","last_change":"2026-02-12T03:59:13.092892+0000","last_active":"2026-02-12T04:04:53.449552+0000","last_peered":"2026-02-12T04:04:53.449552+0000","last_clean":"2026-02-12T04:04:53.449552+0000","last_became_active":"2026-02-12T03:59:13.075804+0000","last_became_peered":"2026-02-12T03:59:13.075804+0000","last_unstale":"2026-02-12T04:04:53.449552+0000","last_undegraded":"2026-02-12T04:04:53.449552+0000","last_fullsized":"2026-02-12T04:04:53.449552+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T05:40:29.002904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,13],"acting":[3,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":627,"reported_epoch":342,"state":"active+clean","last_fresh":"2026-02-12T04:04:51.230779+0000","last_change":"2026-02-12T03:59:13.511621+0000","last_active":"2026-02-12T04:04:51.230779+0000","last_peered":"2026-02-12T04:04:51.230779+0000","last_clean":"2026-02-12T04:04:51.230779+0000","last_became_active":"2026-02-12T03:59:13.509387+0000","last_became_peered":"2026-02-12T03:59:13.509387+0000","last_unstale":"2026-02-12T04:04:51.230779+0000","last_undegraded":"2026-02-12T04:04:51.230779+0000","last_fullsized":"2026-02-12T04:04:51.230779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:19:12.104502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":633,"reported_epoch":343,"state":"active+clean","last_fresh":"2026-02-12T04:04:52.238120+0000","last_change":"2026-02-12T03:59:13.135837+0000","last_active":"2026-02-12T04:04:52.238120+0000","last_peered":"2026-02-12T04:04:52.238120+0000","last_clean":"2026-02-12T04:04:52.238120+0000","last_became_active":"2026-02-12T03:59:13.130685+0000","last_became_peered":"2026-02-12T03:59:13.130685+0000","last_unstale":"2026-02-12T04:04:52.238120+0000","last_undegraded":"2026-02-12T04:04:52.238120+0000","last_fullsized":"2026-02-12T04:04:52.238120+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T05:20:55.632623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":918560,"data_compressed":2320,"data_compressed_allocated":65536,"data_compressed_original":917504,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":22,"seq":94489280590,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30728,"kb_used_data":3768,"kb_used_omap":3011,"kb_used_meta":23932,"kb_avail":94341112,"statfs":{"total":96636764160,"available":96605298688,"internally_reserved":0,"allocated":3858432,"data_stored":4264916,"data_compressed":788959,"data_compressed_allocated":1425408,"data_compressed_original":3643151,"omap_allocated":3083681,"internal_metadata":24506975},"hb_peers":[0,1,2,4,5,6,7,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280589,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30724,"kb_used_data":3764,"kb_used_omap":201,"kb_used_meta":26742,"kb_avail":94341116,"statfs":{"total":96636764160,"available":96605302784,"internally_reserved":0,"allocated":3854336,"data_stored":4264897,"data_compressed":788959,"data_compressed_allocated":1425408,"data_compressed_original":3643151,"omap_allocated":206636,"internal_metadata":27384020},"hb_peers":[0,2,3,4,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280591,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30764,"kb_used_data":3804,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94341076,"statfs":{"total":96636764160,"available":96605261824,"internally_reserved":0,"allocated":3895296,"data_stored":4728273,"data_compressed":790119,"data_compressed_allocated":1458176,"data_compressed_original":4101903,"omap_allocated":214030,"internal_metadata":27376626},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313294,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30760,"kb_used_data":3800,"kb_used_omap":3017,"kb_used_meta":23926,"kb_avail":94341080,"statfs":{"total":96636764160,"available":96605265920,"internally_reserved":0,"allocated":3891200,"data_stored":4306425,"data_compressed":797549,"data_compressed_allocated":1441792,"data_compressed_original":3679690,"omap_allocated":3089836,"internal_metadata":24500820},"hb_peers":[1,2,3,4,5,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313294,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30768,"kb_used_data":3808,"kb_used_omap":3016,"kb_used_meta":23927,"kb_avail":94341072,"statfs":{"total":96636764160,"available":96605257728,"internally_reserved":0,"allocated":3899392,"data_stored":4316437,"data_compressed":799680,"data_compressed_allocated":1445888,"data_compressed_original":3688995,"omap_allocated":3089334,"internal_metadata":24501322},"hb_peers":[0,1,3,4,5,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":21,"seq":90194313295,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30760,"kb_used_data":3800,"kb_used_omap":3018,"kb_used_meta":23925,"kb_avail":94341080,"statfs":{"total":96636764160,"available":96605265920,"internally_reserved":0,"allocated":3891200,"data_stored":4306425,"data_compressed":797549,"data_compressed_allocated":1441792,"data_compressed_original":3679690,"omap_allocated":3090649,"internal_metadata":24500007},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313295,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30804,"kb_used_data":3844,"kb_used_omap":208,"kb_used_meta":26735,"kb_avail":94341036,"statfs":{"total":96636764160,"available":96605220864,"internally_reserved":0,"allocated":3936256,"data_stored":4775717,"data_compressed":800840,"data_compressed_allocated":1478656,"data_compressed_original":4147747,"omap_allocated":213241,"internal_metadata":27377415},"hb_peers":[0,1,3,4,5,7,8,9,10,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313294,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30768,"kb_used_data":3808,"kb_used_omap":1740,"kb_used_meta":25203,"kb_avail":94341072,"statfs":{"total":96636764160,"available":96605257728,"internally_reserved":0,"allocated":3899392,"data_stored":4316437,"data_compressed":799680,"data_compressed_allocated":1445888,"data_compressed_original":3688995,"omap_allocated":1782034,"internal_metadata":25808622},"hb_peers":[1,2,3,5,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313295,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30768,"kb_used_data":3808,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94341072,"statfs":{"total":96636764160,"available":96605257728,"internally_reserved":0,"allocated":3899392,"data_stored":4316437,"data_compressed":799680,"data_compressed_allocated":1445888,"data_compressed_original":3688995,"omap_allocated":214180,"internal_metadata":27376476},"hb_peers":[0,1,3,4,6,7,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313294,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30772,"kb_used_data":3812,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94341068,"statfs":{"total":96636764160,"available":96605253632,"internally_reserved":0,"allocated":3903488,"data_stored":4316456,"data_compressed":799680,"data_compressed_allocated":1445888,"data_compressed_original":3688995,"omap_allocated":214589,"internal_metadata":27376067},"hb_peers":[0,1,2,3,4,6,7,9,10,11,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313296,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30768,"kb_used_data":3808,"kb_used_omap":175,"kb_used_meta":26768,"kb_avail":94341072,"statfs":{"total":96636764160,"available":96605257728,"internally_reserved":0,"allocated":3899392,"data_stored":4316437,"data_compressed":799680,"data_compressed_allocated":1445888,"data_compressed_original":3688995,"omap_allocated":179988,"internal_metadata":27410668},"hb_peers":[0,1,2,3,4,5,6,7,8,10,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":10,"up_from":21,"seq":90194313295,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30772,"kb_used_data":3812,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94341068,"statfs":{"total":96636764160,"available":96605253632,"internally_reserved":0,"allocated":3903488,"data_stored":4316442,"data_compressed":799680,"data_compressed_allocated":1445888,"data_compressed_original":3688995,"omap_allocated":214097,"internal_metadata":27376559},"hb_peers":[0,1,2,3,4,5,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313296,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30768,"kb_used_data":3808,"kb_used_omap":208,"kb_used_meta":26735,"kb_avail":94341072,"statfs":{"total":96636764160,"available":96605257728,"internally_reserved":0,"allocated":3899392,"data_stored":4316437,"data_compressed":799680,"data_compressed_allocated":1445888,"data_compressed_original":3688995,"omap_allocated":213671,"internal_metadata":27376985},"hb_peers":[0,2,3,5,6,7,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":14,"up_from":21,"seq":90194313295,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30768,"kb_used_data":3808,"kb_used_omap":3019,"kb_used_meta":23924,"kb_avail":94341072,"statfs":{"total":96636764160,"available":96605257728,"internally_reserved":0,"allocated":3899392,"data_stored":4316437,"data_compressed":799680,"data_compressed_allocated":1445888,"data_compressed_original":3688995,"omap_allocated":3091722,"internal_metadata":24498934},"hb_peers":[0,2,3,4,5,6,7,8,9,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280592,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30780,"kb_used_data":3820,"kb_used_omap":3012,"kb_used_meta":23931,"kb_avail":94341060,"statfs":{"total":96636764160,"available":96605245440,"internally_reserved":0,"allocated":3911680,"data_stored":4325994,"data_compressed":801755,"data_compressed_allocated":1449984,"data_compressed_original":3697918,"omap_allocated":3085203,"internal_metadata":24505453},"hb_peers":[0,1,2,4,5,6,7,9,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280592,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30784,"kb_used_data":3824,"kb_used_omap":3019,"kb_used_meta":23924,"kb_avail":94341056,"statfs":{"total":96636764160,"available":96605241344,"internally_reserved":0,"allocated":3915776,"data_stored":4325999,"data_compressed":801755,"data_compressed_allocated":1449984,"data_compressed_original":3697918,"omap_allocated":3091515,"internal_metadata":24499141},"hb_peers":[0,3,4,5,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":459280,"data_compressed":1160,"data_compressed_allocated":32768,"data_compressed_original":458752,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":459280,"data_compressed":1160,"data_compressed_allocated":32768,"data_compressed_original":458752,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T04:04:54.791 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T04:04:54.857 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.855+0000 7f0a9c43a640 10 monclient: get_monmap_and_config 2026-02-12T04:04:54.857 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.855+0000 7f0a9c43a640 10 monclient: build_initial_monmap 2026-02-12T04:04:54.857 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.855+0000 7f0a9c43a640 10 monclient: monmap: 2026-02-12T04:04:54.857 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:54.858 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:54.858 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:04:54.856287+0000 2026-02-12T04:04:54.858 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:04:54.856287+0000 2026-02-12T04:04:54.858 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:54.858 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:54.858 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:54.858 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:54.858 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:54.858 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:54.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.856+0000 7f0a9c43a640 1 Processor -- start 2026-02-12T04:04:54.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.856+0000 7f0a9c43a640 1 -- start start 2026-02-12T04:04:54.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.856+0000 7f0a9c43a640 10 monclient: init 2026-02-12T04:04:54.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.856+0000 7f0a9c43a640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:54.861 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.856+0000 7f0a9c43a640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T04:04:54.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.856+0000 7f0a9c43a640 10 monclient(hunting): picked mon.noname-a con 0x7f0a941575d0 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:54.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.856+0000 7f0a9c43a640 10 monclient(hunting): picked mon.noname-c con 0x7f0a94163310 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:54.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.856+0000 7f0a9c43a640 10 monclient(hunting): picked mon.noname-b con 0x7f0a940560d0 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:54.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.856+0000 7f0a9c43a640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a940b20b0 con 0x7f0a941575d0 2026-02-12T04:04:54.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.856+0000 7f0a9c43a640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a940b2390 con 0x7f0a940560d0 2026-02-12T04:04:54.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.856+0000 7f0a9c43a640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a940b2670 con 0x7f0a94163310 2026-02-12T04:04:54.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.856+0000 7f0a9c43a640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:54.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.856+0000 7f0a9c43a640 10 monclient(hunting): authenticate will time out at 1497.599701s 2026-02-12T04:04:54.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.857+0000 7f0a9a1af640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f0a941575d0 0x7f0a94162c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:41352/0 (socket says 10.20.193.91:41352) 2026-02-12T04:04:54.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.857+0000 7f0a9a1af640 1 -- 10.20.193.91:0/4026870378 learned_addr learned my addr 10.20.193.91:0/4026870378 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:54.862 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.858+0000 7f0a991ad640 1 -- 10.20.193.91:0/4026870378 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2216515272 0 0) 0x7f0a940b20b0 con 0x7f0a941575d0 2026-02-12T04:04:54.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.858+0000 7f0a991ad640 10 monclient(hunting): _negotiate 2026-02-12T04:04:54.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.858+0000 7f0a991ad640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:54.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.858+0000 7f0a991ad640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:54.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.858+0000 7f0a991ad640 10 monclient(hunting): my global_id is 30618 2026-02-12T04:04:54.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.858+0000 7f0a991ad640 1 -- 10.20.193.91:0/4026870378 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a7c003610 con 0x7f0a941575d0 2026-02-12T04:04:54.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.858+0000 7f0a991ad640 1 -- 10.20.193.91:0/4026870378 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3793764038 0 0) 0x7f0a940b2670 con 0x7f0a94163310 2026-02-12T04:04:54.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.858+0000 7f0a991ad640 10 monclient(hunting): _negotiate 2026-02-12T04:04:54.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.858+0000 7f0a991ad640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:54.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.858+0000 7f0a991ad640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:54.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.858+0000 7f0a991ad640 10 monclient(hunting): my global_id is 27452 2026-02-12T04:04:54.863 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.858+0000 7f0a991ad640 1 -- 10.20.193.91:0/4026870378 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a940b20b0 con 0x7f0a94163310 2026-02-12T04:04:54.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.858+0000 7f0a991ad640 1 -- 10.20.193.91:0/4026870378 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1816793770 0 0) 0x7f0a940b2390 con 0x7f0a940560d0 2026-02-12T04:04:54.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.858+0000 7f0a991ad640 10 monclient(hunting): _negotiate 2026-02-12T04:04:54.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.858+0000 7f0a991ad640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:54.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.858+0000 7f0a991ad640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:54.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.858+0000 7f0a991ad640 10 monclient(hunting): my global_id is 27757 2026-02-12T04:04:54.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.858+0000 7f0a991ad640 1 -- 10.20.193.91:0/4026870378 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a940b2670 con 0x7f0a940560d0 2026-02-12T04:04:54.869 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.860+0000 7f0a991ad640 1 -- 10.20.193.91:0/4026870378 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1426582893 0 0) 0x7f0a940b20b0 con 0x7f0a94163310 2026-02-12T04:04:54.869 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.860+0000 7f0a991ad640 1 -- 10.20.193.91:0/4026870378 >> v1:10.20.193.98:6789/0 conn(0x7f0a940560d0 legacy=0x7f0a941c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:54.870 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.860+0000 7f0a991ad640 1 -- 10.20.193.91:0/4026870378 >> v1:10.20.193.91:6789/0 conn(0x7f0a941575d0 legacy=0x7f0a94162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:54.870 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.860+0000 7f0a991ad640 10 monclient: _finish_hunting 0 2026-02-12T04:04:54.870 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.860+0000 7f0a991ad640 1 monclient: found mon.noname-c 2026-02-12T04:04:54.870 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.860+0000 7f0a991ad640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:54.870 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.860+0000 7f0a991ad640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.111:6789/0 2026-02-12T04:04:54.870 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.860+0000 7f0a991ad640 1 -- 10.20.193.91:0/4026870378 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a94162400 con 0x7f0a94163310 2026-02-12T04:04:54.870 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.860+0000 7f0a991ad640 10 monclient: _finish_auth 0 2026-02-12T04:04:54.870 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.860+0000 7f0a991ad640 10 monclient: _check_auth_tickets 2026-02-12T04:04:54.870 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.860+0000 7f0a991ad640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:54.870 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.860+0000 7f0a991ad640 1 -- 10.20.193.91:0/4026870378 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f0a88002df0 con 0x7f0a94163310 2026-02-12T04:04:54.871 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.860+0000 7f0a9c43a640 5 monclient: authenticate success, global_id 27452 2026-02-12T04:04:54.871 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.860+0000 7f0a9c43a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:04:54.871 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.860+0000 7f0a991ad640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:54.871 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.860+0000 7f0a991ad640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T04:04:54.871 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.860+0000 7f0a991ad640 10 monclient: dump: 2026-02-12T04:04:54.871 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:54.871 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:54.871 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:54.871 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:54.871 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:54.871 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:54.871 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:54.872 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:54.872 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:54.872 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:54.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.860+0000 7f0a9c43a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:04:54.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.861+0000 7f0a991ad640 1 -- 10.20.193.91:0/4026870378 <== mon.2 v1:10.20.193.111:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0a88002fc0 con 0x7f0a94163310 2026-02-12T04:04:54.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.861+0000 7f0a991ad640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:54.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.861+0000 7f0a991ad640 1 -- 10.20.193.91:0/4026870378 <== mon.2 v1:10.20.193.111:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f0a88003400 con 0x7f0a94163310 2026-02-12T04:04:54.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.861+0000 7f0a9c43a640 10 monclient: get_monmap_and_config success 2026-02-12T04:04:54.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.861+0000 7f0a9c43a640 4 set_mon_vals no callback set 2026-02-12T04:04:54.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.861+0000 7f0a991ad640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:54.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.861+0000 7f0a991ad640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T04:04:54.872 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.861+0000 7f0a991ad640 10 monclient: dump: 2026-02-12T04:04:54.873 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:54.873 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:54.873 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:54.873 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:54.873 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:54.873 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:54.873 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:54.873 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:54.873 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:54.873 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:54.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.861+0000 7f0a9c43a640 10 monclient: shutdown 2026-02-12T04:04:54.873 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.861+0000 7f0a9c43a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:54.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.861+0000 7f0a9c43a640 1 -- 10.20.193.91:0/4026870378 >> v1:10.20.193.111:6789/0 conn(0x7f0a94163310 legacy=0x7f0a940559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:54.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.861+0000 7f0a9c43a640 1 -- 10.20.193.91:0/4026870378 shutdown_connections 2026-02-12T04:04:54.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.861+0000 7f0a9c43a640 1 -- 10.20.193.91:0/4026870378 >> 10.20.193.91:0/4026870378 conn(0x7f0a940b6560 msgr2=0x7f0a940b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:54.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.861+0000 7f0a9c43a640 1 -- 10.20.193.91:0/4026870378 shutdown_connections 2026-02-12T04:04:54.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.861+0000 7f0a9c43a640 1 -- 10.20.193.91:0/4026870378 wait complete. 2026-02-12T04:04:54.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.862+0000 7f0a9c43a640 10 monclient: build_initial_monmap 2026-02-12T04:04:54.874 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.862+0000 7f0a9c43a640 10 monclient: monmap: 2026-02-12T04:04:54.874 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:54.874 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:04:54.874 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:04:54.874 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:04:54.874 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:54.874 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:04:54.874 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:54.875 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:54.875 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:54.875 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:54.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.862+0000 7f0a9c43a640 1 librados: starting msgr at 2026-02-12T04:04:54.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.862+0000 7f0a9c43a640 1 librados: starting objecter 2026-02-12T04:04:54.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.862+0000 7f0a9c43a640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:04:54.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.862+0000 7f0a9c43a640 1 Processor -- start 2026-02-12T04:04:54.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.862+0000 7f0a9c43a640 1 -- start start 2026-02-12T04:04:54.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.862+0000 7f0a9c43a640 1 librados: setting wanted keys 2026-02-12T04:04:54.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.862+0000 7f0a9c43a640 1 librados: calling monclient init 2026-02-12T04:04:54.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.862+0000 7f0a9c43a640 10 monclient: init 2026-02-12T04:04:54.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.862+0000 7f0a9c43a640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:54.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.862+0000 7f0a9c43a640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T04:04:54.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.862+0000 7f0a9c43a640 10 monclient(hunting): picked mon.noname-c con 0x7f0a940560d0 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:54.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.862+0000 7f0a9c43a640 10 monclient(hunting): picked mon.noname-b con 0x7f0a941575d0 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:54.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.862+0000 7f0a9c43a640 10 monclient(hunting): picked mon.noname-a con 0x7f0a94163310 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:54.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.862+0000 7f0a9c43a640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a9415a330 con 0x7f0a94163310 2026-02-12T04:04:54.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.862+0000 7f0a9c43a640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a9415a610 con 0x7f0a941575d0 2026-02-12T04:04:54.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.862+0000 7f0a9c43a640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a9415a8f0 con 0x7f0a940560d0 2026-02-12T04:04:54.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.862+0000 7f0a9c43a640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:54.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.862+0000 7f0a9c43a640 10 monclient(hunting): authenticate will time out at 1497.605714s 2026-02-12T04:04:54.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.862+0000 7f0a9a9b0640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f0a94163310 0x7f0a94157d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:41366/0 (socket says 10.20.193.91:41366) 2026-02-12T04:04:54.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.863+0000 7f0a9a9b0640 1 -- 10.20.193.91:0/679979412 learned_addr learned my addr 10.20.193.91:0/679979412 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:54.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.863+0000 7f0a7affd640 10 client.?.objecter ms_handle_connect 0x7f0a94163310 2026-02-12T04:04:54.877 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.863+0000 7f0a7affd640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:54.877 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.863+0000 7f0a7affd640 10 client.?.objecter ms_handle_connect 0x7f0a940560d0 2026-02-12T04:04:54.877 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.863+0000 7f0a7affd640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:54.877 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.863+0000 7f0a7affd640 10 client.?.objecter ms_handle_connect 0x7f0a941575d0 2026-02-12T04:04:54.877 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.863+0000 7f0a7affd640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:54.877 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.864+0000 7f0a7affd640 1 -- 10.20.193.91:0/679979412 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1566613908 0 0) 0x7f0a9415a8f0 con 0x7f0a940560d0 2026-02-12T04:04:54.877 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.864+0000 7f0a7affd640 10 monclient(hunting): _negotiate 2026-02-12T04:04:54.877 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.864+0000 7f0a7affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:54.877 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.864+0000 7f0a7affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:54.877 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.864+0000 7f0a7affd640 10 monclient(hunting): my global_id is 27455 2026-02-12T04:04:54.877 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.864+0000 7f0a7affd640 1 -- 10.20.193.91:0/679979412 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a64003610 con 0x7f0a940560d0 2026-02-12T04:04:54.877 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.864+0000 7f0a7affd640 1 -- 10.20.193.91:0/679979412 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2821832603 0 0) 0x7f0a9415a330 con 0x7f0a94163310 2026-02-12T04:04:54.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.864+0000 7f0a7affd640 10 monclient(hunting): _negotiate 2026-02-12T04:04:54.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.864+0000 7f0a7affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:54.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.864+0000 7f0a7affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:54.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.864+0000 7f0a7affd640 10 monclient(hunting): my global_id is 30621 2026-02-12T04:04:54.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.864+0000 7f0a7affd640 1 -- 10.20.193.91:0/679979412 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a9415a8f0 con 0x7f0a94163310 2026-02-12T04:04:54.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.864+0000 7f0a7affd640 1 -- 10.20.193.91:0/679979412 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3671610804 0 0) 0x7f0a9415a610 con 0x7f0a941575d0 2026-02-12T04:04:54.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.864+0000 7f0a7affd640 10 monclient(hunting): _negotiate 2026-02-12T04:04:54.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.864+0000 7f0a7affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:54.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.864+0000 7f0a7affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:54.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.864+0000 7f0a7affd640 10 monclient(hunting): my global_id is 27760 2026-02-12T04:04:54.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.864+0000 7f0a7affd640 1 -- 10.20.193.91:0/679979412 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a9415a330 con 0x7f0a941575d0 2026-02-12T04:04:54.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.867+0000 7f0a7affd640 1 -- 10.20.193.91:0/679979412 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2368734510 0 0) 0x7f0a64003610 con 0x7f0a940560d0 2026-02-12T04:04:54.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.867+0000 7f0a7affd640 1 -- 10.20.193.91:0/679979412 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0a9415a610 con 0x7f0a940560d0 2026-02-12T04:04:54.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.867+0000 7f0a7affd640 1 -- 10.20.193.91:0/679979412 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f0a840030b0 con 0x7f0a940560d0 2026-02-12T04:04:54.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.867+0000 7f0a7affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:54.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.867+0000 7f0a7affd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T04:04:54.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.867+0000 7f0a7affd640 10 monclient(hunting): dump: 2026-02-12T04:04:54.879 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:54.879 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:54.879 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:54.879 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:54.879 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:54.879 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:54.879 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:54.879 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:54.880 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:54.880 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:54.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.867+0000 7f0a7affd640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:04:54.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.867+0000 7f0a7affd640 1 -- 10.20.193.91:0/679979412 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4116775527 0 0) 0x7f0a9415a330 con 0x7f0a941575d0 2026-02-12T04:04:54.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.867+0000 7f0a7affd640 1 -- 10.20.193.91:0/679979412 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0a64003610 con 0x7f0a941575d0 2026-02-12T04:04:54.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.867+0000 7f0a7affd640 1 -- 10.20.193.91:0/679979412 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f0a88003310 con 0x7f0a941575d0 2026-02-12T04:04:54.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.867+0000 7f0a7affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:54.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.867+0000 7f0a7affd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T04:04:54.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.867+0000 7f0a7affd640 10 monclient(hunting): dump: 2026-02-12T04:04:54.880 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:54.880 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:54.880 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:54.881 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:54.881 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:54.881 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:54.881 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:54.881 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:54.881 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:54.881 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:54.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.867+0000 7f0a7affd640 1 -- 10.20.193.91:0/679979412 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 927772657 0 0) 0x7f0a9415a8f0 con 0x7f0a94163310 2026-02-12T04:04:54.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.867+0000 7f0a7affd640 1 -- 10.20.193.91:0/679979412 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0a9415a330 con 0x7f0a94163310 2026-02-12T04:04:54.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.867+0000 7f0a7affd640 1 -- 10.20.193.91:0/679979412 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f0a90003470 con 0x7f0a94163310 2026-02-12T04:04:54.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.867+0000 7f0a7affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:54.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.867+0000 7f0a7affd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T04:04:54.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.867+0000 7f0a7affd640 10 monclient(hunting): dump: 2026-02-12T04:04:54.882 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:54.882 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:54.882 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:54.882 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:54.882 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:54.882 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:54.882 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:54.882 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:54.882 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:54.882 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:54.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.868+0000 7f0a7affd640 1 -- 10.20.193.91:0/679979412 <== mon.2 v1:10.20.193.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3309189337 0 0) 0x7f0a9415a610 con 0x7f0a940560d0 2026-02-12T04:04:54.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.868+0000 7f0a7affd640 1 -- 10.20.193.91:0/679979412 >> v1:10.20.193.98:6789/0 conn(0x7f0a941575d0 legacy=0x7f0a9411cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:54.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.868+0000 7f0a7affd640 1 -- 10.20.193.91:0/679979412 >> v1:10.20.193.91:6789/0 conn(0x7f0a94163310 legacy=0x7f0a94157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:54.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.868+0000 7f0a7affd640 10 monclient: _finish_hunting 0 2026-02-12T04:04:54.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.868+0000 7f0a7affd640 1 monclient: found mon.c 2026-02-12T04:04:54.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.868+0000 7f0a7affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:54.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.868+0000 7f0a7affd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:04:54.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.868+0000 7f0a7affd640 1 -- 10.20.193.91:0/679979412 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a9415abd0 con 0x7f0a940560d0 2026-02-12T04:04:54.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.868+0000 7f0a7affd640 10 monclient: _finish_auth 0 2026-02-12T04:04:54.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.868+0000 7f0a7affd640 10 monclient: _check_auth_tickets 2026-02-12T04:04:54.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.868+0000 7f0a7affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:54.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.868+0000 7f0a9c43a640 5 monclient: authenticate success, global_id 27455 2026-02-12T04:04:54.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.868+0000 7f0a9c43a640 10 monclient: _renew_subs 2026-02-12T04:04:54.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.868+0000 7f0a9c43a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:04:54.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.868+0000 7f0a9c43a640 1 -- 10.20.193.91:0/679979412 --> v1:10.20.193.111:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0a9415aeb0 con 0x7f0a940560d0 2026-02-12T04:04:54.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.868+0000 7f0a9c43a640 10 client.27455.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:04:54.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.868+0000 7f0a9c43a640 10 monclient: _renew_subs 2026-02-12T04:04:54.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.868+0000 7f0a9c43a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:04:54.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.868+0000 7f0a9c43a640 1 -- 10.20.193.91:0/679979412 --> v1:10.20.193.111:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0a9405c0e0 con 0x7f0a940560d0 2026-02-12T04:04:54.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.868+0000 7f0a9c43a640 1 librados: init done 2026-02-12T04:04:54.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.869+0000 7f0a9c43a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:54.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.869+0000 7f0a9c43a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:54.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.869+0000 7f0a9c43a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:04:54.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.869+0000 7f0a9c43a640 1 -- 10.20.193.91:0/679979412 --> v1:10.20.193.111:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a94059620 con 0x7f0a940560d0 2026-02-12T04:04:54.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.878+0000 7f0a7affd640 1 -- 10.20.193.91:0/679979412 <== mon.2 v1:10.20.193.111:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0a840048d0 con 0x7f0a940560d0 2026-02-12T04:04:54.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.878+0000 7f0a7affd640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:54.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.878+0000 7f0a7affd640 1 -- 10.20.193.91:0/679979412 <== mon.2 v1:10.20.193.111:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f0a84004c20 con 0x7f0a940560d0 2026-02-12T04:04:54.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.878+0000 7f0a7affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:54.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.878+0000 7f0a7affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T04:04:54.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.878+0000 7f0a989ac640 4 set_mon_vals no callback set 2026-02-12T04:04:54.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.878+0000 7f0a7affd640 10 monclient: dump: 2026-02-12T04:04:54.887 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:54.888 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:54.888 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:54.888 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:54.888 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:54.888 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:54.888 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:54.888 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:54.888 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:54.888 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:54.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.878+0000 7f0a7affd640 1 -- 10.20.193.91:0/679979412 <== mon.2 v1:10.20.193.111:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f0a8401e100 con 0x7f0a940560d0 2026-02-12T04:04:54.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.879+0000 7f0a999ae640 10 monclient: get_auth_request con 0x7f0a6407a040 auth_method 0 2026-02-12T04:04:54.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.879+0000 7f0a7affd640 10 client.27455.objecter ms_handle_connect 0x7f0a6407a040 2026-02-12T04:04:54.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.880+0000 7f0a7affd640 1 -- 10.20.193.91:0/679979412 <== mon.2 v1:10.20.193.111:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7f0a84095a40 con 0x7f0a940560d0 2026-02-12T04:04:54.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.880+0000 7f0a7affd640 10 client.27455.objecter ms_dispatch2 0x7f0a94000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:04:54.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.880+0000 7f0a7affd640 3 client.27455.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:04:54.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.880+0000 7f0a7affd640 3 client.27455.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:04:54.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.880+0000 7f0a7affd640 20 client.27455.objecter dump_active .. 0 homeless 2026-02-12T04:04:54.970 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.968+0000 7f0a7affd640 1 -- 10.20.193.91:0/679979412 <== mon.2 v1:10.20.193.111:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f0a8405f3a0 con 0x7f0a940560d0 2026-02-12T04:04:54.970 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.968+0000 7f0a7affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:54.970 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:54.968+0000 7f0a7affd640 10 monclient: _finish_command 1 = system:0 2026-02-12T04:04:55.077 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:55.075+0000 7f0a9c43a640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-12T04:04:55.077 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:55.075+0000 7f0a9c43a640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T04:04:55.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:55.075+0000 7f0a9c43a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:04:55.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:55.075+0000 7f0a9c43a640 1 -- 10.20.193.91:0/679979412 --> v1:10.20.193.111:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0a940b7290 con 0x7f0a940560d0 2026-02-12T04:04:55.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:55.090+0000 7f0a7affd640 1 -- 10.20.193.91:0/679979412 <== mon.2 v1:10.20.193.111:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v344) ==== 74+0+23412 (unknown 136574737 0 3821083371) 0x7f0a8405eca0 con 0x7f0a940560d0 2026-02-12T04:04:55.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:55.090+0000 7f0a7affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T04:04:55.093 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:55.090+0000 7f0a7affd640 10 monclient: _finish_command 2 = system:0 2026-02-12T04:04:55.093 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T04:04:55.093 INFO:teuthology.orchestra.run.trial091.stdout:{"epoch":344,"fsid":"1e356fcf-3d61-462e-a451-82f8dd01e1f3","created":"2026-02-12T03:57:59.014379+0000","modified":"2026-02-12T04:04:53.265478+0000","last_up_change":"2026-02-12T03:58:32.372907+0000","last_in_change":"2026-02-12T03:58:05.455425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":103,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":268,"max_osd":16,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-12T03:58:32.248062+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":15.380000114440918,"score_stable":15.380000114440918,"optimal_score":0.12999999523162842,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-12T03:58:39.975964+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":28,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":5.9899997711181641,"score_stable":5.9899997711181641,"optimal_score":0.68999999761581421,"raw_score_acting":4.130000114440918,"raw_score_stable":4.130000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"ceph_test_rados_api_asio","create_time":"2026-02-12T03:59:10.022906+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"791c97c5-83f6-4024-9f43-ff3b2ee22a30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":296,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6801","nonce":1203233578}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6802","nonce":1203233578}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6804","nonce":1203233578}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6803","nonce":1203233578}]},"public_addr":"10.20.193.91:6801/1203233578","cluster_addr":"10.20.193.91:6802/1203233578","heartbeat_back_addr":"10.20.193.91:6804/1203233578","heartbeat_front_addr":"10.20.193.91:6803/1203233578","state":["exists","up"]},{"osd":1,"uuid":"0cf561d6-85aa-428a-bc69-83ce77b1c802","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":342,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6812","nonce":2011281833}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6813","nonce":2011281833}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6815","nonce":2011281833}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6814","nonce":2011281833}]},"public_addr":"10.20.193.98:6812/2011281833","cluster_addr":"10.20.193.98:6813/2011281833","heartbeat_back_addr":"10.20.193.98:6815/2011281833","heartbeat_front_addr":"10.20.193.98:6814/2011281833","state":["exists","up"]},{"osd":2,"uuid":"b3dc78b9-cae6-4b1f-931f-7352a43b9e26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":342,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6812","nonce":350848222}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6813","nonce":350848222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6815","nonce":350848222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6814","nonce":350848222}]},"public_addr":"10.20.193.111:6812/350848222","cluster_addr":"10.20.193.111:6813/350848222","heartbeat_back_addr":"10.20.193.111:6815/350848222","heartbeat_front_addr":"10.20.193.111:6814/350848222","state":["exists","up"]},{"osd":3,"uuid":"e164e3ae-cf6a-45ff-b126-3ac739c5b1be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":342,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6800","nonce":4779434}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6801","nonce":4779434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6803","nonce":4779434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6802","nonce":4779434}]},"public_addr":"10.20.193.154:6800/4779434","cluster_addr":"10.20.193.154:6801/4779434","heartbeat_back_addr":"10.20.193.154:6803/4779434","heartbeat_front_addr":"10.20.193.154:6802/4779434","state":["exists","up"]},{"osd":4,"uuid":"5583cc8c-83d4-42b4-a997-c056f3b145a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":342,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6805","nonce":1766507926}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6806","nonce":1766507926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6808","nonce":1766507926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6807","nonce":1766507926}]},"public_addr":"10.20.193.91:6805/1766507926","cluster_addr":"10.20.193.91:6806/1766507926","heartbeat_back_addr":"10.20.193.91:6808/1766507926","heartbeat_front_addr":"10.20.193.91:6807/1766507926","state":["exists","up"]},{"osd":5,"uuid":"d7bb6fa1-b042-4dce-9644-00e817a5bc8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":342,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6808","nonce":3918277953}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6809","nonce":3918277953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6811","nonce":3918277953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6810","nonce":3918277953}]},"public_addr":"10.20.193.98:6808/3918277953","cluster_addr":"10.20.193.98:6809/3918277953","heartbeat_back_addr":"10.20.193.98:6811/3918277953","heartbeat_front_addr":"10.20.193.98:6810/3918277953","state":["exists","up"]},{"osd":6,"uuid":"93cd9edf-a000-4d22-8da7-52f4bd547765","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":342,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6804","nonce":727190484}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6805","nonce":727190484}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6807","nonce":727190484}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6806","nonce":727190484}]},"public_addr":"10.20.193.111:6804/727190484","cluster_addr":"10.20.193.111:6805/727190484","heartbeat_back_addr":"10.20.193.111:6807/727190484","heartbeat_front_addr":"10.20.193.111:6806/727190484","state":["exists","up"]},{"osd":7,"uuid":"f5e11a47-d746-46ca-85f1-27d3bc586371","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":342,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6808","nonce":903276772}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6810","nonce":903276772}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6813","nonce":903276772}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6811","nonce":903276772}]},"public_addr":"10.20.193.154:6808/903276772","cluster_addr":"10.20.193.154:6810/903276772","heartbeat_back_addr":"10.20.193.154:6813/903276772","heartbeat_front_addr":"10.20.193.154:6811/903276772","state":["exists","up"]},{"osd":8,"uuid":"bb8207ce-22b9-46be-9c89-c77f2690e405","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":342,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6809","nonce":443384425}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6810","nonce":443384425}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6812","nonce":443384425}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6811","nonce":443384425}]},"public_addr":"10.20.193.91:6809/443384425","cluster_addr":"10.20.193.91:6810/443384425","heartbeat_back_addr":"10.20.193.91:6812/443384425","heartbeat_front_addr":"10.20.193.91:6811/443384425","state":["exists","up"]},{"osd":9,"uuid":"e6318a6d-2367-48ce-a3a1-47307de14b99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":342,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6801","nonce":4165741185}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6804","nonce":4165741185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6807","nonce":4165741185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6806","nonce":4165741185}]},"public_addr":"10.20.193.98:6801/4165741185","cluster_addr":"10.20.193.98:6804/4165741185","heartbeat_back_addr":"10.20.193.98:6807/4165741185","heartbeat_front_addr":"10.20.193.98:6806/4165741185","state":["exists","up"]},{"osd":10,"uuid":"cd6c97a2-bdfe-4b86-afeb-217315976d6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":342,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6808","nonce":1268343515}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6809","nonce":1268343515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6811","nonce":1268343515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6810","nonce":1268343515}]},"public_addr":"10.20.193.111:6808/1268343515","cluster_addr":"10.20.193.111:6809/1268343515","heartbeat_back_addr":"10.20.193.111:6811/1268343515","heartbeat_front_addr":"10.20.193.111:6810/1268343515","state":["exists","up"]},{"osd":11,"uuid":"b6c647bb-4e86-4b0e-b79c-b0236a780a66","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":342,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6804","nonce":2902069275}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6805","nonce":2902069275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6807","nonce":2902069275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6806","nonce":2902069275}]},"public_addr":"10.20.193.154:6804/2902069275","cluster_addr":"10.20.193.154:6805/2902069275","heartbeat_back_addr":"10.20.193.154:6807/2902069275","heartbeat_front_addr":"10.20.193.154:6806/2902069275","state":["exists","up"]},{"osd":12,"uuid":"19bb3570-0c0a-48cc-a0b8-ec3194f30fa8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":342,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6813","nonce":3587007397}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6814","nonce":3587007397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6816","nonce":3587007397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.91:6815","nonce":3587007397}]},"public_addr":"10.20.193.91:6813/3587007397","cluster_addr":"10.20.193.91:6814/3587007397","heartbeat_back_addr":"10.20.193.91:6816/3587007397","heartbeat_front_addr":"10.20.193.91:6815/3587007397","state":["exists","up"]},{"osd":13,"uuid":"a8215062-521c-47f6-b20a-9e40c1f3f5a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":342,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6800","nonce":1665089474}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6802","nonce":1665089474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6805","nonce":1665089474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.98:6803","nonce":1665089474}]},"public_addr":"10.20.193.98:6800/1665089474","cluster_addr":"10.20.193.98:6802/1665089474","heartbeat_back_addr":"10.20.193.98:6805/1665089474","heartbeat_front_addr":"10.20.193.98:6803/1665089474","state":["exists","up"]},{"osd":14,"uuid":"3cd1bb48-53a2-462e-b7e5-4d6d918dd543","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":342,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6800","nonce":1665676360}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6801","nonce":1665676360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6803","nonce":1665676360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.111:6802","nonce":1665676360}]},"public_addr":"10.20.193.111:6800/1665676360","cluster_addr":"10.20.193.111:6801/1665676360","heartbeat_back_addr":"10.20.193.111:6803/1665676360","heartbeat_front_addr":"10.20.193.111:6802/1665676360","state":["exists","up"]},{"osd":15,"uuid":"9bd39438-f5e5-4a19-afa4-678395d63c24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":342,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6809","nonce":2343771552}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6812","nonce":2343771552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6815","nonce":2343771552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.154:6814","nonce":2343771552}]},"public_addr":"10.20.193.154:6809/2343771552","cluster_addr":"10.20.193.154:6812/2343771552","heartbeat_back_addr":"10.20.193.154:6815/2343771552","heartbeat_front_addr":"10.20.193.154:6814/2343771552","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.723024+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:30.073947+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.930180+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:30.325123+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.735688+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.923661+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.879912+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:30.480032+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.983654+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.730948+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.899878+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:30.549254+0000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.968146+0000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.918456+0000","dead_epoch":0},{"osd":14,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:29.803753+0000","dead_epoch":0},{"osd":15,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T03:58:30.518611+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":11,"snaps":[{"begin":1,"length":4}]},{"pool":12,"snaps":[{"begin":3,"length":4}]},{"pool":26,"snaps":[{"begin":1,"length":1}]},{"pool":59,"snaps":[{"begin":1,"length":1}]},{"pool":92,"snaps":[{"begin":7,"length":2}]},{"pool":101,"snaps":[{"begin":1,"length":1}]},{"pool":121,"snaps":[{"begin":1,"length":2}]},{"pool":139,"snaps":[{"begin":3,"length":1}]},{"pool":144,"snaps":[{"begin":2,"length":3}]},{"pool":150,"snaps":[{"begin":2,"length":2}]},{"pool":159,"snaps":[{"begin":2,"length":3}]},{"pool":167,"snaps":[{"begin":2,"length":4}]},{"pool":170,"snaps":[{"begin":2,"length":2}]},{"pool":175,"snaps":[{"begin":2,"length":1}]},{"pool":183,"snaps":[{"begin":1,"length":4}]},{"pool":194,"snaps":[{"begin":4,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T04:04:55.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:55.092+0000 7f0a9c43a640 10 librados: watch_flush enter 2026-02-12T04:04:55.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:55.092+0000 7f0a9c43a640 10 librados: watch_flush exit 2026-02-12T04:04:55.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:55.092+0000 7f0a9c43a640 20 client.27455.objecter shutdown clearing up homeless session... 2026-02-12T04:04:55.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:55.092+0000 7f0a9c43a640 10 client.27455.objecter successfully canceled tick 2026-02-12T04:04:55.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:55.092+0000 7f0a9c43a640 1 -- 10.20.193.91:0/679979412 >> v1:10.20.193.91:6800/2929217192 conn(0x7f0a6407a040 legacy=0x7f0a6409a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:55.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:55.092+0000 7f0a9c43a640 10 monclient: shutdown 2026-02-12T04:04:55.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:55.092+0000 7f0a9c43a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:55.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:55.092+0000 7f0a9c43a640 1 -- 10.20.193.91:0/679979412 >> v1:10.20.193.111:6789/0 conn(0x7f0a940560d0 legacy=0x7f0a9405b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:55.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:55.092+0000 7f0a9c43a640 1 -- 10.20.193.91:0/679979412 shutdown_connections 2026-02-12T04:04:55.095 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:55.092+0000 7f0a9c43a640 1 -- 10.20.193.91:0/679979412 >> 10.20.193.91:0/679979412 conn(0x7f0a940b6560 msgr2=0x7f0a94058960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:55.096 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:55.092+0000 7f0a9c43a640 1 -- 10.20.193.91:0/679979412 shutdown_connections 2026-02-12T04:04:55.096 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:55.092+0000 7f0a9c43a640 1 -- 10.20.193.91:0/679979412 wait complete. 2026-02-12T04:04:55.096 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:55.092+0000 7f0a9c43a640 1 librados: shutdown 2026-02-12T04:04:56.104 INFO:tasks.ceph:Scrubbing osd.0 2026-02-12T04:04:56.104 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-12T04:04:56.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.173+0000 7f836a8f4640 10 monclient: get_monmap_and_config 2026-02-12T04:04:56.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.173+0000 7f836a8f4640 10 monclient: build_initial_monmap 2026-02-12T04:04:56.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.173+0000 7f836a8f4640 10 monclient: monmap: 2026-02-12T04:04:56.175 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:56.175 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:56.175 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:04:56.173797+0000 2026-02-12T04:04:56.176 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:04:56.173797+0000 2026-02-12T04:04:56.176 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:56.176 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:56.176 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:56.176 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:56.176 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:56.176 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:56.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.173+0000 7f836a8f4640 1 Processor -- start 2026-02-12T04:04:56.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.173+0000 7f836a8f4640 1 -- start start 2026-02-12T04:04:56.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.173+0000 7f836a8f4640 10 monclient: init 2026-02-12T04:04:56.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.174+0000 7f836a8f4640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:56.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.174+0000 7f836a8f4640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T04:04:56.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.174+0000 7f836a8f4640 10 monclient(hunting): picked mon.noname-c con 0x7f8364055c30 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:56.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.174+0000 7f836a8f4640 10 monclient(hunting): picked mon.noname-a con 0x7f8364160f80 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:56.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.174+0000 7f836a8f4640 10 monclient(hunting): picked mon.noname-b con 0x7f8364163230 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:56.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.174+0000 7f836a8f4640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83640b1fc0 con 0x7f8364160f80 2026-02-12T04:04:56.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.174+0000 7f836a8f4640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83640b22a0 con 0x7f8364163230 2026-02-12T04:04:56.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.174+0000 7f836a8f4640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83640b2580 con 0x7f8364055c30 2026-02-12T04:04:56.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.174+0000 7f836a8f4640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:56.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.174+0000 7f836a8f4640 10 monclient(hunting): authenticate will time out at 1498.917576s 2026-02-12T04:04:56.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.175+0000 7f83637fe640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f8364160f80 0x7f83641572d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:41368/0 (socket says 10.20.193.91:41368) 2026-02-12T04:04:56.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.175+0000 7f83637fe640 1 -- 10.20.193.91:0/1682417035 learned_addr learned my addr 10.20.193.91:0/1682417035 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:56.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.176+0000 7f8362ffd640 1 -- 10.20.193.91:0/1682417035 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3786797476 0 0) 0x7f83640b1fc0 con 0x7f8364160f80 2026-02-12T04:04:56.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.176+0000 7f8362ffd640 10 monclient(hunting): _negotiate 2026-02-12T04:04:56.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.176+0000 7f8362ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:56.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.176+0000 7f8362ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:56.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.176+0000 7f8362ffd640 10 monclient(hunting): my global_id is 30624 2026-02-12T04:04:56.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.176+0000 7f8362ffd640 1 -- 10.20.193.91:0/1682417035 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8348003610 con 0x7f8364160f80 2026-02-12T04:04:56.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.176+0000 7f8362ffd640 1 -- 10.20.193.91:0/1682417035 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3502604940 0 0) 0x7f83640b2580 con 0x7f8364055c30 2026-02-12T04:04:56.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.176+0000 7f8362ffd640 10 monclient(hunting): _negotiate 2026-02-12T04:04:56.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.176+0000 7f8362ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:56.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.176+0000 7f8362ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:56.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.176+0000 7f8362ffd640 10 monclient(hunting): my global_id is 27458 2026-02-12T04:04:56.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.176+0000 7f8362ffd640 1 -- 10.20.193.91:0/1682417035 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83640b1fc0 con 0x7f8364055c30 2026-02-12T04:04:56.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.176+0000 7f8362ffd640 1 -- 10.20.193.91:0/1682417035 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1036193110 0 0) 0x7f83640b22a0 con 0x7f8364163230 2026-02-12T04:04:56.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.176+0000 7f8362ffd640 10 monclient(hunting): _negotiate 2026-02-12T04:04:56.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.176+0000 7f8362ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:56.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.176+0000 7f8362ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:56.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.176+0000 7f8362ffd640 10 monclient(hunting): my global_id is 27763 2026-02-12T04:04:56.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.176+0000 7f8362ffd640 1 -- 10.20.193.91:0/1682417035 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83640b2580 con 0x7f8364163230 2026-02-12T04:04:56.187 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.178+0000 7f8362ffd640 1 -- 10.20.193.91:0/1682417035 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 253233143 0 0) 0x7f8348003610 con 0x7f8364160f80 2026-02-12T04:04:56.187 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.178+0000 7f8362ffd640 1 -- 10.20.193.91:0/1682417035 >> v1:10.20.193.111:6789/0 conn(0x7f8364055c30 legacy=0x7f8364162b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:56.187 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.178+0000 7f8362ffd640 1 -- 10.20.193.91:0/1682417035 >> v1:10.20.193.98:6789/0 conn(0x7f8364163230 legacy=0x7f83641c57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:56.187 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.178+0000 7f8362ffd640 10 monclient: _finish_hunting 0 2026-02-12T04:04:56.187 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.178+0000 7f8362ffd640 1 monclient: found mon.noname-a 2026-02-12T04:04:56.187 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.178+0000 7f8362ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:56.188 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.178+0000 7f8362ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.91:6789/0 2026-02-12T04:04:56.188 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.178+0000 7f8362ffd640 1 -- 10.20.193.91:0/1682417035 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83640b2860 con 0x7f8364160f80 2026-02-12T04:04:56.188 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.178+0000 7f8362ffd640 10 monclient: _finish_auth 0 2026-02-12T04:04:56.188 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.178+0000 7f8362ffd640 10 monclient: _check_auth_tickets 2026-02-12T04:04:56.188 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.178+0000 7f8362ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:56.188 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.178+0000 7f8362ffd640 1 -- 10.20.193.91:0/1682417035 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8354002df0 con 0x7f8364160f80 2026-02-12T04:04:56.188 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.178+0000 7f8362ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:56.188 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.178+0000 7f8362ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T04:04:56.188 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.178+0000 7f8362ffd640 10 monclient: dump: 2026-02-12T04:04:56.188 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:56.188 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:56.188 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.189 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.189 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:56.189 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:56.189 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:56.189 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:56.189 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:56.189 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:56.189 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.178+0000 7f836a8f4640 5 monclient: authenticate success, global_id 30624 2026-02-12T04:04:56.189 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.178+0000 7f836a8f4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:04:56.189 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.179+0000 7f8362ffd640 1 -- 10.20.193.91:0/1682417035 <== mon.0 v1:10.20.193.91:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8354002fc0 con 0x7f8364160f80 2026-02-12T04:04:56.189 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.179+0000 7f8362ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:56.190 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.179+0000 7f8362ffd640 1 -- 10.20.193.91:0/1682417035 <== mon.0 v1:10.20.193.91:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8354003400 con 0x7f8364160f80 2026-02-12T04:04:56.190 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.179+0000 7f8362ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:56.190 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.179+0000 7f8362ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T04:04:56.190 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.179+0000 7f8362ffd640 10 monclient: dump: 2026-02-12T04:04:56.190 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:56.190 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:56.190 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.190 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.190 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:56.190 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:56.190 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:56.190 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:56.191 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:56.191 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:56.191 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.179+0000 7f836a8f4640 10 monclient: get_monmap_and_config success 2026-02-12T04:04:56.191 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.179+0000 7f836a8f4640 4 set_mon_vals no callback set 2026-02-12T04:04:56.191 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.179+0000 7f836a8f4640 10 monclient: shutdown 2026-02-12T04:04:56.191 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.179+0000 7f836a8f4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:56.191 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.179+0000 7f836a8f4640 1 -- 10.20.193.91:0/1682417035 >> v1:10.20.193.91:6789/0 conn(0x7f8364160f80 legacy=0x7f83641572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:56.191 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.179+0000 7f836a8f4640 1 -- 10.20.193.91:0/1682417035 shutdown_connections 2026-02-12T04:04:56.191 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.179+0000 7f836a8f4640 1 -- 10.20.193.91:0/1682417035 >> 10.20.193.91:0/1682417035 conn(0x7f83640b6560 msgr2=0x7f83640b6930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:56.191 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.179+0000 7f836a8f4640 1 -- 10.20.193.91:0/1682417035 shutdown_connections 2026-02-12T04:04:56.191 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.179+0000 7f836a8f4640 1 -- 10.20.193.91:0/1682417035 wait complete. 2026-02-12T04:04:56.191 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.179+0000 7f836a8f4640 10 monclient: build_initial_monmap 2026-02-12T04:04:56.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.179+0000 7f836a8f4640 10 monclient: monmap: 2026-02-12T04:04:56.192 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:56.192 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:04:56.192 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:04:56.192 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:04:56.192 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:56.192 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:04:56.192 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:56.192 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:56.192 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:56.192 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:56.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.180+0000 7f836a8f4640 1 librados: starting msgr at 2026-02-12T04:04:56.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.180+0000 7f836a8f4640 1 librados: starting objecter 2026-02-12T04:04:56.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.180+0000 7f836a8f4640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:04:56.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.180+0000 7f836a8f4640 1 Processor -- start 2026-02-12T04:04:56.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.180+0000 7f836a8f4640 1 -- start start 2026-02-12T04:04:56.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.180+0000 7f836a8f4640 1 librados: setting wanted keys 2026-02-12T04:04:56.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.180+0000 7f836a8f4640 1 librados: calling monclient init 2026-02-12T04:04:56.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.180+0000 7f836a8f4640 10 monclient: init 2026-02-12T04:04:56.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.180+0000 7f836a8f4640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:56.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.180+0000 7f836a8f4640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T04:04:56.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.180+0000 7f836a8f4640 10 monclient(hunting): picked mon.noname-a con 0x7f8364055c30 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:56.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.180+0000 7f836a8f4640 10 monclient(hunting): picked mon.noname-b con 0x7f8364160f80 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:56.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.180+0000 7f836a8f4640 10 monclient(hunting): picked mon.noname-c con 0x7f8364163230 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:56.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.180+0000 7f836a8f4640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83640b03b0 con 0x7f8364055c30 2026-02-12T04:04:56.194 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.180+0000 7f836a8f4640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83640ae3e0 con 0x7f8364160f80 2026-02-12T04:04:56.194 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.180+0000 7f836a8f4640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83640ae6c0 con 0x7f8364163230 2026-02-12T04:04:56.194 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.180+0000 7f836a8f4640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:56.194 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.180+0000 7f836a8f4640 10 monclient(hunting): authenticate will time out at 1498.923507s 2026-02-12T04:04:56.194 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.180+0000 7f8363fff640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f8364055c30 0x7f83640afca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:41380/0 (socket says 10.20.193.91:41380) 2026-02-12T04:04:56.194 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.180+0000 7f8363fff640 1 -- 10.20.193.91:0/566840263 learned_addr learned my addr 10.20.193.91:0/566840263 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:56.194 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.180+0000 7f8360ff9640 10 client.?.objecter ms_handle_connect 0x7f8364055c30 2026-02-12T04:04:56.194 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.180+0000 7f8360ff9640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:56.194 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.181+0000 7f8360ff9640 10 client.?.objecter ms_handle_connect 0x7f8364163230 2026-02-12T04:04:56.194 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.181+0000 7f8360ff9640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:56.194 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.181+0000 7f8360ff9640 10 client.?.objecter ms_handle_connect 0x7f8364160f80 2026-02-12T04:04:56.194 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.181+0000 7f8360ff9640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:56.194 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.181+0000 7f8360ff9640 1 -- 10.20.193.91:0/566840263 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1353253243 0 0) 0x7f83640b03b0 con 0x7f8364055c30 2026-02-12T04:04:56.195 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.181+0000 7f8360ff9640 10 monclient(hunting): _negotiate 2026-02-12T04:04:56.195 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.181+0000 7f8360ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:56.195 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.181+0000 7f8360ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:56.195 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.181+0000 7f8360ff9640 10 monclient(hunting): my global_id is 30627 2026-02-12T04:04:56.195 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.181+0000 7f8360ff9640 1 -- 10.20.193.91:0/566840263 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8334003610 con 0x7f8364055c30 2026-02-12T04:04:56.195 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.182+0000 7f8360ff9640 1 -- 10.20.193.91:0/566840263 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3994882805 0 0) 0x7f83640ae6c0 con 0x7f8364163230 2026-02-12T04:04:56.195 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.182+0000 7f8360ff9640 10 monclient(hunting): _negotiate 2026-02-12T04:04:56.195 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.182+0000 7f8360ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:56.195 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.182+0000 7f8360ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:56.195 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.182+0000 7f8360ff9640 10 monclient(hunting): my global_id is 27461 2026-02-12T04:04:56.195 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.182+0000 7f8360ff9640 1 -- 10.20.193.91:0/566840263 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83640b03b0 con 0x7f8364163230 2026-02-12T04:04:56.196 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.182+0000 7f8360ff9640 1 -- 10.20.193.91:0/566840263 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1674529315 0 0) 0x7f83640ae3e0 con 0x7f8364160f80 2026-02-12T04:04:56.196 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.182+0000 7f8360ff9640 10 monclient(hunting): _negotiate 2026-02-12T04:04:56.196 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.182+0000 7f8360ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:56.196 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.182+0000 7f8360ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:56.196 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.182+0000 7f8360ff9640 10 monclient(hunting): my global_id is 27766 2026-02-12T04:04:56.196 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.182+0000 7f8360ff9640 1 -- 10.20.193.91:0/566840263 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83640ae6c0 con 0x7f8364160f80 2026-02-12T04:04:56.196 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.184+0000 7f8360ff9640 1 -- 10.20.193.91:0/566840263 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4053791382 0 0) 0x7f8334003610 con 0x7f8364055c30 2026-02-12T04:04:56.196 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.184+0000 7f8360ff9640 1 -- 10.20.193.91:0/566840263 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f83640ae3e0 con 0x7f8364055c30 2026-02-12T04:04:56.196 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.184+0000 7f8360ff9640 1 -- 10.20.193.91:0/566840263 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8350003190 con 0x7f8364055c30 2026-02-12T04:04:56.196 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.184+0000 7f8360ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:56.196 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.184+0000 7f8360ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T04:04:56.196 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.184+0000 7f8360ff9640 10 monclient(hunting): dump: 2026-02-12T04:04:56.197 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:56.197 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:56.197 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.197 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.197 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:56.197 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:56.197 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:56.197 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:56.197 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:56.197 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:56.197 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.184+0000 7f8360ff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:04:56.197 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.184+0000 7f8360ff9640 1 -- 10.20.193.91:0/566840263 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 668539805 0 0) 0x7f83640b03b0 con 0x7f8364163230 2026-02-12T04:04:56.198 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.184+0000 7f8360ff9640 1 -- 10.20.193.91:0/566840263 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8334003610 con 0x7f8364163230 2026-02-12T04:04:56.198 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.184+0000 7f8360ff9640 1 -- 10.20.193.91:0/566840263 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8358003330 con 0x7f8364163230 2026-02-12T04:04:56.198 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.184+0000 7f8360ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:56.198 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.184+0000 7f8360ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T04:04:56.198 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.184+0000 7f8360ff9640 10 monclient(hunting): dump: 2026-02-12T04:04:56.198 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:56.198 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:56.198 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.198 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.198 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:56.199 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:56.199 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:56.199 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:56.199 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:56.199 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:56.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.185+0000 7f8360ff9640 1 -- 10.20.193.91:0/566840263 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 204222988 0 0) 0x7f83640ae6c0 con 0x7f8364160f80 2026-02-12T04:04:56.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.185+0000 7f8360ff9640 1 -- 10.20.193.91:0/566840263 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f83640b03b0 con 0x7f8364160f80 2026-02-12T04:04:56.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.185+0000 7f8360ff9640 1 -- 10.20.193.91:0/566840263 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8354003310 con 0x7f8364160f80 2026-02-12T04:04:56.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.185+0000 7f8360ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:56.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.185+0000 7f8360ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T04:04:56.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.185+0000 7f8360ff9640 10 monclient(hunting): dump: 2026-02-12T04:04:56.199 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:56.200 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:56.200 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.200 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.200 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:56.200 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:56.200 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:56.200 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:56.200 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:56.200 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:56.204 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.186+0000 7f8360ff9640 1 -- 10.20.193.91:0/566840263 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3630447642 0 0) 0x7f83640ae3e0 con 0x7f8364055c30 2026-02-12T04:04:56.204 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.186+0000 7f8360ff9640 1 -- 10.20.193.91:0/566840263 >> v1:10.20.193.111:6789/0 conn(0x7f8364163230 legacy=0x7f8364142590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:56.204 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.186+0000 7f8360ff9640 1 -- 10.20.193.91:0/566840263 >> v1:10.20.193.98:6789/0 conn(0x7f8364160f80 legacy=0x7f83640ad860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:56.204 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.186+0000 7f8360ff9640 10 monclient: _finish_hunting 0 2026-02-12T04:04:56.204 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.186+0000 7f8360ff9640 1 monclient: found mon.a 2026-02-12T04:04:56.204 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.186+0000 7f8360ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:56.204 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.186+0000 7f8360ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:56.204 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.186+0000 7f8360ff9640 1 -- 10.20.193.91:0/566840263 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83640ae9a0 con 0x7f8364055c30 2026-02-12T04:04:56.204 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.186+0000 7f8360ff9640 10 monclient: _finish_auth 0 2026-02-12T04:04:56.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.186+0000 7f8360ff9640 10 monclient: _check_auth_tickets 2026-02-12T04:04:56.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.186+0000 7f8360ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:56.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.186+0000 7f836a8f4640 5 monclient: authenticate success, global_id 30627 2026-02-12T04:04:56.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.186+0000 7f836a8f4640 10 monclient: _renew_subs 2026-02-12T04:04:56.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.186+0000 7f836a8f4640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:56.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.186+0000 7f836a8f4640 1 -- 10.20.193.91:0/566840263 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f83640aec80 con 0x7f8364055c30 2026-02-12T04:04:56.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.186+0000 7f836a8f4640 10 client.30627.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:04:56.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.186+0000 7f836a8f4640 10 monclient: _renew_subs 2026-02-12T04:04:56.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.186+0000 7f836a8f4640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:56.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.186+0000 7f836a8f4640 1 -- 10.20.193.91:0/566840263 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8364137d90 con 0x7f8364055c30 2026-02-12T04:04:56.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.186+0000 7f836a8f4640 1 librados: init done 2026-02-12T04:04:56.205 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.186+0000 7f836a8f4640 10 client.30627.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:56.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.186+0000 7f836a8f4640 15 client.30627.objecter _session_command_op_assign -1 1 2026-02-12T04:04:56.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.186+0000 7f836a8f4640 20 client.30627.objecter _get_session osd=-1 returning homeless 2026-02-12T04:04:56.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.186+0000 7f836a8f4640 10 client.30627.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:04:56.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.186+0000 7f836a8f4640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:56.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.186+0000 7f836a8f4640 1 -- 10.20.193.91:0/566840263 --> v1:10.20.193.91:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f83640b0990 con 0x7f8364055c30 2026-02-12T04:04:56.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.194+0000 7f8360ff9640 1 -- 10.20.193.91:0/566840263 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f83640b0990 con 0x7f8364055c30 2026-02-12T04:04:56.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.194+0000 7f8360ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:56.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.194+0000 7f8360ff9640 1 -- 10.20.193.91:0/566840263 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f83500039b0 con 0x7f8364055c30 2026-02-12T04:04:56.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.194+0000 7f8360ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:56.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.194+0000 7f8360ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T04:04:56.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.194+0000 7f8360ff9640 10 monclient: dump: 2026-02-12T04:04:56.206 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:56.207 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:56.207 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.207 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.207 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:56.207 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:56.207 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:56.207 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:56.207 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:56.207 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:56.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.194+0000 7f83627fc640 4 set_mon_vals no callback set 2026-02-12T04:04:56.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.195+0000 7f8360ff9640 1 -- 10.20.193.91:0/566840263 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f8350003bc0 con 0x7f8364055c30 2026-02-12T04:04:56.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.195+0000 7f83637fe640 10 monclient: get_auth_request con 0x7f833407a0f0 auth_method 0 2026-02-12T04:04:56.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.195+0000 7f8360ff9640 10 client.30627.objecter ms_handle_connect 0x7f833407a0f0 2026-02-12T04:04:56.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.196+0000 7f8360ff9640 1 -- 10.20.193.91:0/566840263 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7f83500039b0 con 0x7f8364055c30 2026-02-12T04:04:56.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.197+0000 7f8360ff9640 10 client.30627.objecter ms_dispatch2 0x7f8364000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:04:56.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.197+0000 7f8360ff9640 3 client.30627.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:04:56.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.197+0000 7f8360ff9640 3 client.30627.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:04:56.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.197+0000 7f8360ff9640 10 client.30627.objecter checking command 1 2026-02-12T04:04:56.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.197+0000 7f8360ff9640 20 client.30627.objecter _get_session s=0x7f83340a43a0 osd=0 3 2026-02-12T04:04:56.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.197+0000 7f8360ff9640 20 client.30627.objecter put_session s=0x7f83340a43a0 osd=0 3 2026-02-12T04:04:56.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.197+0000 7f8360ff9640 15 client.30627.objecter _session_command_op_remove -1 1 2026-02-12T04:04:56.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.197+0000 7f8360ff9640 20 client.30627.objecter _get_session s=0x7f83340a43a0 osd=0 3 2026-02-12T04:04:56.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.197+0000 7f8360ff9640 20 client.30627.objecter get_session s=0x7f83340a43a0 osd=0 3 2026-02-12T04:04:56.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.197+0000 7f8360ff9640 15 client.30627.objecter _session_command_op_assign 0 1 2026-02-12T04:04:56.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.197+0000 7f8360ff9640 20 client.30627.objecter put_session s=0x7f83340a43a0 osd=0 4 2026-02-12T04:04:56.208 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.197+0000 7f8360ff9640 10 client.30627.objecter _send_command 1 2026-02-12T04:04:56.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.197+0000 7f8360ff9640 1 -- 10.20.193.91:0/566840263 --> v1:10.20.193.91:6801/1203233578 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f83340c66b0 con 0x7f83340a4a50 2026-02-12T04:04:56.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.197+0000 7f8360ff9640 20 client.30627.objecter dump_active .. 0 homeless 2026-02-12T04:04:56.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.197+0000 7f8360ff9640 1 -- 10.20.193.91:0/566840263 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_get_version_reply(handle=1 version=344) ==== 24+0+0 (unknown 1403447244 0 0) 0x7f835005e9d0 con 0x7f8364055c30 2026-02-12T04:04:56.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.197+0000 7f8360ff9640 10 monclient: handle_get_version_reply finishing 1 version 344 2026-02-12T04:04:56.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.197+0000 7f8368e6a640 10 monclient: get_auth_request con 0x7f83340a4a50 auth_method 0 2026-02-12T04:04:56.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.198+0000 7f8360ff9640 10 client.30627.objecter ms_handle_connect 0x7f83340a4a50 2026-02-12T04:04:56.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.198+0000 7f8368e6a640 1 -- 10.20.193.91:0/566840263 >> v1:10.20.193.91:6801/1203233578 conn(0x7f83340a4a50 legacy=0x7f83340c4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2026-02-12T04:04:56.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.198+0000 7f8368e6a640 1 -- 10.20.193.91:0/566840263 >> v1:10.20.193.91:6801/1203233578 conn(0x7f83340a4a50 legacy=0x7f83340c4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T04:04:56.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.198+0000 7f8368e6a640 1 --1- 10.20.193.91:0/566840263 >> v1:10.20.193.91:6801/1203233578 conn(0x7f83340a4a50 0x7f83340c4ee0 :-1 s=OPENED pgs=69 cs=1 l=1).handle_message read tag failed 2026-02-12T04:04:56.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.198+0000 7f8368e6a640 1 --1- 10.20.193.91:0/566840263 >> v1:10.20.193.91:6801/1203233578 conn(0x7f83340a4a50 0x7f83340c4ee0 :-1 s=OPENED pgs=69 cs=1 l=1).fault on lossy channel, failing 2026-02-12T04:04:56.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.198+0000 7f8360ff9640 1 client.30627.objecter ms_handle_reset 0x7f83340a4a50 session 0x7f83340a43a0 osd.0 2026-02-12T04:04:56.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.198+0000 7f8360ff9640 10 client.30627.objecter reopen_session osd.0 session, addr now v1:10.20.193.91:6801/1203233578 2026-02-12T04:04:56.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.198+0000 7f8360ff9640 1 -- 10.20.193.91:0/566840263 >> v1:10.20.193.91:6801/1203233578 conn(0x7f83340a4a50 legacy=0x7f83340c4ee0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T04:04:56.209 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.198+0000 7f8360ff9640 10 client.30627.objecter _send_command 1 2026-02-12T04:04:56.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.198+0000 7f8360ff9640 1 -- 10.20.193.91:0/566840263 --> v1:10.20.193.91:6801/1203233578 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f83340e84e0 con 0x7f83340c6960 2026-02-12T04:04:56.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.198+0000 7f8360ff9640 10 client.30627.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:04:56.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.198+0000 7f8360ff9640 10 monclient: _renew_subs 2026-02-12T04:04:56.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.198+0000 7f8360ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:56.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.198+0000 7f8360ff9640 1 -- 10.20.193.91:0/566840263 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=345}) -- 0x7f83640ae3e0 con 0x7f8364055c30 2026-02-12T04:04:56.210 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.208+0000 7f8368e6a640 10 monclient: get_auth_request con 0x7f83340c6960 auth_method 0 2026-02-12T04:04:56.211 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.209+0000 7f8360ff9640 10 client.30627.objecter ms_handle_connect 0x7f83340c6960 2026-02-12T04:04:56.221 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.219+0000 7f8360ff9640 1 -- 10.20.193.91:0/566840263 <== osd.0 v1:10.20.193.91:6801/1203233578 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f83340e84e0 con 0x7f83340c6960 2026-02-12T04:04:56.221 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.219+0000 7f8360ff9640 10 client.30627.objecter ms_dispatch2 0x7f8364000b90 command_reply(tid 1: 0 ) 2026-02-12T04:04:56.221 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.219+0000 7f8360ff9640 10 client.30627.objecter _finish_command 1 = system:0 2026-02-12T04:04:56.221 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.219+0000 7f8360ff9640 20 client.30627.objecter put_session s=0x7f83340a43a0 osd=0 4 2026-02-12T04:04:56.221 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.219+0000 7f8360ff9640 15 client.30627.objecter _session_command_op_remove 0 1 2026-02-12T04:04:56.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.227+0000 7f836a8f4640 10 client.30627.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-12T04:04:56.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.227+0000 7f836a8f4640 15 client.30627.objecter _session_command_op_assign -1 2 2026-02-12T04:04:56.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.227+0000 7f836a8f4640 20 client.30627.objecter _get_session s=0x7f83340a43a0 osd=0 3 2026-02-12T04:04:56.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.227+0000 7f836a8f4640 20 client.30627.objecter put_session s=0x7f83340a43a0 osd=0 3 2026-02-12T04:04:56.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.227+0000 7f836a8f4640 20 client.30627.objecter _get_session s=0x7f83340a43a0 osd=0 3 2026-02-12T04:04:56.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.227+0000 7f836a8f4640 15 client.30627.objecter _session_command_op_remove -1 2 2026-02-12T04:04:56.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.227+0000 7f836a8f4640 20 client.30627.objecter get_session s=0x7f83340a43a0 osd=0 3 2026-02-12T04:04:56.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.227+0000 7f836a8f4640 15 client.30627.objecter _session_command_op_assign 0 2 2026-02-12T04:04:56.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.227+0000 7f836a8f4640 20 client.30627.objecter put_session s=0x7f83340a43a0 osd=0 4 2026-02-12T04:04:56.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.227+0000 7f836a8f4640 10 client.30627.objecter _send_command 2 2026-02-12T04:04:56.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.227+0000 7f836a8f4640 1 -- 10.20.193.91:0/566840263 --> v1:10.20.193.91:6801/1203233578 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8364156b20 con 0x7f83340c6960 2026-02-12T04:04:56.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.235+0000 7f8360ff9640 1 -- 10.20.193.91:0/566840263 <== osd.0 v1:10.20.193.91:6801/1203233578 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f8364156b20 con 0x7f83340c6960 2026-02-12T04:04:56.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.235+0000 7f8360ff9640 10 client.30627.objecter ms_dispatch2 0x7f8364000b90 command_reply(tid 2: 0 ) 2026-02-12T04:04:56.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.235+0000 7f8360ff9640 10 client.30627.objecter _finish_command 2 = system:0 2026-02-12T04:04:56.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.235+0000 7f8360ff9640 20 client.30627.objecter put_session s=0x7f83340a43a0 osd=0 4 2026-02-12T04:04:56.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.235+0000 7f8360ff9640 15 client.30627.objecter _session_command_op_remove 0 2 2026-02-12T04:04:56.237 INFO:teuthology.orchestra.run.trial091.stdout:{ 2026-02-12T04:04:56.238 INFO:teuthology.orchestra.run.trial091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-12T04:04:56.238 INFO:teuthology.orchestra.run.trial091.stdout:} 2026-02-12T04:04:56.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.235+0000 7f836a8f4640 10 librados: watch_flush enter 2026-02-12T04:04:56.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.235+0000 7f836a8f4640 10 librados: watch_flush exit 2026-02-12T04:04:56.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.235+0000 7f836a8f4640 10 client.30627.objecter close_session for osd.0 2026-02-12T04:04:56.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.235+0000 7f836a8f4640 1 -- 10.20.193.91:0/566840263 >> v1:10.20.193.91:6801/1203233578 conn(0x7f83340c6960 legacy=0x7f83340e6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:56.240 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.235+0000 7f836a8f4640 20 client.30627.objecter put_session s=0x7f83340a43a0 osd=0 1 2026-02-12T04:04:56.240 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.235+0000 7f836a8f4640 20 client.30627.objecter shutdown clearing up homeless session... 2026-02-12T04:04:56.240 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.235+0000 7f836a8f4640 10 client.30627.objecter successfully canceled tick 2026-02-12T04:04:56.240 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.235+0000 7f836a8f4640 1 -- 10.20.193.91:0/566840263 >> v1:10.20.193.91:6800/2929217192 conn(0x7f833407a0f0 legacy=0x7f833409a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:56.240 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.235+0000 7f836a8f4640 10 monclient: shutdown 2026-02-12T04:04:56.240 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.235+0000 7f836a8f4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:56.240 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.235+0000 7f836a8f4640 1 -- 10.20.193.91:0/566840263 >> v1:10.20.193.91:6789/0 conn(0x7f8364055c30 legacy=0x7f83640afca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:56.240 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.235+0000 7f8368e6a640 1 -- 10.20.193.91:0/566840263 reap_dead start 2026-02-12T04:04:56.240 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.235+0000 7f836a8f4640 1 -- 10.20.193.91:0/566840263 shutdown_connections 2026-02-12T04:04:56.240 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.235+0000 7f836a8f4640 1 -- 10.20.193.91:0/566840263 >> 10.20.193.91:0/566840263 conn(0x7f83640b6560 msgr2=0x7f83640b6930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:56.240 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.235+0000 7f836a8f4640 1 -- 10.20.193.91:0/566840263 shutdown_connections 2026-02-12T04:04:56.241 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.235+0000 7f836a8f4640 1 -- 10.20.193.91:0/566840263 wait complete. 2026-02-12T04:04:56.241 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.235+0000 7f836a8f4640 1 librados: shutdown 2026-02-12T04:04:56.246 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-12T04:04:56.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.313+0000 7fa4c5a3a640 10 monclient: get_monmap_and_config 2026-02-12T04:04:56.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.313+0000 7fa4c5a3a640 10 monclient: build_initial_monmap 2026-02-12T04:04:56.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.313+0000 7fa4c5a3a640 10 monclient: monmap: 2026-02-12T04:04:56.316 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:56.316 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:56.316 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:04:56.314514+0000 2026-02-12T04:04:56.316 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:04:56.314514+0000 2026-02-12T04:04:56.316 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:56.316 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:56.317 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:56.317 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:56.317 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:56.317 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:56.319 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.314+0000 7fa4c5a3a640 1 Processor -- start 2026-02-12T04:04:56.320 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.314+0000 7fa4c5a3a640 1 -- start start 2026-02-12T04:04:56.320 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.314+0000 7fa4c5a3a640 10 monclient: init 2026-02-12T04:04:56.320 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.314+0000 7fa4c5a3a640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:56.320 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.314+0000 7fa4c5a3a640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T04:04:56.320 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.314+0000 7fa4c5a3a640 10 monclient(hunting): picked mon.noname-b con 0x7fa4c01575d0 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:56.320 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.314+0000 7fa4c5a3a640 10 monclient(hunting): picked mon.noname-a con 0x7fa4c0163310 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:56.320 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.314+0000 7fa4c5a3a640 10 monclient(hunting): picked mon.noname-c con 0x7fa4c00560d0 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:56.320 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.314+0000 7fa4c5a3a640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4c00b20b0 con 0x7fa4c0163310 2026-02-12T04:04:56.320 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.314+0000 7fa4c5a3a640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4c00b2390 con 0x7fa4c01575d0 2026-02-12T04:04:56.320 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.314+0000 7fa4c5a3a640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4c00b2670 con 0x7fa4c00560d0 2026-02-12T04:04:56.321 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.314+0000 7fa4c5a3a640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:56.321 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.314+0000 7fa4c5a3a640 10 monclient(hunting): authenticate will time out at 1499.057985s 2026-02-12T04:04:56.321 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.315+0000 7fa4be7fc640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7fa4c0163310 0x7fa4c00559c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:41392/0 (socket says 10.20.193.91:41392) 2026-02-12T04:04:56.321 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.315+0000 7fa4be7fc640 1 -- 10.20.193.91:0/198440422 learned_addr learned my addr 10.20.193.91:0/198440422 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:56.321 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.316+0000 7fa4bdffb640 1 -- 10.20.193.91:0/198440422 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1337820934 0 0) 0x7fa4c00b2670 con 0x7fa4c00560d0 2026-02-12T04:04:56.321 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.316+0000 7fa4bdffb640 10 monclient(hunting): _negotiate 2026-02-12T04:04:56.321 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.316+0000 7fa4bdffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:56.321 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.316+0000 7fa4bdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:56.321 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.316+0000 7fa4bdffb640 10 monclient(hunting): my global_id is 27464 2026-02-12T04:04:56.321 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.316+0000 7fa4bdffb640 1 -- 10.20.193.91:0/198440422 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4ac003610 con 0x7fa4c00560d0 2026-02-12T04:04:56.321 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.316+0000 7fa4bdffb640 1 -- 10.20.193.91:0/198440422 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 936559113 0 0) 0x7fa4c00b20b0 con 0x7fa4c0163310 2026-02-12T04:04:56.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.316+0000 7fa4bdffb640 10 monclient(hunting): _negotiate 2026-02-12T04:04:56.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.316+0000 7fa4bdffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:56.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.316+0000 7fa4bdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:56.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.316+0000 7fa4bdffb640 10 monclient(hunting): my global_id is 30630 2026-02-12T04:04:56.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.317+0000 7fa4bdffb640 1 -- 10.20.193.91:0/198440422 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4c00b2670 con 0x7fa4c0163310 2026-02-12T04:04:56.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.317+0000 7fa4bdffb640 1 -- 10.20.193.91:0/198440422 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3172397110 0 0) 0x7fa4c00b2390 con 0x7fa4c01575d0 2026-02-12T04:04:56.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.317+0000 7fa4bdffb640 10 monclient(hunting): _negotiate 2026-02-12T04:04:56.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.317+0000 7fa4bdffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:56.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.317+0000 7fa4bdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:56.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.317+0000 7fa4bdffb640 10 monclient(hunting): my global_id is 27769 2026-02-12T04:04:56.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.317+0000 7fa4bdffb640 1 -- 10.20.193.91:0/198440422 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4c00b20b0 con 0x7fa4c01575d0 2026-02-12T04:04:56.330 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.318+0000 7fa4bdffb640 1 -- 10.20.193.91:0/198440422 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 57378329 0 0) 0x7fa4ac003610 con 0x7fa4c00560d0 2026-02-12T04:04:56.330 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.318+0000 7fa4bdffb640 1 -- 10.20.193.91:0/198440422 >> v1:10.20.193.98:6789/0 conn(0x7fa4c01575d0 legacy=0x7fa4c0162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:56.331 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.318+0000 7fa4bdffb640 1 -- 10.20.193.91:0/198440422 >> v1:10.20.193.91:6789/0 conn(0x7fa4c0163310 legacy=0x7fa4c00559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:56.331 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.318+0000 7fa4bdffb640 10 monclient: _finish_hunting 0 2026-02-12T04:04:56.331 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.318+0000 7fa4bdffb640 1 monclient: found mon.noname-c 2026-02-12T04:04:56.331 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.318+0000 7fa4bdffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:56.331 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.318+0000 7fa4bdffb640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.111:6789/0 2026-02-12T04:04:56.331 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.318+0000 7fa4bdffb640 1 -- 10.20.193.91:0/198440422 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4c0162400 con 0x7fa4c00560d0 2026-02-12T04:04:56.331 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.318+0000 7fa4bdffb640 10 monclient: _finish_auth 0 2026-02-12T04:04:56.331 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.318+0000 7fa4bdffb640 10 monclient: _check_auth_tickets 2026-02-12T04:04:56.331 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.318+0000 7fa4bdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:56.331 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.318+0000 7fa4bdffb640 1 -- 10.20.193.91:0/198440422 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fa4b0003170 con 0x7fa4c00560d0 2026-02-12T04:04:56.332 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.318+0000 7fa4bdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:56.332 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.318+0000 7fa4bdffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T04:04:56.332 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.318+0000 7fa4bdffb640 10 monclient: dump: 2026-02-12T04:04:56.332 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:56.332 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:56.332 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.332 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.332 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:56.332 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:56.332 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:56.332 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:56.332 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:56.333 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:56.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.318+0000 7fa4c5a3a640 5 monclient: authenticate success, global_id 27464 2026-02-12T04:04:56.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.318+0000 7fa4c5a3a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:04:56.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.319+0000 7fa4bdffb640 1 -- 10.20.193.91:0/198440422 <== mon.2 v1:10.20.193.111:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa4b0003340 con 0x7fa4c00560d0 2026-02-12T04:04:56.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.319+0000 7fa4bdffb640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:56.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.319+0000 7fa4bdffb640 1 -- 10.20.193.91:0/198440422 <== mon.2 v1:10.20.193.111:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fa4b0003780 con 0x7fa4c00560d0 2026-02-12T04:04:56.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.319+0000 7fa4c5a3a640 10 monclient: get_monmap_and_config success 2026-02-12T04:04:56.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.319+0000 7fa4c5a3a640 4 set_mon_vals no callback set 2026-02-12T04:04:56.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.319+0000 7fa4bdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:56.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.319+0000 7fa4bdffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T04:04:56.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.319+0000 7fa4bdffb640 10 monclient: dump: 2026-02-12T04:04:56.334 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:56.334 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:56.334 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.334 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.334 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:56.334 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:56.334 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:56.334 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:56.334 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:56.334 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:56.335 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.319+0000 7fa4c5a3a640 10 monclient: shutdown 2026-02-12T04:04:56.335 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.319+0000 7fa4c5a3a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:56.335 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.319+0000 7fa4c5a3a640 1 -- 10.20.193.91:0/198440422 >> v1:10.20.193.111:6789/0 conn(0x7fa4c00560d0 legacy=0x7fa4c01c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:56.335 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.319+0000 7fa4c5a3a640 1 -- 10.20.193.91:0/198440422 shutdown_connections 2026-02-12T04:04:56.335 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.319+0000 7fa4c5a3a640 1 -- 10.20.193.91:0/198440422 >> 10.20.193.91:0/198440422 conn(0x7fa4c00b6560 msgr2=0x7fa4c00b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:56.335 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.320+0000 7fa4c5a3a640 1 -- 10.20.193.91:0/198440422 shutdown_connections 2026-02-12T04:04:56.335 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.320+0000 7fa4c5a3a640 1 -- 10.20.193.91:0/198440422 wait complete. 2026-02-12T04:04:56.335 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.320+0000 7fa4c5a3a640 10 monclient: build_initial_monmap 2026-02-12T04:04:56.335 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.320+0000 7fa4c5a3a640 10 monclient: monmap: 2026-02-12T04:04:56.335 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:56.335 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:04:56.336 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:04:56.336 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:04:56.336 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:56.336 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:04:56.336 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:56.336 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:56.336 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:56.336 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:56.336 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.320+0000 7fa4c5a3a640 1 librados: starting msgr at 2026-02-12T04:04:56.336 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.320+0000 7fa4c5a3a640 1 librados: starting objecter 2026-02-12T04:04:56.337 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.320+0000 7fa4c5a3a640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:04:56.337 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.320+0000 7fa4c5a3a640 1 Processor -- start 2026-02-12T04:04:56.337 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.320+0000 7fa4c5a3a640 1 -- start start 2026-02-12T04:04:56.337 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.320+0000 7fa4c5a3a640 1 librados: setting wanted keys 2026-02-12T04:04:56.337 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.320+0000 7fa4c5a3a640 1 librados: calling monclient init 2026-02-12T04:04:56.337 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.320+0000 7fa4c5a3a640 10 monclient: init 2026-02-12T04:04:56.337 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.321+0000 7fa4c5a3a640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:56.337 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.321+0000 7fa4c5a3a640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T04:04:56.337 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.321+0000 7fa4c5a3a640 10 monclient(hunting): picked mon.noname-a con 0x7fa4c00560d0 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:56.337 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.321+0000 7fa4c5a3a640 10 monclient(hunting): picked mon.noname-b con 0x7fa4c01575d0 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:56.338 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.321+0000 7fa4c5a3a640 10 monclient(hunting): picked mon.noname-c con 0x7fa4c0163310 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:56.338 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.321+0000 7fa4c5a3a640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4c0135150 con 0x7fa4c00560d0 2026-02-12T04:04:56.338 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.321+0000 7fa4c5a3a640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4c01411a0 con 0x7fa4c01575d0 2026-02-12T04:04:56.338 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.321+0000 7fa4c5a3a640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4c011a600 con 0x7fa4c0163310 2026-02-12T04:04:56.338 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.321+0000 7fa4c5a3a640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:56.338 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.321+0000 7fa4c5a3a640 10 monclient(hunting): authenticate will time out at 1499.064112s 2026-02-12T04:04:56.338 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.321+0000 7fa4beffd640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7fa4c00560d0 0x7fa4c0134a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:41402/0 (socket says 10.20.193.91:41402) 2026-02-12T04:04:56.338 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.321+0000 7fa4beffd640 1 -- 10.20.193.91:0/909145477 learned_addr learned my addr 10.20.193.91:0/909145477 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:56.338 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.321+0000 7fa497fff640 10 client.?.objecter ms_handle_connect 0x7fa4c0163310 2026-02-12T04:04:56.338 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.321+0000 7fa497fff640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:56.338 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.321+0000 7fa497fff640 10 client.?.objecter ms_handle_connect 0x7fa4c00560d0 2026-02-12T04:04:56.339 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.321+0000 7fa497fff640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:56.339 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.321+0000 7fa497fff640 10 client.?.objecter ms_handle_connect 0x7fa4c01575d0 2026-02-12T04:04:56.339 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.321+0000 7fa497fff640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:56.339 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.322+0000 7fa497fff640 1 -- 10.20.193.91:0/909145477 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 933712715 0 0) 0x7fa4c011a600 con 0x7fa4c0163310 2026-02-12T04:04:56.339 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.322+0000 7fa497fff640 10 monclient(hunting): _negotiate 2026-02-12T04:04:56.339 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.322+0000 7fa497fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:56.339 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.322+0000 7fa497fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:56.339 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.322+0000 7fa497fff640 10 monclient(hunting): my global_id is 27467 2026-02-12T04:04:56.339 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.322+0000 7fa497fff640 1 -- 10.20.193.91:0/909145477 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa490003610 con 0x7fa4c0163310 2026-02-12T04:04:56.339 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.322+0000 7fa497fff640 1 -- 10.20.193.91:0/909145477 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4248430667 0 0) 0x7fa4c01411a0 con 0x7fa4c01575d0 2026-02-12T04:04:56.339 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.322+0000 7fa497fff640 10 monclient(hunting): _negotiate 2026-02-12T04:04:56.340 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.322+0000 7fa497fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:56.340 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.322+0000 7fa497fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:56.340 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.322+0000 7fa497fff640 10 monclient(hunting): my global_id is 27772 2026-02-12T04:04:56.340 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.322+0000 7fa497fff640 1 -- 10.20.193.91:0/909145477 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4c011a600 con 0x7fa4c01575d0 2026-02-12T04:04:56.340 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.322+0000 7fa497fff640 1 -- 10.20.193.91:0/909145477 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1331251994 0 0) 0x7fa4c0135150 con 0x7fa4c00560d0 2026-02-12T04:04:56.340 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.322+0000 7fa497fff640 10 monclient(hunting): _negotiate 2026-02-12T04:04:56.340 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.322+0000 7fa497fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:56.340 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.322+0000 7fa497fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:56.340 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.322+0000 7fa497fff640 10 monclient(hunting): my global_id is 30633 2026-02-12T04:04:56.340 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.322+0000 7fa497fff640 1 -- 10.20.193.91:0/909145477 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4c01411a0 con 0x7fa4c00560d0 2026-02-12T04:04:56.340 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.324+0000 7fa497fff640 1 -- 10.20.193.91:0/909145477 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3700287829 0 0) 0x7fa4c011a600 con 0x7fa4c01575d0 2026-02-12T04:04:56.340 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.325+0000 7fa497fff640 1 -- 10.20.193.91:0/909145477 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa4c0135150 con 0x7fa4c01575d0 2026-02-12T04:04:56.341 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.325+0000 7fa497fff640 1 -- 10.20.193.91:0/909145477 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fa4a8002fc0 con 0x7fa4c01575d0 2026-02-12T04:04:56.341 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.325+0000 7fa497fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:56.341 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.325+0000 7fa497fff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T04:04:56.341 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.325+0000 7fa497fff640 10 monclient(hunting): dump: 2026-02-12T04:04:56.341 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:56.341 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:56.341 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.341 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.341 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:56.341 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:56.341 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:56.341 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:56.342 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:56.342 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:56.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.325+0000 7fa497fff640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:04:56.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.325+0000 7fa497fff640 1 -- 10.20.193.91:0/909145477 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4208014561 0 0) 0x7fa490003610 con 0x7fa4c0163310 2026-02-12T04:04:56.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.325+0000 7fa497fff640 1 -- 10.20.193.91:0/909145477 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa4c011a600 con 0x7fa4c0163310 2026-02-12T04:04:56.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.325+0000 7fa497fff640 1 -- 10.20.193.91:0/909145477 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fa4b00034f0 con 0x7fa4c0163310 2026-02-12T04:04:56.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.325+0000 7fa497fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:56.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.325+0000 7fa497fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T04:04:56.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.325+0000 7fa497fff640 10 monclient(hunting): dump: 2026-02-12T04:04:56.342 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:56.342 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:56.342 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.343 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.343 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:56.343 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:56.343 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:56.343 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:56.343 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:56.343 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:56.343 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.325+0000 7fa497fff640 1 -- 10.20.193.91:0/909145477 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 255551165 0 0) 0x7fa4c01411a0 con 0x7fa4c00560d0 2026-02-12T04:04:56.343 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.325+0000 7fa497fff640 1 -- 10.20.193.91:0/909145477 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa490003610 con 0x7fa4c00560d0 2026-02-12T04:04:56.343 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.325+0000 7fa497fff640 1 -- 10.20.193.91:0/909145477 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fa4b4003170 con 0x7fa4c00560d0 2026-02-12T04:04:56.343 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.325+0000 7fa497fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:56.343 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.325+0000 7fa497fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T04:04:56.344 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.325+0000 7fa497fff640 10 monclient(hunting): dump: 2026-02-12T04:04:56.344 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:56.344 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:56.344 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.344 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.344 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:56.344 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:56.344 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:56.344 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:56.344 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:56.344 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:56.345 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.326+0000 7fa497fff640 1 -- 10.20.193.91:0/909145477 <== mon.2 v1:10.20.193.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1499504064 0 0) 0x7fa4c011a600 con 0x7fa4c0163310 2026-02-12T04:04:56.345 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.326+0000 7fa497fff640 1 -- 10.20.193.91:0/909145477 >> v1:10.20.193.98:6789/0 conn(0x7fa4c01575d0 legacy=0x7fa4c0119ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:56.345 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.326+0000 7fa497fff640 1 -- 10.20.193.91:0/909145477 >> v1:10.20.193.91:6789/0 conn(0x7fa4c00560d0 legacy=0x7fa4c0134a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:56.345 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.326+0000 7fa497fff640 10 monclient: _finish_hunting 0 2026-02-12T04:04:56.345 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.326+0000 7fa497fff640 1 monclient: found mon.c 2026-02-12T04:04:56.345 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.326+0000 7fa497fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:56.345 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.326+0000 7fa497fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:04:56.345 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.326+0000 7fa497fff640 1 -- 10.20.193.91:0/909145477 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4c0140900 con 0x7fa4c0163310 2026-02-12T04:04:56.345 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.326+0000 7fa497fff640 10 monclient: _finish_auth 0 2026-02-12T04:04:56.345 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.326+0000 7fa497fff640 10 monclient: _check_auth_tickets 2026-02-12T04:04:56.346 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.326+0000 7fa497fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:56.346 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.326+0000 7fa4c5a3a640 5 monclient: authenticate success, global_id 27467 2026-02-12T04:04:56.346 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.326+0000 7fa4c5a3a640 10 monclient: _renew_subs 2026-02-12T04:04:56.346 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.326+0000 7fa4c5a3a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:04:56.346 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.326+0000 7fa4c5a3a640 1 -- 10.20.193.91:0/909145477 --> v1:10.20.193.111:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa4c0140be0 con 0x7fa4c0163310 2026-02-12T04:04:56.346 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.326+0000 7fa4c5a3a640 10 client.27467.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:04:56.346 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.326+0000 7fa4c5a3a640 10 monclient: _renew_subs 2026-02-12T04:04:56.346 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.326+0000 7fa4c5a3a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:04:56.346 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.326+0000 7fa4c5a3a640 1 -- 10.20.193.91:0/909145477 --> v1:10.20.193.111:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa4c0134240 con 0x7fa4c0163310 2026-02-12T04:04:56.346 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.326+0000 7fa4c5a3a640 1 librados: init done 2026-02-12T04:04:56.346 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.327+0000 7fa4c5a3a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:56.347 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.327+0000 7fa4c5a3a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:56.347 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.327+0000 7fa4c5a3a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:04:56.347 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.327+0000 7fa4c5a3a640 1 -- 10.20.193.91:0/909145477 --> v1:10.20.193.111:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4c0053250 con 0x7fa4c0163310 2026-02-12T04:04:56.348 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.332+0000 7fa497fff640 1 -- 10.20.193.91:0/909145477 <== mon.2 v1:10.20.193.111:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa4b0003750 con 0x7fa4c0163310 2026-02-12T04:04:56.349 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.332+0000 7fa497fff640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:56.349 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.332+0000 7fa497fff640 1 -- 10.20.193.91:0/909145477 <== mon.2 v1:10.20.193.111:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fa4b0003ce0 con 0x7fa4c0163310 2026-02-12T04:04:56.349 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.332+0000 7fa497fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:56.349 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.332+0000 7fa497fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T04:04:56.349 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.332+0000 7fa4bd7fa640 4 set_mon_vals no callback set 2026-02-12T04:04:56.349 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.332+0000 7fa497fff640 10 monclient: dump: 2026-02-12T04:04:56.349 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:56.349 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:56.349 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.349 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.349 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:56.350 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:56.350 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:56.350 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:56.350 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:56.350 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:56.350 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.335+0000 7fa497fff640 1 -- 10.20.193.91:0/909145477 <== mon.2 v1:10.20.193.111:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7fa4b001d020 con 0x7fa4c0163310 2026-02-12T04:04:56.350 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.336+0000 7fa4beffd640 10 monclient: get_auth_request con 0x7fa49007a050 auth_method 0 2026-02-12T04:04:56.350 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.336+0000 7fa497fff640 10 client.27467.objecter ms_handle_connect 0x7fa49007a050 2026-02-12T04:04:56.350 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.336+0000 7fa497fff640 1 -- 10.20.193.91:0/909145477 <== mon.2 v1:10.20.193.111:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7fa4b0094970 con 0x7fa4c0163310 2026-02-12T04:04:56.350 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.336+0000 7fa497fff640 10 client.27467.objecter ms_dispatch2 0x7fa4c0000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:04:56.350 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.336+0000 7fa497fff640 3 client.27467.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:04:56.350 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.336+0000 7fa497fff640 3 client.27467.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:04:56.350 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.336+0000 7fa497fff640 20 client.27467.objecter dump_active .. 0 homeless 2026-02-12T04:04:56.428 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.426+0000 7fa497fff640 1 -- 10.20.193.91:0/909145477 <== mon.2 v1:10.20.193.111:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7fa4c0053250 con 0x7fa4c0163310 2026-02-12T04:04:56.428 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.426+0000 7fa497fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:56.428 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.426+0000 7fa497fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T04:04:56.536 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.534+0000 7fa4c5a3a640 1 -- 10.20.193.91:0/909145477 --> v1:10.20.193.91:6800/2929217192 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fa4c00b7290 con 0x7fa49007a050 2026-02-12T04:04:56.536 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.534+0000 7fa497fff640 1 -- 10.20.193.91:0/909145477 <== mgr.4113 v1:10.20.193.91:6800/2929217192 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (unknown 2057319476 0 0) 0x7fa4c00b7290 con 0x7fa49007a050 2026-02-12T04:04:56.536 INFO:teuthology.orchestra.run.trial091.stderr:instructed osd(s) 0 to deep-scrub 2026-02-12T04:04:56.538 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.536+0000 7fa4c5a3a640 10 librados: watch_flush enter 2026-02-12T04:04:56.538 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.536+0000 7fa4c5a3a640 10 librados: watch_flush exit 2026-02-12T04:04:56.539 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.536+0000 7fa4c5a3a640 20 client.27467.objecter shutdown clearing up homeless session... 2026-02-12T04:04:56.539 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.536+0000 7fa4c5a3a640 10 client.27467.objecter successfully canceled tick 2026-02-12T04:04:56.539 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.536+0000 7fa4c5a3a640 1 -- 10.20.193.91:0/909145477 >> v1:10.20.193.91:6800/2929217192 conn(0x7fa49007a050 legacy=0x7fa49009a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:56.539 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.536+0000 7fa4c5a3a640 10 monclient: shutdown 2026-02-12T04:04:56.539 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.536+0000 7fa4c5a3a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:56.539 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.536+0000 7fa4c5a3a640 1 -- 10.20.193.91:0/909145477 >> v1:10.20.193.111:6789/0 conn(0x7fa4c0163310 legacy=0x7fa4c01439e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:56.539 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.536+0000 7fa4c5a3a640 1 -- 10.20.193.91:0/909145477 shutdown_connections 2026-02-12T04:04:56.539 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.536+0000 7fa4c5a3a640 1 -- 10.20.193.91:0/909145477 >> 10.20.193.91:0/909145477 conn(0x7fa4c00b6560 msgr2=0x7fa4c00b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:56.539 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.536+0000 7fa4c5a3a640 1 -- 10.20.193.91:0/909145477 shutdown_connections 2026-02-12T04:04:56.539 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.536+0000 7fa4c5a3a640 1 -- 10.20.193.91:0/909145477 wait complete. 2026-02-12T04:04:56.539 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.536+0000 7fa4c5a3a640 1 librados: shutdown 2026-02-12T04:04:56.546 INFO:tasks.ceph:Scrubbing osd.4 2026-02-12T04:04:56.546 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2026-02-12T04:04:56.615 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.613+0000 7fe5ecaec640 10 monclient: get_monmap_and_config 2026-02-12T04:04:56.615 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.613+0000 7fe5ecaec640 10 monclient: build_initial_monmap 2026-02-12T04:04:56.615 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.613+0000 7fe5ecaec640 10 monclient: monmap: 2026-02-12T04:04:56.616 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:56.616 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:56.616 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:04:56.614271+0000 2026-02-12T04:04:56.616 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:04:56.614271+0000 2026-02-12T04:04:56.616 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:56.616 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:56.616 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:56.616 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:56.616 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:56.616 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:56.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.614+0000 7fe5ecaec640 1 Processor -- start 2026-02-12T04:04:56.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.614+0000 7fe5ecaec640 1 -- start start 2026-02-12T04:04:56.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.614+0000 7fe5ecaec640 10 monclient: init 2026-02-12T04:04:56.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.614+0000 7fe5ecaec640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:56.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.614+0000 7fe5ecaec640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T04:04:56.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.614+0000 7fe5ecaec640 10 monclient(hunting): picked mon.noname-b con 0x7fe5e81599b0 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:56.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.614+0000 7fe5ecaec640 10 monclient(hunting): picked mon.noname-a con 0x7fe5e8159d80 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:56.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.614+0000 7fe5ecaec640 10 monclient(hunting): picked mon.noname-c con 0x7fe5e80b1f80 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:56.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.614+0000 7fe5ecaec640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5e80aea80 con 0x7fe5e8159d80 2026-02-12T04:04:56.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.614+0000 7fe5ecaec640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5e80aed10 con 0x7fe5e81599b0 2026-02-12T04:04:56.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.614+0000 7fe5ecaec640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5e80aeff0 con 0x7fe5e80b1f80 2026-02-12T04:04:56.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.614+0000 7fe5ecaec640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:56.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.614+0000 7fe5ecaec640 10 monclient(hunting): authenticate will time out at 1499.357827s 2026-02-12T04:04:56.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.615+0000 7fe5e5d74640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7fe5e8159d80 0x7fe5e80ae370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:41412/0 (socket says 10.20.193.91:41412) 2026-02-12T04:04:56.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.615+0000 7fe5e5d74640 1 -- 10.20.193.91:0/1786497094 learned_addr learned my addr 10.20.193.91:0/1786497094 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:56.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.616+0000 7fe5e5573640 1 -- 10.20.193.91:0/1786497094 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 609871697 0 0) 0x7fe5e80aea80 con 0x7fe5e8159d80 2026-02-12T04:04:56.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.616+0000 7fe5e5573640 10 monclient(hunting): _negotiate 2026-02-12T04:04:56.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.616+0000 7fe5e5573640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:56.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.616+0000 7fe5e5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:56.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.616+0000 7fe5e5573640 10 monclient(hunting): my global_id is 30636 2026-02-12T04:04:56.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.616+0000 7fe5e5573640 1 -- 10.20.193.91:0/1786497094 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5d4003610 con 0x7fe5e8159d80 2026-02-12T04:04:56.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.616+0000 7fe5e5573640 1 -- 10.20.193.91:0/1786497094 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2445411828 0 0) 0x7fe5e80aeff0 con 0x7fe5e80b1f80 2026-02-12T04:04:56.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.616+0000 7fe5e5573640 10 monclient(hunting): _negotiate 2026-02-12T04:04:56.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.616+0000 7fe5e5573640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:56.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.616+0000 7fe5e5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:56.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.616+0000 7fe5e5573640 10 monclient(hunting): my global_id is 27470 2026-02-12T04:04:56.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.616+0000 7fe5e5573640 1 -- 10.20.193.91:0/1786497094 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5e80aea80 con 0x7fe5e80b1f80 2026-02-12T04:04:56.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.616+0000 7fe5e5573640 1 -- 10.20.193.91:0/1786497094 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4227104064 0 0) 0x7fe5e80aed10 con 0x7fe5e81599b0 2026-02-12T04:04:56.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.616+0000 7fe5e5573640 10 monclient(hunting): _negotiate 2026-02-12T04:04:56.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.616+0000 7fe5e5573640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:56.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.616+0000 7fe5e5573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:56.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.616+0000 7fe5e5573640 10 monclient(hunting): my global_id is 27775 2026-02-12T04:04:56.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.616+0000 7fe5e5573640 1 -- 10.20.193.91:0/1786497094 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5e80aeff0 con 0x7fe5e81599b0 2026-02-12T04:04:56.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.618+0000 7fe5e5573640 1 -- 10.20.193.91:0/1786497094 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1457153197 0 0) 0x7fe5d4003610 con 0x7fe5e8159d80 2026-02-12T04:04:56.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.618+0000 7fe5e5573640 1 -- 10.20.193.91:0/1786497094 >> v1:10.20.193.111:6789/0 conn(0x7fe5e80b1f80 legacy=0x7fe5e8166700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:56.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.618+0000 7fe5e5573640 1 -- 10.20.193.91:0/1786497094 >> v1:10.20.193.98:6789/0 conn(0x7fe5e81599b0 legacy=0x7fe5e805b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:56.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.618+0000 7fe5e5573640 10 monclient: _finish_hunting 0 2026-02-12T04:04:56.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.618+0000 7fe5e5573640 1 monclient: found mon.noname-a 2026-02-12T04:04:56.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.618+0000 7fe5e5573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:56.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.618+0000 7fe5e5573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.91:6789/0 2026-02-12T04:04:56.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.618+0000 7fe5e5573640 1 -- 10.20.193.91:0/1786497094 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5e80b0ee0 con 0x7fe5e8159d80 2026-02-12T04:04:56.630 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.618+0000 7fe5e5573640 10 monclient: _finish_auth 0 2026-02-12T04:04:56.630 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.618+0000 7fe5e5573640 10 monclient: _check_auth_tickets 2026-02-12T04:04:56.630 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.618+0000 7fe5e5573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:56.630 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.618+0000 7fe5e5573640 1 -- 10.20.193.91:0/1786497094 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fe5d0002df0 con 0x7fe5e8159d80 2026-02-12T04:04:56.630 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.618+0000 7fe5e5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:56.630 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.618+0000 7fe5e5573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T04:04:56.630 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.618+0000 7fe5e5573640 10 monclient: dump: 2026-02-12T04:04:56.630 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:56.630 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:56.630 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.630 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.630 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:56.631 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:56.631 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:56.631 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:56.631 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:56.631 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:56.631 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.618+0000 7fe5ecaec640 5 monclient: authenticate success, global_id 30636 2026-02-12T04:04:56.631 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.618+0000 7fe5ecaec640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:04:56.631 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.619+0000 7fe5e5573640 1 -- 10.20.193.91:0/1786497094 <== mon.0 v1:10.20.193.91:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe5d0002fc0 con 0x7fe5e8159d80 2026-02-12T04:04:56.631 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.619+0000 7fe5e5573640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:56.631 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.619+0000 7fe5e5573640 1 -- 10.20.193.91:0/1786497094 <== mon.0 v1:10.20.193.91:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fe5d0003400 con 0x7fe5e8159d80 2026-02-12T04:04:56.631 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.619+0000 7fe5e5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:56.631 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.619+0000 7fe5e5573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T04:04:56.632 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.619+0000 7fe5e5573640 10 monclient: dump: 2026-02-12T04:04:56.632 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:56.632 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:56.632 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.632 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.632 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:56.632 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:56.632 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:56.632 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:56.632 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:56.632 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:56.632 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.619+0000 7fe5ecaec640 10 monclient: get_monmap_and_config success 2026-02-12T04:04:56.633 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.619+0000 7fe5ecaec640 4 set_mon_vals no callback set 2026-02-12T04:04:56.633 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.619+0000 7fe5ecaec640 10 monclient: shutdown 2026-02-12T04:04:56.633 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.619+0000 7fe5ecaec640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:56.633 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.619+0000 7fe5ecaec640 1 -- 10.20.193.91:0/1786497094 >> v1:10.20.193.91:6789/0 conn(0x7fe5e8159d80 legacy=0x7fe5e80ae370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:56.633 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.619+0000 7fe5ecaec640 1 -- 10.20.193.91:0/1786497094 shutdown_connections 2026-02-12T04:04:56.633 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.619+0000 7fe5ecaec640 1 -- 10.20.193.91:0/1786497094 >> 10.20.193.91:0/1786497094 conn(0x7fe5e80b6560 msgr2=0x7fe5e80b6930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:56.633 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.619+0000 7fe5ecaec640 1 -- 10.20.193.91:0/1786497094 shutdown_connections 2026-02-12T04:04:56.633 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.619+0000 7fe5ecaec640 1 -- 10.20.193.91:0/1786497094 wait complete. 2026-02-12T04:04:56.633 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.619+0000 7fe5ecaec640 10 monclient: build_initial_monmap 2026-02-12T04:04:56.633 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.619+0000 7fe5ecaec640 10 monclient: monmap: 2026-02-12T04:04:56.633 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:56.633 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:04:56.634 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:04:56.634 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:04:56.634 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:56.634 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:04:56.634 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:56.634 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:56.634 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:56.634 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:56.634 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.620+0000 7fe5ecaec640 1 librados: starting msgr at 2026-02-12T04:04:56.634 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.620+0000 7fe5ecaec640 1 librados: starting objecter 2026-02-12T04:04:56.634 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.620+0000 7fe5ecaec640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:04:56.634 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.620+0000 7fe5ecaec640 1 Processor -- start 2026-02-12T04:04:56.635 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.620+0000 7fe5ecaec640 1 -- start start 2026-02-12T04:04:56.635 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.620+0000 7fe5ecaec640 1 librados: setting wanted keys 2026-02-12T04:04:56.635 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.620+0000 7fe5ecaec640 1 librados: calling monclient init 2026-02-12T04:04:56.635 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.620+0000 7fe5ecaec640 10 monclient: init 2026-02-12T04:04:56.635 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.620+0000 7fe5ecaec640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:56.635 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.620+0000 7fe5ecaec640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T04:04:56.635 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.620+0000 7fe5ecaec640 10 monclient(hunting): picked mon.noname-c con 0x7fe5e80b1f80 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:56.635 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.620+0000 7fe5ecaec640 10 monclient(hunting): picked mon.noname-a con 0x7fe5e81599b0 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:56.635 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.620+0000 7fe5ecaec640 10 monclient(hunting): picked mon.noname-b con 0x7fe5e8159d80 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:56.635 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.620+0000 7fe5ecaec640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5e81335a0 con 0x7fe5e81599b0 2026-02-12T04:04:56.635 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.620+0000 7fe5ecaec640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5e812f7d0 con 0x7fe5e8159d80 2026-02-12T04:04:56.635 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.620+0000 7fe5ecaec640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5e812fab0 con 0x7fe5e80b1f80 2026-02-12T04:04:56.635 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.620+0000 7fe5ecaec640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:56.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.620+0000 7fe5ecaec640 10 monclient(hunting): authenticate will time out at 1499.363572s 2026-02-12T04:04:56.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.620+0000 7fe5e5d74640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7fe5e81599b0 0x7fe5e8130870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:41422/0 (socket says 10.20.193.91:41422) 2026-02-12T04:04:56.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.620+0000 7fe5e5d74640 1 -- 10.20.193.91:0/2335551718 learned_addr learned my addr 10.20.193.91:0/2335551718 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:56.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.621+0000 7fe5ceffd640 10 client.?.objecter ms_handle_connect 0x7fe5e81599b0 2026-02-12T04:04:56.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.621+0000 7fe5ceffd640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:56.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.621+0000 7fe5ceffd640 10 client.?.objecter ms_handle_connect 0x7fe5e8159d80 2026-02-12T04:04:56.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.621+0000 7fe5ceffd640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:56.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.621+0000 7fe5ceffd640 10 client.?.objecter ms_handle_connect 0x7fe5e80b1f80 2026-02-12T04:04:56.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.621+0000 7fe5ceffd640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:56.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.621+0000 7fe5ceffd640 1 -- 10.20.193.91:0/2335551718 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3303198900 0 0) 0x7fe5e81335a0 con 0x7fe5e81599b0 2026-02-12T04:04:56.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.621+0000 7fe5ceffd640 10 monclient(hunting): _negotiate 2026-02-12T04:04:56.636 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.621+0000 7fe5ceffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:56.637 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.621+0000 7fe5ceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:56.637 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.621+0000 7fe5ceffd640 10 monclient(hunting): my global_id is 30639 2026-02-12T04:04:56.637 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.621+0000 7fe5ceffd640 1 -- 10.20.193.91:0/2335551718 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5b4003610 con 0x7fe5e81599b0 2026-02-12T04:04:56.637 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.622+0000 7fe5ceffd640 1 -- 10.20.193.91:0/2335551718 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2958778641 0 0) 0x7fe5e812f7d0 con 0x7fe5e8159d80 2026-02-12T04:04:56.637 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.622+0000 7fe5ceffd640 10 monclient(hunting): _negotiate 2026-02-12T04:04:56.637 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.622+0000 7fe5ceffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:56.637 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.622+0000 7fe5ceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:56.637 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.622+0000 7fe5ceffd640 10 monclient(hunting): my global_id is 27778 2026-02-12T04:04:56.637 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.622+0000 7fe5ceffd640 1 -- 10.20.193.91:0/2335551718 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5e81335a0 con 0x7fe5e8159d80 2026-02-12T04:04:56.637 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.622+0000 7fe5ceffd640 1 -- 10.20.193.91:0/2335551718 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 579161987 0 0) 0x7fe5e812fab0 con 0x7fe5e80b1f80 2026-02-12T04:04:56.637 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.622+0000 7fe5ceffd640 10 monclient(hunting): _negotiate 2026-02-12T04:04:56.637 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.622+0000 7fe5ceffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:56.638 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.622+0000 7fe5ceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:56.638 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.622+0000 7fe5ceffd640 10 monclient(hunting): my global_id is 27473 2026-02-12T04:04:56.638 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.622+0000 7fe5ceffd640 1 -- 10.20.193.91:0/2335551718 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5e812f7d0 con 0x7fe5e80b1f80 2026-02-12T04:04:56.638 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.624+0000 7fe5ceffd640 1 -- 10.20.193.91:0/2335551718 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 13645526 0 0) 0x7fe5b4003610 con 0x7fe5e81599b0 2026-02-12T04:04:56.638 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.624+0000 7fe5ceffd640 1 -- 10.20.193.91:0/2335551718 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe5e812fab0 con 0x7fe5e81599b0 2026-02-12T04:04:56.638 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.624+0000 7fe5ceffd640 1 -- 10.20.193.91:0/2335551718 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fe5d0003310 con 0x7fe5e81599b0 2026-02-12T04:04:56.638 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.624+0000 7fe5ceffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:56.638 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.624+0000 7fe5ceffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T04:04:56.638 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.624+0000 7fe5ceffd640 10 monclient(hunting): dump: 2026-02-12T04:04:56.638 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:56.638 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:56.639 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.639 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.639 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:56.639 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:56.639 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:56.639 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:56.639 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:56.639 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:56.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.624+0000 7fe5ceffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:04:56.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.624+0000 7fe5ceffd640 1 -- 10.20.193.91:0/2335551718 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1714101246 0 0) 0x7fe5e812f7d0 con 0x7fe5e80b1f80 2026-02-12T04:04:56.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.624+0000 7fe5ceffd640 1 -- 10.20.193.91:0/2335551718 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe5b4003610 con 0x7fe5e80b1f80 2026-02-12T04:04:56.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.624+0000 7fe5ceffd640 1 -- 10.20.193.91:0/2335551718 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fe5dc003060 con 0x7fe5e80b1f80 2026-02-12T04:04:56.639 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.624+0000 7fe5ceffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:56.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.624+0000 7fe5ceffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T04:04:56.640 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.624+0000 7fe5ceffd640 10 monclient(hunting): dump: 2026-02-12T04:04:56.640 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:56.640 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:56.640 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.640 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.640 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:56.640 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:56.640 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:56.640 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:56.640 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:56.640 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:56.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.624+0000 7fe5ceffd640 1 -- 10.20.193.91:0/2335551718 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 175737362 0 0) 0x7fe5e81335a0 con 0x7fe5e8159d80 2026-02-12T04:04:56.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.624+0000 7fe5ceffd640 1 -- 10.20.193.91:0/2335551718 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe5e812f7d0 con 0x7fe5e8159d80 2026-02-12T04:04:56.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.624+0000 7fe5ceffd640 1 -- 10.20.193.91:0/2335551718 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fe5d8003430 con 0x7fe5e8159d80 2026-02-12T04:04:56.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.624+0000 7fe5ceffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:56.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.624+0000 7fe5ceffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T04:04:56.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.624+0000 7fe5ceffd640 10 monclient(hunting): dump: 2026-02-12T04:04:56.641 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:56.641 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:56.641 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.641 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.641 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:56.641 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:56.641 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:56.642 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:56.642 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:56.642 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:56.642 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.626+0000 7fe5ceffd640 1 -- 10.20.193.91:0/2335551718 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2916326991 0 0) 0x7fe5e812fab0 con 0x7fe5e81599b0 2026-02-12T04:04:56.642 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.626+0000 7fe5ceffd640 1 -- 10.20.193.91:0/2335551718 >> v1:10.20.193.111:6789/0 conn(0x7fe5e80b1f80 legacy=0x7fe5e8132e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:56.642 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.626+0000 7fe5ceffd640 1 -- 10.20.193.91:0/2335551718 >> v1:10.20.193.98:6789/0 conn(0x7fe5e8159d80 legacy=0x7fe5e81373c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:56.642 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.626+0000 7fe5ceffd640 10 monclient: _finish_hunting 0 2026-02-12T04:04:56.642 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.626+0000 7fe5ceffd640 1 monclient: found mon.a 2026-02-12T04:04:56.642 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.626+0000 7fe5ceffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:56.642 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.626+0000 7fe5ceffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:56.642 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.626+0000 7fe5ceffd640 1 -- 10.20.193.91:0/2335551718 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5e812fd90 con 0x7fe5e81599b0 2026-02-12T04:04:56.642 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.626+0000 7fe5ceffd640 10 monclient: _finish_auth 0 2026-02-12T04:04:56.642 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.626+0000 7fe5ceffd640 10 monclient: _check_auth_tickets 2026-02-12T04:04:56.643 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.626+0000 7fe5ceffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:56.643 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.626+0000 7fe5ecaec640 5 monclient: authenticate success, global_id 30639 2026-02-12T04:04:56.643 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.626+0000 7fe5ecaec640 10 monclient: _renew_subs 2026-02-12T04:04:56.643 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.626+0000 7fe5ecaec640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:56.643 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.626+0000 7fe5ecaec640 1 -- 10.20.193.91:0/2335551718 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe5e8130070 con 0x7fe5e81599b0 2026-02-12T04:04:56.643 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.626+0000 7fe5ecaec640 10 client.30639.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:04:56.643 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.626+0000 7fe5ecaec640 10 monclient: _renew_subs 2026-02-12T04:04:56.643 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.626+0000 7fe5ecaec640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:56.643 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.626+0000 7fe5ecaec640 1 -- 10.20.193.91:0/2335551718 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe5e8130f80 con 0x7fe5e81599b0 2026-02-12T04:04:56.643 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.626+0000 7fe5ecaec640 1 librados: init done 2026-02-12T04:04:56.643 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.626+0000 7fe5ecaec640 10 client.30639.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:56.643 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.626+0000 7fe5ecaec640 15 client.30639.objecter _session_command_op_assign -1 1 2026-02-12T04:04:56.643 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.626+0000 7fe5ecaec640 20 client.30639.objecter _get_session osd=-1 returning homeless 2026-02-12T04:04:56.644 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.626+0000 7fe5ecaec640 10 client.30639.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:04:56.644 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.626+0000 7fe5ecaec640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:56.644 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.626+0000 7fe5ecaec640 1 -- 10.20.193.91:0/2335551718 --> v1:10.20.193.91:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fe5e80ae1a0 con 0x7fe5e81599b0 2026-02-12T04:04:56.646 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.634+0000 7fe5ceffd640 1 -- 10.20.193.91:0/2335551718 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe5e80ae1a0 con 0x7fe5e81599b0 2026-02-12T04:04:56.646 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.634+0000 7fe5ceffd640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:56.646 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.634+0000 7fe5ceffd640 1 -- 10.20.193.91:0/2335551718 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fe5d0002f70 con 0x7fe5e81599b0 2026-02-12T04:04:56.646 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.634+0000 7fe5ceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:56.646 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.634+0000 7fe5e4d72640 4 set_mon_vals no callback set 2026-02-12T04:04:56.646 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.635+0000 7fe5ceffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T04:04:56.647 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.635+0000 7fe5ceffd640 10 monclient: dump: 2026-02-12T04:04:56.647 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:56.647 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:56.647 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.647 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.647 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:56.647 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:56.647 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:56.647 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:56.647 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:56.647 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:56.647 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.635+0000 7fe5ceffd640 1 -- 10.20.193.91:0/2335551718 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7fe5d001dec0 con 0x7fe5e81599b0 2026-02-12T04:04:56.648 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.636+0000 7fe5e6575640 10 monclient: get_auth_request con 0x7fe5b407a080 auth_method 0 2026-02-12T04:04:56.648 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.636+0000 7fe5ceffd640 10 client.30639.objecter ms_handle_connect 0x7fe5b407a080 2026-02-12T04:04:56.648 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.637+0000 7fe5ceffd640 1 -- 10.20.193.91:0/2335551718 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7fe5d0095820 con 0x7fe5e81599b0 2026-02-12T04:04:56.648 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.637+0000 7fe5ceffd640 10 client.30639.objecter ms_dispatch2 0x7fe5e8000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:04:56.648 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.637+0000 7fe5ceffd640 3 client.30639.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:04:56.648 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.637+0000 7fe5ceffd640 3 client.30639.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:04:56.648 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.637+0000 7fe5ceffd640 10 client.30639.objecter checking command 1 2026-02-12T04:04:56.648 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.637+0000 7fe5ceffd640 20 client.30639.objecter _get_session s=0x7fe5b40a4330 osd=4 3 2026-02-12T04:04:56.648 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.637+0000 7fe5ceffd640 20 client.30639.objecter put_session s=0x7fe5b40a4330 osd=4 3 2026-02-12T04:04:56.648 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.637+0000 7fe5ceffd640 15 client.30639.objecter _session_command_op_remove -1 1 2026-02-12T04:04:56.648 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.637+0000 7fe5ceffd640 20 client.30639.objecter _get_session s=0x7fe5b40a4330 osd=4 3 2026-02-12T04:04:56.648 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.637+0000 7fe5ceffd640 20 client.30639.objecter get_session s=0x7fe5b40a4330 osd=4 3 2026-02-12T04:04:56.648 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.637+0000 7fe5ceffd640 15 client.30639.objecter _session_command_op_assign 4 1 2026-02-12T04:04:56.648 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.637+0000 7fe5ceffd640 20 client.30639.objecter put_session s=0x7fe5b40a4330 osd=4 4 2026-02-12T04:04:56.648 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.637+0000 7fe5ceffd640 10 client.30639.objecter _send_command 1 2026-02-12T04:04:56.649 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.637+0000 7fe5ceffd640 1 -- 10.20.193.91:0/2335551718 --> v1:10.20.193.91:6805/1766507926 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe5b40c6640 con 0x7fe5b40a49e0 2026-02-12T04:04:56.649 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.637+0000 7fe5ceffd640 20 client.30639.objecter dump_active .. 0 homeless 2026-02-12T04:04:56.649 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.637+0000 7fe5ceffd640 1 -- 10.20.193.91:0/2335551718 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_get_version_reply(handle=1 version=344) ==== 24+0+0 (unknown 1403447244 0 0) 0x7fe5d005e850 con 0x7fe5e81599b0 2026-02-12T04:04:56.649 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.637+0000 7fe5ceffd640 10 monclient: handle_get_version_reply finishing 1 version 344 2026-02-12T04:04:56.649 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.637+0000 7fe5e6d76640 10 monclient: get_auth_request con 0x7fe5b40a49e0 auth_method 0 2026-02-12T04:04:56.649 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.638+0000 7fe5ceffd640 10 client.30639.objecter ms_handle_connect 0x7fe5b40a49e0 2026-02-12T04:04:56.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.648+0000 7fe5ceffd640 1 -- 10.20.193.91:0/2335551718 <== osd.4 v1:10.20.193.91:6805/1766507926 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fe5b40c6640 con 0x7fe5b40a49e0 2026-02-12T04:04:56.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.648+0000 7fe5ceffd640 10 client.30639.objecter ms_dispatch2 0x7fe5e8000b90 command_reply(tid 1: 0 ) 2026-02-12T04:04:56.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.648+0000 7fe5ceffd640 10 client.30639.objecter _finish_command 1 = system:0 2026-02-12T04:04:56.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.648+0000 7fe5ceffd640 20 client.30639.objecter put_session s=0x7fe5b40a4330 osd=4 4 2026-02-12T04:04:56.650 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.648+0000 7fe5ceffd640 15 client.30639.objecter _session_command_op_remove 4 1 2026-02-12T04:04:56.657 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.655+0000 7fe5ecaec640 10 client.30639.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-12T04:04:56.657 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.655+0000 7fe5ecaec640 15 client.30639.objecter _session_command_op_assign -1 2 2026-02-12T04:04:56.657 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.655+0000 7fe5ecaec640 20 client.30639.objecter _get_session s=0x7fe5b40a4330 osd=4 3 2026-02-12T04:04:56.657 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.655+0000 7fe5ecaec640 20 client.30639.objecter put_session s=0x7fe5b40a4330 osd=4 3 2026-02-12T04:04:56.657 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.655+0000 7fe5ecaec640 20 client.30639.objecter _get_session s=0x7fe5b40a4330 osd=4 3 2026-02-12T04:04:56.657 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.655+0000 7fe5ecaec640 15 client.30639.objecter _session_command_op_remove -1 2 2026-02-12T04:04:56.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.655+0000 7fe5ecaec640 20 client.30639.objecter get_session s=0x7fe5b40a4330 osd=4 3 2026-02-12T04:04:56.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.655+0000 7fe5ecaec640 15 client.30639.objecter _session_command_op_assign 4 2 2026-02-12T04:04:56.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.655+0000 7fe5ecaec640 20 client.30639.objecter put_session s=0x7fe5b40a4330 osd=4 4 2026-02-12T04:04:56.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.655+0000 7fe5ecaec640 10 client.30639.objecter _send_command 2 2026-02-12T04:04:56.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.655+0000 7fe5ecaec640 1 -- 10.20.193.91:0/2335551718 --> v1:10.20.193.91:6805/1766507926 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe5e80adec0 con 0x7fe5b40a49e0 2026-02-12T04:04:56.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.663+0000 7fe5ceffd640 1 -- 10.20.193.91:0/2335551718 <== osd.4 v1:10.20.193.91:6805/1766507926 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fe5e80adec0 con 0x7fe5b40a49e0 2026-02-12T04:04:56.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.663+0000 7fe5ceffd640 10 client.30639.objecter ms_dispatch2 0x7fe5e8000b90 command_reply(tid 2: 0 ) 2026-02-12T04:04:56.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.663+0000 7fe5ceffd640 10 client.30639.objecter _finish_command 2 = system:0 2026-02-12T04:04:56.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.663+0000 7fe5ceffd640 20 client.30639.objecter put_session s=0x7fe5b40a4330 osd=4 4 2026-02-12T04:04:56.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.663+0000 7fe5ceffd640 15 client.30639.objecter _session_command_op_remove 4 2 2026-02-12T04:04:56.665 INFO:teuthology.orchestra.run.trial091.stdout:{ 2026-02-12T04:04:56.666 INFO:teuthology.orchestra.run.trial091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-12T04:04:56.666 INFO:teuthology.orchestra.run.trial091.stdout:} 2026-02-12T04:04:56.667 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.663+0000 7fe5ecaec640 10 librados: watch_flush enter 2026-02-12T04:04:56.667 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.663+0000 7fe5ecaec640 10 librados: watch_flush exit 2026-02-12T04:04:56.667 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.663+0000 7fe5ecaec640 10 client.30639.objecter close_session for osd.4 2026-02-12T04:04:56.667 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.663+0000 7fe5ecaec640 1 -- 10.20.193.91:0/2335551718 >> v1:10.20.193.91:6805/1766507926 conn(0x7fe5b40a49e0 legacy=0x7fe5b40c4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:56.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.663+0000 7fe5ecaec640 20 client.30639.objecter put_session s=0x7fe5b40a4330 osd=4 1 2026-02-12T04:04:56.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.663+0000 7fe5ecaec640 20 client.30639.objecter shutdown clearing up homeless session... 2026-02-12T04:04:56.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.663+0000 7fe5ecaec640 10 client.30639.objecter successfully canceled tick 2026-02-12T04:04:56.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.663+0000 7fe5ecaec640 1 -- 10.20.193.91:0/2335551718 >> v1:10.20.193.91:6800/2929217192 conn(0x7fe5b407a080 legacy=0x7fe5b409a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:56.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.663+0000 7fe5ecaec640 10 monclient: shutdown 2026-02-12T04:04:56.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.663+0000 7fe5ecaec640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:56.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.663+0000 7fe5ecaec640 1 -- 10.20.193.91:0/2335551718 >> v1:10.20.193.91:6789/0 conn(0x7fe5e81599b0 legacy=0x7fe5e8130870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:56.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.663+0000 7fe5e6d76640 1 -- 10.20.193.91:0/2335551718 reap_dead start 2026-02-12T04:04:56.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.663+0000 7fe5ecaec640 1 -- 10.20.193.91:0/2335551718 shutdown_connections 2026-02-12T04:04:56.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.663+0000 7fe5ecaec640 1 -- 10.20.193.91:0/2335551718 >> 10.20.193.91:0/2335551718 conn(0x7fe5e80b6560 msgr2=0x7fe5e80b6930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:56.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.663+0000 7fe5ecaec640 1 -- 10.20.193.91:0/2335551718 shutdown_connections 2026-02-12T04:04:56.668 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.663+0000 7fe5ecaec640 1 -- 10.20.193.91:0/2335551718 wait complete. 2026-02-12T04:04:56.669 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.663+0000 7fe5ecaec640 1 librados: shutdown 2026-02-12T04:04:56.673 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2026-02-12T04:04:56.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.740+0000 7f5b2b97f640 10 monclient: get_monmap_and_config 2026-02-12T04:04:56.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.740+0000 7f5b2b97f640 10 monclient: build_initial_monmap 2026-02-12T04:04:56.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.740+0000 7f5b2b97f640 10 monclient: monmap: 2026-02-12T04:04:56.742 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:56.742 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:56.742 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:04:56.741001+0000 2026-02-12T04:04:56.743 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:04:56.741001+0000 2026-02-12T04:04:56.743 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:56.743 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:56.743 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:56.743 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:56.743 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:56.743 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:56.745 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.740+0000 7f5b2b97f640 1 Processor -- start 2026-02-12T04:04:56.745 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.740+0000 7f5b2b97f640 1 -- start start 2026-02-12T04:04:56.746 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.740+0000 7f5b2b97f640 10 monclient: init 2026-02-12T04:04:56.746 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.741+0000 7f5b2b97f640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:56.746 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.741+0000 7f5b2b97f640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T04:04:56.746 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.741+0000 7f5b2b97f640 10 monclient(hunting): picked mon.noname-a con 0x7f5b241575d0 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:56.746 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.741+0000 7f5b2b97f640 10 monclient(hunting): picked mon.noname-b con 0x7f5b24163310 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:56.746 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.741+0000 7f5b2b97f640 10 monclient(hunting): picked mon.noname-c con 0x7f5b240560d0 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:56.746 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.741+0000 7f5b2b97f640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b240b20b0 con 0x7f5b241575d0 2026-02-12T04:04:56.746 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.741+0000 7f5b2b97f640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b240b2390 con 0x7f5b24163310 2026-02-12T04:04:56.746 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.741+0000 7f5b2b97f640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b240b2670 con 0x7f5b240560d0 2026-02-12T04:04:56.746 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.741+0000 7f5b2b97f640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:56.746 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.741+0000 7f5b2b97f640 10 monclient(hunting): authenticate will time out at 1499.484512s 2026-02-12T04:04:56.746 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.741+0000 7f5b296f4640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f5b241575d0 0x7f5b24162c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:41432/0 (socket says 10.20.193.91:41432) 2026-02-12T04:04:56.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.741+0000 7f5b296f4640 1 -- 10.20.193.91:0/2396370646 learned_addr learned my addr 10.20.193.91:0/2396370646 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:56.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.743+0000 7f5b13fff640 1 -- 10.20.193.91:0/2396370646 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1554258256 0 0) 0x7f5b240b2390 con 0x7f5b24163310 2026-02-12T04:04:56.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.743+0000 7f5b13fff640 10 monclient(hunting): _negotiate 2026-02-12T04:04:56.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.743+0000 7f5b13fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:56.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.743+0000 7f5b13fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:56.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.743+0000 7f5b13fff640 10 monclient(hunting): my global_id is 27781 2026-02-12T04:04:56.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.743+0000 7f5b13fff640 1 -- 10.20.193.91:0/2396370646 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b0c003610 con 0x7f5b24163310 2026-02-12T04:04:56.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.743+0000 7f5b13fff640 1 -- 10.20.193.91:0/2396370646 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 839947072 0 0) 0x7f5b240b20b0 con 0x7f5b241575d0 2026-02-12T04:04:56.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.743+0000 7f5b13fff640 10 monclient(hunting): _negotiate 2026-02-12T04:04:56.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.743+0000 7f5b13fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:56.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.743+0000 7f5b13fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:56.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.743+0000 7f5b13fff640 10 monclient(hunting): my global_id is 30642 2026-02-12T04:04:56.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.743+0000 7f5b13fff640 1 -- 10.20.193.91:0/2396370646 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b240b2390 con 0x7f5b241575d0 2026-02-12T04:04:56.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.743+0000 7f5b13fff640 1 -- 10.20.193.91:0/2396370646 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3950885612 0 0) 0x7f5b240b2670 con 0x7f5b240560d0 2026-02-12T04:04:56.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.743+0000 7f5b13fff640 10 monclient(hunting): _negotiate 2026-02-12T04:04:56.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.743+0000 7f5b13fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:56.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.743+0000 7f5b13fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:56.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.743+0000 7f5b13fff640 10 monclient(hunting): my global_id is 27476 2026-02-12T04:04:56.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.743+0000 7f5b13fff640 1 -- 10.20.193.91:0/2396370646 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b240b20b0 con 0x7f5b240560d0 2026-02-12T04:04:56.754 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.744+0000 7f5b13fff640 1 -- 10.20.193.91:0/2396370646 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 466017218 0 0) 0x7f5b0c003610 con 0x7f5b24163310 2026-02-12T04:04:56.754 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.744+0000 7f5b13fff640 1 -- 10.20.193.91:0/2396370646 >> v1:10.20.193.111:6789/0 conn(0x7f5b240560d0 legacy=0x7f5b241c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:56.754 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.744+0000 7f5b13fff640 1 -- 10.20.193.91:0/2396370646 >> v1:10.20.193.91:6789/0 conn(0x7f5b241575d0 legacy=0x7f5b24162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:56.754 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.744+0000 7f5b13fff640 10 monclient: _finish_hunting 0 2026-02-12T04:04:56.754 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.744+0000 7f5b13fff640 1 monclient: found mon.noname-b 2026-02-12T04:04:56.755 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.744+0000 7f5b13fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:56.755 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.744+0000 7f5b13fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T04:04:56.755 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.744+0000 7f5b13fff640 1 -- 10.20.193.91:0/2396370646 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b24162400 con 0x7f5b24163310 2026-02-12T04:04:56.755 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.744+0000 7f5b13fff640 10 monclient: _finish_auth 0 2026-02-12T04:04:56.755 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.744+0000 7f5b13fff640 10 monclient: _check_auth_tickets 2026-02-12T04:04:56.755 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.744+0000 7f5b13fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:56.755 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.744+0000 7f5b13fff640 1 -- 10.20.193.91:0/2396370646 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f5b18002df0 con 0x7f5b24163310 2026-02-12T04:04:56.755 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.744+0000 7f5b13fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:56.755 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.744+0000 7f5b13fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T04:04:56.755 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.744+0000 7f5b13fff640 10 monclient: dump: 2026-02-12T04:04:56.755 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:56.755 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:56.756 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.756 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.756 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:56.756 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:56.756 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:56.756 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:56.756 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:56.756 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:56.756 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.744+0000 7f5b2b97f640 5 monclient: authenticate success, global_id 27781 2026-02-12T04:04:56.756 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.744+0000 7f5b2b97f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:04:56.756 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.745+0000 7f5b13fff640 1 -- 10.20.193.91:0/2396370646 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5b18002fc0 con 0x7f5b24163310 2026-02-12T04:04:56.756 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.745+0000 7f5b13fff640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:56.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.745+0000 7f5b13fff640 1 -- 10.20.193.91:0/2396370646 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f5b18003400 con 0x7f5b24163310 2026-02-12T04:04:56.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.745+0000 7f5b13fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:56.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.745+0000 7f5b13fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T04:04:56.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.745+0000 7f5b13fff640 10 monclient: dump: 2026-02-12T04:04:56.757 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:56.757 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:56.757 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.757 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.757 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:56.757 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:56.757 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:56.757 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:56.758 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:56.758 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:56.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.745+0000 7f5b2b97f640 10 monclient: get_monmap_and_config success 2026-02-12T04:04:56.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.745+0000 7f5b2b97f640 4 set_mon_vals no callback set 2026-02-12T04:04:56.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.746+0000 7f5b2b97f640 10 monclient: shutdown 2026-02-12T04:04:56.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.746+0000 7f5b2b97f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:56.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.746+0000 7f5b2b97f640 1 -- 10.20.193.91:0/2396370646 >> v1:10.20.193.98:6789/0 conn(0x7f5b24163310 legacy=0x7f5b240559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:56.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.746+0000 7f5b2b97f640 1 -- 10.20.193.91:0/2396370646 shutdown_connections 2026-02-12T04:04:56.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.746+0000 7f5b2b97f640 1 -- 10.20.193.91:0/2396370646 >> 10.20.193.91:0/2396370646 conn(0x7f5b240b6560 msgr2=0x7f5b240b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:56.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.746+0000 7f5b2b97f640 1 -- 10.20.193.91:0/2396370646 shutdown_connections 2026-02-12T04:04:56.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.746+0000 7f5b2b97f640 1 -- 10.20.193.91:0/2396370646 wait complete. 2026-02-12T04:04:56.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.746+0000 7f5b2b97f640 10 monclient: build_initial_monmap 2026-02-12T04:04:56.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.746+0000 7f5b2b97f640 10 monclient: monmap: 2026-02-12T04:04:56.759 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:56.759 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:04:56.759 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:04:56.759 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:04:56.759 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:56.759 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:04:56.759 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:56.759 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:56.759 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:56.759 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:56.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.746+0000 7f5b2b97f640 1 librados: starting msgr at 2026-02-12T04:04:56.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.746+0000 7f5b2b97f640 1 librados: starting objecter 2026-02-12T04:04:56.760 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.746+0000 7f5b2b97f640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:04:56.760 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.746+0000 7f5b2b97f640 1 Processor -- start 2026-02-12T04:04:56.760 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.747+0000 7f5b2b97f640 1 -- start start 2026-02-12T04:04:56.760 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.747+0000 7f5b2b97f640 1 librados: setting wanted keys 2026-02-12T04:04:56.760 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.747+0000 7f5b2b97f640 1 librados: calling monclient init 2026-02-12T04:04:56.760 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.747+0000 7f5b2b97f640 10 monclient: init 2026-02-12T04:04:56.760 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.747+0000 7f5b2b97f640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:56.760 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.747+0000 7f5b2b97f640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T04:04:56.760 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.747+0000 7f5b2b97f640 10 monclient(hunting): picked mon.noname-a con 0x7f5b240560d0 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:56.760 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.747+0000 7f5b2b97f640 10 monclient(hunting): picked mon.noname-b con 0x7f5b241575d0 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:56.760 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.747+0000 7f5b2b97f640 10 monclient(hunting): picked mon.noname-c con 0x7f5b24163310 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:56.760 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.747+0000 7f5b2b97f640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b24139890 con 0x7f5b240560d0 2026-02-12T04:04:56.761 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.747+0000 7f5b2b97f640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b24058790 con 0x7f5b241575d0 2026-02-12T04:04:56.761 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.747+0000 7f5b2b97f640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b24058a70 con 0x7f5b24163310 2026-02-12T04:04:56.761 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.747+0000 7f5b2b97f640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:56.761 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.747+0000 7f5b2b97f640 10 monclient(hunting): authenticate will time out at 1499.490459s 2026-02-12T04:04:56.761 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.747+0000 7f5b296f4640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f5b240560d0 0x7f5b24059b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:41444/0 (socket says 10.20.193.91:41444) 2026-02-12T04:04:56.761 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.747+0000 7f5b296f4640 1 -- 10.20.193.91:0/1579409976 learned_addr learned my addr 10.20.193.91:0/1579409976 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:56.761 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.748+0000 7f5b11ffb640 10 client.?.objecter ms_handle_connect 0x7f5b240560d0 2026-02-12T04:04:56.761 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.748+0000 7f5b11ffb640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:56.761 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.748+0000 7f5b11ffb640 10 client.?.objecter ms_handle_connect 0x7f5b241575d0 2026-02-12T04:04:56.761 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.748+0000 7f5b11ffb640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:56.761 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.748+0000 7f5b11ffb640 10 client.?.objecter ms_handle_connect 0x7f5b24163310 2026-02-12T04:04:56.761 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.748+0000 7f5b11ffb640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:56.762 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.748+0000 7f5b11ffb640 1 -- 10.20.193.91:0/1579409976 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3224170469 0 0) 0x7f5b24139890 con 0x7f5b240560d0 2026-02-12T04:04:56.762 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.748+0000 7f5b11ffb640 10 monclient(hunting): _negotiate 2026-02-12T04:04:56.762 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.748+0000 7f5b11ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:56.762 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.748+0000 7f5b11ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:56.762 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.748+0000 7f5b11ffb640 10 monclient(hunting): my global_id is 30645 2026-02-12T04:04:56.762 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.748+0000 7f5b11ffb640 1 -- 10.20.193.91:0/1579409976 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5af4003610 con 0x7f5b240560d0 2026-02-12T04:04:56.762 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.749+0000 7f5b11ffb640 1 -- 10.20.193.91:0/1579409976 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4090933078 0 0) 0x7f5b24058790 con 0x7f5b241575d0 2026-02-12T04:04:56.762 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.749+0000 7f5b11ffb640 10 monclient(hunting): _negotiate 2026-02-12T04:04:56.762 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.749+0000 7f5b11ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:56.762 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.749+0000 7f5b11ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:56.762 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.749+0000 7f5b11ffb640 10 monclient(hunting): my global_id is 27784 2026-02-12T04:04:56.762 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.749+0000 7f5b11ffb640 1 -- 10.20.193.91:0/1579409976 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b24139890 con 0x7f5b241575d0 2026-02-12T04:04:56.763 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.749+0000 7f5b11ffb640 1 -- 10.20.193.91:0/1579409976 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 350872725 0 0) 0x7f5b24058a70 con 0x7f5b24163310 2026-02-12T04:04:56.763 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.749+0000 7f5b11ffb640 10 monclient(hunting): _negotiate 2026-02-12T04:04:56.763 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.749+0000 7f5b11ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:56.763 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.749+0000 7f5b11ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:56.763 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.749+0000 7f5b11ffb640 10 monclient(hunting): my global_id is 27479 2026-02-12T04:04:56.763 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.749+0000 7f5b11ffb640 1 -- 10.20.193.91:0/1579409976 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b24058790 con 0x7f5b24163310 2026-02-12T04:04:56.763 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.751+0000 7f5b11ffb640 1 -- 10.20.193.91:0/1579409976 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3366575315 0 0) 0x7f5af4003610 con 0x7f5b240560d0 2026-02-12T04:04:56.763 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.751+0000 7f5b11ffb640 1 -- 10.20.193.91:0/1579409976 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5b24058a70 con 0x7f5b240560d0 2026-02-12T04:04:56.763 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.751+0000 7f5b11ffb640 1 -- 10.20.193.91:0/1579409976 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f5b14003170 con 0x7f5b240560d0 2026-02-12T04:04:56.763 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.751+0000 7f5b11ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:56.763 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.751+0000 7f5b11ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T04:04:56.763 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.751+0000 7f5b11ffb640 10 monclient(hunting): dump: 2026-02-12T04:04:56.763 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:56.764 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:56.764 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.764 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.764 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:56.764 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:56.764 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:56.764 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:56.764 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:56.764 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:56.764 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.751+0000 7f5b11ffb640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:04:56.764 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.751+0000 7f5b11ffb640 1 -- 10.20.193.91:0/1579409976 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2823251912 0 0) 0x7f5b24139890 con 0x7f5b241575d0 2026-02-12T04:04:56.764 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.751+0000 7f5b11ffb640 1 -- 10.20.193.91:0/1579409976 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5af4003610 con 0x7f5b241575d0 2026-02-12T04:04:56.765 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.751+0000 7f5b11ffb640 1 -- 10.20.193.91:0/1579409976 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f5b18003310 con 0x7f5b241575d0 2026-02-12T04:04:56.765 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.751+0000 7f5b11ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:56.765 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.751+0000 7f5b11ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T04:04:56.765 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.751+0000 7f5b11ffb640 10 monclient(hunting): dump: 2026-02-12T04:04:56.765 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:56.765 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:56.765 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.765 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.765 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:56.765 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:56.765 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:56.765 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:56.765 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:56.766 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:56.766 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.751+0000 7f5b11ffb640 1 -- 10.20.193.91:0/1579409976 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1042777352 0 0) 0x7f5b24058790 con 0x7f5b24163310 2026-02-12T04:04:56.766 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.751+0000 7f5b11ffb640 1 -- 10.20.193.91:0/1579409976 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5b24139890 con 0x7f5b24163310 2026-02-12T04:04:56.766 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.751+0000 7f5b11ffb640 1 -- 10.20.193.91:0/1579409976 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f5b20003410 con 0x7f5b24163310 2026-02-12T04:04:56.766 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.751+0000 7f5b11ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:56.766 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.751+0000 7f5b11ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T04:04:56.766 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.751+0000 7f5b11ffb640 10 monclient(hunting): dump: 2026-02-12T04:04:56.766 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:56.766 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:56.766 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.766 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.766 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:56.767 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:56.767 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:56.767 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:56.767 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:56.767 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:56.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.753+0000 7f5b11ffb640 1 -- 10.20.193.91:0/1579409976 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3118376997 0 0) 0x7f5b24058a70 con 0x7f5b240560d0 2026-02-12T04:04:56.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.753+0000 7f5b11ffb640 1 -- 10.20.193.91:0/1579409976 >> v1:10.20.193.111:6789/0 conn(0x7f5b24163310 legacy=0x7f5b2415fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:56.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.753+0000 7f5b11ffb640 1 -- 10.20.193.91:0/1579409976 >> v1:10.20.193.98:6789/0 conn(0x7f5b241575d0 legacy=0x7f5b24139180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:56.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.753+0000 7f5b11ffb640 10 monclient: _finish_hunting 0 2026-02-12T04:04:56.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.753+0000 7f5b11ffb640 1 monclient: found mon.a 2026-02-12T04:04:56.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.753+0000 7f5b11ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:56.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.753+0000 7f5b11ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:56.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.753+0000 7f5b11ffb640 1 -- 10.20.193.91:0/1579409976 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b24058d50 con 0x7f5b240560d0 2026-02-12T04:04:56.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.753+0000 7f5b11ffb640 10 monclient: _finish_auth 0 2026-02-12T04:04:56.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.753+0000 7f5b11ffb640 10 monclient: _check_auth_tickets 2026-02-12T04:04:56.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.753+0000 7f5b11ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:56.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.753+0000 7f5b2b97f640 5 monclient: authenticate success, global_id 30645 2026-02-12T04:04:56.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.753+0000 7f5b2b97f640 10 monclient: _renew_subs 2026-02-12T04:04:56.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.753+0000 7f5b2b97f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:56.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.753+0000 7f5b2b97f640 1 -- 10.20.193.91:0/1579409976 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5b24059030 con 0x7f5b240560d0 2026-02-12T04:04:56.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.753+0000 7f5b2b97f640 10 client.30645.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:04:56.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.753+0000 7f5b2b97f640 10 monclient: _renew_subs 2026-02-12T04:04:56.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.753+0000 7f5b2b97f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:56.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.753+0000 7f5b2b97f640 1 -- 10.20.193.91:0/1579409976 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5b241feb20 con 0x7f5b240560d0 2026-02-12T04:04:56.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.753+0000 7f5b2b97f640 1 librados: init done 2026-02-12T04:04:56.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.753+0000 7f5b2b97f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:56.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.753+0000 7f5b2b97f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:56.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.753+0000 7f5b2b97f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:56.771 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.753+0000 7f5b2b97f640 1 -- 10.20.193.91:0/1579409976 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b24051de0 con 0x7f5b240560d0 2026-02-12T04:04:56.848 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.846+0000 7f5b11ffb640 1 -- 10.20.193.91:0/1579409976 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5b140034c0 con 0x7f5b240560d0 2026-02-12T04:04:56.848 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.846+0000 7f5b11ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:56.849 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.846+0000 7f5b11ffb640 1 -- 10.20.193.91:0/1579409976 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f5b14004d20 con 0x7f5b240560d0 2026-02-12T04:04:56.849 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.846+0000 7f5b11ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:56.849 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.846+0000 7f5b11ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T04:04:56.849 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.846+0000 7f5b137fe640 4 set_mon_vals no callback set 2026-02-12T04:04:56.849 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.846+0000 7f5b11ffb640 10 monclient: dump: 2026-02-12T04:04:56.849 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:56.849 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:56.849 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.849 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:56.850 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:56.850 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:56.850 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:56.850 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:56.850 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:56.850 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:56.851 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.847+0000 7f5b11ffb640 1 -- 10.20.193.91:0/1579409976 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f5b1401e200 con 0x7f5b240560d0 2026-02-12T04:04:56.852 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.847+0000 7f5b28ef3640 10 monclient: get_auth_request con 0x7f5af4079fa0 auth_method 0 2026-02-12T04:04:56.852 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.848+0000 7f5b11ffb640 10 client.30645.objecter ms_handle_connect 0x7f5af4079fa0 2026-02-12T04:04:56.852 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.849+0000 7f5b11ffb640 1 -- 10.20.193.91:0/1579409976 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7f5b14095ba0 con 0x7f5b240560d0 2026-02-12T04:04:56.852 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.849+0000 7f5b11ffb640 10 client.30645.objecter ms_dispatch2 0x7f5b24000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:04:56.852 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.849+0000 7f5b11ffb640 3 client.30645.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:04:56.852 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.849+0000 7f5b11ffb640 3 client.30645.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:04:56.852 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.849+0000 7f5b11ffb640 20 client.30645.objecter dump_active .. 0 homeless 2026-02-12T04:04:56.852 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.849+0000 7f5b11ffb640 1 -- 10.20.193.91:0/1579409976 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f5b24051de0 con 0x7f5b240560d0 2026-02-12T04:04:56.852 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.849+0000 7f5b11ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:56.852 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.849+0000 7f5b11ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T04:04:56.957 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.955+0000 7f5b2b97f640 1 -- 10.20.193.91:0/1579409976 --> v1:10.20.193.91:6800/2929217192 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f5b240b7290 con 0x7f5af4079fa0 2026-02-12T04:04:56.957 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.955+0000 7f5b11ffb640 1 -- 10.20.193.91:0/1579409976 <== mgr.4113 v1:10.20.193.91:6800/2929217192 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (unknown 3782719169 0 0) 0x7f5b240b7290 con 0x7f5af4079fa0 2026-02-12T04:04:56.957 INFO:teuthology.orchestra.run.trial091.stderr:instructed osd(s) 4 to deep-scrub 2026-02-12T04:04:56.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.956+0000 7f5b2b97f640 10 librados: watch_flush enter 2026-02-12T04:04:56.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.956+0000 7f5b2b97f640 10 librados: watch_flush exit 2026-02-12T04:04:56.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.956+0000 7f5b2b97f640 20 client.30645.objecter shutdown clearing up homeless session... 2026-02-12T04:04:56.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.956+0000 7f5b2b97f640 10 client.30645.objecter successfully canceled tick 2026-02-12T04:04:56.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.956+0000 7f5b2b97f640 1 -- 10.20.193.91:0/1579409976 >> v1:10.20.193.91:6800/2929217192 conn(0x7f5af4079fa0 legacy=0x7f5af409a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:56.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.956+0000 7f5b2b97f640 10 monclient: shutdown 2026-02-12T04:04:56.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.956+0000 7f5b2b97f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:56.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.956+0000 7f5b2b97f640 1 -- 10.20.193.91:0/1579409976 >> v1:10.20.193.91:6789/0 conn(0x7f5b240560d0 legacy=0x7f5b24059b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:56.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.956+0000 7f5b2b97f640 1 -- 10.20.193.91:0/1579409976 shutdown_connections 2026-02-12T04:04:56.959 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.956+0000 7f5b2b97f640 1 -- 10.20.193.91:0/1579409976 >> 10.20.193.91:0/1579409976 conn(0x7f5b240b6560 msgr2=0x7f5b241637a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:56.960 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.956+0000 7f5b2b97f640 1 -- 10.20.193.91:0/1579409976 shutdown_connections 2026-02-12T04:04:56.960 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.956+0000 7f5b2b97f640 1 -- 10.20.193.91:0/1579409976 wait complete. 2026-02-12T04:04:56.960 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:56.956+0000 7f5b2b97f640 1 librados: shutdown 2026-02-12T04:04:56.966 INFO:tasks.ceph:Scrubbing osd.8 2026-02-12T04:04:56.967 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 config set osd_debug_deep_scrub_sleep 0 2026-02-12T04:04:57.036 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.035+0000 7f32b2865640 10 monclient: get_monmap_and_config 2026-02-12T04:04:57.037 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.035+0000 7f32b2865640 10 monclient: build_initial_monmap 2026-02-12T04:04:57.037 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.035+0000 7f32b2865640 10 monclient: monmap: 2026-02-12T04:04:57.037 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:57.037 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:57.037 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:04:57.035587+0000 2026-02-12T04:04:57.037 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:04:57.035587+0000 2026-02-12T04:04:57.037 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:57.037 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:57.037 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:57.037 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:57.038 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:57.038 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.035+0000 7f32b2865640 1 Processor -- start 2026-02-12T04:04:57.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.035+0000 7f32b2865640 1 -- start start 2026-02-12T04:04:57.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.035+0000 7f32b2865640 10 monclient: init 2026-02-12T04:04:57.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.035+0000 7f32b2865640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:57.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.035+0000 7f32b2865640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T04:04:57.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.035+0000 7f32b2865640 10 monclient(hunting): picked mon.noname-a con 0x7f32ac055c30 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:57.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.035+0000 7f32b2865640 10 monclient(hunting): picked mon.noname-b con 0x7f32ac160f80 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:57.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.035+0000 7f32b2865640 10 monclient(hunting): picked mon.noname-c con 0x7f32ac163230 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:57.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.036+0000 7f32b2865640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32ac0b1fc0 con 0x7f32ac055c30 2026-02-12T04:04:57.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.036+0000 7f32b2865640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32ac0b22a0 con 0x7f32ac160f80 2026-02-12T04:04:57.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.036+0000 7f32b2865640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32ac0b2580 con 0x7f32ac163230 2026-02-12T04:04:57.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.036+0000 7f32b2865640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:57.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.036+0000 7f32b2865640 10 monclient(hunting): authenticate will time out at 1499.779058s 2026-02-12T04:04:57.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.036+0000 7f32abfff640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f32ac055c30 0x7f32ac162b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:41458/0 (socket says 10.20.193.91:41458) 2026-02-12T04:04:57.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.036+0000 7f32abfff640 1 -- 10.20.193.91:0/842928261 learned_addr learned my addr 10.20.193.91:0/842928261 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:57.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.037+0000 7f32aaffd640 1 -- 10.20.193.91:0/842928261 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1043922287 0 0) 0x7f32ac0b1fc0 con 0x7f32ac055c30 2026-02-12T04:04:57.042 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.037+0000 7f32aaffd640 10 monclient(hunting): _negotiate 2026-02-12T04:04:57.042 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.037+0000 7f32aaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:57.042 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.037+0000 7f32aaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:57.042 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.037+0000 7f32aaffd640 10 monclient(hunting): my global_id is 30648 2026-02-12T04:04:57.042 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.037+0000 7f32aaffd640 1 -- 10.20.193.91:0/842928261 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3290003610 con 0x7f32ac055c30 2026-02-12T04:04:57.042 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.038+0000 7f32aaffd640 1 -- 10.20.193.91:0/842928261 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2514065777 0 0) 0x7f32ac0b22a0 con 0x7f32ac160f80 2026-02-12T04:04:57.042 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.038+0000 7f32aaffd640 10 monclient(hunting): _negotiate 2026-02-12T04:04:57.042 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.038+0000 7f32aaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:57.042 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.038+0000 7f32aaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:57.042 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.038+0000 7f32aaffd640 10 monclient(hunting): my global_id is 27787 2026-02-12T04:04:57.042 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.038+0000 7f32aaffd640 1 -- 10.20.193.91:0/842928261 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32ac0b1fc0 con 0x7f32ac160f80 2026-02-12T04:04:57.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.038+0000 7f32aaffd640 1 -- 10.20.193.91:0/842928261 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 290936839 0 0) 0x7f32ac0b2580 con 0x7f32ac163230 2026-02-12T04:04:57.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.038+0000 7f32aaffd640 10 monclient(hunting): _negotiate 2026-02-12T04:04:57.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.038+0000 7f32aaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:57.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.038+0000 7f32aaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:57.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.038+0000 7f32aaffd640 10 monclient(hunting): my global_id is 27482 2026-02-12T04:04:57.043 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.038+0000 7f32aaffd640 1 -- 10.20.193.91:0/842928261 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32ac0b22a0 con 0x7f32ac163230 2026-02-12T04:04:57.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.039+0000 7f32aaffd640 1 -- 10.20.193.91:0/842928261 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2570116555 0 0) 0x7f3290003610 con 0x7f32ac055c30 2026-02-12T04:04:57.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.039+0000 7f32aaffd640 1 -- 10.20.193.91:0/842928261 >> v1:10.20.193.111:6789/0 conn(0x7f32ac163230 legacy=0x7f32ac1c57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:57.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.039+0000 7f32aaffd640 1 -- 10.20.193.91:0/842928261 >> v1:10.20.193.98:6789/0 conn(0x7f32ac160f80 legacy=0x7f32ac1572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:57.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.039+0000 7f32aaffd640 10 monclient: _finish_hunting 0 2026-02-12T04:04:57.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.039+0000 7f32aaffd640 1 monclient: found mon.noname-a 2026-02-12T04:04:57.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.039+0000 7f32aaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:57.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.039+0000 7f32aaffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.91:6789/0 2026-02-12T04:04:57.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.039+0000 7f32aaffd640 1 -- 10.20.193.91:0/842928261 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32ac0b2860 con 0x7f32ac055c30 2026-02-12T04:04:57.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.039+0000 7f32aaffd640 10 monclient: _finish_auth 0 2026-02-12T04:04:57.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.039+0000 7f32aaffd640 10 monclient: _check_auth_tickets 2026-02-12T04:04:57.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.039+0000 7f32aaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:57.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.039+0000 7f32aaffd640 1 -- 10.20.193.91:0/842928261 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f3298002df0 con 0x7f32ac055c30 2026-02-12T04:04:57.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.039+0000 7f32b2865640 5 monclient: authenticate success, global_id 30648 2026-02-12T04:04:57.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.039+0000 7f32aaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:57.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.039+0000 7f32aaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T04:04:57.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.039+0000 7f32aaffd640 10 monclient: dump: 2026-02-12T04:04:57.050 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:57.050 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:57.050 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.050 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.050 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:57.051 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:57.051 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:57.051 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:57.051 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:57.051 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.039+0000 7f32b2865640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:04:57.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.040+0000 7f32aaffd640 1 -- 10.20.193.91:0/842928261 <== mon.0 v1:10.20.193.91:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3298002fc0 con 0x7f32ac055c30 2026-02-12T04:04:57.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.040+0000 7f32aaffd640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:57.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.040+0000 7f32aaffd640 1 -- 10.20.193.91:0/842928261 <== mon.0 v1:10.20.193.91:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f3298003400 con 0x7f32ac055c30 2026-02-12T04:04:57.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.040+0000 7f32aaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:57.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.040+0000 7f32aaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T04:04:57.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.040+0000 7f32aaffd640 10 monclient: dump: 2026-02-12T04:04:57.052 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:57.052 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:57.052 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.052 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.052 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:57.052 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:57.052 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:57.052 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:57.052 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:57.052 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.052 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.040+0000 7f32b2865640 10 monclient: get_monmap_and_config success 2026-02-12T04:04:57.052 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.040+0000 7f32b2865640 4 set_mon_vals no callback set 2026-02-12T04:04:57.052 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.040+0000 7f32b2865640 10 monclient: shutdown 2026-02-12T04:04:57.053 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.041+0000 7f32b2865640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:57.053 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.041+0000 7f32b2865640 1 -- 10.20.193.91:0/842928261 >> v1:10.20.193.91:6789/0 conn(0x7f32ac055c30 legacy=0x7f32ac162b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:57.053 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.041+0000 7f32b2865640 1 -- 10.20.193.91:0/842928261 shutdown_connections 2026-02-12T04:04:57.053 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.041+0000 7f32b2865640 1 -- 10.20.193.91:0/842928261 >> 10.20.193.91:0/842928261 conn(0x7f32ac0b6560 msgr2=0x7f32ac0b6930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:57.053 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.041+0000 7f32b2865640 1 -- 10.20.193.91:0/842928261 shutdown_connections 2026-02-12T04:04:57.053 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.041+0000 7f32b2865640 1 -- 10.20.193.91:0/842928261 wait complete. 2026-02-12T04:04:57.053 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.041+0000 7f32b2865640 10 monclient: build_initial_monmap 2026-02-12T04:04:57.053 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.041+0000 7f32b2865640 10 monclient: monmap: 2026-02-12T04:04:57.053 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:57.053 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:04:57.053 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:04:57.053 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:04:57.054 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:57.054 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:04:57.054 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:57.054 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:57.054 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:57.054 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.054 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.042+0000 7f32b2865640 1 librados: starting msgr at 2026-02-12T04:04:57.054 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.042+0000 7f32b2865640 1 librados: starting objecter 2026-02-12T04:04:57.054 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.042+0000 7f32b2865640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:04:57.054 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.042+0000 7f32b2865640 1 Processor -- start 2026-02-12T04:04:57.054 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.042+0000 7f32b2865640 1 -- start start 2026-02-12T04:04:57.054 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.042+0000 7f32b2865640 1 librados: setting wanted keys 2026-02-12T04:04:57.055 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.042+0000 7f32b2865640 1 librados: calling monclient init 2026-02-12T04:04:57.055 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.042+0000 7f32b2865640 10 monclient: init 2026-02-12T04:04:57.055 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.042+0000 7f32b2865640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:57.055 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.042+0000 7f32b2865640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T04:04:57.055 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.042+0000 7f32b2865640 10 monclient(hunting): picked mon.noname-c con 0x7f32ac055c30 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:57.055 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.042+0000 7f32b2865640 10 monclient(hunting): picked mon.noname-a con 0x7f32ac160f80 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:57.055 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.042+0000 7f32b2865640 10 monclient(hunting): picked mon.noname-b con 0x7f32ac163230 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:57.055 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.042+0000 7f32b2865640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32ac059670 con 0x7f32ac160f80 2026-02-12T04:04:57.055 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.042+0000 7f32b2865640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32ac138220 con 0x7f32ac163230 2026-02-12T04:04:57.055 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.042+0000 7f32b2865640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32ac138500 con 0x7f32ac055c30 2026-02-12T04:04:57.055 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.042+0000 7f32b2865640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:57.055 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.042+0000 7f32b2865640 10 monclient(hunting): authenticate will time out at 1499.785685s 2026-02-12T04:04:57.055 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.042+0000 7f32ab7fe640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f32ac160f80 0x7f32ac15cf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:41472/0 (socket says 10.20.193.91:41472) 2026-02-12T04:04:57.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.043+0000 7f32ab7fe640 1 -- 10.20.193.91:0/1994036316 learned_addr learned my addr 10.20.193.91:0/1994036316 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:57.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.043+0000 7f32a8ff9640 10 client.?.objecter ms_handle_connect 0x7f32ac160f80 2026-02-12T04:04:57.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.043+0000 7f32a8ff9640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:57.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.043+0000 7f32a8ff9640 10 client.?.objecter ms_handle_connect 0x7f32ac163230 2026-02-12T04:04:57.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.043+0000 7f32a8ff9640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:57.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.043+0000 7f32a8ff9640 10 client.?.objecter ms_handle_connect 0x7f32ac055c30 2026-02-12T04:04:57.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.043+0000 7f32a8ff9640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:57.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.044+0000 7f32a8ff9640 1 -- 10.20.193.91:0/1994036316 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2477886729 0 0) 0x7f32ac059670 con 0x7f32ac160f80 2026-02-12T04:04:57.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.044+0000 7f32a8ff9640 10 monclient(hunting): _negotiate 2026-02-12T04:04:57.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.044+0000 7f32a8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:57.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.044+0000 7f32a8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:57.056 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.044+0000 7f32a8ff9640 10 monclient(hunting): my global_id is 30651 2026-02-12T04:04:57.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.044+0000 7f32a8ff9640 1 -- 10.20.193.91:0/1994036316 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f327c003610 con 0x7f32ac160f80 2026-02-12T04:04:57.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.044+0000 7f32a8ff9640 1 -- 10.20.193.91:0/1994036316 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3314257650 0 0) 0x7f32ac138500 con 0x7f32ac055c30 2026-02-12T04:04:57.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.044+0000 7f32a8ff9640 10 monclient(hunting): _negotiate 2026-02-12T04:04:57.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.044+0000 7f32a8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:57.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.044+0000 7f32a8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:57.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.044+0000 7f32a8ff9640 10 monclient(hunting): my global_id is 27485 2026-02-12T04:04:57.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.044+0000 7f32a8ff9640 1 -- 10.20.193.91:0/1994036316 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32ac059670 con 0x7f32ac055c30 2026-02-12T04:04:57.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.044+0000 7f32a8ff9640 1 -- 10.20.193.91:0/1994036316 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 766202084 0 0) 0x7f32ac138220 con 0x7f32ac163230 2026-02-12T04:04:57.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.044+0000 7f32a8ff9640 10 monclient(hunting): _negotiate 2026-02-12T04:04:57.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.044+0000 7f32a8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:57.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.044+0000 7f32a8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:57.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.044+0000 7f32a8ff9640 10 monclient(hunting): my global_id is 27790 2026-02-12T04:04:57.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.044+0000 7f32a8ff9640 1 -- 10.20.193.91:0/1994036316 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32ac138500 con 0x7f32ac163230 2026-02-12T04:04:57.058 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.046+0000 7f32a8ff9640 1 -- 10.20.193.91:0/1994036316 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3890169824 0 0) 0x7f32ac059670 con 0x7f32ac055c30 2026-02-12T04:04:57.058 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.046+0000 7f32a8ff9640 1 -- 10.20.193.91:0/1994036316 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f32ac138220 con 0x7f32ac055c30 2026-02-12T04:04:57.058 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.046+0000 7f32a8ff9640 1 -- 10.20.193.91:0/1994036316 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f3298003310 con 0x7f32ac055c30 2026-02-12T04:04:57.058 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.046+0000 7f32a8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:57.058 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.046+0000 7f32a8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T04:04:57.058 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.046+0000 7f32a8ff9640 10 monclient(hunting): dump: 2026-02-12T04:04:57.058 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:57.058 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:57.058 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.058 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.058 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:57.059 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:57.059 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:57.059 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:57.059 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:57.059 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.059 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.046+0000 7f32a8ff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:04:57.059 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.046+0000 7f32a8ff9640 1 -- 10.20.193.91:0/1994036316 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2299119173 0 0) 0x7f327c003610 con 0x7f32ac160f80 2026-02-12T04:04:57.059 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.046+0000 7f32a8ff9640 1 -- 10.20.193.91:0/1994036316 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f32ac059670 con 0x7f32ac160f80 2026-02-12T04:04:57.059 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.046+0000 7f32a8ff9640 1 -- 10.20.193.91:0/1994036316 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f329c003170 con 0x7f32ac160f80 2026-02-12T04:04:57.059 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.046+0000 7f32a8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:57.059 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.046+0000 7f32a8ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T04:04:57.060 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.046+0000 7f32a8ff9640 10 monclient(hunting): dump: 2026-02-12T04:04:57.060 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:57.060 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:57.060 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.060 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.060 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:57.060 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:57.060 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:57.060 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:57.060 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:57.060 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.060 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.047+0000 7f32a8ff9640 1 -- 10.20.193.91:0/1994036316 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 451563897 0 0) 0x7f32ac138500 con 0x7f32ac163230 2026-02-12T04:04:57.061 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.047+0000 7f32a8ff9640 1 -- 10.20.193.91:0/1994036316 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f327c003610 con 0x7f32ac163230 2026-02-12T04:04:57.061 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.047+0000 7f32a8ff9640 1 -- 10.20.193.91:0/1994036316 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f32a0003330 con 0x7f32ac163230 2026-02-12T04:04:57.061 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.047+0000 7f32a8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:57.061 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.047+0000 7f32a8ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T04:04:57.061 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.047+0000 7f32a8ff9640 10 monclient(hunting): dump: 2026-02-12T04:04:57.061 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:57.061 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:57.061 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.061 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.061 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:57.061 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:57.061 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:57.062 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:57.062 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:57.062 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.065 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.048+0000 7f32a8ff9640 1 -- 10.20.193.91:0/1994036316 <== mon.2 v1:10.20.193.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3123208866 0 0) 0x7f32ac138220 con 0x7f32ac055c30 2026-02-12T04:04:57.065 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.048+0000 7f32a8ff9640 1 -- 10.20.193.91:0/1994036316 >> v1:10.20.193.98:6789/0 conn(0x7f32ac163230 legacy=0x7f32ac137440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:57.065 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.048+0000 7f32a8ff9640 1 -- 10.20.193.91:0/1994036316 >> v1:10.20.193.91:6789/0 conn(0x7f32ac160f80 legacy=0x7f32ac15cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:57.065 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.048+0000 7f32a8ff9640 10 monclient: _finish_hunting 0 2026-02-12T04:04:57.065 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.048+0000 7f32a8ff9640 1 monclient: found mon.c 2026-02-12T04:04:57.065 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.048+0000 7f32a8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:57.065 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.048+0000 7f32a8ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:04:57.065 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.048+0000 7f32a8ff9640 1 -- 10.20.193.91:0/1994036316 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32ac15c490 con 0x7f32ac055c30 2026-02-12T04:04:57.066 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.048+0000 7f32a8ff9640 10 monclient: _finish_auth 0 2026-02-12T04:04:57.066 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.048+0000 7f32a8ff9640 10 monclient: _check_auth_tickets 2026-02-12T04:04:57.066 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.048+0000 7f32a8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:57.066 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.048+0000 7f32b2865640 5 monclient: authenticate success, global_id 27485 2026-02-12T04:04:57.066 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.048+0000 7f32b2865640 10 monclient: _renew_subs 2026-02-12T04:04:57.066 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.048+0000 7f32b2865640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:04:57.066 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.048+0000 7f32b2865640 1 -- 10.20.193.91:0/1994036316 --> v1:10.20.193.111:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f32ac15c770 con 0x7f32ac055c30 2026-02-12T04:04:57.066 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.048+0000 7f32b2865640 10 client.27485.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:04:57.066 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.048+0000 7f32b2865640 10 monclient: _renew_subs 2026-02-12T04:04:57.066 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.048+0000 7f32b2865640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:04:57.066 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.048+0000 7f32b2865640 1 -- 10.20.193.91:0/1994036316 --> v1:10.20.193.111:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f32ac15d680 con 0x7f32ac055c30 2026-02-12T04:04:57.066 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.048+0000 7f32b2865640 1 librados: init done 2026-02-12T04:04:57.066 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.048+0000 7f32b2865640 10 client.27485.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:57.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.048+0000 7f32b2865640 15 client.27485.objecter _session_command_op_assign -1 1 2026-02-12T04:04:57.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.048+0000 7f32b2865640 20 client.27485.objecter _get_session osd=-1 returning homeless 2026-02-12T04:04:57.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.048+0000 7f32b2865640 10 client.27485.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:04:57.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.048+0000 7f32b2865640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:04:57.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.048+0000 7f32b2865640 1 -- 10.20.193.91:0/1994036316 --> v1:10.20.193.111:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f32ac15c2c0 con 0x7f32ac055c30 2026-02-12T04:04:57.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.057+0000 7f32a8ff9640 1 -- 10.20.193.91:0/1994036316 <== mon.2 v1:10.20.193.111:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f32ac15c2c0 con 0x7f32ac055c30 2026-02-12T04:04:57.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.057+0000 7f32a8ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:57.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.057+0000 7f32a8ff9640 1 -- 10.20.193.91:0/1994036316 <== mon.2 v1:10.20.193.111:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f32980028e0 con 0x7f32ac055c30 2026-02-12T04:04:57.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.057+0000 7f32a8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:57.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.057+0000 7f32a8ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T04:04:57.067 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.057+0000 7f32a8ff9640 10 monclient: dump: 2026-02-12T04:04:57.067 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:57.068 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:57.068 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.068 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.068 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:57.068 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:57.068 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:57.068 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:57.068 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:57.068 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.068 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.057+0000 7f32aa7fc640 4 set_mon_vals no callback set 2026-02-12T04:04:57.068 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.057+0000 7f32a8ff9640 1 -- 10.20.193.91:0/1994036316 <== mon.2 v1:10.20.193.111:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f329801dec0 con 0x7f32ac055c30 2026-02-12T04:04:57.068 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.058+0000 7f32ab7fe640 10 monclient: get_auth_request con 0x7f327c07a0f0 auth_method 0 2026-02-12T04:04:57.069 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.058+0000 7f32a8ff9640 10 client.27485.objecter ms_handle_connect 0x7f327c07a0f0 2026-02-12T04:04:57.069 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.058+0000 7f32a8ff9640 1 -- 10.20.193.91:0/1994036316 <== mon.2 v1:10.20.193.111:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7f3298095930 con 0x7f32ac055c30 2026-02-12T04:04:57.069 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.058+0000 7f32a8ff9640 10 client.27485.objecter ms_dispatch2 0x7f32ac000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:04:57.069 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.058+0000 7f32a8ff9640 3 client.27485.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:04:57.069 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.058+0000 7f32a8ff9640 3 client.27485.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:04:57.069 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.058+0000 7f32a8ff9640 10 client.27485.objecter checking command 1 2026-02-12T04:04:57.069 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.058+0000 7f32a8ff9640 20 client.27485.objecter _get_session s=0x7f327c0a43a0 osd=8 3 2026-02-12T04:04:57.069 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.058+0000 7f32a8ff9640 20 client.27485.objecter put_session s=0x7f327c0a43a0 osd=8 3 2026-02-12T04:04:57.069 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.058+0000 7f32a8ff9640 15 client.27485.objecter _session_command_op_remove -1 1 2026-02-12T04:04:57.069 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.058+0000 7f32a8ff9640 20 client.27485.objecter _get_session s=0x7f327c0a43a0 osd=8 3 2026-02-12T04:04:57.069 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.058+0000 7f32a8ff9640 20 client.27485.objecter get_session s=0x7f327c0a43a0 osd=8 3 2026-02-12T04:04:57.069 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.058+0000 7f32a8ff9640 15 client.27485.objecter _session_command_op_assign 8 1 2026-02-12T04:04:57.070 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.058+0000 7f32a8ff9640 20 client.27485.objecter put_session s=0x7f327c0a43a0 osd=8 4 2026-02-12T04:04:57.070 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.058+0000 7f32a8ff9640 10 client.27485.objecter _send_command 1 2026-02-12T04:04:57.070 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.058+0000 7f32a8ff9640 1 -- 10.20.193.91:0/1994036316 --> v1:10.20.193.91:6809/443384425 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3298002fc0 con 0x7f327c0a4a50 2026-02-12T04:04:57.070 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.058+0000 7f32a8ff9640 20 client.27485.objecter dump_active .. 0 homeless 2026-02-12T04:04:57.070 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.058+0000 7f32a8ff9640 1 -- 10.20.193.91:0/1994036316 <== mon.2 v1:10.20.193.111:6789/0 9 ==== mon_get_version_reply(handle=1 version=344) ==== 24+0+0 (unknown 1403447244 0 0) 0x7f329805af00 con 0x7f32ac055c30 2026-02-12T04:04:57.070 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.058+0000 7f32a8ff9640 10 monclient: handle_get_version_reply finishing 1 version 344 2026-02-12T04:04:57.070 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.059+0000 7f32b0ddb640 10 monclient: get_auth_request con 0x7f327c0a4a50 auth_method 0 2026-02-12T04:04:57.070 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.060+0000 7f32a8ff9640 10 client.27485.objecter ms_handle_connect 0x7f327c0a4a50 2026-02-12T04:04:57.071 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.069+0000 7f32a8ff9640 1 -- 10.20.193.91:0/1994036316 <== osd.8 v1:10.20.193.91:6809/443384425 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f3298002fc0 con 0x7f327c0a4a50 2026-02-12T04:04:57.071 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.069+0000 7f32a8ff9640 10 client.27485.objecter ms_dispatch2 0x7f32ac000b90 command_reply(tid 1: 0 ) 2026-02-12T04:04:57.071 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.069+0000 7f32a8ff9640 10 client.27485.objecter _finish_command 1 = system:0 2026-02-12T04:04:57.071 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.069+0000 7f32a8ff9640 20 client.27485.objecter put_session s=0x7f327c0a43a0 osd=8 4 2026-02-12T04:04:57.071 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.069+0000 7f32a8ff9640 15 client.27485.objecter _session_command_op_remove 8 1 2026-02-12T04:04:57.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.076+0000 7f32b2865640 10 client.27485.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-12T04:04:57.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.076+0000 7f32b2865640 15 client.27485.objecter _session_command_op_assign -1 2 2026-02-12T04:04:57.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.076+0000 7f32b2865640 20 client.27485.objecter _get_session s=0x7f327c0a43a0 osd=8 3 2026-02-12T04:04:57.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.076+0000 7f32b2865640 20 client.27485.objecter put_session s=0x7f327c0a43a0 osd=8 3 2026-02-12T04:04:57.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.076+0000 7f32b2865640 20 client.27485.objecter _get_session s=0x7f327c0a43a0 osd=8 3 2026-02-12T04:04:57.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.076+0000 7f32b2865640 15 client.27485.objecter _session_command_op_remove -1 2 2026-02-12T04:04:57.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.076+0000 7f32b2865640 20 client.27485.objecter get_session s=0x7f327c0a43a0 osd=8 3 2026-02-12T04:04:57.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.076+0000 7f32b2865640 15 client.27485.objecter _session_command_op_assign 8 2 2026-02-12T04:04:57.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.076+0000 7f32b2865640 20 client.27485.objecter put_session s=0x7f327c0a43a0 osd=8 4 2026-02-12T04:04:57.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.076+0000 7f32b2865640 10 client.27485.objecter _send_command 2 2026-02-12T04:04:57.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.076+0000 7f32b2865640 1 -- 10.20.193.91:0/1994036316 --> v1:10.20.193.91:6809/443384425 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f32ac157450 con 0x7f327c0a4a50 2026-02-12T04:04:57.086 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.084+0000 7f32a8ff9640 1 -- 10.20.193.91:0/1994036316 <== osd.8 v1:10.20.193.91:6809/443384425 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f32ac157450 con 0x7f327c0a4a50 2026-02-12T04:04:57.086 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.084+0000 7f32a8ff9640 10 client.27485.objecter ms_dispatch2 0x7f32ac000b90 command_reply(tid 2: 0 ) 2026-02-12T04:04:57.086 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.084+0000 7f32a8ff9640 10 client.27485.objecter _finish_command 2 = system:0 2026-02-12T04:04:57.087 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.084+0000 7f32a8ff9640 20 client.27485.objecter put_session s=0x7f327c0a43a0 osd=8 4 2026-02-12T04:04:57.087 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.084+0000 7f32a8ff9640 15 client.27485.objecter _session_command_op_remove 8 2 2026-02-12T04:04:57.087 INFO:teuthology.orchestra.run.trial091.stdout:{ 2026-02-12T04:04:57.087 INFO:teuthology.orchestra.run.trial091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-12T04:04:57.087 INFO:teuthology.orchestra.run.trial091.stdout:} 2026-02-12T04:04:57.088 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.085+0000 7f32b2865640 10 librados: watch_flush enter 2026-02-12T04:04:57.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.085+0000 7f32b2865640 10 librados: watch_flush exit 2026-02-12T04:04:57.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.085+0000 7f32b2865640 10 client.27485.objecter close_session for osd.8 2026-02-12T04:04:57.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.085+0000 7f32b2865640 1 -- 10.20.193.91:0/1994036316 >> v1:10.20.193.91:6809/443384425 conn(0x7f327c0a4a50 legacy=0x7f327c0c4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:57.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.085+0000 7f32b2865640 20 client.27485.objecter put_session s=0x7f327c0a43a0 osd=8 1 2026-02-12T04:04:57.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.085+0000 7f32b2865640 20 client.27485.objecter shutdown clearing up homeless session... 2026-02-12T04:04:57.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.085+0000 7f32b2865640 10 client.27485.objecter successfully canceled tick 2026-02-12T04:04:57.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.085+0000 7f32b2865640 1 -- 10.20.193.91:0/1994036316 >> v1:10.20.193.91:6800/2929217192 conn(0x7f327c07a0f0 legacy=0x7f327c09a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:57.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.085+0000 7f32b2865640 10 monclient: shutdown 2026-02-12T04:04:57.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.085+0000 7f32b2865640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:57.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.085+0000 7f32b2865640 1 -- 10.20.193.91:0/1994036316 >> v1:10.20.193.111:6789/0 conn(0x7f32ac055c30 legacy=0x7f32ac058f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:57.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.085+0000 7f32b0ddb640 1 -- 10.20.193.91:0/1994036316 reap_dead start 2026-02-12T04:04:57.090 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.085+0000 7f32b2865640 1 -- 10.20.193.91:0/1994036316 shutdown_connections 2026-02-12T04:04:57.090 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.085+0000 7f32b2865640 1 -- 10.20.193.91:0/1994036316 >> 10.20.193.91:0/1994036316 conn(0x7f32ac0b6560 msgr2=0x7f32ac160170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:57.090 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.085+0000 7f32b2865640 1 -- 10.20.193.91:0/1994036316 shutdown_connections 2026-02-12T04:04:57.090 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.085+0000 7f32b2865640 1 -- 10.20.193.91:0/1994036316 wait complete. 2026-02-12T04:04:57.090 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.085+0000 7f32b2865640 1 librados: shutdown 2026-02-12T04:04:57.094 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 8 2026-02-12T04:04:57.163 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.161+0000 7f6df8ef3640 10 monclient: get_monmap_and_config 2026-02-12T04:04:57.163 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.161+0000 7f6df8ef3640 10 monclient: build_initial_monmap 2026-02-12T04:04:57.163 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.161+0000 7f6df8ef3640 10 monclient: monmap: 2026-02-12T04:04:57.164 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:57.164 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:57.164 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:04:57.161914+0000 2026-02-12T04:04:57.164 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:04:57.161914+0000 2026-02-12T04:04:57.164 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:57.164 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:57.164 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:57.164 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:57.164 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:57.164 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.164 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.161+0000 7f6df8ef3640 1 Processor -- start 2026-02-12T04:04:57.164 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.161+0000 7f6df8ef3640 1 -- start start 2026-02-12T04:04:57.165 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.161+0000 7f6df8ef3640 10 monclient: init 2026-02-12T04:04:57.167 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.162+0000 7f6df8ef3640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:57.167 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.162+0000 7f6df8ef3640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T04:04:57.167 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.162+0000 7f6df8ef3640 10 monclient(hunting): picked mon.noname-a con 0x7f6df41575d0 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:57.167 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.162+0000 7f6df8ef3640 10 monclient(hunting): picked mon.noname-b con 0x7f6df4163310 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:57.167 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.162+0000 7f6df8ef3640 10 monclient(hunting): picked mon.noname-c con 0x7f6df40560d0 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:57.167 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.162+0000 7f6df8ef3640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6df40b20b0 con 0x7f6df41575d0 2026-02-12T04:04:57.167 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.162+0000 7f6df8ef3640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6df40b2390 con 0x7f6df4163310 2026-02-12T04:04:57.167 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.162+0000 7f6df8ef3640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6df40b2670 con 0x7f6df40560d0 2026-02-12T04:04:57.167 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.162+0000 7f6df8ef3640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:57.167 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.162+0000 7f6df8ef3640 10 monclient(hunting): authenticate will time out at 1499.905328s 2026-02-12T04:04:57.168 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.162+0000 7f6df2575640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f6df41575d0 0x7f6df4162c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:41476/0 (socket says 10.20.193.91:41476) 2026-02-12T04:04:57.168 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.162+0000 7f6df2575640 1 -- 10.20.193.91:0/2256395484 learned_addr learned my addr 10.20.193.91:0/2256395484 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:57.168 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.164+0000 7f6df1573640 1 -- 10.20.193.91:0/2256395484 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 989599557 0 0) 0x7f6df40b2390 con 0x7f6df4163310 2026-02-12T04:04:57.168 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.164+0000 7f6df1573640 10 monclient(hunting): _negotiate 2026-02-12T04:04:57.168 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.164+0000 7f6df1573640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:57.168 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.164+0000 7f6df1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:57.168 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.164+0000 7f6df1573640 10 monclient(hunting): my global_id is 27793 2026-02-12T04:04:57.168 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.164+0000 7f6df1573640 1 -- 10.20.193.91:0/2256395484 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6de0003610 con 0x7f6df4163310 2026-02-12T04:04:57.168 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.164+0000 7f6df1573640 1 -- 10.20.193.91:0/2256395484 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3402362046 0 0) 0x7f6df40b20b0 con 0x7f6df41575d0 2026-02-12T04:04:57.168 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.164+0000 7f6df1573640 10 monclient(hunting): _negotiate 2026-02-12T04:04:57.168 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.164+0000 7f6df1573640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:57.169 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.164+0000 7f6df1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:57.169 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.164+0000 7f6df1573640 10 monclient(hunting): my global_id is 30654 2026-02-12T04:04:57.169 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.164+0000 7f6df1573640 1 -- 10.20.193.91:0/2256395484 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6df40b2390 con 0x7f6df41575d0 2026-02-12T04:04:57.169 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.164+0000 7f6df1573640 1 -- 10.20.193.91:0/2256395484 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4022332408 0 0) 0x7f6df40b2670 con 0x7f6df40560d0 2026-02-12T04:04:57.169 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.164+0000 7f6df1573640 10 monclient(hunting): _negotiate 2026-02-12T04:04:57.169 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.164+0000 7f6df1573640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:57.169 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.164+0000 7f6df1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:57.169 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.164+0000 7f6df1573640 10 monclient(hunting): my global_id is 27488 2026-02-12T04:04:57.169 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.164+0000 7f6df1573640 1 -- 10.20.193.91:0/2256395484 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6df40b20b0 con 0x7f6df40560d0 2026-02-12T04:04:57.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.165+0000 7f6df1573640 1 -- 10.20.193.91:0/2256395484 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2281422471 0 0) 0x7f6de0003610 con 0x7f6df4163310 2026-02-12T04:04:57.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.165+0000 7f6df1573640 1 -- 10.20.193.91:0/2256395484 >> v1:10.20.193.111:6789/0 conn(0x7f6df40560d0 legacy=0x7f6df41c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:57.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.165+0000 7f6df1573640 1 -- 10.20.193.91:0/2256395484 >> v1:10.20.193.91:6789/0 conn(0x7f6df41575d0 legacy=0x7f6df4162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:57.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.165+0000 7f6df1573640 10 monclient: _finish_hunting 0 2026-02-12T04:04:57.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.165+0000 7f6df1573640 1 monclient: found mon.noname-b 2026-02-12T04:04:57.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.165+0000 7f6df1573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:57.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.165+0000 7f6df1573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T04:04:57.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.165+0000 7f6df1573640 1 -- 10.20.193.91:0/2256395484 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df4162400 con 0x7f6df4163310 2026-02-12T04:04:57.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.165+0000 7f6df1573640 10 monclient: _finish_auth 0 2026-02-12T04:04:57.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.165+0000 7f6df1573640 10 monclient: _check_auth_tickets 2026-02-12T04:04:57.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.165+0000 7f6df1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:57.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.165+0000 7f6df1573640 1 -- 10.20.193.91:0/2256395484 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f6ddc002df0 con 0x7f6df4163310 2026-02-12T04:04:57.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.165+0000 7f6df1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:57.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.165+0000 7f6df1573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T04:04:57.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.165+0000 7f6df1573640 10 monclient: dump: 2026-02-12T04:04:57.176 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:57.176 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:57.176 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.176 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.176 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:57.177 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:57.177 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:57.177 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:57.177 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:57.177 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.177 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.165+0000 7f6df8ef3640 5 monclient: authenticate success, global_id 27793 2026-02-12T04:04:57.177 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.165+0000 7f6df8ef3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:04:57.177 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.166+0000 7f6df1573640 1 -- 10.20.193.91:0/2256395484 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6ddc002fc0 con 0x7f6df4163310 2026-02-12T04:04:57.177 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.166+0000 7f6df1573640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:57.177 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.166+0000 7f6df1573640 1 -- 10.20.193.91:0/2256395484 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f6ddc003400 con 0x7f6df4163310 2026-02-12T04:04:57.177 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.166+0000 7f6df1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:57.177 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.166+0000 7f6df1573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T04:04:57.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.166+0000 7f6df1573640 10 monclient: dump: 2026-02-12T04:04:57.178 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:57.178 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:57.178 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.178 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.178 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:57.178 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:57.178 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:57.178 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:57.178 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:57.178 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.166+0000 7f6df8ef3640 10 monclient: get_monmap_and_config success 2026-02-12T04:04:57.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.166+0000 7f6df8ef3640 4 set_mon_vals no callback set 2026-02-12T04:04:57.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.167+0000 7f6df8ef3640 10 monclient: shutdown 2026-02-12T04:04:57.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.167+0000 7f6df8ef3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:57.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.167+0000 7f6df8ef3640 1 -- 10.20.193.91:0/2256395484 >> v1:10.20.193.98:6789/0 conn(0x7f6df4163310 legacy=0x7f6df40559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:57.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.167+0000 7f6df8ef3640 1 -- 10.20.193.91:0/2256395484 shutdown_connections 2026-02-12T04:04:57.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.167+0000 7f6df8ef3640 1 -- 10.20.193.91:0/2256395484 >> 10.20.193.91:0/2256395484 conn(0x7f6df40b6560 msgr2=0x7f6df40b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:57.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.167+0000 7f6df8ef3640 1 -- 10.20.193.91:0/2256395484 shutdown_connections 2026-02-12T04:04:57.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.167+0000 7f6df8ef3640 1 -- 10.20.193.91:0/2256395484 wait complete. 2026-02-12T04:04:57.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.167+0000 7f6df8ef3640 10 monclient: build_initial_monmap 2026-02-12T04:04:57.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.167+0000 7f6df8ef3640 10 monclient: monmap: 2026-02-12T04:04:57.179 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:57.179 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:04:57.179 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:04:57.180 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:04:57.180 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:57.180 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:04:57.180 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:57.180 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:57.180 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:57.180 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.167+0000 7f6df8ef3640 1 librados: starting msgr at 2026-02-12T04:04:57.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.167+0000 7f6df8ef3640 1 librados: starting objecter 2026-02-12T04:04:57.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.167+0000 7f6df8ef3640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:04:57.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.167+0000 7f6df8ef3640 1 Processor -- start 2026-02-12T04:04:57.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.167+0000 7f6df8ef3640 1 -- start start 2026-02-12T04:04:57.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.167+0000 7f6df8ef3640 1 librados: setting wanted keys 2026-02-12T04:04:57.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.167+0000 7f6df8ef3640 1 librados: calling monclient init 2026-02-12T04:04:57.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.167+0000 7f6df8ef3640 10 monclient: init 2026-02-12T04:04:57.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.168+0000 7f6df8ef3640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:57.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.168+0000 7f6df8ef3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T04:04:57.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.168+0000 7f6df8ef3640 10 monclient(hunting): picked mon.noname-c con 0x7f6df40560d0 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:57.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.168+0000 7f6df8ef3640 10 monclient(hunting): picked mon.noname-a con 0x7f6df41575d0 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:57.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.168+0000 7f6df8ef3640 10 monclient(hunting): picked mon.noname-b con 0x7f6df4163310 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:57.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.168+0000 7f6df8ef3640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6df4155770 con 0x7f6df41575d0 2026-02-12T04:04:57.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.168+0000 7f6df8ef3640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6df4057a70 con 0x7f6df4163310 2026-02-12T04:04:57.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.168+0000 7f6df8ef3640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6df4057d50 con 0x7f6df40560d0 2026-02-12T04:04:57.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.168+0000 7f6df8ef3640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:57.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.168+0000 7f6df8ef3640 10 monclient(hunting): authenticate will time out at 1499.911325s 2026-02-12T04:04:57.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.168+0000 7f6df1d74640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f6df41575d0 0x7f6df4155060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:41490/0 (socket says 10.20.193.91:41490) 2026-02-12T04:04:57.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.168+0000 7f6df1d74640 1 -- 10.20.193.91:0/329866399 learned_addr learned my addr 10.20.193.91:0/329866399 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:57.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.168+0000 7f6ddaffd640 10 client.?.objecter ms_handle_connect 0x7f6df41575d0 2026-02-12T04:04:57.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.168+0000 7f6ddaffd640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:57.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.168+0000 7f6ddaffd640 10 client.?.objecter ms_handle_connect 0x7f6df4163310 2026-02-12T04:04:57.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.168+0000 7f6ddaffd640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:57.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.168+0000 7f6ddaffd640 10 client.?.objecter ms_handle_connect 0x7f6df40560d0 2026-02-12T04:04:57.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.168+0000 7f6ddaffd640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:57.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.169+0000 7f6ddaffd640 1 -- 10.20.193.91:0/329866399 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2644498908 0 0) 0x7f6df4155770 con 0x7f6df41575d0 2026-02-12T04:04:57.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.169+0000 7f6ddaffd640 10 monclient(hunting): _negotiate 2026-02-12T04:04:57.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.169+0000 7f6ddaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:57.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.169+0000 7f6ddaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:57.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.169+0000 7f6ddaffd640 10 monclient(hunting): my global_id is 30657 2026-02-12T04:04:57.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.169+0000 7f6ddaffd640 1 -- 10.20.193.91:0/329866399 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6dc0003610 con 0x7f6df41575d0 2026-02-12T04:04:57.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.169+0000 7f6ddaffd640 1 -- 10.20.193.91:0/329866399 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2383553759 0 0) 0x7f6df4057a70 con 0x7f6df4163310 2026-02-12T04:04:57.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.169+0000 7f6ddaffd640 10 monclient(hunting): _negotiate 2026-02-12T04:04:57.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.169+0000 7f6ddaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:57.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.169+0000 7f6ddaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:57.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.169+0000 7f6ddaffd640 10 monclient(hunting): my global_id is 27796 2026-02-12T04:04:57.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.169+0000 7f6ddaffd640 1 -- 10.20.193.91:0/329866399 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6df4155770 con 0x7f6df4163310 2026-02-12T04:04:57.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.170+0000 7f6ddaffd640 1 -- 10.20.193.91:0/329866399 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2571190234 0 0) 0x7f6df4057d50 con 0x7f6df40560d0 2026-02-12T04:04:57.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.170+0000 7f6ddaffd640 10 monclient(hunting): _negotiate 2026-02-12T04:04:57.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.170+0000 7f6ddaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:57.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.170+0000 7f6ddaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:57.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.170+0000 7f6ddaffd640 10 monclient(hunting): my global_id is 27491 2026-02-12T04:04:57.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.170+0000 7f6ddaffd640 1 -- 10.20.193.91:0/329866399 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6df4057a70 con 0x7f6df40560d0 2026-02-12T04:04:57.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.172+0000 7f6ddaffd640 1 -- 10.20.193.91:0/329866399 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1412212365 0 0) 0x7f6dc0003610 con 0x7f6df41575d0 2026-02-12T04:04:57.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.172+0000 7f6ddaffd640 1 -- 10.20.193.91:0/329866399 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6df4057d50 con 0x7f6df41575d0 2026-02-12T04:04:57.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.172+0000 7f6ddaffd640 1 -- 10.20.193.91:0/329866399 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f6ddc003310 con 0x7f6df41575d0 2026-02-12T04:04:57.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.172+0000 7f6ddaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:57.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.172+0000 7f6ddaffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T04:04:57.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.172+0000 7f6ddaffd640 10 monclient(hunting): dump: 2026-02-12T04:04:57.184 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:57.184 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:57.184 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.184 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.185 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:57.185 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:57.185 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:57.185 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:57.185 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:57.185 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.172+0000 7f6ddaffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:04:57.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.172+0000 7f6ddaffd640 1 -- 10.20.193.91:0/329866399 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 717269695 0 0) 0x7f6df4155770 con 0x7f6df4163310 2026-02-12T04:04:57.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.172+0000 7f6ddaffd640 1 -- 10.20.193.91:0/329866399 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6dc0003610 con 0x7f6df4163310 2026-02-12T04:04:57.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.172+0000 7f6ddaffd640 1 -- 10.20.193.91:0/329866399 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f6de4003410 con 0x7f6df4163310 2026-02-12T04:04:57.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.172+0000 7f6ddaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:57.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.172+0000 7f6ddaffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T04:04:57.186 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.172+0000 7f6ddaffd640 10 monclient(hunting): dump: 2026-02-12T04:04:57.186 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:57.186 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:57.186 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.186 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.186 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:57.186 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:57.186 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:57.186 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:57.186 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:57.186 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.186 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.172+0000 7f6ddaffd640 1 -- 10.20.193.91:0/329866399 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3883549610 0 0) 0x7f6df4057a70 con 0x7f6df40560d0 2026-02-12T04:04:57.187 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.172+0000 7f6ddaffd640 1 -- 10.20.193.91:0/329866399 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6df4155770 con 0x7f6df40560d0 2026-02-12T04:04:57.187 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.172+0000 7f6ddaffd640 1 -- 10.20.193.91:0/329866399 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f6de8003070 con 0x7f6df40560d0 2026-02-12T04:04:57.187 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.172+0000 7f6ddaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:57.187 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.172+0000 7f6ddaffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T04:04:57.187 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.172+0000 7f6ddaffd640 10 monclient(hunting): dump: 2026-02-12T04:04:57.187 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:57.187 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:57.187 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.187 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.187 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:57.187 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:57.187 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:57.187 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:57.188 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:57.188 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.190 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.173+0000 7f6ddaffd640 1 -- 10.20.193.91:0/329866399 <== mon.1 v1:10.20.193.98:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3759730878 0 0) 0x7f6dc0003610 con 0x7f6df4163310 2026-02-12T04:04:57.190 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.173+0000 7f6ddaffd640 1 -- 10.20.193.91:0/329866399 >> v1:10.20.193.111:6789/0 conn(0x7f6df40560d0 legacy=0x7f6df4058b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:57.191 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.173+0000 7f6ddaffd640 1 -- 10.20.193.91:0/329866399 >> v1:10.20.193.91:6789/0 conn(0x7f6df41575d0 legacy=0x7f6df4155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:57.191 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.173+0000 7f6ddaffd640 10 monclient: _finish_hunting 0 2026-02-12T04:04:57.191 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.173+0000 7f6ddaffd640 1 monclient: found mon.b 2026-02-12T04:04:57.191 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.173+0000 7f6ddaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:57.191 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.173+0000 7f6ddaffd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:04:57.191 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.173+0000 7f6ddaffd640 1 -- 10.20.193.91:0/329866399 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df4058030 con 0x7f6df4163310 2026-02-12T04:04:57.191 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.173+0000 7f6ddaffd640 10 monclient: _finish_auth 0 2026-02-12T04:04:57.191 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.173+0000 7f6ddaffd640 10 monclient: _check_auth_tickets 2026-02-12T04:04:57.191 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.173+0000 7f6ddaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:57.191 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.173+0000 7f6df8ef3640 5 monclient: authenticate success, global_id 27796 2026-02-12T04:04:57.191 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.173+0000 7f6df8ef3640 10 monclient: _renew_subs 2026-02-12T04:04:57.191 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.173+0000 7f6df8ef3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:04:57.191 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.173+0000 7f6df8ef3640 1 -- 10.20.193.91:0/329866399 --> v1:10.20.193.98:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6df4058310 con 0x7f6df4163310 2026-02-12T04:04:57.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.173+0000 7f6df8ef3640 10 client.27796.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:04:57.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.173+0000 7f6df8ef3640 10 monclient: _renew_subs 2026-02-12T04:04:57.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.173+0000 7f6df8ef3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:04:57.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.173+0000 7f6df8ef3640 1 -- 10.20.193.91:0/329866399 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6df41fd0e0 con 0x7f6df4163310 2026-02-12T04:04:57.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.173+0000 7f6df8ef3640 1 librados: init done 2026-02-12T04:04:57.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.174+0000 7f6df8ef3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:57.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.174+0000 7f6df8ef3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:57.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.174+0000 7f6df8ef3640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:04:57.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.174+0000 7f6df8ef3640 1 -- 10.20.193.91:0/329866399 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6df4051de0 con 0x7f6df4163310 2026-02-12T04:04:57.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.181+0000 7f6ddaffd640 1 -- 10.20.193.91:0/329866399 <== mon.1 v1:10.20.193.98:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6de4003a80 con 0x7f6df4163310 2026-02-12T04:04:57.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.181+0000 7f6ddaffd640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:57.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.181+0000 7f6ddaffd640 1 -- 10.20.193.91:0/329866399 <== mon.1 v1:10.20.193.98:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f6de4003dd0 con 0x7f6df4163310 2026-02-12T04:04:57.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.181+0000 7f6ddaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:57.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.181+0000 7f6ddaffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T04:04:57.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.181+0000 7f6df0d72640 4 set_mon_vals no callback set 2026-02-12T04:04:57.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.181+0000 7f6ddaffd640 10 monclient: dump: 2026-02-12T04:04:57.193 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:57.193 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:57.193 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.193 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.193 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:57.193 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:57.193 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:57.193 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:57.193 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:57.193 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.182+0000 7f6ddaffd640 1 -- 10.20.193.91:0/329866399 <== mon.1 v1:10.20.193.98:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f6de401d2b0 con 0x7f6df4163310 2026-02-12T04:04:57.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.183+0000 7f6df2575640 10 monclient: get_auth_request con 0x7f6dc007a190 auth_method 0 2026-02-12T04:04:57.194 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.183+0000 7f6ddaffd640 10 client.27796.objecter ms_handle_connect 0x7f6dc007a190 2026-02-12T04:04:57.194 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.183+0000 7f6ddaffd640 1 -- 10.20.193.91:0/329866399 <== mon.1 v1:10.20.193.98:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7f6de4094a40 con 0x7f6df4163310 2026-02-12T04:04:57.194 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.183+0000 7f6ddaffd640 10 client.27796.objecter ms_dispatch2 0x7f6df4000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:04:57.194 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.183+0000 7f6ddaffd640 3 client.27796.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:04:57.194 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.183+0000 7f6ddaffd640 3 client.27796.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:04:57.194 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.183+0000 7f6ddaffd640 20 client.27796.objecter dump_active .. 0 homeless 2026-02-12T04:04:57.273 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.271+0000 7f6ddaffd640 1 -- 10.20.193.91:0/329866399 <== mon.1 v1:10.20.193.98:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f6df4051de0 con 0x7f6df4163310 2026-02-12T04:04:57.273 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.271+0000 7f6ddaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:57.273 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.271+0000 7f6ddaffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T04:04:57.378 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.376+0000 7f6df8ef3640 1 -- 10.20.193.91:0/329866399 --> v1:10.20.193.91:6800/2929217192 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "8", "target": ["mon-mgr", ""]}) -- 0x7f6df40577d0 con 0x7f6dc007a190 2026-02-12T04:04:57.379 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.377+0000 7f6ddaffd640 1 -- 10.20.193.91:0/329866399 <== mgr.4113 v1:10.20.193.91:6800/2929217192 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 8 to deep-scrub) ==== 41+0+0 (unknown 1222854447 0 0) 0x7f6df40577d0 con 0x7f6dc007a190 2026-02-12T04:04:57.379 INFO:teuthology.orchestra.run.trial091.stderr:instructed osd(s) 8 to deep-scrub 2026-02-12T04:04:57.381 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.378+0000 7f6df8ef3640 10 librados: watch_flush enter 2026-02-12T04:04:57.381 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.378+0000 7f6df8ef3640 10 librados: watch_flush exit 2026-02-12T04:04:57.381 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.378+0000 7f6df8ef3640 20 client.27796.objecter shutdown clearing up homeless session... 2026-02-12T04:04:57.381 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.378+0000 7f6df8ef3640 10 client.27796.objecter successfully canceled tick 2026-02-12T04:04:57.381 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.378+0000 7f6df8ef3640 1 -- 10.20.193.91:0/329866399 >> v1:10.20.193.91:6800/2929217192 conn(0x7f6dc007a190 legacy=0x7f6dc009a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:57.381 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.378+0000 7f6df8ef3640 10 monclient: shutdown 2026-02-12T04:04:57.381 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.378+0000 7f6df8ef3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:57.381 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.378+0000 7f6df8ef3640 1 -- 10.20.193.91:0/329866399 >> v1:10.20.193.98:6789/0 conn(0x7f6df4163310 legacy=0x7f6df41f53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:57.382 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.378+0000 7f6df8ef3640 1 -- 10.20.193.91:0/329866399 shutdown_connections 2026-02-12T04:04:57.382 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.378+0000 7f6df8ef3640 1 -- 10.20.193.91:0/329866399 >> 10.20.193.91:0/329866399 conn(0x7f6df40b6560 msgr2=0x7f6df4056f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:57.382 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.378+0000 7f6df8ef3640 1 -- 10.20.193.91:0/329866399 shutdown_connections 2026-02-12T04:04:57.382 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.378+0000 7f6df8ef3640 1 -- 10.20.193.91:0/329866399 wait complete. 2026-02-12T04:04:57.382 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.378+0000 7f6df8ef3640 1 librados: shutdown 2026-02-12T04:04:57.388 INFO:tasks.ceph:Scrubbing osd.12 2026-02-12T04:04:57.389 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.12 config set osd_debug_deep_scrub_sleep 0 2026-02-12T04:04:57.459 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.458+0000 7fc4696e0640 10 monclient: get_monmap_and_config 2026-02-12T04:04:57.460 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.458+0000 7fc4696e0640 10 monclient: build_initial_monmap 2026-02-12T04:04:57.460 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.458+0000 7fc4696e0640 10 monclient: monmap: 2026-02-12T04:04:57.460 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:57.460 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:57.460 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:04:57.458610+0000 2026-02-12T04:04:57.460 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:04:57.458610+0000 2026-02-12T04:04:57.460 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:57.460 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:57.460 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:57.460 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:57.460 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:57.461 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.463 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.458+0000 7fc4696e0640 1 Processor -- start 2026-02-12T04:04:57.463 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.458+0000 7fc4696e0640 1 -- start start 2026-02-12T04:04:57.464 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.458+0000 7fc4696e0640 10 monclient: init 2026-02-12T04:04:57.464 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.459+0000 7fc4696e0640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:57.464 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.459+0000 7fc4696e0640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T04:04:57.464 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.459+0000 7fc4696e0640 10 monclient(hunting): picked mon.noname-c con 0x7fc464055c30 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:57.464 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.459+0000 7fc4696e0640 10 monclient(hunting): picked mon.noname-b con 0x7fc464160f80 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:57.464 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.459+0000 7fc4696e0640 10 monclient(hunting): picked mon.noname-a con 0x7fc464163230 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:57.464 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.459+0000 7fc4696e0640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4640b1fc0 con 0x7fc464163230 2026-02-12T04:04:57.464 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.459+0000 7fc4696e0640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4640b22a0 con 0x7fc464160f80 2026-02-12T04:04:57.464 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.459+0000 7fc4696e0640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4640b2580 con 0x7fc464055c30 2026-02-12T04:04:57.464 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.459+0000 7fc4696e0640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:57.464 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.459+0000 7fc4696e0640 10 monclient(hunting): authenticate will time out at 1500.202112s 2026-02-12T04:04:57.464 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.459+0000 7fc462ffd640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7fc464055c30 0x7fc464162b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:44260/0 (socket says 10.20.193.91:44260) 2026-02-12T04:04:57.465 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.459+0000 7fc462ffd640 1 -- 10.20.193.91:0/427858898 learned_addr learned my addr 10.20.193.91:0/427858898 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:57.465 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.460+0000 7fc461ffb640 1 -- 10.20.193.91:0/427858898 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2258811600 0 0) 0x7fc4640b22a0 con 0x7fc464160f80 2026-02-12T04:04:57.465 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.460+0000 7fc461ffb640 10 monclient(hunting): _negotiate 2026-02-12T04:04:57.465 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.460+0000 7fc461ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:57.465 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.460+0000 7fc461ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:57.465 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.460+0000 7fc461ffb640 10 monclient(hunting): my global_id is 27799 2026-02-12T04:04:57.465 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.460+0000 7fc461ffb640 1 -- 10.20.193.91:0/427858898 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc450003610 con 0x7fc464160f80 2026-02-12T04:04:57.465 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.460+0000 7fc461ffb640 1 -- 10.20.193.91:0/427858898 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1966352292 0 0) 0x7fc4640b2580 con 0x7fc464055c30 2026-02-12T04:04:57.465 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.460+0000 7fc461ffb640 10 monclient(hunting): _negotiate 2026-02-12T04:04:57.465 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.460+0000 7fc461ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:57.466 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.460+0000 7fc461ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:57.466 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.460+0000 7fc461ffb640 10 monclient(hunting): my global_id is 27494 2026-02-12T04:04:57.466 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.460+0000 7fc461ffb640 1 -- 10.20.193.91:0/427858898 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4640b22a0 con 0x7fc464055c30 2026-02-12T04:04:57.466 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.461+0000 7fc461ffb640 1 -- 10.20.193.91:0/427858898 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3851602745 0 0) 0x7fc4640b1fc0 con 0x7fc464163230 2026-02-12T04:04:57.466 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.461+0000 7fc461ffb640 10 monclient(hunting): _negotiate 2026-02-12T04:04:57.466 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.461+0000 7fc461ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:57.466 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.461+0000 7fc461ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:57.466 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.461+0000 7fc461ffb640 10 monclient(hunting): my global_id is 30660 2026-02-12T04:04:57.466 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.461+0000 7fc461ffb640 1 -- 10.20.193.91:0/427858898 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4640b2580 con 0x7fc464163230 2026-02-12T04:04:57.473 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.462+0000 7fc461ffb640 1 -- 10.20.193.91:0/427858898 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3065399765 0 0) 0x7fc450003610 con 0x7fc464160f80 2026-02-12T04:04:57.474 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.462+0000 7fc461ffb640 1 -- 10.20.193.91:0/427858898 >> v1:10.20.193.111:6789/0 conn(0x7fc464055c30 legacy=0x7fc464162b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:57.474 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.462+0000 7fc461ffb640 1 -- 10.20.193.91:0/427858898 >> v1:10.20.193.91:6789/0 conn(0x7fc464163230 legacy=0x7fc4641c57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:57.474 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.462+0000 7fc461ffb640 10 monclient: _finish_hunting 0 2026-02-12T04:04:57.474 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.462+0000 7fc461ffb640 1 monclient: found mon.noname-b 2026-02-12T04:04:57.474 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.462+0000 7fc461ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:57.474 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.462+0000 7fc461ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T04:04:57.474 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.462+0000 7fc461ffb640 1 -- 10.20.193.91:0/427858898 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4640b2860 con 0x7fc464160f80 2026-02-12T04:04:57.474 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.462+0000 7fc461ffb640 10 monclient: _finish_auth 0 2026-02-12T04:04:57.474 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.462+0000 7fc461ffb640 10 monclient: _check_auth_tickets 2026-02-12T04:04:57.474 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.462+0000 7fc461ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:57.474 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.462+0000 7fc4696e0640 5 monclient: authenticate success, global_id 27799 2026-02-12T04:04:57.475 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.462+0000 7fc4696e0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:04:57.475 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.462+0000 7fc461ffb640 1 -- 10.20.193.91:0/427858898 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fc44c002df0 con 0x7fc464160f80 2026-02-12T04:04:57.475 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.462+0000 7fc461ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:57.475 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.462+0000 7fc461ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T04:04:57.475 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.462+0000 7fc461ffb640 10 monclient: dump: 2026-02-12T04:04:57.475 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:57.475 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:57.475 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.475 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.475 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:57.475 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:57.475 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:57.476 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:57.476 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:57.476 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.476 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.462+0000 7fc4696e0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:04:57.476 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.463+0000 7fc461ffb640 1 -- 10.20.193.91:0/427858898 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc44c003040 con 0x7fc464160f80 2026-02-12T04:04:57.476 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.463+0000 7fc461ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:57.476 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.463+0000 7fc461ffb640 1 -- 10.20.193.91:0/427858898 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fc44c003440 con 0x7fc464160f80 2026-02-12T04:04:57.476 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.463+0000 7fc4696e0640 10 monclient: get_monmap_and_config success 2026-02-12T04:04:57.476 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.463+0000 7fc4696e0640 4 set_mon_vals no callback set 2026-02-12T04:04:57.476 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.463+0000 7fc461ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:57.476 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.463+0000 7fc461ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T04:04:57.476 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.463+0000 7fc461ffb640 10 monclient: dump: 2026-02-12T04:04:57.477 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:57.477 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:57.477 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.477 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.477 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:57.477 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:57.477 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:57.477 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:57.477 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:57.477 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.477 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.463+0000 7fc4696e0640 10 monclient: shutdown 2026-02-12T04:04:57.478 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.463+0000 7fc4696e0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:57.478 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.463+0000 7fc4696e0640 1 -- 10.20.193.91:0/427858898 >> v1:10.20.193.98:6789/0 conn(0x7fc464160f80 legacy=0x7fc4641572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:57.478 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.463+0000 7fc4696e0640 1 -- 10.20.193.91:0/427858898 shutdown_connections 2026-02-12T04:04:57.478 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.463+0000 7fc4696e0640 1 -- 10.20.193.91:0/427858898 >> 10.20.193.91:0/427858898 conn(0x7fc4640b6560 msgr2=0x7fc4640b6930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:57.478 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.463+0000 7fc4696e0640 1 -- 10.20.193.91:0/427858898 shutdown_connections 2026-02-12T04:04:57.478 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.463+0000 7fc4696e0640 1 -- 10.20.193.91:0/427858898 wait complete. 2026-02-12T04:04:57.478 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.464+0000 7fc4696e0640 10 monclient: build_initial_monmap 2026-02-12T04:04:57.478 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.464+0000 7fc4696e0640 10 monclient: monmap: 2026-02-12T04:04:57.478 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:57.478 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:04:57.478 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:04:57.478 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:04:57.478 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:57.479 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:04:57.479 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:57.479 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:57.479 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:57.479 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.479 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.464+0000 7fc4696e0640 1 librados: starting msgr at 2026-02-12T04:04:57.479 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.464+0000 7fc4696e0640 1 librados: starting objecter 2026-02-12T04:04:57.479 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.464+0000 7fc4696e0640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:04:57.479 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.464+0000 7fc4696e0640 1 Processor -- start 2026-02-12T04:04:57.479 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.464+0000 7fc4696e0640 1 -- start start 2026-02-12T04:04:57.479 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.464+0000 7fc4696e0640 1 librados: setting wanted keys 2026-02-12T04:04:57.479 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.464+0000 7fc4696e0640 1 librados: calling monclient init 2026-02-12T04:04:57.480 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.464+0000 7fc4696e0640 10 monclient: init 2026-02-12T04:04:57.480 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.464+0000 7fc4696e0640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:57.480 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.464+0000 7fc4696e0640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T04:04:57.480 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.464+0000 7fc4696e0640 10 monclient(hunting): picked mon.noname-b con 0x7fc464055c30 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:57.480 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.464+0000 7fc4696e0640 10 monclient(hunting): picked mon.noname-c con 0x7fc464160f80 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:57.480 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.464+0000 7fc4696e0640 10 monclient(hunting): picked mon.noname-a con 0x7fc464163230 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:57.480 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.464+0000 7fc4696e0640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc46405a040 con 0x7fc464163230 2026-02-12T04:04:57.480 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.464+0000 7fc4696e0640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc464142260 con 0x7fc464055c30 2026-02-12T04:04:57.480 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.464+0000 7fc4696e0640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc464142540 con 0x7fc464160f80 2026-02-12T04:04:57.480 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.464+0000 7fc4696e0640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:57.480 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.464+0000 7fc4696e0640 10 monclient(hunting): authenticate will time out at 1500.207936s 2026-02-12T04:04:57.480 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.465+0000 7fc4637fe640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7fc464163230 0x7fc4641444c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:41508/0 (socket says 10.20.193.91:41508) 2026-02-12T04:04:57.481 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.465+0000 7fc4637fe640 1 -- 10.20.193.91:0/3502403608 learned_addr learned my addr 10.20.193.91:0/3502403608 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:57.481 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.465+0000 7fc4437fe640 10 client.?.objecter ms_handle_connect 0x7fc464163230 2026-02-12T04:04:57.481 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.465+0000 7fc4437fe640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:57.481 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.465+0000 7fc4437fe640 10 client.?.objecter ms_handle_connect 0x7fc464160f80 2026-02-12T04:04:57.481 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.465+0000 7fc4437fe640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:57.481 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.465+0000 7fc4437fe640 10 client.?.objecter ms_handle_connect 0x7fc464055c30 2026-02-12T04:04:57.481 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.465+0000 7fc4437fe640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:57.481 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.466+0000 7fc4437fe640 1 -- 10.20.193.91:0/3502403608 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3080294963 0 0) 0x7fc46405a040 con 0x7fc464163230 2026-02-12T04:04:57.481 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.466+0000 7fc4437fe640 10 monclient(hunting): _negotiate 2026-02-12T04:04:57.481 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.466+0000 7fc4437fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:57.481 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.466+0000 7fc4437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:57.481 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.466+0000 7fc4437fe640 10 monclient(hunting): my global_id is 30663 2026-02-12T04:04:57.482 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.466+0000 7fc4437fe640 1 -- 10.20.193.91:0/3502403608 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc430003610 con 0x7fc464163230 2026-02-12T04:04:57.482 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.466+0000 7fc4437fe640 1 -- 10.20.193.91:0/3502403608 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2315203541 0 0) 0x7fc464142540 con 0x7fc464160f80 2026-02-12T04:04:57.482 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.466+0000 7fc4437fe640 10 monclient(hunting): _negotiate 2026-02-12T04:04:57.482 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.466+0000 7fc4437fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:57.482 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.466+0000 7fc4437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:57.482 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.466+0000 7fc4437fe640 10 monclient(hunting): my global_id is 27497 2026-02-12T04:04:57.482 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.466+0000 7fc4437fe640 1 -- 10.20.193.91:0/3502403608 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc46405a040 con 0x7fc464160f80 2026-02-12T04:04:57.482 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.466+0000 7fc4437fe640 1 -- 10.20.193.91:0/3502403608 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1426765358 0 0) 0x7fc464142260 con 0x7fc464055c30 2026-02-12T04:04:57.482 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.466+0000 7fc4437fe640 10 monclient(hunting): _negotiate 2026-02-12T04:04:57.482 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.466+0000 7fc4437fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:57.482 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.466+0000 7fc4437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:57.483 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.466+0000 7fc4437fe640 10 monclient(hunting): my global_id is 27802 2026-02-12T04:04:57.483 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.466+0000 7fc4437fe640 1 -- 10.20.193.91:0/3502403608 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc464142540 con 0x7fc464055c30 2026-02-12T04:04:57.483 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.468+0000 7fc4437fe640 1 -- 10.20.193.91:0/3502403608 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4056355269 0 0) 0x7fc46405a040 con 0x7fc464160f80 2026-02-12T04:04:57.483 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.468+0000 7fc4437fe640 1 -- 10.20.193.91:0/3502403608 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc464142260 con 0x7fc464160f80 2026-02-12T04:04:57.483 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.468+0000 7fc4437fe640 1 -- 10.20.193.91:0/3502403608 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fc44c003390 con 0x7fc464160f80 2026-02-12T04:04:57.483 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.468+0000 7fc4437fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:57.483 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.468+0000 7fc4437fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T04:04:57.483 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.468+0000 7fc4437fe640 10 monclient(hunting): dump: 2026-02-12T04:04:57.483 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:57.483 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:57.483 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.483 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.483 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:57.484 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:57.484 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:57.484 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:57.484 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:57.484 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.484 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.468+0000 7fc4437fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:04:57.484 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.468+0000 7fc4437fe640 1 -- 10.20.193.91:0/3502403608 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3438312918 0 0) 0x7fc430003610 con 0x7fc464163230 2026-02-12T04:04:57.484 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.468+0000 7fc4437fe640 1 -- 10.20.193.91:0/3502403608 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc46405a040 con 0x7fc464163230 2026-02-12T04:04:57.484 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.468+0000 7fc4437fe640 1 -- 10.20.193.91:0/3502403608 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fc454003390 con 0x7fc464163230 2026-02-12T04:04:57.484 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.468+0000 7fc4437fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:57.484 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.468+0000 7fc4437fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T04:04:57.484 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.468+0000 7fc4437fe640 10 monclient(hunting): dump: 2026-02-12T04:04:57.485 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:57.485 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:57.485 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.485 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.485 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:57.485 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:57.485 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:57.485 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:57.485 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:57.485 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.485 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.469+0000 7fc4437fe640 1 -- 10.20.193.91:0/3502403608 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3298089007 0 0) 0x7fc464142540 con 0x7fc464055c30 2026-02-12T04:04:57.485 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.469+0000 7fc4437fe640 1 -- 10.20.193.91:0/3502403608 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc430003610 con 0x7fc464055c30 2026-02-12T04:04:57.486 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.469+0000 7fc4437fe640 1 -- 10.20.193.91:0/3502403608 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fc4580030b0 con 0x7fc464055c30 2026-02-12T04:04:57.486 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.469+0000 7fc4437fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:57.486 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.469+0000 7fc4437fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T04:04:57.486 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.469+0000 7fc4437fe640 10 monclient(hunting): dump: 2026-02-12T04:04:57.486 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:57.486 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:57.486 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.486 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.486 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:57.486 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:57.486 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:57.486 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:57.487 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:57.487 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.487 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.470+0000 7fc4437fe640 1 -- 10.20.193.91:0/3502403608 <== mon.2 v1:10.20.193.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3542435818 0 0) 0x7fc464142260 con 0x7fc464160f80 2026-02-12T04:04:57.487 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.470+0000 7fc4437fe640 1 -- 10.20.193.91:0/3502403608 >> v1:10.20.193.98:6789/0 conn(0x7fc464055c30 legacy=0x7fc464059700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:57.487 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.470+0000 7fc4437fe640 1 -- 10.20.193.91:0/3502403608 >> v1:10.20.193.91:6789/0 conn(0x7fc464163230 legacy=0x7fc4641444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:57.487 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.470+0000 7fc4437fe640 10 monclient: _finish_hunting 0 2026-02-12T04:04:57.487 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.470+0000 7fc4437fe640 1 monclient: found mon.c 2026-02-12T04:04:57.487 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.470+0000 7fc4437fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:57.487 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.470+0000 7fc4437fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:04:57.487 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.470+0000 7fc4437fe640 1 -- 10.20.193.91:0/3502403608 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc464142820 con 0x7fc464160f80 2026-02-12T04:04:57.487 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.470+0000 7fc4437fe640 10 monclient: _finish_auth 0 2026-02-12T04:04:57.487 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.470+0000 7fc4437fe640 10 monclient: _check_auth_tickets 2026-02-12T04:04:57.487 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.470+0000 7fc4437fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:57.488 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.470+0000 7fc4696e0640 5 monclient: authenticate success, global_id 27497 2026-02-12T04:04:57.488 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.470+0000 7fc4696e0640 10 monclient: _renew_subs 2026-02-12T04:04:57.488 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.470+0000 7fc4696e0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:04:57.488 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.470+0000 7fc4696e0640 1 -- 10.20.193.91:0/3502403608 --> v1:10.20.193.111:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc464142b00 con 0x7fc464160f80 2026-02-12T04:04:57.488 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.470+0000 7fc4696e0640 10 client.27497.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:04:57.488 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.470+0000 7fc4696e0640 10 monclient: _renew_subs 2026-02-12T04:04:57.488 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.470+0000 7fc4696e0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:04:57.488 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.470+0000 7fc4696e0640 1 -- 10.20.193.91:0/3502403608 --> v1:10.20.193.111:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc464143a10 con 0x7fc464160f80 2026-02-12T04:04:57.488 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.470+0000 7fc4696e0640 1 librados: init done 2026-02-12T04:04:57.488 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.470+0000 7fc4696e0640 10 client.27497.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:57.488 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.470+0000 7fc4696e0640 15 client.27497.objecter _session_command_op_assign -1 1 2026-02-12T04:04:57.488 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.470+0000 7fc4696e0640 20 client.27497.objecter _get_session osd=-1 returning homeless 2026-02-12T04:04:57.488 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.470+0000 7fc4696e0640 10 client.27497.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:04:57.489 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.470+0000 7fc4696e0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:04:57.489 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.470+0000 7fc4696e0640 1 -- 10.20.193.91:0/3502403608 --> v1:10.20.193.111:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fc4640b0990 con 0x7fc464160f80 2026-02-12T04:04:57.491 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.479+0000 7fc4437fe640 1 -- 10.20.193.91:0/3502403608 <== mon.2 v1:10.20.193.111:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc4640b0990 con 0x7fc464160f80 2026-02-12T04:04:57.491 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.479+0000 7fc4437fe640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:57.491 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.479+0000 7fc4437fe640 1 -- 10.20.193.91:0/3502403608 <== mon.2 v1:10.20.193.111:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fc44c0028f0 con 0x7fc464160f80 2026-02-12T04:04:57.491 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.479+0000 7fc4437fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:57.491 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.479+0000 7fc4437fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T04:04:57.491 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.479+0000 7fc4617fa640 4 set_mon_vals no callback set 2026-02-12T04:04:57.491 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.479+0000 7fc4437fe640 10 monclient: dump: 2026-02-12T04:04:57.491 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:57.491 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:57.492 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.492 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.492 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:57.492 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:57.492 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:57.492 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:57.492 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:57.492 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.492 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.480+0000 7fc4437fe640 1 -- 10.20.193.91:0/3502403608 <== mon.2 v1:10.20.193.111:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7fc44c01cd90 con 0x7fc464160f80 2026-02-12T04:04:57.492 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.480+0000 7fc462ffd640 10 monclient: get_auth_request con 0x7fc43007a0f0 auth_method 0 2026-02-12T04:04:57.492 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.480+0000 7fc4437fe640 10 client.27497.objecter ms_handle_connect 0x7fc43007a0f0 2026-02-12T04:04:57.492 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.481+0000 7fc4437fe640 1 -- 10.20.193.91:0/3502403608 <== mon.2 v1:10.20.193.111:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7fc44c094670 con 0x7fc464160f80 2026-02-12T04:04:57.492 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.481+0000 7fc4437fe640 10 client.27497.objecter ms_dispatch2 0x7fc464000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:04:57.492 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.481+0000 7fc4437fe640 3 client.27497.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:04:57.493 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.481+0000 7fc4437fe640 3 client.27497.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:04:57.493 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.481+0000 7fc4437fe640 10 client.27497.objecter checking command 1 2026-02-12T04:04:57.493 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.481+0000 7fc4437fe640 20 client.27497.objecter _get_session s=0x7fc4300a43a0 osd=12 3 2026-02-12T04:04:57.493 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.481+0000 7fc4437fe640 20 client.27497.objecter put_session s=0x7fc4300a43a0 osd=12 3 2026-02-12T04:04:57.493 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.481+0000 7fc4437fe640 15 client.27497.objecter _session_command_op_remove -1 1 2026-02-12T04:04:57.493 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.481+0000 7fc4437fe640 20 client.27497.objecter _get_session s=0x7fc4300a43a0 osd=12 3 2026-02-12T04:04:57.493 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.481+0000 7fc4437fe640 20 client.27497.objecter get_session s=0x7fc4300a43a0 osd=12 3 2026-02-12T04:04:57.493 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.481+0000 7fc4437fe640 15 client.27497.objecter _session_command_op_assign 12 1 2026-02-12T04:04:57.493 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.481+0000 7fc4437fe640 20 client.27497.objecter put_session s=0x7fc4300a43a0 osd=12 4 2026-02-12T04:04:57.493 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.481+0000 7fc4437fe640 10 client.27497.objecter _send_command 1 2026-02-12T04:04:57.493 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.481+0000 7fc4437fe640 1 -- 10.20.193.91:0/3502403608 --> v1:10.20.193.91:6813/3587007397 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc4300c66b0 con 0x7fc4300a4a50 2026-02-12T04:04:57.493 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.481+0000 7fc4437fe640 20 client.27497.objecter dump_active .. 0 homeless 2026-02-12T04:04:57.493 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.481+0000 7fc4437fe640 1 -- 10.20.193.91:0/3502403608 <== mon.2 v1:10.20.193.111:6789/0 9 ==== mon_get_version_reply(handle=1 version=344) ==== 24+0+0 (unknown 1403447244 0 0) 0x7fc44c05d6a0 con 0x7fc464160f80 2026-02-12T04:04:57.493 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.481+0000 7fc4437fe640 10 monclient: handle_get_version_reply finishing 1 version 344 2026-02-12T04:04:57.494 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.481+0000 7fc4637fe640 10 monclient: get_auth_request con 0x7fc4300a4a50 auth_method 0 2026-02-12T04:04:57.494 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.482+0000 7fc4437fe640 10 client.27497.objecter ms_handle_connect 0x7fc4300a4a50 2026-02-12T04:04:57.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.493+0000 7fc4437fe640 1 -- 10.20.193.91:0/3502403608 <== osd.12 v1:10.20.193.91:6813/3587007397 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fc4300c66b0 con 0x7fc4300a4a50 2026-02-12T04:04:57.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.493+0000 7fc4437fe640 10 client.27497.objecter ms_dispatch2 0x7fc464000b90 command_reply(tid 1: 0 ) 2026-02-12T04:04:57.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.493+0000 7fc4437fe640 10 client.27497.objecter _finish_command 1 = system:0 2026-02-12T04:04:57.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.493+0000 7fc4437fe640 20 client.27497.objecter put_session s=0x7fc4300a43a0 osd=12 4 2026-02-12T04:04:57.495 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.493+0000 7fc4437fe640 15 client.27497.objecter _session_command_op_remove 12 1 2026-02-12T04:04:57.502 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.500+0000 7fc4696e0640 10 client.27497.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-12T04:04:57.502 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.500+0000 7fc4696e0640 15 client.27497.objecter _session_command_op_assign -1 2 2026-02-12T04:04:57.503 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.500+0000 7fc4696e0640 20 client.27497.objecter _get_session s=0x7fc4300a43a0 osd=12 3 2026-02-12T04:04:57.503 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.500+0000 7fc4696e0640 20 client.27497.objecter put_session s=0x7fc4300a43a0 osd=12 3 2026-02-12T04:04:57.503 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.500+0000 7fc4696e0640 20 client.27497.objecter _get_session s=0x7fc4300a43a0 osd=12 3 2026-02-12T04:04:57.503 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.500+0000 7fc4696e0640 15 client.27497.objecter _session_command_op_remove -1 2 2026-02-12T04:04:57.503 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.500+0000 7fc4696e0640 20 client.27497.objecter get_session s=0x7fc4300a43a0 osd=12 3 2026-02-12T04:04:57.503 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.500+0000 7fc4696e0640 15 client.27497.objecter _session_command_op_assign 12 2 2026-02-12T04:04:57.503 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.500+0000 7fc4696e0640 20 client.27497.objecter put_session s=0x7fc4300a43a0 osd=12 4 2026-02-12T04:04:57.503 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.500+0000 7fc4696e0640 10 client.27497.objecter _send_command 2 2026-02-12T04:04:57.503 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.500+0000 7fc4696e0640 1 -- 10.20.193.91:0/3502403608 --> v1:10.20.193.91:6813/3587007397 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc464056970 con 0x7fc4300a4a50 2026-02-12T04:04:57.511 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.509+0000 7fc4437fe640 1 -- 10.20.193.91:0/3502403608 <== osd.12 v1:10.20.193.91:6813/3587007397 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fc464056970 con 0x7fc4300a4a50 2026-02-12T04:04:57.511 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.509+0000 7fc4437fe640 10 client.27497.objecter ms_dispatch2 0x7fc464000b90 command_reply(tid 2: 0 ) 2026-02-12T04:04:57.511 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.509+0000 7fc4437fe640 10 client.27497.objecter _finish_command 2 = system:0 2026-02-12T04:04:57.511 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.509+0000 7fc4437fe640 20 client.27497.objecter put_session s=0x7fc4300a43a0 osd=12 4 2026-02-12T04:04:57.511 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.509+0000 7fc4437fe640 15 client.27497.objecter _session_command_op_remove 12 2 2026-02-12T04:04:57.512 INFO:teuthology.orchestra.run.trial091.stdout:{ 2026-02-12T04:04:57.512 INFO:teuthology.orchestra.run.trial091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-12T04:04:57.512 INFO:teuthology.orchestra.run.trial091.stdout:} 2026-02-12T04:04:57.513 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.509+0000 7fc4696e0640 10 librados: watch_flush enter 2026-02-12T04:04:57.513 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.509+0000 7fc4696e0640 10 librados: watch_flush exit 2026-02-12T04:04:57.513 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.509+0000 7fc4696e0640 10 client.27497.objecter close_session for osd.12 2026-02-12T04:04:57.514 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.509+0000 7fc4696e0640 1 -- 10.20.193.91:0/3502403608 >> v1:10.20.193.91:6813/3587007397 conn(0x7fc4300a4a50 legacy=0x7fc4300c4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:57.514 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.509+0000 7fc4696e0640 20 client.27497.objecter put_session s=0x7fc4300a43a0 osd=12 1 2026-02-12T04:04:57.514 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.509+0000 7fc4696e0640 20 client.27497.objecter shutdown clearing up homeless session... 2026-02-12T04:04:57.514 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.509+0000 7fc4696e0640 10 client.27497.objecter successfully canceled tick 2026-02-12T04:04:57.514 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.509+0000 7fc4696e0640 1 -- 10.20.193.91:0/3502403608 >> v1:10.20.193.91:6800/2929217192 conn(0x7fc43007a0f0 legacy=0x7fc43009a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:57.514 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.509+0000 7fc4696e0640 10 monclient: shutdown 2026-02-12T04:04:57.514 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.509+0000 7fc4696e0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:57.514 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.509+0000 7fc4696e0640 1 -- 10.20.193.91:0/3502403608 >> v1:10.20.193.111:6789/0 conn(0x7fc464160f80 legacy=0x7fc464143300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:57.514 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.509+0000 7fc4637fe640 1 -- 10.20.193.91:0/3502403608 reap_dead start 2026-02-12T04:04:57.514 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.509+0000 7fc4696e0640 1 -- 10.20.193.91:0/3502403608 shutdown_connections 2026-02-12T04:04:57.514 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.509+0000 7fc4696e0640 1 -- 10.20.193.91:0/3502403608 >> 10.20.193.91:0/3502403608 conn(0x7fc4640b6560 msgr2=0x7fc4641614b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:57.515 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.509+0000 7fc4696e0640 1 -- 10.20.193.91:0/3502403608 shutdown_connections 2026-02-12T04:04:57.515 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.509+0000 7fc4696e0640 1 -- 10.20.193.91:0/3502403608 wait complete. 2026-02-12T04:04:57.515 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.509+0000 7fc4696e0640 1 librados: shutdown 2026-02-12T04:04:57.520 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 12 2026-02-12T04:04:57.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.587+0000 7ffbad3cf640 10 monclient: get_monmap_and_config 2026-02-12T04:04:57.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.587+0000 7ffbad3cf640 10 monclient: build_initial_monmap 2026-02-12T04:04:57.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.587+0000 7ffbad3cf640 10 monclient: monmap: 2026-02-12T04:04:57.589 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:57.589 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:57.589 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:04:57.587756+0000 2026-02-12T04:04:57.589 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:04:57.587756+0000 2026-02-12T04:04:57.589 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:57.590 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:57.590 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:57.590 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:57.590 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:57.590 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.592 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.587+0000 7ffbad3cf640 1 Processor -- start 2026-02-12T04:04:57.593 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.587+0000 7ffbad3cf640 1 -- start start 2026-02-12T04:04:57.593 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.587+0000 7ffbad3cf640 10 monclient: init 2026-02-12T04:04:57.593 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.588+0000 7ffbad3cf640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:57.593 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.588+0000 7ffbad3cf640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T04:04:57.593 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.588+0000 7ffbad3cf640 10 monclient(hunting): picked mon.noname-b con 0x7ffba81575d0 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:57.593 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.588+0000 7ffbad3cf640 10 monclient(hunting): picked mon.noname-a con 0x7ffba8163310 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:57.593 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.588+0000 7ffbad3cf640 10 monclient(hunting): picked mon.noname-c con 0x7ffba80560d0 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:57.593 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.588+0000 7ffbad3cf640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffba80b20b0 con 0x7ffba8163310 2026-02-12T04:04:57.593 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.588+0000 7ffbad3cf640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffba80b2390 con 0x7ffba81575d0 2026-02-12T04:04:57.593 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.588+0000 7ffbad3cf640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffba80b2670 con 0x7ffba80560d0 2026-02-12T04:04:57.594 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.588+0000 7ffbad3cf640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:57.594 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.588+0000 7ffbad3cf640 10 monclient(hunting): authenticate will time out at 1500.331239s 2026-02-12T04:04:57.594 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.588+0000 7ffba67fc640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7ffba8163310 0x7ffba80559c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:41516/0 (socket says 10.20.193.91:41516) 2026-02-12T04:04:57.594 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.588+0000 7ffba67fc640 1 -- 10.20.193.91:0/514556140 learned_addr learned my addr 10.20.193.91:0/514556140 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:57.594 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.589+0000 7ffba5ffb640 1 -- 10.20.193.91:0/514556140 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 645640858 0 0) 0x7ffba80b2390 con 0x7ffba81575d0 2026-02-12T04:04:57.594 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.589+0000 7ffba5ffb640 10 monclient(hunting): _negotiate 2026-02-12T04:04:57.594 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.589+0000 7ffba5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:57.594 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.589+0000 7ffba5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:57.594 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.589+0000 7ffba5ffb640 10 monclient(hunting): my global_id is 27805 2026-02-12T04:04:57.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.589+0000 7ffba5ffb640 1 -- 10.20.193.91:0/514556140 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb94003610 con 0x7ffba81575d0 2026-02-12T04:04:57.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.590+0000 7ffba5ffb640 1 -- 10.20.193.91:0/514556140 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3048082061 0 0) 0x7ffba80b20b0 con 0x7ffba8163310 2026-02-12T04:04:57.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.590+0000 7ffba5ffb640 10 monclient(hunting): _negotiate 2026-02-12T04:04:57.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.590+0000 7ffba5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:57.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.590+0000 7ffba5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:57.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.590+0000 7ffba5ffb640 10 monclient(hunting): my global_id is 30666 2026-02-12T04:04:57.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.590+0000 7ffba5ffb640 1 -- 10.20.193.91:0/514556140 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffba80b2390 con 0x7ffba8163310 2026-02-12T04:04:57.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.590+0000 7ffba5ffb640 1 -- 10.20.193.91:0/514556140 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3789489400 0 0) 0x7ffba80b2670 con 0x7ffba80560d0 2026-02-12T04:04:57.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.590+0000 7ffba5ffb640 10 monclient(hunting): _negotiate 2026-02-12T04:04:57.595 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.590+0000 7ffba5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:57.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.590+0000 7ffba5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:57.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.590+0000 7ffba5ffb640 10 monclient(hunting): my global_id is 27500 2026-02-12T04:04:57.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.590+0000 7ffba5ffb640 1 -- 10.20.193.91:0/514556140 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffba80b20b0 con 0x7ffba80560d0 2026-02-12T04:04:57.603 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.591+0000 7ffba5ffb640 1 -- 10.20.193.91:0/514556140 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 644824540 0 0) 0x7ffb94003610 con 0x7ffba81575d0 2026-02-12T04:04:57.603 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.591+0000 7ffba5ffb640 1 -- 10.20.193.91:0/514556140 >> v1:10.20.193.111:6789/0 conn(0x7ffba80560d0 legacy=0x7ffba81c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:57.603 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.591+0000 7ffba5ffb640 1 -- 10.20.193.91:0/514556140 >> v1:10.20.193.91:6789/0 conn(0x7ffba8163310 legacy=0x7ffba80559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:57.603 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.591+0000 7ffba5ffb640 10 monclient: _finish_hunting 0 2026-02-12T04:04:57.603 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.591+0000 7ffba5ffb640 1 monclient: found mon.noname-b 2026-02-12T04:04:57.604 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.591+0000 7ffba5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:57.604 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.591+0000 7ffba5ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T04:04:57.604 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.591+0000 7ffba5ffb640 1 -- 10.20.193.91:0/514556140 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffba8162400 con 0x7ffba81575d0 2026-02-12T04:04:57.604 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.591+0000 7ffba5ffb640 10 monclient: _finish_auth 0 2026-02-12T04:04:57.604 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.591+0000 7ffba5ffb640 10 monclient: _check_auth_tickets 2026-02-12T04:04:57.604 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.591+0000 7ffba5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:57.604 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.591+0000 7ffba5ffb640 1 -- 10.20.193.91:0/514556140 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7ffb9c002df0 con 0x7ffba81575d0 2026-02-12T04:04:57.604 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.591+0000 7ffbad3cf640 5 monclient: authenticate success, global_id 27805 2026-02-12T04:04:57.604 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.591+0000 7ffbad3cf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:04:57.604 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.591+0000 7ffba5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:57.604 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.591+0000 7ffba5ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T04:04:57.604 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.591+0000 7ffba5ffb640 10 monclient: dump: 2026-02-12T04:04:57.605 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:57.605 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:57.605 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.605 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.605 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:57.605 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:57.605 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:57.605 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:57.605 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:57.605 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.591+0000 7ffbad3cf640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:04:57.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.592+0000 7ffba5ffb640 1 -- 10.20.193.91:0/514556140 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffb9c002fc0 con 0x7ffba81575d0 2026-02-12T04:04:57.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.592+0000 7ffba5ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:57.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.592+0000 7ffba5ffb640 1 -- 10.20.193.91:0/514556140 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7ffb9c003400 con 0x7ffba81575d0 2026-02-12T04:04:57.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.592+0000 7ffba5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:57.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.592+0000 7ffba5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T04:04:57.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.592+0000 7ffba5ffb640 10 monclient: dump: 2026-02-12T04:04:57.606 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:57.606 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:57.606 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.606 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.606 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:57.606 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:57.606 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:57.606 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:57.607 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:57.607 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.592+0000 7ffbad3cf640 10 monclient: get_monmap_and_config success 2026-02-12T04:04:57.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.592+0000 7ffbad3cf640 4 set_mon_vals no callback set 2026-02-12T04:04:57.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.592+0000 7ffbad3cf640 10 monclient: shutdown 2026-02-12T04:04:57.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.592+0000 7ffbad3cf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:57.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.592+0000 7ffbad3cf640 1 -- 10.20.193.91:0/514556140 >> v1:10.20.193.98:6789/0 conn(0x7ffba81575d0 legacy=0x7ffba8162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:57.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.592+0000 7ffbad3cf640 1 -- 10.20.193.91:0/514556140 shutdown_connections 2026-02-12T04:04:57.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.592+0000 7ffbad3cf640 1 -- 10.20.193.91:0/514556140 >> 10.20.193.91:0/514556140 conn(0x7ffba80b6560 msgr2=0x7ffba80b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:57.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.592+0000 7ffbad3cf640 1 -- 10.20.193.91:0/514556140 shutdown_connections 2026-02-12T04:04:57.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.592+0000 7ffbad3cf640 1 -- 10.20.193.91:0/514556140 wait complete. 2026-02-12T04:04:57.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.593+0000 7ffbad3cf640 10 monclient: build_initial_monmap 2026-02-12T04:04:57.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.593+0000 7ffbad3cf640 10 monclient: monmap: 2026-02-12T04:04:57.608 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:57.608 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:04:57.608 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:04:57.608 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:04:57.608 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:57.608 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:04:57.608 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:57.608 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:57.608 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:57.608 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.593+0000 7ffbad3cf640 1 librados: starting msgr at 2026-02-12T04:04:57.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.593+0000 7ffbad3cf640 1 librados: starting objecter 2026-02-12T04:04:57.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.593+0000 7ffbad3cf640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:04:57.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.593+0000 7ffbad3cf640 1 Processor -- start 2026-02-12T04:04:57.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.593+0000 7ffbad3cf640 1 -- start start 2026-02-12T04:04:57.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.593+0000 7ffbad3cf640 1 librados: setting wanted keys 2026-02-12T04:04:57.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.593+0000 7ffbad3cf640 1 librados: calling monclient init 2026-02-12T04:04:57.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.593+0000 7ffbad3cf640 10 monclient: init 2026-02-12T04:04:57.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.593+0000 7ffbad3cf640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:57.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.593+0000 7ffbad3cf640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T04:04:57.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.593+0000 7ffbad3cf640 10 monclient(hunting): picked mon.noname-b con 0x7ffba80560d0 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:57.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.593+0000 7ffbad3cf640 10 monclient(hunting): picked mon.noname-c con 0x7ffba81575d0 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:57.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.593+0000 7ffbad3cf640 10 monclient(hunting): picked mon.noname-a con 0x7ffba8163310 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:57.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.593+0000 7ffbad3cf640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffba81192c0 con 0x7ffba8163310 2026-02-12T04:04:57.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.593+0000 7ffbad3cf640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffba8059320 con 0x7ffba80560d0 2026-02-12T04:04:57.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.593+0000 7ffbad3cf640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffba8119560 con 0x7ffba81575d0 2026-02-12T04:04:57.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.593+0000 7ffbad3cf640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:57.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.593+0000 7ffbad3cf640 10 monclient(hunting): authenticate will time out at 1500.336998s 2026-02-12T04:04:57.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.594+0000 7ffba77fe640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7ffba8163310 0x7ffba8133840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:41532/0 (socket says 10.20.193.91:41532) 2026-02-12T04:04:57.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.594+0000 7ffba77fe640 1 -- 10.20.193.91:0/3094356404 learned_addr learned my addr 10.20.193.91:0/3094356404 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:57.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.594+0000 7ffb877fe640 10 client.?.objecter ms_handle_connect 0x7ffba8163310 2026-02-12T04:04:57.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.594+0000 7ffb877fe640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:57.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.594+0000 7ffb877fe640 10 client.?.objecter ms_handle_connect 0x7ffba80560d0 2026-02-12T04:04:57.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.594+0000 7ffb877fe640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:57.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.594+0000 7ffb877fe640 10 client.?.objecter ms_handle_connect 0x7ffba81575d0 2026-02-12T04:04:57.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.594+0000 7ffb877fe640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:57.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.595+0000 7ffb877fe640 1 -- 10.20.193.91:0/3094356404 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 688884693 0 0) 0x7ffba8059320 con 0x7ffba80560d0 2026-02-12T04:04:57.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.595+0000 7ffb877fe640 10 monclient(hunting): _negotiate 2026-02-12T04:04:57.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.595+0000 7ffb877fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:57.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.595+0000 7ffb877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:57.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.595+0000 7ffb877fe640 10 monclient(hunting): my global_id is 27808 2026-02-12T04:04:57.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.595+0000 7ffb877fe640 1 -- 10.20.193.91:0/3094356404 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb74003610 con 0x7ffba80560d0 2026-02-12T04:04:57.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.595+0000 7ffb877fe640 1 -- 10.20.193.91:0/3094356404 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1852459330 0 0) 0x7ffba81192c0 con 0x7ffba8163310 2026-02-12T04:04:57.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.595+0000 7ffb877fe640 10 monclient(hunting): _negotiate 2026-02-12T04:04:57.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.595+0000 7ffb877fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:57.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.595+0000 7ffb877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:57.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.595+0000 7ffb877fe640 10 monclient(hunting): my global_id is 30669 2026-02-12T04:04:57.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.595+0000 7ffb877fe640 1 -- 10.20.193.91:0/3094356404 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffba8059320 con 0x7ffba8163310 2026-02-12T04:04:57.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.595+0000 7ffb877fe640 1 -- 10.20.193.91:0/3094356404 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3115664740 0 0) 0x7ffba8119560 con 0x7ffba81575d0 2026-02-12T04:04:57.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.595+0000 7ffb877fe640 10 monclient(hunting): _negotiate 2026-02-12T04:04:57.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.596+0000 7ffb877fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:57.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.596+0000 7ffb877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:57.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.596+0000 7ffb877fe640 10 monclient(hunting): my global_id is 27503 2026-02-12T04:04:57.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.596+0000 7ffb877fe640 1 -- 10.20.193.91:0/3094356404 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffba81192c0 con 0x7ffba81575d0 2026-02-12T04:04:57.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.597+0000 7ffb877fe640 1 -- 10.20.193.91:0/3094356404 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4233526043 0 0) 0x7ffb74003610 con 0x7ffba80560d0 2026-02-12T04:04:57.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.597+0000 7ffb877fe640 1 -- 10.20.193.91:0/3094356404 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffba8119560 con 0x7ffba80560d0 2026-02-12T04:04:57.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.597+0000 7ffb877fe640 1 -- 10.20.193.91:0/3094356404 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7ffb9c003310 con 0x7ffba80560d0 2026-02-12T04:04:57.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.597+0000 7ffb877fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:57.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.597+0000 7ffb877fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T04:04:57.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.597+0000 7ffb877fe640 10 monclient(hunting): dump: 2026-02-12T04:04:57.612 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:57.613 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:57.613 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.613 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.613 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:57.613 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:57.613 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:57.613 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:57.613 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:57.613 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.613 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.597+0000 7ffb877fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:04:57.613 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.598+0000 7ffb877fe640 1 -- 10.20.193.91:0/3094356404 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3558561390 0 0) 0x7ffba8059320 con 0x7ffba8163310 2026-02-12T04:04:57.613 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.598+0000 7ffb877fe640 1 -- 10.20.193.91:0/3094356404 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffb74003610 con 0x7ffba8163310 2026-02-12T04:04:57.614 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.598+0000 7ffb877fe640 1 -- 10.20.193.91:0/3094356404 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7ffb98003470 con 0x7ffba8163310 2026-02-12T04:04:57.614 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.598+0000 7ffb877fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:57.614 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.598+0000 7ffb877fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T04:04:57.614 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.598+0000 7ffb877fe640 10 monclient(hunting): dump: 2026-02-12T04:04:57.614 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:57.614 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:57.614 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.614 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.614 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:57.614 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:57.614 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:57.614 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:57.614 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:57.614 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.615 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.598+0000 7ffb877fe640 1 -- 10.20.193.91:0/3094356404 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3248661655 0 0) 0x7ffba81192c0 con 0x7ffba81575d0 2026-02-12T04:04:57.615 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.598+0000 7ffb877fe640 1 -- 10.20.193.91:0/3094356404 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffba8059320 con 0x7ffba81575d0 2026-02-12T04:04:57.615 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.598+0000 7ffb877fe640 1 -- 10.20.193.91:0/3094356404 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7ffb90002fc0 con 0x7ffba81575d0 2026-02-12T04:04:57.615 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.598+0000 7ffb877fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:57.615 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.598+0000 7ffb877fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T04:04:57.615 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.598+0000 7ffb877fe640 10 monclient(hunting): dump: 2026-02-12T04:04:57.615 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:57.615 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:57.615 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.615 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.615 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:57.616 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:57.616 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:57.616 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:57.616 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:57.616 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.616 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.599+0000 7ffb877fe640 1 -- 10.20.193.91:0/3094356404 <== mon.1 v1:10.20.193.98:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1640364056 0 0) 0x7ffba8119560 con 0x7ffba80560d0 2026-02-12T04:04:57.616 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.599+0000 7ffb877fe640 1 -- 10.20.193.91:0/3094356404 >> v1:10.20.193.111:6789/0 conn(0x7ffba81575d0 legacy=0x7ffba8058c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:57.616 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.599+0000 7ffb877fe640 1 -- 10.20.193.91:0/3094356404 >> v1:10.20.193.91:6789/0 conn(0x7ffba8163310 legacy=0x7ffba8133840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:57.616 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.599+0000 7ffb877fe640 10 monclient: _finish_hunting 0 2026-02-12T04:04:57.616 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.599+0000 7ffb877fe640 1 monclient: found mon.b 2026-02-12T04:04:57.616 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.599+0000 7ffb877fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:57.616 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.599+0000 7ffb877fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:04:57.616 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.599+0000 7ffb877fe640 1 -- 10.20.193.91:0/3094356404 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffba8119840 con 0x7ffba80560d0 2026-02-12T04:04:57.617 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.599+0000 7ffb877fe640 10 monclient: _finish_auth 0 2026-02-12T04:04:57.617 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.599+0000 7ffb877fe640 10 monclient: _check_auth_tickets 2026-02-12T04:04:57.617 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.599+0000 7ffb877fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:57.617 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.599+0000 7ffbad3cf640 5 monclient: authenticate success, global_id 27808 2026-02-12T04:04:57.617 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.599+0000 7ffbad3cf640 10 monclient: _renew_subs 2026-02-12T04:04:57.617 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.599+0000 7ffbad3cf640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:04:57.617 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.599+0000 7ffbad3cf640 1 -- 10.20.193.91:0/3094356404 --> v1:10.20.193.98:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ffba8119b20 con 0x7ffba80560d0 2026-02-12T04:04:57.617 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.599+0000 7ffbad3cf640 10 client.27808.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:04:57.617 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.599+0000 7ffbad3cf640 10 monclient: _renew_subs 2026-02-12T04:04:57.617 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.599+0000 7ffbad3cf640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:04:57.617 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.599+0000 7ffbad3cf640 1 -- 10.20.193.91:0/3094356404 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ffba811a600 con 0x7ffba80560d0 2026-02-12T04:04:57.617 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.599+0000 7ffbad3cf640 1 librados: init done 2026-02-12T04:04:57.617 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.600+0000 7ffbad3cf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:57.618 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.600+0000 7ffbad3cf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:57.618 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.600+0000 7ffbad3cf640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:04:57.618 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.600+0000 7ffbad3cf640 1 -- 10.20.193.91:0/3094356404 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffba80b7290 con 0x7ffba80560d0 2026-02-12T04:04:57.618 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.600+0000 7ffb877fe640 1 -- 10.20.193.91:0/3094356404 <== mon.1 v1:10.20.193.98:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffb9c002fc0 con 0x7ffba80560d0 2026-02-12T04:04:57.618 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.600+0000 7ffb877fe640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:57.618 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.600+0000 7ffba57fa640 4 set_mon_vals no callback set 2026-02-12T04:04:57.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.607+0000 7ffb877fe640 1 -- 10.20.193.91:0/3094356404 <== mon.1 v1:10.20.193.98:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7ffb9c003960 con 0x7ffba80560d0 2026-02-12T04:04:57.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.607+0000 7ffb877fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:57.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.607+0000 7ffb877fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T04:04:57.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.607+0000 7ffb877fe640 10 monclient: dump: 2026-02-12T04:04:57.620 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:57.620 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:57.620 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.620 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.620 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:57.620 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:57.620 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:57.620 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:57.620 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:57.620 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.608+0000 7ffb877fe640 1 -- 10.20.193.91:0/3094356404 <== mon.1 v1:10.20.193.98:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7ffb9c01ce40 con 0x7ffba80560d0 2026-02-12T04:04:57.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.608+0000 7ffba67fc640 10 monclient: get_auth_request con 0x7ffb7407a0f0 auth_method 0 2026-02-12T04:04:57.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.608+0000 7ffb877fe640 10 client.27808.objecter ms_handle_connect 0x7ffb7407a0f0 2026-02-12T04:04:57.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.609+0000 7ffb877fe640 1 -- 10.20.193.91:0/3094356404 <== mon.1 v1:10.20.193.98:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7ffb9c094810 con 0x7ffba80560d0 2026-02-12T04:04:57.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.609+0000 7ffb877fe640 10 client.27808.objecter ms_dispatch2 0x7ffba8000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:04:57.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.609+0000 7ffb877fe640 3 client.27808.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:04:57.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.609+0000 7ffb877fe640 3 client.27808.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:04:57.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.609+0000 7ffb877fe640 20 client.27808.objecter dump_active .. 0 homeless 2026-02-12T04:04:57.698 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.696+0000 7ffb877fe640 1 -- 10.20.193.91:0/3094356404 <== mon.1 v1:10.20.193.98:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7ffb9c05e170 con 0x7ffba80560d0 2026-02-12T04:04:57.698 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.696+0000 7ffb877fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:57.698 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.696+0000 7ffb877fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T04:04:57.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.804+0000 7ffbad3cf640 1 -- 10.20.193.91:0/3094356404 --> v1:10.20.193.91:6800/2929217192 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "12", "target": ["mon-mgr", ""]}) -- 0x7ffba8155550 con 0x7ffb7407a0f0 2026-02-12T04:04:57.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.804+0000 7ffb877fe640 1 -- 10.20.193.91:0/3094356404 <== mgr.4113 v1:10.20.193.91:6800/2929217192 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 12 to deep-scrub) ==== 42+0+0 (unknown 660425183 0 0) 0x7ffba8155550 con 0x7ffb7407a0f0 2026-02-12T04:04:57.806 INFO:teuthology.orchestra.run.trial091.stderr:instructed osd(s) 12 to deep-scrub 2026-02-12T04:04:57.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.805+0000 7ffbad3cf640 10 librados: watch_flush enter 2026-02-12T04:04:57.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.805+0000 7ffbad3cf640 10 librados: watch_flush exit 2026-02-12T04:04:57.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.805+0000 7ffbad3cf640 20 client.27808.objecter shutdown clearing up homeless session... 2026-02-12T04:04:57.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.805+0000 7ffbad3cf640 10 client.27808.objecter successfully canceled tick 2026-02-12T04:04:57.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.805+0000 7ffbad3cf640 1 -- 10.20.193.91:0/3094356404 >> v1:10.20.193.91:6800/2929217192 conn(0x7ffb7407a0f0 legacy=0x7ffb7409a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:57.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.805+0000 7ffbad3cf640 10 monclient: shutdown 2026-02-12T04:04:57.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.805+0000 7ffbad3cf640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:57.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.805+0000 7ffbad3cf640 1 -- 10.20.193.91:0/3094356404 >> v1:10.20.193.98:6789/0 conn(0x7ffba80560d0 legacy=0x7ffba81358b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:57.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.805+0000 7ffbad3cf640 1 -- 10.20.193.91:0/3094356404 shutdown_connections 2026-02-12T04:04:57.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.805+0000 7ffbad3cf640 1 -- 10.20.193.91:0/3094356404 >> 10.20.193.91:0/3094356404 conn(0x7ffba80b6560 msgr2=0x7ffba81562d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:57.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.805+0000 7ffbad3cf640 1 -- 10.20.193.91:0/3094356404 shutdown_connections 2026-02-12T04:04:57.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.805+0000 7ffbad3cf640 1 -- 10.20.193.91:0/3094356404 wait complete. 2026-02-12T04:04:57.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.805+0000 7ffbad3cf640 1 librados: shutdown 2026-02-12T04:04:57.815 INFO:tasks.ceph:Scrubbing osd.1 2026-02-12T04:04:57.816 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-12T04:04:57.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.883+0000 7f97868e0640 10 monclient: get_monmap_and_config 2026-02-12T04:04:57.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.883+0000 7f97868e0640 10 monclient: build_initial_monmap 2026-02-12T04:04:57.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.883+0000 7f97868e0640 10 monclient: monmap: 2026-02-12T04:04:57.885 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:57.886 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:57.886 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:04:57.884232+0000 2026-02-12T04:04:57.886 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:04:57.884232+0000 2026-02-12T04:04:57.886 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:57.886 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:57.886 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:57.886 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:57.886 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:57.886 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.884+0000 7f97868e0640 1 Processor -- start 2026-02-12T04:04:57.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.884+0000 7f97868e0640 1 -- start start 2026-02-12T04:04:57.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.884+0000 7f97868e0640 10 monclient: init 2026-02-12T04:04:57.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.884+0000 7f97868e0640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:57.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.884+0000 7f97868e0640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T04:04:57.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.884+0000 7f97868e0640 10 monclient(hunting): picked mon.noname-c con 0x7f9780055c30 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:57.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.884+0000 7f97868e0640 10 monclient(hunting): picked mon.noname-b con 0x7f9780160f80 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:57.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.884+0000 7f97868e0640 10 monclient(hunting): picked mon.noname-a con 0x7f9780163230 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:57.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.884+0000 7f97868e0640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97800b1fc0 con 0x7f9780163230 2026-02-12T04:04:57.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.884+0000 7f97868e0640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97800b22a0 con 0x7f9780160f80 2026-02-12T04:04:57.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.884+0000 7f97868e0640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97800b2580 con 0x7f9780055c30 2026-02-12T04:04:57.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.884+0000 7f97868e0640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:57.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.884+0000 7f97868e0640 10 monclient(hunting): authenticate will time out at 1500.627671s 2026-02-12T04:04:57.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.885+0000 7f9784e56640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f9780163230 0x7f97801c57b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:41542/0 (socket says 10.20.193.91:41542) 2026-02-12T04:04:57.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.885+0000 7f9784e56640 1 -- 10.20.193.91:0/4203110807 learned_addr learned my addr 10.20.193.91:0/4203110807 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:57.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.885+0000 7f977ffff640 1 --1- 10.20.193.91:0/4203110807 >> v1:10.20.193.111:6789/0 conn(0x7f9780055c30 0x7f9780162b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:44302/0 (socket says 10.20.193.91:44302) 2026-02-12T04:04:57.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.886+0000 7f977effd640 1 -- 10.20.193.91:0/4203110807 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4239898855 0 0) 0x7f97800b2580 con 0x7f9780055c30 2026-02-12T04:04:57.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.886+0000 7f977effd640 10 monclient(hunting): _negotiate 2026-02-12T04:04:57.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.886+0000 7f977effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:57.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.886+0000 7f977effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:57.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.886+0000 7f977effd640 10 monclient(hunting): my global_id is 27506 2026-02-12T04:04:57.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.886+0000 7f977effd640 1 -- 10.20.193.91:0/4203110807 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9764003610 con 0x7f9780055c30 2026-02-12T04:04:57.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.886+0000 7f977effd640 1 -- 10.20.193.91:0/4203110807 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1884239649 0 0) 0x7f97800b1fc0 con 0x7f9780163230 2026-02-12T04:04:57.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.886+0000 7f977effd640 10 monclient(hunting): _negotiate 2026-02-12T04:04:57.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.886+0000 7f977effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:57.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.886+0000 7f977effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:57.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.886+0000 7f977effd640 10 monclient(hunting): my global_id is 30672 2026-02-12T04:04:57.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.886+0000 7f977effd640 1 -- 10.20.193.91:0/4203110807 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97800b2580 con 0x7f9780163230 2026-02-12T04:04:57.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.886+0000 7f977effd640 1 -- 10.20.193.91:0/4203110807 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2120957231 0 0) 0x7f97800b22a0 con 0x7f9780160f80 2026-02-12T04:04:57.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.886+0000 7f977effd640 10 monclient(hunting): _negotiate 2026-02-12T04:04:57.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.886+0000 7f977effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:57.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.886+0000 7f977effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:57.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.886+0000 7f977effd640 10 monclient(hunting): my global_id is 27811 2026-02-12T04:04:57.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.886+0000 7f977effd640 1 -- 10.20.193.91:0/4203110807 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97800b1fc0 con 0x7f9780160f80 2026-02-12T04:04:57.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.887+0000 7f977effd640 1 -- 10.20.193.91:0/4203110807 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2770961627 0 0) 0x7f9764003610 con 0x7f9780055c30 2026-02-12T04:04:57.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.887+0000 7f977effd640 1 -- 10.20.193.91:0/4203110807 >> v1:10.20.193.98:6789/0 conn(0x7f9780160f80 legacy=0x7f97801572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:57.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.887+0000 7f977effd640 1 -- 10.20.193.91:0/4203110807 >> v1:10.20.193.91:6789/0 conn(0x7f9780163230 legacy=0x7f97801c57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:57.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.887+0000 7f977effd640 10 monclient: _finish_hunting 0 2026-02-12T04:04:57.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.887+0000 7f977effd640 1 monclient: found mon.noname-c 2026-02-12T04:04:57.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.887+0000 7f977effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:57.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.887+0000 7f977effd640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.111:6789/0 2026-02-12T04:04:57.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.887+0000 7f977effd640 1 -- 10.20.193.91:0/4203110807 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97800b2860 con 0x7f9780055c30 2026-02-12T04:04:57.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.887+0000 7f977effd640 10 monclient: _finish_auth 0 2026-02-12T04:04:57.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.887+0000 7f977effd640 10 monclient: _check_auth_tickets 2026-02-12T04:04:57.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.887+0000 7f977effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:57.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.887+0000 7f977effd640 1 -- 10.20.193.91:0/4203110807 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f976c002df0 con 0x7f9780055c30 2026-02-12T04:04:57.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.887+0000 7f977effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:57.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.887+0000 7f977effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T04:04:57.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.887+0000 7f977effd640 10 monclient: dump: 2026-02-12T04:04:57.900 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:57.900 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:57.900 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.901 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.901 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:57.901 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:57.901 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:57.901 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:57.901 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:57.901 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.887+0000 7f97868e0640 5 monclient: authenticate success, global_id 27506 2026-02-12T04:04:57.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.887+0000 7f97868e0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:04:57.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.888+0000 7f977effd640 1 -- 10.20.193.91:0/4203110807 <== mon.2 v1:10.20.193.111:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f976c002fc0 con 0x7f9780055c30 2026-02-12T04:04:57.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.888+0000 7f977effd640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:57.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.888+0000 7f977effd640 1 -- 10.20.193.91:0/4203110807 <== mon.2 v1:10.20.193.111:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f976c003400 con 0x7f9780055c30 2026-02-12T04:04:57.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.888+0000 7f977effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:57.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.888+0000 7f977effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T04:04:57.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.888+0000 7f977effd640 10 monclient: dump: 2026-02-12T04:04:57.902 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:57.902 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:57.902 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.902 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.902 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:57.902 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:57.902 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:57.902 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:57.902 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:57.902 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.888+0000 7f97868e0640 10 monclient: get_monmap_and_config success 2026-02-12T04:04:57.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.888+0000 7f97868e0640 4 set_mon_vals no callback set 2026-02-12T04:04:57.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.889+0000 7f97868e0640 10 monclient: shutdown 2026-02-12T04:04:57.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.889+0000 7f97868e0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:57.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.889+0000 7f97868e0640 1 -- 10.20.193.91:0/4203110807 >> v1:10.20.193.111:6789/0 conn(0x7f9780055c30 legacy=0x7f9780162b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:57.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.889+0000 7f97868e0640 1 -- 10.20.193.91:0/4203110807 shutdown_connections 2026-02-12T04:04:57.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.889+0000 7f97868e0640 1 -- 10.20.193.91:0/4203110807 >> 10.20.193.91:0/4203110807 conn(0x7f97800b6560 msgr2=0x7f97800b6930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:57.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.889+0000 7f97868e0640 1 -- 10.20.193.91:0/4203110807 shutdown_connections 2026-02-12T04:04:57.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.889+0000 7f97868e0640 1 -- 10.20.193.91:0/4203110807 wait complete. 2026-02-12T04:04:57.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.889+0000 7f97868e0640 10 monclient: build_initial_monmap 2026-02-12T04:04:57.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.889+0000 7f97868e0640 10 monclient: monmap: 2026-02-12T04:04:57.903 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:57.904 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:04:57.904 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:04:57.904 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:04:57.904 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:57.904 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:04:57.904 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:57.904 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:57.904 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:57.904 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.889+0000 7f97868e0640 1 librados: starting msgr at 2026-02-12T04:04:57.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.889+0000 7f97868e0640 1 librados: starting objecter 2026-02-12T04:04:57.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.889+0000 7f97868e0640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:04:57.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.889+0000 7f97868e0640 1 Processor -- start 2026-02-12T04:04:57.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.889+0000 7f97868e0640 1 -- start start 2026-02-12T04:04:57.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.889+0000 7f97868e0640 1 librados: setting wanted keys 2026-02-12T04:04:57.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.889+0000 7f97868e0640 1 librados: calling monclient init 2026-02-12T04:04:57.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.889+0000 7f97868e0640 10 monclient: init 2026-02-12T04:04:57.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.890+0000 7f97868e0640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:57.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.890+0000 7f97868e0640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T04:04:57.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.890+0000 7f97868e0640 10 monclient(hunting): picked mon.noname-b con 0x7f9780055c30 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:57.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.890+0000 7f97868e0640 10 monclient(hunting): picked mon.noname-a con 0x7f9780160f80 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:57.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.890+0000 7f97868e0640 10 monclient(hunting): picked mon.noname-c con 0x7f9780163230 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:57.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.890+0000 7f97868e0640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f978013b810 con 0x7f9780160f80 2026-02-12T04:04:57.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.890+0000 7f97868e0640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97801fb580 con 0x7f9780055c30 2026-02-12T04:04:57.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.890+0000 7f97868e0640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97801fb860 con 0x7f9780163230 2026-02-12T04:04:57.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.890+0000 7f97868e0640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:57.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.890+0000 7f97868e0640 10 monclient(hunting): authenticate will time out at 1500.633425s 2026-02-12T04:04:57.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.890+0000 7f9784e56640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f9780163230 0x7f97800ad3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:44308/0 (socket says 10.20.193.91:44308) 2026-02-12T04:04:57.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.890+0000 7f9784e56640 1 -- 10.20.193.91:0/2599703522 learned_addr learned my addr 10.20.193.91:0/2599703522 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:57.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.891+0000 7f977cff9640 10 client.?.objecter ms_handle_connect 0x7f9780160f80 2026-02-12T04:04:57.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.891+0000 7f977cff9640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:57.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.891+0000 7f977cff9640 10 client.?.objecter ms_handle_connect 0x7f9780055c30 2026-02-12T04:04:57.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.891+0000 7f977cff9640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:57.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.891+0000 7f977cff9640 10 client.?.objecter ms_handle_connect 0x7f9780163230 2026-02-12T04:04:57.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.891+0000 7f977cff9640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:57.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.892+0000 7f977cff9640 1 -- 10.20.193.91:0/2599703522 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3809112940 0 0) 0x7f97801fb860 con 0x7f9780163230 2026-02-12T04:04:57.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.892+0000 7f977cff9640 10 monclient(hunting): _negotiate 2026-02-12T04:04:57.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.892+0000 7f977cff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:57.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.892+0000 7f977cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:57.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.892+0000 7f977cff9640 10 monclient(hunting): my global_id is 27509 2026-02-12T04:04:57.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.892+0000 7f977cff9640 1 -- 10.20.193.91:0/2599703522 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9750003610 con 0x7f9780163230 2026-02-12T04:04:57.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.892+0000 7f977cff9640 1 -- 10.20.193.91:0/2599703522 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4209531650 0 0) 0x7f978013b810 con 0x7f9780160f80 2026-02-12T04:04:57.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.892+0000 7f977cff9640 10 monclient(hunting): _negotiate 2026-02-12T04:04:57.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.892+0000 7f977cff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:57.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.892+0000 7f977cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:57.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.892+0000 7f977cff9640 10 monclient(hunting): my global_id is 30675 2026-02-12T04:04:57.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.892+0000 7f977cff9640 1 -- 10.20.193.91:0/2599703522 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97801fb860 con 0x7f9780160f80 2026-02-12T04:04:57.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.892+0000 7f977cff9640 1 -- 10.20.193.91:0/2599703522 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1042673180 0 0) 0x7f97801fb580 con 0x7f9780055c30 2026-02-12T04:04:57.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.892+0000 7f977cff9640 10 monclient(hunting): _negotiate 2026-02-12T04:04:57.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.892+0000 7f977cff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:57.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.892+0000 7f977cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:57.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.892+0000 7f977cff9640 10 monclient(hunting): my global_id is 27814 2026-02-12T04:04:57.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.892+0000 7f977cff9640 1 -- 10.20.193.91:0/2599703522 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f978013b810 con 0x7f9780055c30 2026-02-12T04:04:57.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.894+0000 7f977cff9640 1 -- 10.20.193.91:0/2599703522 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 179533774 0 0) 0x7f97801fb860 con 0x7f9780160f80 2026-02-12T04:04:57.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.894+0000 7f977cff9640 1 -- 10.20.193.91:0/2599703522 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f97801fb580 con 0x7f9780160f80 2026-02-12T04:04:57.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.894+0000 7f977cff9640 1 -- 10.20.193.91:0/2599703522 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f9770003060 con 0x7f9780160f80 2026-02-12T04:04:57.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.894+0000 7f977cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:57.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.894+0000 7f977cff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T04:04:57.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.894+0000 7f977cff9640 10 monclient(hunting): dump: 2026-02-12T04:04:57.908 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:57.908 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:57.909 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.909 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.909 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:57.909 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:57.909 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:57.909 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:57.909 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:57.909 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.894+0000 7f977cff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:04:57.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.894+0000 7f977cff9640 1 -- 10.20.193.91:0/2599703522 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 882638233 0 0) 0x7f978013b810 con 0x7f9780055c30 2026-02-12T04:04:57.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.894+0000 7f977cff9640 1 -- 10.20.193.91:0/2599703522 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f97801fb860 con 0x7f9780055c30 2026-02-12T04:04:57.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.894+0000 7f977cff9640 1 -- 10.20.193.91:0/2599703522 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f976c003310 con 0x7f9780055c30 2026-02-12T04:04:57.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.894+0000 7f977cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:57.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.894+0000 7f977cff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T04:04:57.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.894+0000 7f977cff9640 10 monclient(hunting): dump: 2026-02-12T04:04:57.910 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:57.910 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:57.910 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.910 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.910 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:57.910 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:57.910 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:57.910 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:57.910 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:57.911 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.894+0000 7f977cff9640 1 -- 10.20.193.91:0/2599703522 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4076060938 0 0) 0x7f9750003610 con 0x7f9780163230 2026-02-12T04:04:57.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.894+0000 7f977cff9640 1 -- 10.20.193.91:0/2599703522 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f978013b810 con 0x7f9780163230 2026-02-12T04:04:57.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.894+0000 7f977cff9640 1 -- 10.20.193.91:0/2599703522 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f97740032f0 con 0x7f9780163230 2026-02-12T04:04:57.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.894+0000 7f977cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:57.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.894+0000 7f977cff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T04:04:57.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.894+0000 7f977cff9640 10 monclient(hunting): dump: 2026-02-12T04:04:57.911 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:57.911 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:57.911 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.911 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.911 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:57.912 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:57.912 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:57.912 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:57.912 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:57.912 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.912 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.896+0000 7f977cff9640 1 -- 10.20.193.91:0/2599703522 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3542571020 0 0) 0x7f97801fb580 con 0x7f9780160f80 2026-02-12T04:04:57.912 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.896+0000 7f977cff9640 1 -- 10.20.193.91:0/2599703522 >> v1:10.20.193.111:6789/0 conn(0x7f9780163230 legacy=0x7f97800ad3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:57.912 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.896+0000 7f977cff9640 1 -- 10.20.193.91:0/2599703522 >> v1:10.20.193.98:6789/0 conn(0x7f9780055c30 legacy=0x7f97800af790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:57.912 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.896+0000 7f977cff9640 10 monclient: _finish_hunting 0 2026-02-12T04:04:57.912 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.896+0000 7f977cff9640 1 monclient: found mon.a 2026-02-12T04:04:57.912 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.896+0000 7f977cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:57.912 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.896+0000 7f977cff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:57.912 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.896+0000 7f977cff9640 1 -- 10.20.193.91:0/2599703522 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97801fbb40 con 0x7f9780160f80 2026-02-12T04:04:57.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.896+0000 7f977cff9640 10 monclient: _finish_auth 0 2026-02-12T04:04:57.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.896+0000 7f977cff9640 10 monclient: _check_auth_tickets 2026-02-12T04:04:57.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.896+0000 7f977cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:57.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.896+0000 7f97868e0640 5 monclient: authenticate success, global_id 30675 2026-02-12T04:04:57.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.896+0000 7f97868e0640 10 monclient: _renew_subs 2026-02-12T04:04:57.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.896+0000 7f97868e0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:57.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.896+0000 7f97868e0640 1 -- 10.20.193.91:0/2599703522 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f97801fbe20 con 0x7f9780160f80 2026-02-12T04:04:57.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.896+0000 7f97868e0640 10 client.30675.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:04:57.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.896+0000 7f97868e0640 10 monclient: _renew_subs 2026-02-12T04:04:57.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.896+0000 7f97868e0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:57.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.896+0000 7f97868e0640 1 -- 10.20.193.91:0/2599703522 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f97800adae0 con 0x7f9780160f80 2026-02-12T04:04:57.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.896+0000 7f97868e0640 1 librados: init done 2026-02-12T04:04:57.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.896+0000 7f97868e0640 10 client.30675.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:57.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.896+0000 7f97868e0640 15 client.30675.objecter _session_command_op_assign -1 1 2026-02-12T04:04:57.914 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.896+0000 7f97868e0640 20 client.30675.objecter _get_session osd=-1 returning homeless 2026-02-12T04:04:57.914 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.896+0000 7f97868e0640 10 client.30675.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:04:57.914 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.896+0000 7f97868e0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:57.914 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.896+0000 7f97868e0640 1 -- 10.20.193.91:0/2599703522 --> v1:10.20.193.91:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f97800add70 con 0x7f9780160f80 2026-02-12T04:04:57.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.905+0000 7f977cff9640 1 -- 10.20.193.91:0/2599703522 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f97800add70 con 0x7f9780160f80 2026-02-12T04:04:57.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.905+0000 7f977cff9640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:57.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.905+0000 7f977cff9640 1 -- 10.20.193.91:0/2599703522 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f97700038a0 con 0x7f9780160f80 2026-02-12T04:04:57.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.905+0000 7f977cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:57.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.905+0000 7f977cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T04:04:57.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.905+0000 7f977e7fc640 4 set_mon_vals no callback set 2026-02-12T04:04:57.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.905+0000 7f977cff9640 10 monclient: dump: 2026-02-12T04:04:57.917 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:57.917 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:57.917 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.917 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:57.917 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:57.917 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:57.917 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:57.917 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:57.917 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:57.917 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:57.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.905+0000 7f977cff9640 1 -- 10.20.193.91:0/2599703522 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f977001cd80 con 0x7f9780160f80 2026-02-12T04:04:57.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.906+0000 7f977ffff640 10 monclient: get_auth_request con 0x7f9750079fc0 auth_method 0 2026-02-12T04:04:57.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.906+0000 7f977cff9640 10 client.30675.objecter ms_handle_connect 0x7f9750079fc0 2026-02-12T04:04:57.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.907+0000 7f977cff9640 1 -- 10.20.193.91:0/2599703522 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7f9770094740 con 0x7f9780160f80 2026-02-12T04:04:57.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.907+0000 7f977cff9640 10 client.30675.objecter ms_dispatch2 0x7f9780000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:04:57.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.907+0000 7f977cff9640 3 client.30675.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:04:57.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.907+0000 7f977cff9640 3 client.30675.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:04:57.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.907+0000 7f977cff9640 10 client.30675.objecter checking command 1 2026-02-12T04:04:57.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.907+0000 7f977cff9640 20 client.30675.objecter _get_session s=0x7f97500a4270 osd=1 3 2026-02-12T04:04:57.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.907+0000 7f977cff9640 20 client.30675.objecter put_session s=0x7f97500a4270 osd=1 3 2026-02-12T04:04:57.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.907+0000 7f977cff9640 15 client.30675.objecter _session_command_op_remove -1 1 2026-02-12T04:04:57.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.907+0000 7f977cff9640 20 client.30675.objecter _get_session s=0x7f97500a4270 osd=1 3 2026-02-12T04:04:57.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.907+0000 7f977cff9640 20 client.30675.objecter get_session s=0x7f97500a4270 osd=1 3 2026-02-12T04:04:57.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.907+0000 7f977cff9640 15 client.30675.objecter _session_command_op_assign 1 1 2026-02-12T04:04:57.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.907+0000 7f977cff9640 20 client.30675.objecter put_session s=0x7f97500a4270 osd=1 4 2026-02-12T04:04:57.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.907+0000 7f977cff9640 10 client.30675.objecter _send_command 1 2026-02-12T04:04:57.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.907+0000 7f977cff9640 1 -- 10.20.193.91:0/2599703522 --> v1:10.20.193.98:6812/2011281833 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f97500c6580 con 0x7f97500a4920 2026-02-12T04:04:57.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.907+0000 7f977cff9640 20 client.30675.objecter dump_active .. 0 homeless 2026-02-12T04:04:57.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.907+0000 7f977cff9640 1 -- 10.20.193.91:0/2599703522 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_get_version_reply(handle=1 version=344) ==== 24+0+0 (unknown 1403447244 0 0) 0x7f977005d770 con 0x7f9780160f80 2026-02-12T04:04:57.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.907+0000 7f977cff9640 10 monclient: handle_get_version_reply finishing 1 version 344 2026-02-12T04:04:57.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.907+0000 7f9784e56640 10 monclient: get_auth_request con 0x7f97500a4920 auth_method 0 2026-02-12T04:04:57.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.908+0000 7f977cff9640 10 client.30675.objecter ms_handle_connect 0x7f97500a4920 2026-02-12T04:04:57.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.918+0000 7f977cff9640 1 -- 10.20.193.91:0/2599703522 <== osd.1 v1:10.20.193.98:6812/2011281833 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f97500c6580 con 0x7f97500a4920 2026-02-12T04:04:57.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.918+0000 7f977cff9640 10 client.30675.objecter ms_dispatch2 0x7f9780000b90 command_reply(tid 1: 0 ) 2026-02-12T04:04:57.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.918+0000 7f977cff9640 10 client.30675.objecter _finish_command 1 = system:0 2026-02-12T04:04:57.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.918+0000 7f977cff9640 20 client.30675.objecter put_session s=0x7f97500a4270 osd=1 4 2026-02-12T04:04:57.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.918+0000 7f977cff9640 15 client.30675.objecter _session_command_op_remove 1 1 2026-02-12T04:04:57.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.925+0000 7f97868e0640 10 client.30675.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-12T04:04:57.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.925+0000 7f97868e0640 15 client.30675.objecter _session_command_op_assign -1 2 2026-02-12T04:04:57.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.925+0000 7f97868e0640 20 client.30675.objecter _get_session s=0x7f97500a4270 osd=1 3 2026-02-12T04:04:57.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.925+0000 7f97868e0640 20 client.30675.objecter put_session s=0x7f97500a4270 osd=1 3 2026-02-12T04:04:57.927 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.925+0000 7f97868e0640 20 client.30675.objecter _get_session s=0x7f97500a4270 osd=1 3 2026-02-12T04:04:57.928 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.925+0000 7f97868e0640 15 client.30675.objecter _session_command_op_remove -1 2 2026-02-12T04:04:57.928 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.925+0000 7f97868e0640 20 client.30675.objecter get_session s=0x7f97500a4270 osd=1 3 2026-02-12T04:04:57.928 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.925+0000 7f97868e0640 15 client.30675.objecter _session_command_op_assign 1 2 2026-02-12T04:04:57.928 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.925+0000 7f97868e0640 20 client.30675.objecter put_session s=0x7f97500a4270 osd=1 4 2026-02-12T04:04:57.928 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.925+0000 7f97868e0640 10 client.30675.objecter _send_command 2 2026-02-12T04:04:57.928 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.925+0000 7f97868e0640 1 -- 10.20.193.91:0/2599703522 --> v1:10.20.193.98:6812/2011281833 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f978015fcb0 con 0x7f97500a4920 2026-02-12T04:04:57.934 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.932+0000 7f977cff9640 1 -- 10.20.193.91:0/2599703522 <== osd.1 v1:10.20.193.98:6812/2011281833 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f978015fcb0 con 0x7f97500a4920 2026-02-12T04:04:57.934 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.932+0000 7f977cff9640 10 client.30675.objecter ms_dispatch2 0x7f9780000b90 command_reply(tid 2: 0 ) 2026-02-12T04:04:57.934 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.932+0000 7f977cff9640 10 client.30675.objecter _finish_command 2 = system:0 2026-02-12T04:04:57.934 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.932+0000 7f977cff9640 20 client.30675.objecter put_session s=0x7f97500a4270 osd=1 4 2026-02-12T04:04:57.934 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.932+0000 7f977cff9640 15 client.30675.objecter _session_command_op_remove 1 2 2026-02-12T04:04:57.935 INFO:teuthology.orchestra.run.trial091.stdout:{ 2026-02-12T04:04:57.935 INFO:teuthology.orchestra.run.trial091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-12T04:04:57.935 INFO:teuthology.orchestra.run.trial091.stdout:} 2026-02-12T04:04:57.936 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.932+0000 7f97868e0640 10 librados: watch_flush enter 2026-02-12T04:04:57.937 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.932+0000 7f97868e0640 10 librados: watch_flush exit 2026-02-12T04:04:57.937 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.932+0000 7f97868e0640 10 client.30675.objecter close_session for osd.1 2026-02-12T04:04:57.937 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.932+0000 7f97868e0640 1 -- 10.20.193.91:0/2599703522 >> v1:10.20.193.98:6812/2011281833 conn(0x7f97500a4920 legacy=0x7f97500c4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:57.937 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.932+0000 7f97868e0640 20 client.30675.objecter put_session s=0x7f97500a4270 osd=1 1 2026-02-12T04:04:57.937 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.932+0000 7f97868e0640 20 client.30675.objecter shutdown clearing up homeless session... 2026-02-12T04:04:57.937 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.932+0000 7f97868e0640 10 client.30675.objecter successfully canceled tick 2026-02-12T04:04:57.937 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.932+0000 7f97868e0640 1 -- 10.20.193.91:0/2599703522 >> v1:10.20.193.91:6800/2929217192 conn(0x7f9750079fc0 legacy=0x7f975009a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:57.937 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.932+0000 7f97868e0640 10 monclient: shutdown 2026-02-12T04:04:57.937 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.932+0000 7f97868e0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:57.937 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.932+0000 7f97868e0640 1 -- 10.20.193.91:0/2599703522 >> v1:10.20.193.91:6789/0 conn(0x7f9780160f80 legacy=0x7f9780153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:57.937 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.932+0000 7f9784e56640 1 -- 10.20.193.91:0/2599703522 reap_dead start 2026-02-12T04:04:57.938 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.932+0000 7f97868e0640 1 -- 10.20.193.91:0/2599703522 shutdown_connections 2026-02-12T04:04:57.938 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.932+0000 7f97868e0640 1 -- 10.20.193.91:0/2599703522 >> 10.20.193.91:0/2599703522 conn(0x7f97800b6560 msgr2=0x7f97801613b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:57.938 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.932+0000 7f97868e0640 1 -- 10.20.193.91:0/2599703522 shutdown_connections 2026-02-12T04:04:57.938 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.932+0000 7f97868e0640 1 -- 10.20.193.91:0/2599703522 wait complete. 2026-02-12T04:04:57.938 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:57.933+0000 7f97868e0640 1 librados: shutdown 2026-02-12T04:04:57.943 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-12T04:04:58.010 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.009+0000 7f883588b640 10 monclient: get_monmap_and_config 2026-02-12T04:04:58.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.009+0000 7f883588b640 10 monclient: build_initial_monmap 2026-02-12T04:04:58.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.009+0000 7f883588b640 10 monclient: monmap: 2026-02-12T04:04:58.011 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:58.011 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:58.011 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:04:58.009679+0000 2026-02-12T04:04:58.011 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:04:58.009679+0000 2026-02-12T04:04:58.011 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:58.011 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:58.011 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:58.012 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:58.012 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:58.012 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.009+0000 7f883588b640 1 Processor -- start 2026-02-12T04:04:58.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.009+0000 7f883588b640 1 -- start start 2026-02-12T04:04:58.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.009+0000 7f883588b640 10 monclient: init 2026-02-12T04:04:58.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.010+0000 7f883588b640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:58.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.010+0000 7f883588b640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T04:04:58.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.010+0000 7f883588b640 10 monclient(hunting): picked mon.noname-c con 0x7f88301575d0 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:58.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.010+0000 7f883588b640 10 monclient(hunting): picked mon.noname-b con 0x7f8830163310 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:58.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.010+0000 7f883588b640 10 monclient(hunting): picked mon.noname-a con 0x7f88300560d0 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:58.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.010+0000 7f883588b640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88300b20b0 con 0x7f88300560d0 2026-02-12T04:04:58.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.010+0000 7f883588b640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88300b2390 con 0x7f8830163310 2026-02-12T04:04:58.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.010+0000 7f883588b640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88300b2670 con 0x7f88301575d0 2026-02-12T04:04:58.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.010+0000 7f883588b640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:58.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.010+0000 7f883588b640 10 monclient(hunting): authenticate will time out at 1500.753096s 2026-02-12T04:04:58.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.010+0000 7f882effd640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f88301575d0 0x7f8830162c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:44314/0 (socket says 10.20.193.91:44314) 2026-02-12T04:04:58.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.010+0000 7f882effd640 1 -- 10.20.193.91:0/977947511 learned_addr learned my addr 10.20.193.91:0/977947511 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:58.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.011+0000 7f882dffb640 1 -- 10.20.193.91:0/977947511 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 340654460 0 0) 0x7f88300b2670 con 0x7f88301575d0 2026-02-12T04:04:58.015 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.011+0000 7f882dffb640 10 monclient(hunting): _negotiate 2026-02-12T04:04:58.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.011+0000 7f882dffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:58.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.011+0000 7f882dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:58.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.011+0000 7f882dffb640 10 monclient(hunting): my global_id is 27512 2026-02-12T04:04:58.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.011+0000 7f882dffb640 1 -- 10.20.193.91:0/977947511 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f881c003610 con 0x7f88301575d0 2026-02-12T04:04:58.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.012+0000 7f882dffb640 1 -- 10.20.193.91:0/977947511 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 823374834 0 0) 0x7f88300b2390 con 0x7f8830163310 2026-02-12T04:04:58.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.012+0000 7f882dffb640 10 monclient(hunting): _negotiate 2026-02-12T04:04:58.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.012+0000 7f882dffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:58.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.012+0000 7f882dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:58.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.012+0000 7f882dffb640 10 monclient(hunting): my global_id is 27817 2026-02-12T04:04:58.016 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.012+0000 7f882dffb640 1 -- 10.20.193.91:0/977947511 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88300b2670 con 0x7f8830163310 2026-02-12T04:04:58.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.013+0000 7f882dffb640 1 -- 10.20.193.91:0/977947511 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3937017961 0 0) 0x7f881c003610 con 0x7f88301575d0 2026-02-12T04:04:58.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.013+0000 7f882dffb640 1 -- 10.20.193.91:0/977947511 >> v1:10.20.193.98:6789/0 conn(0x7f8830163310 legacy=0x7f88300559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:58.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.013+0000 7f882dffb640 1 -- 10.20.193.91:0/977947511 >> v1:10.20.193.91:6789/0 conn(0x7f88300560d0 legacy=0x7f88301c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T04:04:58.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.013+0000 7f882dffb640 10 monclient: _finish_hunting 0 2026-02-12T04:04:58.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.013+0000 7f882dffb640 1 monclient: found mon.noname-c 2026-02-12T04:04:58.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.013+0000 7f882dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:58.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.013+0000 7f882dffb640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.111:6789/0 2026-02-12T04:04:58.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.013+0000 7f882dffb640 1 -- 10.20.193.91:0/977947511 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8830162400 con 0x7f88301575d0 2026-02-12T04:04:58.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.013+0000 7f882dffb640 10 monclient: _finish_auth 0 2026-02-12T04:04:58.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.013+0000 7f882dffb640 10 monclient: _check_auth_tickets 2026-02-12T04:04:58.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.013+0000 7f882dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:58.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.013+0000 7f882dffb640 1 -- 10.20.193.91:0/977947511 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8824002df0 con 0x7f88301575d0 2026-02-12T04:04:58.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.013+0000 7f882dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:58.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.013+0000 7f882dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T04:04:58.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.013+0000 7f882dffb640 10 monclient: dump: 2026-02-12T04:04:58.023 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:58.023 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:58.023 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.024 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.024 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:58.024 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:58.024 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:58.024 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:58.024 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:58.024 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.013+0000 7f883588b640 5 monclient: authenticate success, global_id 27512 2026-02-12T04:04:58.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.013+0000 7f883588b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:04:58.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.013+0000 7f882dffb640 1 -- 10.20.193.91:0/977947511 <== mon.2 v1:10.20.193.111:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8824003000 con 0x7f88301575d0 2026-02-12T04:04:58.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.013+0000 7f882dffb640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:58.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.013+0000 7f882dffb640 1 -- 10.20.193.91:0/977947511 <== mon.2 v1:10.20.193.111:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8824003440 con 0x7f88301575d0 2026-02-12T04:04:58.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.013+0000 7f882dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:58.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.013+0000 7f882dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T04:04:58.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.013+0000 7f882dffb640 10 monclient: dump: 2026-02-12T04:04:58.025 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:58.025 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:58.025 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.025 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.025 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:58.025 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:58.025 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:58.025 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:58.025 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:58.025 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.013+0000 7f883588b640 10 monclient: get_monmap_and_config success 2026-02-12T04:04:58.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.013+0000 7f883588b640 4 set_mon_vals no callback set 2026-02-12T04:04:58.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.014+0000 7f883588b640 10 monclient: shutdown 2026-02-12T04:04:58.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.014+0000 7f883588b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:58.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.014+0000 7f883588b640 1 -- 10.20.193.91:0/977947511 >> v1:10.20.193.111:6789/0 conn(0x7f88301575d0 legacy=0x7f8830162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:58.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.014+0000 7f883588b640 1 -- 10.20.193.91:0/977947511 shutdown_connections 2026-02-12T04:04:58.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.014+0000 7f883588b640 1 -- 10.20.193.91:0/977947511 >> 10.20.193.91:0/977947511 conn(0x7f88300b6560 msgr2=0x7f88300b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:58.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.014+0000 7f883588b640 1 -- 10.20.193.91:0/977947511 shutdown_connections 2026-02-12T04:04:58.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.014+0000 7f883588b640 1 -- 10.20.193.91:0/977947511 wait complete. 2026-02-12T04:04:58.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.014+0000 7f883588b640 10 monclient: build_initial_monmap 2026-02-12T04:04:58.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.014+0000 7f883588b640 10 monclient: monmap: 2026-02-12T04:04:58.026 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:58.027 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:04:58.027 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:04:58.027 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:04:58.027 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:58.027 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:04:58.027 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:58.027 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:58.027 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:58.027 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.027 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.014+0000 7f883588b640 1 librados: starting msgr at 2026-02-12T04:04:58.027 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.014+0000 7f883588b640 1 librados: starting objecter 2026-02-12T04:04:58.027 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.014+0000 7f883588b640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:04:58.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.014+0000 7f883588b640 1 Processor -- start 2026-02-12T04:04:58.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.014+0000 7f883588b640 1 -- start start 2026-02-12T04:04:58.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.015+0000 7f883588b640 1 librados: setting wanted keys 2026-02-12T04:04:58.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.015+0000 7f883588b640 1 librados: calling monclient init 2026-02-12T04:04:58.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.015+0000 7f883588b640 10 monclient: init 2026-02-12T04:04:58.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.015+0000 7f883588b640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:58.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.015+0000 7f883588b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T04:04:58.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.015+0000 7f883588b640 10 monclient(hunting): picked mon.noname-b con 0x7f88300560d0 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:58.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.015+0000 7f883588b640 10 monclient(hunting): picked mon.noname-a con 0x7f88301575d0 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:58.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.015+0000 7f883588b640 10 monclient(hunting): picked mon.noname-c con 0x7f8830163310 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:58.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.015+0000 7f883588b640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88300af2d0 con 0x7f88301575d0 2026-02-12T04:04:58.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.015+0000 7f883588b640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88300af5b0 con 0x7f88300560d0 2026-02-12T04:04:58.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.015+0000 7f883588b640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88300af890 con 0x7f8830163310 2026-02-12T04:04:58.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.015+0000 7f883588b640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:58.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.015+0000 7f883588b640 10 monclient(hunting): authenticate will time out at 1500.758556s 2026-02-12T04:04:58.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.015+0000 7f882f7fe640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f8830163310 0x7f8830160280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:44320/0 (socket says 10.20.193.91:44320) 2026-02-12T04:04:58.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.015+0000 7f882effd640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f88300560d0 0x7f8830058840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:45532/0 (socket says 10.20.193.91:45532) 2026-02-12T04:04:58.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.015+0000 7f882f7fe640 1 -- 10.20.193.91:0/1728522419 learned_addr learned my addr 10.20.193.91:0/1728522419 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:58.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.016+0000 7f8807fff640 10 client.?.objecter ms_handle_connect 0x7f8830163310 2026-02-12T04:04:58.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.016+0000 7f8807fff640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:58.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.016+0000 7f8807fff640 10 client.?.objecter ms_handle_connect 0x7f88300560d0 2026-02-12T04:04:58.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.016+0000 7f8807fff640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:58.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.016+0000 7f8807fff640 1 -- 10.20.193.91:0/1728522419 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 678124015 0 0) 0x7f88300af890 con 0x7f8830163310 2026-02-12T04:04:58.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.016+0000 7f8807fff640 10 monclient(hunting): _negotiate 2026-02-12T04:04:58.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.016+0000 7f8807fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:58.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.016+0000 7f8807fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:58.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.016+0000 7f8807fff640 10 monclient(hunting): my global_id is 27515 2026-02-12T04:04:58.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.016+0000 7f8807fff640 1 -- 10.20.193.91:0/1728522419 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8800003610 con 0x7f8830163310 2026-02-12T04:04:58.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.017+0000 7f8807fff640 1 -- 10.20.193.91:0/1728522419 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2329040610 0 0) 0x7f88300af5b0 con 0x7f88300560d0 2026-02-12T04:04:58.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.017+0000 7f8807fff640 10 monclient(hunting): _negotiate 2026-02-12T04:04:58.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.017+0000 7f8807fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:58.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.017+0000 7f8807fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:58.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.017+0000 7f8807fff640 10 monclient(hunting): my global_id is 27820 2026-02-12T04:04:58.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.017+0000 7f8807fff640 1 -- 10.20.193.91:0/1728522419 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88300af890 con 0x7f88300560d0 2026-02-12T04:04:58.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.017+0000 7f8807fff640 10 client.?.objecter ms_handle_connect 0x7f88301575d0 2026-02-12T04:04:58.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.017+0000 7f8807fff640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:58.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.018+0000 7f8807fff640 1 -- 10.20.193.91:0/1728522419 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4070393848 0 0) 0x7f88300af2d0 con 0x7f88301575d0 2026-02-12T04:04:58.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.018+0000 7f8807fff640 10 monclient(hunting): _negotiate 2026-02-12T04:04:58.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.018+0000 7f8807fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:58.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.018+0000 7f8807fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:58.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.018+0000 7f8807fff640 10 monclient(hunting): my global_id is 30678 2026-02-12T04:04:58.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.018+0000 7f8807fff640 1 -- 10.20.193.91:0/1728522419 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88300af5b0 con 0x7f88301575d0 2026-02-12T04:04:58.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.019+0000 7f8807fff640 1 -- 10.20.193.91:0/1728522419 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 307607513 0 0) 0x7f88300af890 con 0x7f88300560d0 2026-02-12T04:04:58.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.019+0000 7f8807fff640 1 -- 10.20.193.91:0/1728522419 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f88300af2d0 con 0x7f88300560d0 2026-02-12T04:04:58.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.019+0000 7f8807fff640 1 -- 10.20.193.91:0/1728522419 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8824003350 con 0x7f88300560d0 2026-02-12T04:04:58.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.019+0000 7f8807fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:58.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.019+0000 7f8807fff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T04:04:58.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.019+0000 7f8807fff640 10 monclient(hunting): dump: 2026-02-12T04:04:58.031 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:58.032 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:58.032 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.032 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.032 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:58.032 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:58.032 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:58.032 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:58.032 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:58.032 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.019+0000 7f8807fff640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:04:58.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.020+0000 7f8807fff640 1 -- 10.20.193.91:0/1728522419 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 140377289 0 0) 0x7f8800003610 con 0x7f8830163310 2026-02-12T04:04:58.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.020+0000 7f8807fff640 1 -- 10.20.193.91:0/1728522419 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f88300af890 con 0x7f8830163310 2026-02-12T04:04:58.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.020+0000 7f8807fff640 1 -- 10.20.193.91:0/1728522419 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f88200032d0 con 0x7f8830163310 2026-02-12T04:04:58.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.020+0000 7f8807fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:58.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.020+0000 7f8807fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T04:04:58.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.020+0000 7f8807fff640 10 monclient(hunting): dump: 2026-02-12T04:04:58.033 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:58.033 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:58.033 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.033 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.033 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:58.033 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:58.033 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:58.033 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:58.034 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:58.034 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.036 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.021+0000 7f8807fff640 1 -- 10.20.193.91:0/1728522419 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1270864826 0 0) 0x7f88300af5b0 con 0x7f88301575d0 2026-02-12T04:04:58.037 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.021+0000 7f8807fff640 1 -- 10.20.193.91:0/1728522419 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8800003610 con 0x7f88301575d0 2026-02-12T04:04:58.037 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.021+0000 7f8807fff640 1 -- 10.20.193.91:0/1728522419 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8818002fc0 con 0x7f88301575d0 2026-02-12T04:04:58.037 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.021+0000 7f8807fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:58.037 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.021+0000 7f8807fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T04:04:58.037 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.021+0000 7f8807fff640 10 monclient(hunting): dump: 2026-02-12T04:04:58.037 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:58.037 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:58.037 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.037 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.037 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:58.037 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:58.038 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:58.038 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:58.038 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:58.038 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.021+0000 7f8807fff640 1 -- 10.20.193.91:0/1728522419 <== mon.1 v1:10.20.193.98:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1244268244 0 0) 0x7f88300af2d0 con 0x7f88300560d0 2026-02-12T04:04:58.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.021+0000 7f8807fff640 1 -- 10.20.193.91:0/1728522419 >> v1:10.20.193.111:6789/0 conn(0x7f8830163310 legacy=0x7f8830160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:58.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.021+0000 7f8807fff640 1 -- 10.20.193.91:0/1728522419 >> v1:10.20.193.91:6789/0 conn(0x7f88301575d0 legacy=0x7f883015fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:58.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.021+0000 7f8807fff640 10 monclient: _finish_hunting 0 2026-02-12T04:04:58.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.021+0000 7f8807fff640 1 monclient: found mon.b 2026-02-12T04:04:58.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.021+0000 7f8807fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:58.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.021+0000 7f8807fff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:04:58.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.021+0000 7f8807fff640 1 -- 10.20.193.91:0/1728522419 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88300afb70 con 0x7f88300560d0 2026-02-12T04:04:58.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.021+0000 7f8807fff640 10 monclient: _finish_auth 0 2026-02-12T04:04:58.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.021+0000 7f8807fff640 10 monclient: _check_auth_tickets 2026-02-12T04:04:58.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.021+0000 7f8807fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:58.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.021+0000 7f883588b640 5 monclient: authenticate success, global_id 27820 2026-02-12T04:04:58.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.021+0000 7f883588b640 10 monclient: _renew_subs 2026-02-12T04:04:58.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.021+0000 7f883588b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:04:58.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.021+0000 7f883588b640 1 -- 10.20.193.91:0/1728522419 --> v1:10.20.193.98:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f88300afe50 con 0x7f88300560d0 2026-02-12T04:04:58.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.021+0000 7f883588b640 10 client.27820.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:04:58.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.021+0000 7f883588b640 10 monclient: _renew_subs 2026-02-12T04:04:58.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.021+0000 7f883588b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:04:58.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.021+0000 7f883588b640 1 -- 10.20.193.91:0/1728522419 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8830058f50 con 0x7f88300560d0 2026-02-12T04:04:58.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.021+0000 7f883588b640 1 librados: init done 2026-02-12T04:04:58.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.021+0000 7f883588b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:58.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.021+0000 7f883588b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:58.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.021+0000 7f883588b640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:04:58.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.021+0000 7f883588b640 1 -- 10.20.193.91:0/1728522419 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88300b7290 con 0x7f88300560d0 2026-02-12T04:04:58.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.029+0000 7f8807fff640 1 -- 10.20.193.91:0/1728522419 <== mon.1 v1:10.20.193.98:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8824003000 con 0x7f88300560d0 2026-02-12T04:04:58.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.029+0000 7f8807fff640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:58.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.029+0000 7f8807fff640 1 -- 10.20.193.91:0/1728522419 <== mon.1 v1:10.20.193.98:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8824004ce0 con 0x7f88300560d0 2026-02-12T04:04:58.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.029+0000 7f8807fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:58.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.029+0000 7f8807fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T04:04:58.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.029+0000 7f8807fff640 10 monclient: dump: 2026-02-12T04:04:58.040 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:58.040 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:58.040 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.040 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.041 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:58.041 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:58.041 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:58.041 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:58.041 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:58.041 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.029+0000 7f882d7fa640 4 set_mon_vals no callback set 2026-02-12T04:04:58.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.030+0000 7f8807fff640 1 -- 10.20.193.91:0/1728522419 <== mon.1 v1:10.20.193.98:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f882401e1c0 con 0x7f88300560d0 2026-02-12T04:04:58.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.030+0000 7f882e7fc640 10 monclient: get_auth_request con 0x7f880007a0f0 auth_method 0 2026-02-12T04:04:58.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.030+0000 7f8807fff640 10 client.27820.objecter ms_handle_connect 0x7f880007a0f0 2026-02-12T04:04:58.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.030+0000 7f8807fff640 1 -- 10.20.193.91:0/1728522419 <== mon.1 v1:10.20.193.98:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7f88240959f0 con 0x7f88300560d0 2026-02-12T04:04:58.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.030+0000 7f8807fff640 10 client.27820.objecter ms_dispatch2 0x7f8830000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:04:58.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.030+0000 7f8807fff640 3 client.27820.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:04:58.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.030+0000 7f8807fff640 3 client.27820.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:04:58.042 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.030+0000 7f8807fff640 20 client.27820.objecter dump_active .. 0 homeless 2026-02-12T04:04:58.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.120+0000 7f8807fff640 1 -- 10.20.193.91:0/1728522419 <== mon.1 v1:10.20.193.98:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f882405f350 con 0x7f88300560d0 2026-02-12T04:04:58.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.120+0000 7f8807fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:58.122 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.120+0000 7f8807fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T04:04:58.228 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.226+0000 7f883588b640 1 -- 10.20.193.91:0/1728522419 --> v1:10.20.193.91:6800/2929217192 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f8830163d40 con 0x7f880007a0f0 2026-02-12T04:04:58.228 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.226+0000 7f8807fff640 1 -- 10.20.193.91:0/1728522419 <== mgr.4113 v1:10.20.193.91:6800/2929217192 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (unknown 489605429 0 0) 0x7f8830163d40 con 0x7f880007a0f0 2026-02-12T04:04:58.228 INFO:teuthology.orchestra.run.trial091.stderr:instructed osd(s) 1 to deep-scrub 2026-02-12T04:04:58.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.227+0000 7f883588b640 10 librados: watch_flush enter 2026-02-12T04:04:58.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.227+0000 7f883588b640 10 librados: watch_flush exit 2026-02-12T04:04:58.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.227+0000 7f883588b640 20 client.27820.objecter shutdown clearing up homeless session... 2026-02-12T04:04:58.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.227+0000 7f883588b640 10 client.27820.objecter successfully canceled tick 2026-02-12T04:04:58.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.227+0000 7f883588b640 1 -- 10.20.193.91:0/1728522419 >> v1:10.20.193.91:6800/2929217192 conn(0x7f880007a0f0 legacy=0x7f880009a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:58.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.227+0000 7f883588b640 10 monclient: shutdown 2026-02-12T04:04:58.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.227+0000 7f883588b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:58.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.227+0000 7f883588b640 1 -- 10.20.193.91:0/1728522419 >> v1:10.20.193.98:6789/0 conn(0x7f88300560d0 legacy=0x7f8830058840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:58.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.227+0000 7f883588b640 1 -- 10.20.193.91:0/1728522419 shutdown_connections 2026-02-12T04:04:58.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.227+0000 7f883588b640 1 -- 10.20.193.91:0/1728522419 >> 10.20.193.91:0/1728522419 conn(0x7f88300b6560 msgr2=0x7f8830154df0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:58.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.227+0000 7f883588b640 1 -- 10.20.193.91:0/1728522419 shutdown_connections 2026-02-12T04:04:58.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.227+0000 7f883588b640 1 -- 10.20.193.91:0/1728522419 wait complete. 2026-02-12T04:04:58.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.227+0000 7f883588b640 1 librados: shutdown 2026-02-12T04:04:58.237 INFO:tasks.ceph:Scrubbing osd.5 2026-02-12T04:04:58.237 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2026-02-12T04:04:58.309 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.307+0000 7f15fdfa8640 10 monclient: get_monmap_and_config 2026-02-12T04:04:58.309 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.307+0000 7f15fdfa8640 10 monclient: build_initial_monmap 2026-02-12T04:04:58.309 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.307+0000 7f15fdfa8640 10 monclient: monmap: 2026-02-12T04:04:58.309 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:58.309 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:58.309 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:04:58.307938+0000 2026-02-12T04:04:58.309 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:04:58.307938+0000 2026-02-12T04:04:58.309 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:58.310 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:58.310 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:58.310 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:58.310 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:58.310 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.312 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.307+0000 7f15fdfa8640 1 Processor -- start 2026-02-12T04:04:58.312 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.307+0000 7f15fdfa8640 1 -- start start 2026-02-12T04:04:58.312 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.307+0000 7f15fdfa8640 10 monclient: init 2026-02-12T04:04:58.312 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.308+0000 7f15fdfa8640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:58.312 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.308+0000 7f15fdfa8640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T04:04:58.312 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.308+0000 7f15fdfa8640 10 monclient(hunting): picked mon.noname-a con 0x7f15f8055c30 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:58.313 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.308+0000 7f15fdfa8640 10 monclient(hunting): picked mon.noname-b con 0x7f15f8160f80 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:58.313 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.308+0000 7f15fdfa8640 10 monclient(hunting): picked mon.noname-c con 0x7f15f8163230 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:58.313 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.308+0000 7f15fdfa8640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15f80b1fc0 con 0x7f15f8055c30 2026-02-12T04:04:58.313 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.308+0000 7f15fdfa8640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15f80b22a0 con 0x7f15f8160f80 2026-02-12T04:04:58.313 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.308+0000 7f15fdfa8640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15f80b2580 con 0x7f15f8163230 2026-02-12T04:04:58.313 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.308+0000 7f15fdfa8640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:58.313 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.308+0000 7f15fdfa8640 10 monclient(hunting): authenticate will time out at 1501.051376s 2026-02-12T04:04:58.313 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.308+0000 7f15f77fe640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f15f8055c30 0x7f15f8162b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:41582/0 (socket says 10.20.193.91:41582) 2026-02-12T04:04:58.313 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.308+0000 7f15f77fe640 1 -- 10.20.193.91:0/3872886873 learned_addr learned my addr 10.20.193.91:0/3872886873 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:58.313 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.310+0000 7f15f67fc640 1 -- 10.20.193.91:0/3872886873 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3582334245 0 0) 0x7f15f80b1fc0 con 0x7f15f8055c30 2026-02-12T04:04:58.314 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.310+0000 7f15f67fc640 10 monclient(hunting): _negotiate 2026-02-12T04:04:58.314 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.310+0000 7f15f67fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:58.314 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.310+0000 7f15f67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:58.314 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.310+0000 7f15f67fc640 10 monclient(hunting): my global_id is 30681 2026-02-12T04:04:58.314 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.310+0000 7f15f67fc640 1 -- 10.20.193.91:0/3872886873 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15dc003610 con 0x7f15f8055c30 2026-02-12T04:04:58.314 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.310+0000 7f15f67fc640 1 -- 10.20.193.91:0/3872886873 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2004994499 0 0) 0x7f15f80b22a0 con 0x7f15f8160f80 2026-02-12T04:04:58.314 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.310+0000 7f15f67fc640 10 monclient(hunting): _negotiate 2026-02-12T04:04:58.314 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.310+0000 7f15f67fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:58.314 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.310+0000 7f15f67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:58.314 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.310+0000 7f15f67fc640 10 monclient(hunting): my global_id is 27823 2026-02-12T04:04:58.314 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.310+0000 7f15f67fc640 1 -- 10.20.193.91:0/3872886873 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15f80b1fc0 con 0x7f15f8160f80 2026-02-12T04:04:58.314 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.310+0000 7f15f67fc640 1 -- 10.20.193.91:0/3872886873 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 517811922 0 0) 0x7f15f80b2580 con 0x7f15f8163230 2026-02-12T04:04:58.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.310+0000 7f15f67fc640 10 monclient(hunting): _negotiate 2026-02-12T04:04:58.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.310+0000 7f15f67fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:58.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.310+0000 7f15f67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:58.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.310+0000 7f15f67fc640 10 monclient(hunting): my global_id is 27518 2026-02-12T04:04:58.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.310+0000 7f15f67fc640 1 -- 10.20.193.91:0/3872886873 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15f80b22a0 con 0x7f15f8163230 2026-02-12T04:04:58.320 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.311+0000 7f15f67fc640 1 -- 10.20.193.91:0/3872886873 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1787836676 0 0) 0x7f15f80b1fc0 con 0x7f15f8160f80 2026-02-12T04:04:58.321 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.311+0000 7f15f67fc640 1 -- 10.20.193.91:0/3872886873 >> v1:10.20.193.111:6789/0 conn(0x7f15f8163230 legacy=0x7f15f81c57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:58.321 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.311+0000 7f15f67fc640 1 -- 10.20.193.91:0/3872886873 >> v1:10.20.193.91:6789/0 conn(0x7f15f8055c30 legacy=0x7f15f8162b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:58.321 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.311+0000 7f15f67fc640 10 monclient: _finish_hunting 0 2026-02-12T04:04:58.321 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.311+0000 7f15f67fc640 1 monclient: found mon.noname-b 2026-02-12T04:04:58.321 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.311+0000 7f15f67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:58.321 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.311+0000 7f15f67fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T04:04:58.321 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.311+0000 7f15f67fc640 1 -- 10.20.193.91:0/3872886873 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15f80b2860 con 0x7f15f8160f80 2026-02-12T04:04:58.321 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.311+0000 7f15f67fc640 10 monclient: _finish_auth 0 2026-02-12T04:04:58.321 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.311+0000 7f15f67fc640 10 monclient: _check_auth_tickets 2026-02-12T04:04:58.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.311+0000 7f15f67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:58.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.311+0000 7f15f67fc640 1 -- 10.20.193.91:0/3872886873 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f15e8002df0 con 0x7f15f8160f80 2026-02-12T04:04:58.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.311+0000 7f15f67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:58.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.311+0000 7f15f67fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T04:04:58.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.311+0000 7f15f67fc640 10 monclient: dump: 2026-02-12T04:04:58.322 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:58.322 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:58.322 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.322 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.322 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:58.322 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:58.322 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:58.323 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:58.323 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:58.323 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.311+0000 7f15fdfa8640 5 monclient: authenticate success, global_id 27823 2026-02-12T04:04:58.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.311+0000 7f15fdfa8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:04:58.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.312+0000 7f15f67fc640 1 -- 10.20.193.91:0/3872886873 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f15e8002f90 con 0x7f15f8160f80 2026-02-12T04:04:58.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.312+0000 7f15f67fc640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:58.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.312+0000 7f15f67fc640 1 -- 10.20.193.91:0/3872886873 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f15e80033d0 con 0x7f15f8160f80 2026-02-12T04:04:58.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.312+0000 7f15f67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:58.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.312+0000 7f15f67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T04:04:58.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.312+0000 7f15f67fc640 10 monclient: dump: 2026-02-12T04:04:58.323 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:58.324 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:58.324 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.324 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.324 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:58.324 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:58.324 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:58.324 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:58.324 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:58.324 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.312+0000 7f15fdfa8640 10 monclient: get_monmap_and_config success 2026-02-12T04:04:58.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.312+0000 7f15fdfa8640 4 set_mon_vals no callback set 2026-02-12T04:04:58.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.313+0000 7f15fdfa8640 10 monclient: shutdown 2026-02-12T04:04:58.325 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.313+0000 7f15fdfa8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:58.325 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.313+0000 7f15fdfa8640 1 -- 10.20.193.91:0/3872886873 >> v1:10.20.193.98:6789/0 conn(0x7f15f8160f80 legacy=0x7f15f81572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:58.325 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.313+0000 7f15fdfa8640 1 -- 10.20.193.91:0/3872886873 shutdown_connections 2026-02-12T04:04:58.325 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.313+0000 7f15fdfa8640 1 -- 10.20.193.91:0/3872886873 >> 10.20.193.91:0/3872886873 conn(0x7f15f80b6560 msgr2=0x7f15f80b6930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:58.325 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.313+0000 7f15fdfa8640 1 -- 10.20.193.91:0/3872886873 shutdown_connections 2026-02-12T04:04:58.325 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.313+0000 7f15fdfa8640 1 -- 10.20.193.91:0/3872886873 wait complete. 2026-02-12T04:04:58.325 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.313+0000 7f15fdfa8640 10 monclient: build_initial_monmap 2026-02-12T04:04:58.325 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.313+0000 7f15fdfa8640 10 monclient: monmap: 2026-02-12T04:04:58.325 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:58.325 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:04:58.325 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:04:58.325 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:04:58.326 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:58.326 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:04:58.326 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:58.326 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:58.326 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:58.326 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.326 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.313+0000 7f15fdfa8640 1 librados: starting msgr at 2026-02-12T04:04:58.326 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.313+0000 7f15fdfa8640 1 librados: starting objecter 2026-02-12T04:04:58.326 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.313+0000 7f15fdfa8640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:04:58.326 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.313+0000 7f15fdfa8640 1 Processor -- start 2026-02-12T04:04:58.326 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.313+0000 7f15fdfa8640 1 -- start start 2026-02-12T04:04:58.326 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.313+0000 7f15fdfa8640 1 librados: setting wanted keys 2026-02-12T04:04:58.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.313+0000 7f15fdfa8640 1 librados: calling monclient init 2026-02-12T04:04:58.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.313+0000 7f15fdfa8640 10 monclient: init 2026-02-12T04:04:58.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.314+0000 7f15fdfa8640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:58.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.314+0000 7f15fdfa8640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T04:04:58.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.314+0000 7f15fdfa8640 10 monclient(hunting): picked mon.noname-c con 0x7f15f8055c30 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:58.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.314+0000 7f15fdfa8640 10 monclient(hunting): picked mon.noname-b con 0x7f15f8160f80 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:58.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.314+0000 7f15fdfa8640 10 monclient(hunting): picked mon.noname-a con 0x7f15f8163230 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:58.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.314+0000 7f15fdfa8640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15f81606d0 con 0x7f15f8163230 2026-02-12T04:04:58.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.314+0000 7f15fdfa8640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15f81609b0 con 0x7f15f8160f80 2026-02-12T04:04:58.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.314+0000 7f15fdfa8640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15f8160c90 con 0x7f15f8055c30 2026-02-12T04:04:58.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.314+0000 7f15fdfa8640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:58.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.314+0000 7f15fdfa8640 10 monclient(hunting): authenticate will time out at 1501.057221s 2026-02-12T04:04:58.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.314+0000 7f15f7fff640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f15f8163230 0x7f15f812edd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:41592/0 (socket says 10.20.193.91:41592) 2026-02-12T04:04:58.328 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.314+0000 7f15f7fff640 1 -- 10.20.193.91:0/3168952377 learned_addr learned my addr 10.20.193.91:0/3168952377 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:58.328 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.314+0000 7f15d3fff640 10 client.?.objecter ms_handle_connect 0x7f15f8163230 2026-02-12T04:04:58.328 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.314+0000 7f15d3fff640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:58.328 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.314+0000 7f15d3fff640 10 client.?.objecter ms_handle_connect 0x7f15f8055c30 2026-02-12T04:04:58.328 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.314+0000 7f15d3fff640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:58.328 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.315+0000 7f15d3fff640 10 client.?.objecter ms_handle_connect 0x7f15f8160f80 2026-02-12T04:04:58.328 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.315+0000 7f15d3fff640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:58.328 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.315+0000 7f15d3fff640 1 -- 10.20.193.91:0/3168952377 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1884113252 0 0) 0x7f15f81606d0 con 0x7f15f8163230 2026-02-12T04:04:58.328 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.315+0000 7f15d3fff640 10 monclient(hunting): _negotiate 2026-02-12T04:04:58.328 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.315+0000 7f15d3fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:58.328 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.315+0000 7f15d3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:58.329 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.315+0000 7f15d3fff640 10 monclient(hunting): my global_id is 30684 2026-02-12T04:04:58.329 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.315+0000 7f15d3fff640 1 -- 10.20.193.91:0/3168952377 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15c8003610 con 0x7f15f8163230 2026-02-12T04:04:58.329 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.315+0000 7f15d3fff640 1 -- 10.20.193.91:0/3168952377 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3222657398 0 0) 0x7f15f8160c90 con 0x7f15f8055c30 2026-02-12T04:04:58.329 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.315+0000 7f15d3fff640 10 monclient(hunting): _negotiate 2026-02-12T04:04:58.329 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.315+0000 7f15d3fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:58.329 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.315+0000 7f15d3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:58.329 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.315+0000 7f15d3fff640 10 monclient(hunting): my global_id is 27521 2026-02-12T04:04:58.329 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.316+0000 7f15d3fff640 1 -- 10.20.193.91:0/3168952377 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15f81606d0 con 0x7f15f8055c30 2026-02-12T04:04:58.329 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.316+0000 7f15d3fff640 1 -- 10.20.193.91:0/3168952377 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3817369040 0 0) 0x7f15f81609b0 con 0x7f15f8160f80 2026-02-12T04:04:58.329 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.316+0000 7f15d3fff640 10 monclient(hunting): _negotiate 2026-02-12T04:04:58.329 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.316+0000 7f15d3fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:58.329 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.316+0000 7f15d3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:58.330 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.316+0000 7f15d3fff640 10 monclient(hunting): my global_id is 27826 2026-02-12T04:04:58.330 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.316+0000 7f15d3fff640 1 -- 10.20.193.91:0/3168952377 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15f8160c90 con 0x7f15f8160f80 2026-02-12T04:04:58.330 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.318+0000 7f15d3fff640 1 -- 10.20.193.91:0/3168952377 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1725687016 0 0) 0x7f15c8003610 con 0x7f15f8163230 2026-02-12T04:04:58.330 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.318+0000 7f15d3fff640 1 -- 10.20.193.91:0/3168952377 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f15f81609b0 con 0x7f15f8163230 2026-02-12T04:04:58.330 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.318+0000 7f15d3fff640 1 -- 10.20.193.91:0/3168952377 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f15ec003390 con 0x7f15f8163230 2026-02-12T04:04:58.330 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.318+0000 7f15d3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:58.330 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.318+0000 7f15d3fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T04:04:58.330 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.318+0000 7f15d3fff640 10 monclient(hunting): dump: 2026-02-12T04:04:58.330 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:58.330 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:58.330 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.330 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.331 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:58.331 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:58.331 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:58.331 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:58.331 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:58.331 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.331 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.318+0000 7f15d3fff640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:04:58.331 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.318+0000 7f15d3fff640 1 -- 10.20.193.91:0/3168952377 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3345478727 0 0) 0x7f15f8160c90 con 0x7f15f8160f80 2026-02-12T04:04:58.331 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.318+0000 7f15d3fff640 1 -- 10.20.193.91:0/3168952377 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f15c8003610 con 0x7f15f8160f80 2026-02-12T04:04:58.331 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.318+0000 7f15d3fff640 1 -- 10.20.193.91:0/3168952377 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f15e80032e0 con 0x7f15f8160f80 2026-02-12T04:04:58.331 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.318+0000 7f15d3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:58.332 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.318+0000 7f15d3fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T04:04:58.332 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.318+0000 7f15d3fff640 10 monclient(hunting): dump: 2026-02-12T04:04:58.332 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:58.332 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:58.332 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.332 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.332 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:58.332 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:58.332 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:58.332 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:58.332 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:58.332 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.318+0000 7f15d3fff640 1 -- 10.20.193.91:0/3168952377 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3817916417 0 0) 0x7f15f81606d0 con 0x7f15f8055c30 2026-02-12T04:04:58.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.318+0000 7f15d3fff640 1 -- 10.20.193.91:0/3168952377 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f15f8160c90 con 0x7f15f8055c30 2026-02-12T04:04:58.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.318+0000 7f15d3fff640 1 -- 10.20.193.91:0/3168952377 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f15e4003020 con 0x7f15f8055c30 2026-02-12T04:04:58.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.318+0000 7f15d3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:58.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.318+0000 7f15d3fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T04:04:58.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.318+0000 7f15d3fff640 10 monclient(hunting): dump: 2026-02-12T04:04:58.333 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:58.333 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:58.333 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.333 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.334 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:58.334 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:58.334 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:58.334 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:58.334 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:58.334 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.337 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.319+0000 7f15d3fff640 1 -- 10.20.193.91:0/3168952377 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3109130700 0 0) 0x7f15f81609b0 con 0x7f15f8163230 2026-02-12T04:04:58.337 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.319+0000 7f15d3fff640 1 -- 10.20.193.91:0/3168952377 >> v1:10.20.193.111:6789/0 conn(0x7f15f8055c30 legacy=0x7f15f811d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:58.337 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.319+0000 7f15d3fff640 1 -- 10.20.193.91:0/3168952377 >> v1:10.20.193.98:6789/0 conn(0x7f15f8160f80 legacy=0x7f15f8156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:58.337 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.319+0000 7f15d3fff640 10 monclient: _finish_hunting 0 2026-02-12T04:04:58.337 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.319+0000 7f15d3fff640 1 monclient: found mon.a 2026-02-12T04:04:58.337 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.319+0000 7f15d3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:58.338 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.319+0000 7f15d3fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:58.338 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.319+0000 7f15d3fff640 1 -- 10.20.193.91:0/3168952377 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15f8120fb0 con 0x7f15f8163230 2026-02-12T04:04:58.338 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.319+0000 7f15d3fff640 10 monclient: _finish_auth 0 2026-02-12T04:04:58.338 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.319+0000 7f15d3fff640 10 monclient: _check_auth_tickets 2026-02-12T04:04:58.338 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.319+0000 7f15d3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:58.338 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.319+0000 7f15fdfa8640 5 monclient: authenticate success, global_id 30684 2026-02-12T04:04:58.338 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.319+0000 7f15fdfa8640 10 monclient: _renew_subs 2026-02-12T04:04:58.338 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.319+0000 7f15fdfa8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:58.338 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.319+0000 7f15fdfa8640 1 -- 10.20.193.91:0/3168952377 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f15f8121290 con 0x7f15f8163230 2026-02-12T04:04:58.338 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.320+0000 7f15fdfa8640 10 client.30684.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:04:58.338 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.320+0000 7f15fdfa8640 10 monclient: _renew_subs 2026-02-12T04:04:58.338 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.320+0000 7f15fdfa8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:58.339 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.320+0000 7f15fdfa8640 1 -- 10.20.193.91:0/3168952377 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f15f8131a50 con 0x7f15f8163230 2026-02-12T04:04:58.339 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.320+0000 7f15fdfa8640 1 librados: init done 2026-02-12T04:04:58.339 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.320+0000 7f15fdfa8640 10 client.30684.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:58.339 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.320+0000 7f15fdfa8640 15 client.30684.objecter _session_command_op_assign -1 1 2026-02-12T04:04:58.339 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.320+0000 7f15fdfa8640 20 client.30684.objecter _get_session osd=-1 returning homeless 2026-02-12T04:04:58.339 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.320+0000 7f15fdfa8640 10 client.30684.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:04:58.339 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.320+0000 7f15fdfa8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:58.339 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.320+0000 7f15fdfa8640 1 -- 10.20.193.91:0/3168952377 --> v1:10.20.193.91:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f15f80b0990 con 0x7f15f8163230 2026-02-12T04:04:58.339 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.329+0000 7f15d3fff640 1 -- 10.20.193.91:0/3168952377 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f15f80b0990 con 0x7f15f8163230 2026-02-12T04:04:58.339 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.329+0000 7f15d3fff640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:58.339 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.329+0000 7f15d3fff640 1 -- 10.20.193.91:0/3168952377 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f15ec003c20 con 0x7f15f8163230 2026-02-12T04:04:58.339 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.329+0000 7f15d3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:58.339 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.329+0000 7f15d3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T04:04:58.340 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.329+0000 7f15f5ffb640 4 set_mon_vals no callback set 2026-02-12T04:04:58.340 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.329+0000 7f15d3fff640 10 monclient: dump: 2026-02-12T04:04:58.340 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:58.340 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:58.340 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.340 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.340 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:58.340 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:58.340 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:58.340 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:58.340 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:58.340 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.341 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.330+0000 7f15d3fff640 1 -- 10.20.193.91:0/3168952377 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f15ec003e00 con 0x7f15f8163230 2026-02-12T04:04:58.341 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.330+0000 7f15f77fe640 10 monclient: get_auth_request con 0x7f15c807a0f0 auth_method 0 2026-02-12T04:04:58.341 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.330+0000 7f15d3fff640 10 client.30684.objecter ms_handle_connect 0x7f15c807a0f0 2026-02-12T04:04:58.341 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.332+0000 7f15d3fff640 1 -- 10.20.193.91:0/3168952377 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7f15ec095bc0 con 0x7f15f8163230 2026-02-12T04:04:58.341 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.332+0000 7f15d3fff640 10 client.30684.objecter ms_dispatch2 0x7f15f8000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:04:58.341 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.332+0000 7f15d3fff640 3 client.30684.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:04:58.341 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.332+0000 7f15d3fff640 3 client.30684.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:04:58.341 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.332+0000 7f15d3fff640 10 client.30684.objecter checking command 1 2026-02-12T04:04:58.341 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.332+0000 7f15d3fff640 20 client.30684.objecter _get_session s=0x7f15c80a43a0 osd=5 3 2026-02-12T04:04:58.341 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.332+0000 7f15d3fff640 20 client.30684.objecter put_session s=0x7f15c80a43a0 osd=5 3 2026-02-12T04:04:58.341 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.332+0000 7f15d3fff640 15 client.30684.objecter _session_command_op_remove -1 1 2026-02-12T04:04:58.341 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.332+0000 7f15d3fff640 20 client.30684.objecter _get_session s=0x7f15c80a43a0 osd=5 3 2026-02-12T04:04:58.341 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.332+0000 7f15d3fff640 20 client.30684.objecter get_session s=0x7f15c80a43a0 osd=5 3 2026-02-12T04:04:58.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.332+0000 7f15d3fff640 15 client.30684.objecter _session_command_op_assign 5 1 2026-02-12T04:04:58.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.332+0000 7f15d3fff640 20 client.30684.objecter put_session s=0x7f15c80a43a0 osd=5 4 2026-02-12T04:04:58.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.332+0000 7f15d3fff640 10 client.30684.objecter _send_command 1 2026-02-12T04:04:58.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.332+0000 7f15d3fff640 1 -- 10.20.193.91:0/3168952377 --> v1:10.20.193.98:6808/3918277953 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f15c80c66b0 con 0x7f15c80a4a50 2026-02-12T04:04:58.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.332+0000 7f15d3fff640 20 client.30684.objecter dump_active .. 0 homeless 2026-02-12T04:04:58.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.332+0000 7f15d3fff640 1 -- 10.20.193.91:0/3168952377 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_get_version_reply(handle=1 version=344) ==== 24+0+0 (unknown 1403447244 0 0) 0x7f15ec05ebf0 con 0x7f15f8163230 2026-02-12T04:04:58.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.332+0000 7f15d3fff640 10 monclient: handle_get_version_reply finishing 1 version 344 2026-02-12T04:04:58.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.332+0000 7f15f6ffd640 10 monclient: get_auth_request con 0x7f15c80a4a50 auth_method 0 2026-02-12T04:04:58.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.333+0000 7f15d3fff640 10 client.30684.objecter ms_handle_connect 0x7f15c80a4a50 2026-02-12T04:04:58.345 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.343+0000 7f15d3fff640 1 -- 10.20.193.91:0/3168952377 <== osd.5 v1:10.20.193.98:6808/3918277953 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f15c80c66b0 con 0x7f15c80a4a50 2026-02-12T04:04:58.345 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.343+0000 7f15d3fff640 10 client.30684.objecter ms_dispatch2 0x7f15f8000b90 command_reply(tid 1: 0 ) 2026-02-12T04:04:58.345 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.343+0000 7f15d3fff640 10 client.30684.objecter _finish_command 1 = system:0 2026-02-12T04:04:58.345 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.343+0000 7f15d3fff640 20 client.30684.objecter put_session s=0x7f15c80a43a0 osd=5 4 2026-02-12T04:04:58.345 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.343+0000 7f15d3fff640 15 client.30684.objecter _session_command_op_remove 5 1 2026-02-12T04:04:58.352 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.350+0000 7f15fdfa8640 10 client.30684.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-12T04:04:58.352 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.350+0000 7f15fdfa8640 15 client.30684.objecter _session_command_op_assign -1 2 2026-02-12T04:04:58.352 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.350+0000 7f15fdfa8640 20 client.30684.objecter _get_session s=0x7f15c80a43a0 osd=5 3 2026-02-12T04:04:58.352 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.350+0000 7f15fdfa8640 20 client.30684.objecter put_session s=0x7f15c80a43a0 osd=5 3 2026-02-12T04:04:58.352 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.350+0000 7f15fdfa8640 20 client.30684.objecter _get_session s=0x7f15c80a43a0 osd=5 3 2026-02-12T04:04:58.353 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.350+0000 7f15fdfa8640 15 client.30684.objecter _session_command_op_remove -1 2 2026-02-12T04:04:58.353 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.350+0000 7f15fdfa8640 20 client.30684.objecter get_session s=0x7f15c80a43a0 osd=5 3 2026-02-12T04:04:58.353 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.350+0000 7f15fdfa8640 15 client.30684.objecter _session_command_op_assign 5 2 2026-02-12T04:04:58.353 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.350+0000 7f15fdfa8640 20 client.30684.objecter put_session s=0x7f15c80a43a0 osd=5 4 2026-02-12T04:04:58.353 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.350+0000 7f15fdfa8640 10 client.30684.objecter _send_command 2 2026-02-12T04:04:58.353 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.350+0000 7f15fdfa8640 1 -- 10.20.193.91:0/3168952377 --> v1:10.20.193.98:6808/3918277953 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f15f805a050 con 0x7f15c80a4a50 2026-02-12T04:04:58.359 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.358+0000 7f15d3fff640 1 -- 10.20.193.91:0/3168952377 <== osd.5 v1:10.20.193.98:6808/3918277953 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f15f805a050 con 0x7f15c80a4a50 2026-02-12T04:04:58.359 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.358+0000 7f15d3fff640 10 client.30684.objecter ms_dispatch2 0x7f15f8000b90 command_reply(tid 2: 0 ) 2026-02-12T04:04:58.360 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.358+0000 7f15d3fff640 10 client.30684.objecter _finish_command 2 = system:0 2026-02-12T04:04:58.360 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.358+0000 7f15d3fff640 20 client.30684.objecter put_session s=0x7f15c80a43a0 osd=5 4 2026-02-12T04:04:58.360 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.358+0000 7f15d3fff640 15 client.30684.objecter _session_command_op_remove 5 2 2026-02-12T04:04:58.360 INFO:teuthology.orchestra.run.trial091.stdout:{ 2026-02-12T04:04:58.360 INFO:teuthology.orchestra.run.trial091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-12T04:04:58.360 INFO:teuthology.orchestra.run.trial091.stdout:} 2026-02-12T04:04:58.362 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.358+0000 7f15fdfa8640 10 librados: watch_flush enter 2026-02-12T04:04:58.362 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.358+0000 7f15fdfa8640 10 librados: watch_flush exit 2026-02-12T04:04:58.362 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.358+0000 7f15fdfa8640 10 client.30684.objecter close_session for osd.5 2026-02-12T04:04:58.362 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.358+0000 7f15fdfa8640 1 -- 10.20.193.91:0/3168952377 >> v1:10.20.193.98:6808/3918277953 conn(0x7f15c80a4a50 legacy=0x7f15c80c4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:58.362 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.358+0000 7f15fdfa8640 20 client.30684.objecter put_session s=0x7f15c80a43a0 osd=5 1 2026-02-12T04:04:58.362 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.358+0000 7f15fdfa8640 20 client.30684.objecter shutdown clearing up homeless session... 2026-02-12T04:04:58.362 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.358+0000 7f15fdfa8640 10 client.30684.objecter successfully canceled tick 2026-02-12T04:04:58.362 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.358+0000 7f15fdfa8640 1 -- 10.20.193.91:0/3168952377 >> v1:10.20.193.91:6800/2929217192 conn(0x7f15c807a0f0 legacy=0x7f15c809a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:58.362 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.358+0000 7f15fdfa8640 10 monclient: shutdown 2026-02-12T04:04:58.362 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.358+0000 7f15fdfa8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:58.363 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.358+0000 7f15fdfa8640 1 -- 10.20.193.91:0/3168952377 >> v1:10.20.193.91:6789/0 conn(0x7f15f8163230 legacy=0x7f15f812edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:58.363 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.358+0000 7f15f7fff640 1 -- 10.20.193.91:0/3168952377 reap_dead start 2026-02-12T04:04:58.363 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.358+0000 7f15fdfa8640 1 -- 10.20.193.91:0/3168952377 shutdown_connections 2026-02-12T04:04:58.363 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.358+0000 7f15fdfa8640 1 -- 10.20.193.91:0/3168952377 >> 10.20.193.91:0/3168952377 conn(0x7f15f80b6560 msgr2=0x7f15f80b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:58.363 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.358+0000 7f15fdfa8640 1 -- 10.20.193.91:0/3168952377 shutdown_connections 2026-02-12T04:04:58.363 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.358+0000 7f15fdfa8640 1 -- 10.20.193.91:0/3168952377 wait complete. 2026-02-12T04:04:58.363 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.358+0000 7f15fdfa8640 1 librados: shutdown 2026-02-12T04:04:58.367 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2026-02-12T04:04:58.436 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.435+0000 7f636165e640 10 monclient: get_monmap_and_config 2026-02-12T04:04:58.437 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.435+0000 7f636165e640 10 monclient: build_initial_monmap 2026-02-12T04:04:58.437 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.435+0000 7f636165e640 10 monclient: monmap: 2026-02-12T04:04:58.437 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:58.437 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:58.437 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:04:58.435811+0000 2026-02-12T04:04:58.437 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:04:58.435811+0000 2026-02-12T04:04:58.437 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:58.437 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:58.438 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:58.438 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:58.438 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:58.438 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.440 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.435+0000 7f636165e640 1 Processor -- start 2026-02-12T04:04:58.440 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.435+0000 7f636165e640 1 -- start start 2026-02-12T04:04:58.440 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.435+0000 7f636165e640 10 monclient: init 2026-02-12T04:04:58.441 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.436+0000 7f636165e640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:58.441 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.436+0000 7f636165e640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T04:04:58.441 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.436+0000 7f636165e640 10 monclient(hunting): picked mon.noname-a con 0x7f635c1575d0 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:58.441 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.436+0000 7f636165e640 10 monclient(hunting): picked mon.noname-c con 0x7f635c163310 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:58.441 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.436+0000 7f636165e640 10 monclient(hunting): picked mon.noname-b con 0x7f635c0560d0 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:58.441 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.436+0000 7f636165e640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f635c0b20b0 con 0x7f635c1575d0 2026-02-12T04:04:58.441 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.436+0000 7f636165e640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f635c0b2390 con 0x7f635c0560d0 2026-02-12T04:04:58.441 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.436+0000 7f636165e640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f635c0b2670 con 0x7f635c163310 2026-02-12T04:04:58.441 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.436+0000 7f636165e640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:58.441 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.436+0000 7f636165e640 10 monclient(hunting): authenticate will time out at 1501.179302s 2026-02-12T04:04:58.441 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.436+0000 7f635b7fe640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f635c0560d0 0x7f635c1c56f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:45564/0 (socket says 10.20.193.91:45564) 2026-02-12T04:04:58.442 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.436+0000 7f635b7fe640 1 -- 10.20.193.91:0/4037511873 learned_addr learned my addr 10.20.193.91:0/4037511873 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:58.442 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.438+0000 7f6359ffb640 1 -- 10.20.193.91:0/4037511873 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1163321634 0 0) 0x7f635c0b2670 con 0x7f635c163310 2026-02-12T04:04:58.442 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.438+0000 7f6359ffb640 10 monclient(hunting): _negotiate 2026-02-12T04:04:58.442 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.438+0000 7f6359ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:58.442 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.438+0000 7f6359ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:58.442 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.438+0000 7f6359ffb640 10 monclient(hunting): my global_id is 27524 2026-02-12T04:04:58.442 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.438+0000 7f6359ffb640 1 -- 10.20.193.91:0/4037511873 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6348003610 con 0x7f635c163310 2026-02-12T04:04:58.442 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.438+0000 7f6359ffb640 1 -- 10.20.193.91:0/4037511873 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1487963180 0 0) 0x7f635c0b2390 con 0x7f635c0560d0 2026-02-12T04:04:58.442 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.438+0000 7f6359ffb640 10 monclient(hunting): _negotiate 2026-02-12T04:04:58.442 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.438+0000 7f6359ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:58.442 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.438+0000 7f6359ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:58.443 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.438+0000 7f6359ffb640 10 monclient(hunting): my global_id is 27829 2026-02-12T04:04:58.443 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.438+0000 7f6359ffb640 1 -- 10.20.193.91:0/4037511873 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f635c0b2670 con 0x7f635c0560d0 2026-02-12T04:04:58.443 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.438+0000 7f6359ffb640 1 -- 10.20.193.91:0/4037511873 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1229247752 0 0) 0x7f635c0b20b0 con 0x7f635c1575d0 2026-02-12T04:04:58.443 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.438+0000 7f6359ffb640 10 monclient(hunting): _negotiate 2026-02-12T04:04:58.443 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.438+0000 7f6359ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:58.443 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.438+0000 7f6359ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:58.443 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.438+0000 7f6359ffb640 10 monclient(hunting): my global_id is 30687 2026-02-12T04:04:58.443 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.438+0000 7f6359ffb640 1 -- 10.20.193.91:0/4037511873 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f635c0b2390 con 0x7f635c1575d0 2026-02-12T04:04:58.448 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.439+0000 7f6359ffb640 1 -- 10.20.193.91:0/4037511873 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 251804415 0 0) 0x7f6348003610 con 0x7f635c163310 2026-02-12T04:04:58.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.439+0000 7f6359ffb640 1 -- 10.20.193.91:0/4037511873 >> v1:10.20.193.98:6789/0 conn(0x7f635c0560d0 legacy=0x7f635c1c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:58.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.439+0000 7f6359ffb640 1 -- 10.20.193.91:0/4037511873 >> v1:10.20.193.91:6789/0 conn(0x7f635c1575d0 legacy=0x7f635c162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:58.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.439+0000 7f6359ffb640 10 monclient: _finish_hunting 0 2026-02-12T04:04:58.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.439+0000 7f6359ffb640 1 monclient: found mon.noname-c 2026-02-12T04:04:58.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.439+0000 7f6359ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:58.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.439+0000 7f6359ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.111:6789/0 2026-02-12T04:04:58.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.439+0000 7f6359ffb640 1 -- 10.20.193.91:0/4037511873 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f635c162400 con 0x7f635c163310 2026-02-12T04:04:58.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.439+0000 7f6359ffb640 10 monclient: _finish_auth 0 2026-02-12T04:04:58.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.439+0000 7f6359ffb640 10 monclient: _check_auth_tickets 2026-02-12T04:04:58.450 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.439+0000 7f6359ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:58.450 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.439+0000 7f6359ffb640 1 -- 10.20.193.91:0/4037511873 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f6344002df0 con 0x7f635c163310 2026-02-12T04:04:58.450 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.439+0000 7f6359ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:58.450 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.439+0000 7f6359ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T04:04:58.450 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.439+0000 7f6359ffb640 10 monclient: dump: 2026-02-12T04:04:58.450 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:58.450 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:58.450 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.450 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.450 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:58.450 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:58.450 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:58.450 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:58.451 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:58.451 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.439+0000 7f636165e640 5 monclient: authenticate success, global_id 27524 2026-02-12T04:04:58.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.439+0000 7f636165e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:04:58.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.440+0000 7f6359ffb640 1 -- 10.20.193.91:0/4037511873 <== mon.2 v1:10.20.193.111:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6344002fc0 con 0x7f635c163310 2026-02-12T04:04:58.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.440+0000 7f6359ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:58.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.440+0000 7f6359ffb640 1 -- 10.20.193.91:0/4037511873 <== mon.2 v1:10.20.193.111:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f6344003400 con 0x7f635c163310 2026-02-12T04:04:58.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.440+0000 7f6359ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:58.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.440+0000 7f6359ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T04:04:58.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.440+0000 7f6359ffb640 10 monclient: dump: 2026-02-12T04:04:58.451 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:58.451 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:58.452 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.452 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.452 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:58.452 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:58.452 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:58.452 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:58.452 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:58.452 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.452 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.440+0000 7f636165e640 10 monclient: get_monmap_and_config success 2026-02-12T04:04:58.452 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.440+0000 7f636165e640 4 set_mon_vals no callback set 2026-02-12T04:04:58.452 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.440+0000 7f636165e640 10 monclient: shutdown 2026-02-12T04:04:58.452 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.440+0000 7f636165e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:58.453 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.440+0000 7f636165e640 1 -- 10.20.193.91:0/4037511873 >> v1:10.20.193.111:6789/0 conn(0x7f635c163310 legacy=0x7f635c0559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:58.453 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.440+0000 7f636165e640 1 -- 10.20.193.91:0/4037511873 shutdown_connections 2026-02-12T04:04:58.453 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.440+0000 7f636165e640 1 -- 10.20.193.91:0/4037511873 >> 10.20.193.91:0/4037511873 conn(0x7f635c0b6560 msgr2=0x7f635c0b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:58.453 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.440+0000 7f636165e640 1 -- 10.20.193.91:0/4037511873 shutdown_connections 2026-02-12T04:04:58.453 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.440+0000 7f636165e640 1 -- 10.20.193.91:0/4037511873 wait complete. 2026-02-12T04:04:58.453 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.441+0000 7f636165e640 10 monclient: build_initial_monmap 2026-02-12T04:04:58.453 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.441+0000 7f636165e640 10 monclient: monmap: 2026-02-12T04:04:58.453 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:58.453 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:04:58.453 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:04:58.453 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:04:58.453 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:58.454 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:04:58.454 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:58.454 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:58.454 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:58.454 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.454 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.441+0000 7f636165e640 1 librados: starting msgr at 2026-02-12T04:04:58.454 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.441+0000 7f636165e640 1 librados: starting objecter 2026-02-12T04:04:58.454 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.441+0000 7f636165e640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:04:58.454 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.441+0000 7f636165e640 1 Processor -- start 2026-02-12T04:04:58.454 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.441+0000 7f636165e640 1 -- start start 2026-02-12T04:04:58.454 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.441+0000 7f636165e640 1 librados: setting wanted keys 2026-02-12T04:04:58.454 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.441+0000 7f636165e640 1 librados: calling monclient init 2026-02-12T04:04:58.455 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.441+0000 7f636165e640 10 monclient: init 2026-02-12T04:04:58.455 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.441+0000 7f636165e640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:58.455 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.441+0000 7f636165e640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T04:04:58.455 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.441+0000 7f636165e640 10 monclient(hunting): picked mon.noname-c con 0x7f635c0560d0 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:58.455 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.442+0000 7f636165e640 10 monclient(hunting): picked mon.noname-b con 0x7f635c1575d0 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:58.455 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.442+0000 7f636165e640 10 monclient(hunting): picked mon.noname-a con 0x7f635c163310 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:58.455 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.442+0000 7f636165e640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f635c11a4e0 con 0x7f635c163310 2026-02-12T04:04:58.455 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.442+0000 7f636165e640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f635c1195f0 con 0x7f635c1575d0 2026-02-12T04:04:58.455 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.442+0000 7f636165e640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f635c1198d0 con 0x7f635c0560d0 2026-02-12T04:04:58.455 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.442+0000 7f636165e640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:58.455 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.442+0000 7f636165e640 10 monclient(hunting): authenticate will time out at 1501.185028s 2026-02-12T04:04:58.455 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.442+0000 7f635b7fe640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f635c163310 0x7f635c144ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:41604/0 (socket says 10.20.193.91:41604) 2026-02-12T04:04:58.455 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.442+0000 7f635b7fe640 1 -- 10.20.193.91:0/709436785 learned_addr learned my addr 10.20.193.91:0/709436785 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:58.456 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.442+0000 7f633b7fe640 10 client.?.objecter ms_handle_connect 0x7f635c163310 2026-02-12T04:04:58.456 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.442+0000 7f633b7fe640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:58.456 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.442+0000 7f633b7fe640 10 client.?.objecter ms_handle_connect 0x7f635c0560d0 2026-02-12T04:04:58.456 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.442+0000 7f633b7fe640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:58.456 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.442+0000 7f633b7fe640 10 client.?.objecter ms_handle_connect 0x7f635c1575d0 2026-02-12T04:04:58.456 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.442+0000 7f633b7fe640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:58.456 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.443+0000 7f633b7fe640 1 -- 10.20.193.91:0/709436785 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 266829835 0 0) 0x7f635c0b2670 con 0x7f635c163310 2026-02-12T04:04:58.456 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.443+0000 7f633b7fe640 10 monclient(hunting): _negotiate 2026-02-12T04:04:58.456 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.443+0000 7f633b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:58.456 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.443+0000 7f633b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:58.456 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.443+0000 7f633b7fe640 10 monclient(hunting): my global_id is 30690 2026-02-12T04:04:58.456 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.443+0000 7f633b7fe640 1 -- 10.20.193.91:0/709436785 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6328003610 con 0x7f635c163310 2026-02-12T04:04:58.457 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.443+0000 7f633b7fe640 1 -- 10.20.193.91:0/709436785 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 234936221 0 0) 0x7f635c1198d0 con 0x7f635c0560d0 2026-02-12T04:04:58.457 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.443+0000 7f633b7fe640 10 monclient(hunting): _negotiate 2026-02-12T04:04:58.457 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.443+0000 7f633b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:58.457 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.443+0000 7f633b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:58.457 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.443+0000 7f633b7fe640 10 monclient(hunting): my global_id is 27527 2026-02-12T04:04:58.457 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.443+0000 7f633b7fe640 1 -- 10.20.193.91:0/709436785 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f635c0b2670 con 0x7f635c0560d0 2026-02-12T04:04:58.457 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.443+0000 7f633b7fe640 1 -- 10.20.193.91:0/709436785 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3658467756 0 0) 0x7f635c1195f0 con 0x7f635c1575d0 2026-02-12T04:04:58.457 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.443+0000 7f633b7fe640 10 monclient(hunting): _negotiate 2026-02-12T04:04:58.457 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.443+0000 7f633b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:58.457 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.443+0000 7f633b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:58.457 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.443+0000 7f633b7fe640 10 monclient(hunting): my global_id is 27832 2026-02-12T04:04:58.458 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.443+0000 7f633b7fe640 1 -- 10.20.193.91:0/709436785 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f635c1198d0 con 0x7f635c1575d0 2026-02-12T04:04:58.458 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.446+0000 7f633b7fe640 1 -- 10.20.193.91:0/709436785 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 549987557 0 0) 0x7f635c0b2670 con 0x7f635c0560d0 2026-02-12T04:04:58.458 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.446+0000 7f633b7fe640 1 -- 10.20.193.91:0/709436785 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f635c1195f0 con 0x7f635c0560d0 2026-02-12T04:04:58.458 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.446+0000 7f633b7fe640 1 -- 10.20.193.91:0/709436785 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f6350003060 con 0x7f635c0560d0 2026-02-12T04:04:58.458 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.446+0000 7f633b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:58.458 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.446+0000 7f633b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T04:04:58.458 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.446+0000 7f633b7fe640 10 monclient(hunting): dump: 2026-02-12T04:04:58.458 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:58.458 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:58.458 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.458 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.458 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:58.458 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:58.459 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:58.459 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:58.459 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:58.459 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.459 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.446+0000 7f633b7fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:04:58.459 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.446+0000 7f633b7fe640 1 -- 10.20.193.91:0/709436785 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4010041164 0 0) 0x7f6328003610 con 0x7f635c163310 2026-02-12T04:04:58.459 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.446+0000 7f633b7fe640 1 -- 10.20.193.91:0/709436785 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f635c0b2670 con 0x7f635c163310 2026-02-12T04:04:58.459 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.446+0000 7f633b7fe640 1 -- 10.20.193.91:0/709436785 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f634c003430 con 0x7f635c163310 2026-02-12T04:04:58.459 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.446+0000 7f633b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:58.459 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.446+0000 7f633b7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T04:04:58.459 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.446+0000 7f633b7fe640 10 monclient(hunting): dump: 2026-02-12T04:04:58.460 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:58.460 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:58.460 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.460 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.460 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:58.460 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:58.460 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:58.460 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:58.460 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:58.460 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.460 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.446+0000 7f633b7fe640 1 -- 10.20.193.91:0/709436785 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1811759916 0 0) 0x7f635c1198d0 con 0x7f635c1575d0 2026-02-12T04:04:58.460 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.446+0000 7f633b7fe640 1 -- 10.20.193.91:0/709436785 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6328003610 con 0x7f635c1575d0 2026-02-12T04:04:58.460 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.446+0000 7f633b7fe640 1 -- 10.20.193.91:0/709436785 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f6344003310 con 0x7f635c1575d0 2026-02-12T04:04:58.461 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.446+0000 7f633b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:58.461 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.446+0000 7f633b7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T04:04:58.461 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.446+0000 7f633b7fe640 10 monclient(hunting): dump: 2026-02-12T04:04:58.461 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:58.461 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:58.461 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.461 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.461 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:58.461 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:58.461 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:58.461 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:58.461 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:58.462 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.464 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.447+0000 7f633b7fe640 1 -- 10.20.193.91:0/709436785 <== mon.2 v1:10.20.193.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4142312589 0 0) 0x7f635c1195f0 con 0x7f635c0560d0 2026-02-12T04:04:58.465 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.447+0000 7f633b7fe640 1 -- 10.20.193.91:0/709436785 >> v1:10.20.193.98:6789/0 conn(0x7f635c1575d0 legacy=0x7f635c118b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:58.465 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.447+0000 7f633b7fe640 1 -- 10.20.193.91:0/709436785 >> v1:10.20.193.91:6789/0 conn(0x7f635c163310 legacy=0x7f635c144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:58.465 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.447+0000 7f633b7fe640 10 monclient: _finish_hunting 0 2026-02-12T04:04:58.465 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.447+0000 7f633b7fe640 1 monclient: found mon.c 2026-02-12T04:04:58.465 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.447+0000 7f633b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:58.465 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.447+0000 7f633b7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:04:58.465 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.447+0000 7f633b7fe640 1 -- 10.20.193.91:0/709436785 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f635c119bb0 con 0x7f635c0560d0 2026-02-12T04:04:58.465 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.447+0000 7f633b7fe640 10 monclient: _finish_auth 0 2026-02-12T04:04:58.465 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.447+0000 7f633b7fe640 10 monclient: _check_auth_tickets 2026-02-12T04:04:58.465 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.447+0000 7f633b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:58.465 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.447+0000 7f636165e640 5 monclient: authenticate success, global_id 27527 2026-02-12T04:04:58.465 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.447+0000 7f636165e640 10 monclient: _renew_subs 2026-02-12T04:04:58.466 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.447+0000 7f636165e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:04:58.466 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.447+0000 7f636165e640 1 -- 10.20.193.91:0/709436785 --> v1:10.20.193.111:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f635c119e90 con 0x7f635c0560d0 2026-02-12T04:04:58.466 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.448+0000 7f636165e640 10 client.27527.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:04:58.466 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.448+0000 7f636165e640 10 monclient: _renew_subs 2026-02-12T04:04:58.466 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.448+0000 7f636165e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:04:58.466 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.448+0000 7f636165e640 1 -- 10.20.193.91:0/709436785 --> v1:10.20.193.111:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f635c1476e0 con 0x7f635c0560d0 2026-02-12T04:04:58.466 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.448+0000 7f636165e640 1 librados: init done 2026-02-12T04:04:58.466 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.448+0000 7f636165e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:58.466 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.448+0000 7f636165e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:58.466 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.448+0000 7f636165e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:04:58.466 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.448+0000 7f636165e640 1 -- 10.20.193.91:0/709436785 --> v1:10.20.193.111:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f635c0b7290 con 0x7f635c0560d0 2026-02-12T04:04:58.466 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.456+0000 7f633b7fe640 1 -- 10.20.193.91:0/709436785 <== mon.2 v1:10.20.193.111:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6350003200 con 0x7f635c0560d0 2026-02-12T04:04:58.467 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.456+0000 7f633b7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:58.467 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.456+0000 7f633b7fe640 1 -- 10.20.193.91:0/709436785 <== mon.2 v1:10.20.193.111:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f6350003920 con 0x7f635c0560d0 2026-02-12T04:04:58.467 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.456+0000 7f633b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:58.467 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.456+0000 7f633b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T04:04:58.467 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.456+0000 7f633b7fe640 10 monclient: dump: 2026-02-12T04:04:58.467 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:58.467 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:58.467 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.467 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.467 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:58.467 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:58.467 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:58.468 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:58.468 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:58.468 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.468 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.456+0000 7f63597fa640 4 set_mon_vals no callback set 2026-02-12T04:04:58.468 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.457+0000 7f633b7fe640 1 -- 10.20.193.91:0/709436785 <== mon.2 v1:10.20.193.111:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f635001ce00 con 0x7f635c0560d0 2026-02-12T04:04:58.468 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.457+0000 7f635a7fc640 10 monclient: get_auth_request con 0x7f6328079ff0 auth_method 0 2026-02-12T04:04:58.468 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.457+0000 7f633b7fe640 10 client.27527.objecter ms_handle_connect 0x7f6328079ff0 2026-02-12T04:04:58.468 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.458+0000 7f633b7fe640 1 -- 10.20.193.91:0/709436785 <== mon.2 v1:10.20.193.111:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7f63500948a0 con 0x7f635c0560d0 2026-02-12T04:04:58.468 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.458+0000 7f633b7fe640 10 client.27527.objecter ms_dispatch2 0x7f635c000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:04:58.468 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.458+0000 7f633b7fe640 3 client.27527.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:04:58.468 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.458+0000 7f633b7fe640 3 client.27527.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:04:58.468 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.458+0000 7f633b7fe640 20 client.27527.objecter dump_active .. 0 homeless 2026-02-12T04:04:58.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.547+0000 7f633b7fe640 1 -- 10.20.193.91:0/709436785 <== mon.2 v1:10.20.193.111:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f635005e200 con 0x7f635c0560d0 2026-02-12T04:04:58.549 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.547+0000 7f633b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:58.549 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.547+0000 7f633b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T04:04:58.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.656+0000 7f636165e640 1 -- 10.20.193.91:0/709436785 --> v1:10.20.193.91:6800/2929217192 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f635c1388d0 con 0x7f6328079ff0 2026-02-12T04:04:58.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.656+0000 7f633b7fe640 1 -- 10.20.193.91:0/709436785 <== mgr.4113 v1:10.20.193.91:6800/2929217192 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (unknown 2264484800 0 0) 0x7f635c1388d0 con 0x7f6328079ff0 2026-02-12T04:04:58.658 INFO:teuthology.orchestra.run.trial091.stderr:instructed osd(s) 5 to deep-scrub 2026-02-12T04:04:58.661 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.658+0000 7f636165e640 10 librados: watch_flush enter 2026-02-12T04:04:58.661 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.658+0000 7f636165e640 10 librados: watch_flush exit 2026-02-12T04:04:58.661 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.658+0000 7f636165e640 20 client.27527.objecter shutdown clearing up homeless session... 2026-02-12T04:04:58.661 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.658+0000 7f636165e640 10 client.27527.objecter successfully canceled tick 2026-02-12T04:04:58.661 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.658+0000 7f636165e640 1 -- 10.20.193.91:0/709436785 >> v1:10.20.193.91:6800/2929217192 conn(0x7f6328079ff0 legacy=0x7f632809a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:58.661 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.658+0000 7f636165e640 10 monclient: shutdown 2026-02-12T04:04:58.661 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.658+0000 7f636165e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:58.661 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.658+0000 7f636165e640 1 -- 10.20.193.91:0/709436785 >> v1:10.20.193.111:6789/0 conn(0x7f635c0560d0 legacy=0x7f635c059470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:58.661 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.658+0000 7f636165e640 1 -- 10.20.193.91:0/709436785 shutdown_connections 2026-02-12T04:04:58.661 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.658+0000 7f636165e640 1 -- 10.20.193.91:0/709436785 >> 10.20.193.91:0/709436785 conn(0x7f635c0b6560 msgr2=0x7f635c156750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:58.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.658+0000 7f636165e640 1 -- 10.20.193.91:0/709436785 shutdown_connections 2026-02-12T04:04:58.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.658+0000 7f636165e640 1 -- 10.20.193.91:0/709436785 wait complete. 2026-02-12T04:04:58.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.658+0000 7f636165e640 1 librados: shutdown 2026-02-12T04:04:58.668 INFO:tasks.ceph:Scrubbing osd.9 2026-02-12T04:04:58.669 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 config set osd_debug_deep_scrub_sleep 0 2026-02-12T04:04:58.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.738+0000 7f9f17768640 10 monclient: get_monmap_and_config 2026-02-12T04:04:58.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.738+0000 7f9f17768640 10 monclient: build_initial_monmap 2026-02-12T04:04:58.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.738+0000 7f9f17768640 10 monclient: monmap: 2026-02-12T04:04:58.740 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:58.740 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:58.740 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:04:58.738980+0000 2026-02-12T04:04:58.740 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:04:58.738980+0000 2026-02-12T04:04:58.740 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:58.741 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:58.741 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:58.741 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:58.741 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:58.741 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.738+0000 7f9f17768640 1 Processor -- start 2026-02-12T04:04:58.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.738+0000 7f9f17768640 1 -- start start 2026-02-12T04:04:58.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.738+0000 7f9f17768640 10 monclient: init 2026-02-12T04:04:58.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.739+0000 7f9f17768640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:58.743 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.739+0000 7f9f17768640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T04:04:58.743 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.739+0000 7f9f17768640 10 monclient(hunting): picked mon.noname-b con 0x7f9f10055c30 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:58.743 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.739+0000 7f9f17768640 10 monclient(hunting): picked mon.noname-a con 0x7f9f10160f80 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:58.743 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.739+0000 7f9f17768640 10 monclient(hunting): picked mon.noname-c con 0x7f9f10163230 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:58.743 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.739+0000 7f9f17768640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f100b1fc0 con 0x7f9f10160f80 2026-02-12T04:04:58.743 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.739+0000 7f9f17768640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f100b22a0 con 0x7f9f10055c30 2026-02-12T04:04:58.743 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.739+0000 7f9f17768640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f100b2580 con 0x7f9f10163230 2026-02-12T04:04:58.743 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.739+0000 7f9f17768640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:58.743 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.739+0000 7f9f17768640 10 monclient(hunting): authenticate will time out at 1501.482409s 2026-02-12T04:04:58.743 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.739+0000 7f9f14cdc640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f9f10160f80 0x7f9f101572d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:41612/0 (socket says 10.20.193.91:41612) 2026-02-12T04:04:58.743 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.739+0000 7f9f14cdc640 1 -- 10.20.193.91:0/3092234288 learned_addr learned my addr 10.20.193.91:0/3092234288 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:58.749 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.741+0000 7f9efffff640 1 -- 10.20.193.91:0/3092234288 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2616529282 0 0) 0x7f9f100b1fc0 con 0x7f9f10160f80 2026-02-12T04:04:58.749 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.741+0000 7f9efffff640 10 monclient(hunting): _negotiate 2026-02-12T04:04:58.749 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.741+0000 7f9efffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:58.749 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.741+0000 7f9efffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:58.749 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.741+0000 7f9efffff640 10 monclient(hunting): my global_id is 30693 2026-02-12T04:04:58.750 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.741+0000 7f9efffff640 1 -- 10.20.193.91:0/3092234288 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ef8003610 con 0x7f9f10160f80 2026-02-12T04:04:58.750 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.741+0000 7f9efffff640 1 -- 10.20.193.91:0/3092234288 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4020709261 0 0) 0x7f9f100b22a0 con 0x7f9f10055c30 2026-02-12T04:04:58.750 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.741+0000 7f9efffff640 10 monclient(hunting): _negotiate 2026-02-12T04:04:58.750 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.741+0000 7f9efffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:58.750 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.741+0000 7f9efffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:58.750 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.741+0000 7f9efffff640 10 monclient(hunting): my global_id is 27835 2026-02-12T04:04:58.750 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.741+0000 7f9efffff640 1 -- 10.20.193.91:0/3092234288 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f100b1fc0 con 0x7f9f10055c30 2026-02-12T04:04:58.750 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.741+0000 7f9efffff640 1 -- 10.20.193.91:0/3092234288 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1352128063 0 0) 0x7f9f100b2580 con 0x7f9f10163230 2026-02-12T04:04:58.750 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.741+0000 7f9efffff640 10 monclient(hunting): _negotiate 2026-02-12T04:04:58.750 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.741+0000 7f9efffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:58.750 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.741+0000 7f9efffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:58.751 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.741+0000 7f9efffff640 10 monclient(hunting): my global_id is 27530 2026-02-12T04:04:58.751 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.741+0000 7f9efffff640 1 -- 10.20.193.91:0/3092234288 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f100b22a0 con 0x7f9f10163230 2026-02-12T04:04:58.751 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.743+0000 7f9efffff640 1 -- 10.20.193.91:0/3092234288 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 746122238 0 0) 0x7f9f100b1fc0 con 0x7f9f10055c30 2026-02-12T04:04:58.751 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.743+0000 7f9efffff640 1 -- 10.20.193.91:0/3092234288 >> v1:10.20.193.111:6789/0 conn(0x7f9f10163230 legacy=0x7f9f101c57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:58.751 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.743+0000 7f9efffff640 1 -- 10.20.193.91:0/3092234288 >> v1:10.20.193.91:6789/0 conn(0x7f9f10160f80 legacy=0x7f9f101572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:58.751 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.743+0000 7f9efffff640 10 monclient: _finish_hunting 0 2026-02-12T04:04:58.751 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.743+0000 7f9efffff640 1 monclient: found mon.noname-b 2026-02-12T04:04:58.751 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.743+0000 7f9efffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:58.751 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.743+0000 7f9efffff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T04:04:58.751 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.743+0000 7f9efffff640 1 -- 10.20.193.91:0/3092234288 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f100b2860 con 0x7f9f10055c30 2026-02-12T04:04:58.751 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.743+0000 7f9efffff640 10 monclient: _finish_auth 0 2026-02-12T04:04:58.751 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.743+0000 7f9efffff640 10 monclient: _check_auth_tickets 2026-02-12T04:04:58.752 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.743+0000 7f9efffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:58.752 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.743+0000 7f9efffff640 1 -- 10.20.193.91:0/3092234288 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f9f00002df0 con 0x7f9f10055c30 2026-02-12T04:04:58.752 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.743+0000 7f9efffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:58.752 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.743+0000 7f9efffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T04:04:58.752 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.743+0000 7f9efffff640 10 monclient: dump: 2026-02-12T04:04:58.752 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:58.752 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:58.752 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.752 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.752 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:58.752 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:58.752 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:58.753 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:58.753 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:58.753 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.753 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.743+0000 7f9f17768640 5 monclient: authenticate success, global_id 27835 2026-02-12T04:04:58.753 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.743+0000 7f9f17768640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:04:58.753 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.744+0000 7f9efffff640 1 -- 10.20.193.91:0/3092234288 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9f00002fc0 con 0x7f9f10055c30 2026-02-12T04:04:58.753 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.744+0000 7f9efffff640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:58.753 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.744+0000 7f9efffff640 1 -- 10.20.193.91:0/3092234288 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f9f00003400 con 0x7f9f10055c30 2026-02-12T04:04:58.753 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.744+0000 7f9efffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:58.753 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.744+0000 7f9efffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T04:04:58.753 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.744+0000 7f9efffff640 10 monclient: dump: 2026-02-12T04:04:58.754 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:58.754 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:58.754 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.754 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.754 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:58.754 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:58.754 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:58.754 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:58.754 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:58.754 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.754 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.744+0000 7f9f17768640 10 monclient: get_monmap_and_config success 2026-02-12T04:04:58.754 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.744+0000 7f9f17768640 4 set_mon_vals no callback set 2026-02-12T04:04:58.755 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.744+0000 7f9f17768640 10 monclient: shutdown 2026-02-12T04:04:58.755 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.744+0000 7f9f17768640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:58.755 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.744+0000 7f9f17768640 1 -- 10.20.193.91:0/3092234288 >> v1:10.20.193.98:6789/0 conn(0x7f9f10055c30 legacy=0x7f9f10162b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:58.755 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.744+0000 7f9f17768640 1 -- 10.20.193.91:0/3092234288 shutdown_connections 2026-02-12T04:04:58.755 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.744+0000 7f9f17768640 1 -- 10.20.193.91:0/3092234288 >> 10.20.193.91:0/3092234288 conn(0x7f9f100b6560 msgr2=0x7f9f100b6930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:58.755 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.744+0000 7f9f17768640 1 -- 10.20.193.91:0/3092234288 shutdown_connections 2026-02-12T04:04:58.755 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.744+0000 7f9f17768640 1 -- 10.20.193.91:0/3092234288 wait complete. 2026-02-12T04:04:58.755 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.744+0000 7f9f17768640 10 monclient: build_initial_monmap 2026-02-12T04:04:58.755 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.744+0000 7f9f17768640 10 monclient: monmap: 2026-02-12T04:04:58.755 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:58.755 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:04:58.755 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:04:58.755 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:04:58.756 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:58.756 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:04:58.756 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:58.756 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:58.756 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:58.756 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.756 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.744+0000 7f9f17768640 1 librados: starting msgr at 2026-02-12T04:04:58.756 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.744+0000 7f9f17768640 1 librados: starting objecter 2026-02-12T04:04:58.756 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.744+0000 7f9f17768640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:04:58.756 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.745+0000 7f9f17768640 1 Processor -- start 2026-02-12T04:04:58.756 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.745+0000 7f9f17768640 1 -- start start 2026-02-12T04:04:58.756 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.745+0000 7f9f17768640 1 librados: setting wanted keys 2026-02-12T04:04:58.756 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.745+0000 7f9f17768640 1 librados: calling monclient init 2026-02-12T04:04:58.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.745+0000 7f9f17768640 10 monclient: init 2026-02-12T04:04:58.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.745+0000 7f9f17768640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:58.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.745+0000 7f9f17768640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T04:04:58.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.745+0000 7f9f17768640 10 monclient(hunting): picked mon.noname-b con 0x7f9f10055c30 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:58.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.745+0000 7f9f17768640 10 monclient(hunting): picked mon.noname-c con 0x7f9f10160f80 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:58.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.745+0000 7f9f17768640 10 monclient(hunting): picked mon.noname-a con 0x7f9f10163230 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:58.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.745+0000 7f9f17768640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f100b19d0 con 0x7f9f10163230 2026-02-12T04:04:58.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.745+0000 7f9f17768640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f1011db10 con 0x7f9f10055c30 2026-02-12T04:04:58.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.745+0000 7f9f17768640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f1011ddf0 con 0x7f9f10160f80 2026-02-12T04:04:58.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.745+0000 7f9f17768640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:58.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.745+0000 7f9f17768640 10 monclient(hunting): authenticate will time out at 1501.488432s 2026-02-12T04:04:58.757 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.745+0000 7f9f15cde640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f9f10163230 0x7f9f10137b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:41626/0 (socket says 10.20.193.91:41626) 2026-02-12T04:04:58.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.745+0000 7f9f15cde640 1 -- 10.20.193.91:0/949030140 learned_addr learned my addr 10.20.193.91:0/949030140 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:58.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.745+0000 7f9efdffb640 10 client.?.objecter ms_handle_connect 0x7f9f10163230 2026-02-12T04:04:58.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.745+0000 7f9efdffb640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:58.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.745+0000 7f9efdffb640 10 client.?.objecter ms_handle_connect 0x7f9f10055c30 2026-02-12T04:04:58.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.745+0000 7f9efdffb640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:58.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.746+0000 7f9efdffb640 10 client.?.objecter ms_handle_connect 0x7f9f10160f80 2026-02-12T04:04:58.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.746+0000 7f9efdffb640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:58.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.746+0000 7f9efdffb640 1 -- 10.20.193.91:0/949030140 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3828387432 0 0) 0x7f9f100b19d0 con 0x7f9f10163230 2026-02-12T04:04:58.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.746+0000 7f9efdffb640 10 monclient(hunting): _negotiate 2026-02-12T04:04:58.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.746+0000 7f9efdffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:58.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.746+0000 7f9efdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:58.758 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.746+0000 7f9efdffb640 10 monclient(hunting): my global_id is 30696 2026-02-12T04:04:58.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.746+0000 7f9efdffb640 1 -- 10.20.193.91:0/949030140 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ee0003610 con 0x7f9f10163230 2026-02-12T04:04:58.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.747+0000 7f9efdffb640 1 -- 10.20.193.91:0/949030140 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2157563323 0 0) 0x7f9f1011db10 con 0x7f9f10055c30 2026-02-12T04:04:58.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.747+0000 7f9efdffb640 10 monclient(hunting): _negotiate 2026-02-12T04:04:58.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.747+0000 7f9efdffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:58.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.747+0000 7f9efdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:58.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.747+0000 7f9efdffb640 10 monclient(hunting): my global_id is 27838 2026-02-12T04:04:58.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.747+0000 7f9efdffb640 1 -- 10.20.193.91:0/949030140 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f100b19d0 con 0x7f9f10055c30 2026-02-12T04:04:58.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.747+0000 7f9efdffb640 1 -- 10.20.193.91:0/949030140 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 22466615 0 0) 0x7f9f1011ddf0 con 0x7f9f10160f80 2026-02-12T04:04:58.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.747+0000 7f9efdffb640 10 monclient(hunting): _negotiate 2026-02-12T04:04:58.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.747+0000 7f9efdffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:58.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.747+0000 7f9efdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:58.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.747+0000 7f9efdffb640 10 monclient(hunting): my global_id is 27533 2026-02-12T04:04:58.759 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.747+0000 7f9efdffb640 1 -- 10.20.193.91:0/949030140 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f1011db10 con 0x7f9f10160f80 2026-02-12T04:04:58.764 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.749+0000 7f9efdffb640 1 -- 10.20.193.91:0/949030140 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3576648373 0 0) 0x7f9ee0003610 con 0x7f9f10163230 2026-02-12T04:04:58.764 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.749+0000 7f9efdffb640 1 -- 10.20.193.91:0/949030140 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9f1011ddf0 con 0x7f9f10163230 2026-02-12T04:04:58.764 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.749+0000 7f9efdffb640 1 -- 10.20.193.91:0/949030140 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f9f0c003390 con 0x7f9f10163230 2026-02-12T04:04:58.764 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.749+0000 7f9efdffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:58.764 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.749+0000 7f9efdffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T04:04:58.764 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.749+0000 7f9efdffb640 10 monclient(hunting): dump: 2026-02-12T04:04:58.764 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:58.764 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:58.764 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.764 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.765 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:58.765 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:58.765 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:58.765 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:58.765 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:58.765 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.765 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.749+0000 7f9efdffb640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:04:58.765 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.749+0000 7f9efdffb640 1 -- 10.20.193.91:0/949030140 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 425743854 0 0) 0x7f9f100b19d0 con 0x7f9f10055c30 2026-02-12T04:04:58.765 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.749+0000 7f9efdffb640 1 -- 10.20.193.91:0/949030140 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9ee0003610 con 0x7f9f10055c30 2026-02-12T04:04:58.765 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.749+0000 7f9efdffb640 1 -- 10.20.193.91:0/949030140 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f9f00003310 con 0x7f9f10055c30 2026-02-12T04:04:58.765 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.749+0000 7f9efdffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:58.765 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.749+0000 7f9efdffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T04:04:58.766 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.749+0000 7f9efdffb640 10 monclient(hunting): dump: 2026-02-12T04:04:58.766 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:58.766 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:58.766 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.766 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.766 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:58.766 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:58.766 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:58.766 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:58.766 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:58.766 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.766 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.749+0000 7f9efdffb640 1 -- 10.20.193.91:0/949030140 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1653399592 0 0) 0x7f9f1011db10 con 0x7f9f10160f80 2026-02-12T04:04:58.767 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.749+0000 7f9efdffb640 1 -- 10.20.193.91:0/949030140 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9f100b19d0 con 0x7f9f10160f80 2026-02-12T04:04:58.767 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.749+0000 7f9efdffb640 1 -- 10.20.193.91:0/949030140 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f9f04003080 con 0x7f9f10160f80 2026-02-12T04:04:58.767 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.749+0000 7f9efdffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:58.767 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.749+0000 7f9efdffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T04:04:58.767 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.749+0000 7f9efdffb640 10 monclient(hunting): dump: 2026-02-12T04:04:58.767 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:58.767 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:58.767 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.767 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.767 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:58.767 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:58.767 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:58.768 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:58.768 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:58.768 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.768 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.750+0000 7f9efdffb640 1 -- 10.20.193.91:0/949030140 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 822819788 0 0) 0x7f9f1011ddf0 con 0x7f9f10163230 2026-02-12T04:04:58.768 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.750+0000 7f9efdffb640 1 -- 10.20.193.91:0/949030140 >> v1:10.20.193.111:6789/0 conn(0x7f9f10160f80 legacy=0x7f9f100b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:58.768 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.750+0000 7f9efdffb640 1 -- 10.20.193.91:0/949030140 >> v1:10.20.193.98:6789/0 conn(0x7f9f10055c30 legacy=0x7f9f1011a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:58.768 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.750+0000 7f9efdffb640 10 monclient: _finish_hunting 0 2026-02-12T04:04:58.768 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.750+0000 7f9efdffb640 1 monclient: found mon.a 2026-02-12T04:04:58.768 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.750+0000 7f9efdffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:58.768 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.750+0000 7f9efdffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:58.768 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.750+0000 7f9efdffb640 1 -- 10.20.193.91:0/949030140 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f1011e0d0 con 0x7f9f10163230 2026-02-12T04:04:58.768 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.750+0000 7f9efdffb640 10 monclient: _finish_auth 0 2026-02-12T04:04:58.768 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.750+0000 7f9efdffb640 10 monclient: _check_auth_tickets 2026-02-12T04:04:58.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.750+0000 7f9efdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:58.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.750+0000 7f9f17768640 5 monclient: authenticate success, global_id 30696 2026-02-12T04:04:58.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.750+0000 7f9f17768640 10 monclient: _renew_subs 2026-02-12T04:04:58.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.750+0000 7f9f17768640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:58.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.750+0000 7f9f17768640 1 -- 10.20.193.91:0/949030140 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9f1011a060 con 0x7f9f10163230 2026-02-12T04:04:58.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.750+0000 7f9f17768640 10 client.30696.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:04:58.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.750+0000 7f9f17768640 10 monclient: _renew_subs 2026-02-12T04:04:58.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.750+0000 7f9f17768640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:58.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.750+0000 7f9f17768640 1 -- 10.20.193.91:0/949030140 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9f1011d4b0 con 0x7f9f10163230 2026-02-12T04:04:58.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.750+0000 7f9f17768640 1 librados: init done 2026-02-12T04:04:58.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.751+0000 7f9f17768640 10 client.30696.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:58.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.751+0000 7f9f17768640 15 client.30696.objecter _session_command_op_assign -1 1 2026-02-12T04:04:58.769 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.751+0000 7f9f17768640 20 client.30696.objecter _get_session osd=-1 returning homeless 2026-02-12T04:04:58.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.751+0000 7f9f17768640 10 client.30696.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:04:58.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.751+0000 7f9f17768640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:58.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.751+0000 7f9f17768640 1 -- 10.20.193.91:0/949030140 --> v1:10.20.193.91:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f9f100b0990 con 0x7f9f10163230 2026-02-12T04:04:58.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.759+0000 7f9efdffb640 1 -- 10.20.193.91:0/949030140 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9f100b0990 con 0x7f9f10163230 2026-02-12T04:04:58.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.759+0000 7f9efdffb640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:58.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.759+0000 7f9efdffb640 1 -- 10.20.193.91:0/949030140 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f9f0c003c20 con 0x7f9f10163230 2026-02-12T04:04:58.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.759+0000 7f9efdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:58.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.759+0000 7f9efdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T04:04:58.770 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.759+0000 7f9efdffb640 10 monclient: dump: 2026-02-12T04:04:58.770 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:58.770 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:58.770 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.770 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.771 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:58.771 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:58.771 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:58.771 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:58.771 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:58.771 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.771 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.759+0000 7f9eff7fe640 4 set_mon_vals no callback set 2026-02-12T04:04:58.771 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.760+0000 7f9efdffb640 1 -- 10.20.193.91:0/949030140 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f9f0c003e00 con 0x7f9f10163230 2026-02-12T04:04:58.771 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.760+0000 7f9f154dd640 10 monclient: get_auth_request con 0x7f9ee007a0f0 auth_method 0 2026-02-12T04:04:58.771 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.760+0000 7f9efdffb640 10 client.30696.objecter ms_handle_connect 0x7f9ee007a0f0 2026-02-12T04:04:58.771 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.761+0000 7f9efdffb640 1 -- 10.20.193.91:0/949030140 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7f9f0c095bd0 con 0x7f9f10163230 2026-02-12T04:04:58.771 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.761+0000 7f9efdffb640 10 client.30696.objecter ms_dispatch2 0x7f9f10000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:04:58.772 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.761+0000 7f9efdffb640 3 client.30696.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:04:58.772 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.761+0000 7f9efdffb640 3 client.30696.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:04:58.772 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.761+0000 7f9efdffb640 10 client.30696.objecter checking command 1 2026-02-12T04:04:58.772 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.761+0000 7f9efdffb640 20 client.30696.objecter _get_session s=0x7f9ee00a43a0 osd=9 3 2026-02-12T04:04:58.772 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.761+0000 7f9efdffb640 20 client.30696.objecter put_session s=0x7f9ee00a43a0 osd=9 3 2026-02-12T04:04:58.772 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.761+0000 7f9efdffb640 15 client.30696.objecter _session_command_op_remove -1 1 2026-02-12T04:04:58.772 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.761+0000 7f9efdffb640 20 client.30696.objecter _get_session s=0x7f9ee00a43a0 osd=9 3 2026-02-12T04:04:58.772 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.761+0000 7f9efdffb640 20 client.30696.objecter get_session s=0x7f9ee00a43a0 osd=9 3 2026-02-12T04:04:58.772 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.761+0000 7f9efdffb640 15 client.30696.objecter _session_command_op_assign 9 1 2026-02-12T04:04:58.772 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.761+0000 7f9efdffb640 20 client.30696.objecter put_session s=0x7f9ee00a43a0 osd=9 4 2026-02-12T04:04:58.772 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.761+0000 7f9efdffb640 10 client.30696.objecter _send_command 1 2026-02-12T04:04:58.772 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.761+0000 7f9efdffb640 1 -- 10.20.193.91:0/949030140 --> v1:10.20.193.98:6801/4165741185 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9ee00c6750 con 0x7f9ee00a4a50 2026-02-12T04:04:58.772 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.761+0000 7f9efdffb640 20 client.30696.objecter dump_active .. 0 homeless 2026-02-12T04:04:58.773 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.761+0000 7f9efdffb640 1 -- 10.20.193.91:0/949030140 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_get_version_reply(handle=1 version=344) ==== 24+0+0 (unknown 1403447244 0 0) 0x7f9f0c05ec00 con 0x7f9f10163230 2026-02-12T04:04:58.773 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.761+0000 7f9efdffb640 10 monclient: handle_get_version_reply finishing 1 version 344 2026-02-12T04:04:58.773 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.761+0000 7f9f14cdc640 10 monclient: get_auth_request con 0x7f9ee00a4a50 auth_method 0 2026-02-12T04:04:58.773 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.762+0000 7f9efdffb640 10 client.30696.objecter ms_handle_connect 0x7f9ee00a4a50 2026-02-12T04:04:58.775 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.773+0000 7f9efdffb640 1 -- 10.20.193.91:0/949030140 <== osd.9 v1:10.20.193.98:6801/4165741185 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f9ee00c6750 con 0x7f9ee00a4a50 2026-02-12T04:04:58.775 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.773+0000 7f9efdffb640 10 client.30696.objecter ms_dispatch2 0x7f9f10000b90 command_reply(tid 1: 0 ) 2026-02-12T04:04:58.775 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.773+0000 7f9efdffb640 10 client.30696.objecter _finish_command 1 = system:0 2026-02-12T04:04:58.775 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.773+0000 7f9efdffb640 20 client.30696.objecter put_session s=0x7f9ee00a43a0 osd=9 4 2026-02-12T04:04:58.775 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.773+0000 7f9efdffb640 15 client.30696.objecter _session_command_op_remove 9 1 2026-02-12T04:04:58.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.780+0000 7f9f17768640 10 client.30696.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-12T04:04:58.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.780+0000 7f9f17768640 15 client.30696.objecter _session_command_op_assign -1 2 2026-02-12T04:04:58.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.780+0000 7f9f17768640 20 client.30696.objecter _get_session s=0x7f9ee00a43a0 osd=9 3 2026-02-12T04:04:58.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.780+0000 7f9f17768640 20 client.30696.objecter put_session s=0x7f9ee00a43a0 osd=9 3 2026-02-12T04:04:58.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.780+0000 7f9f17768640 20 client.30696.objecter _get_session s=0x7f9ee00a43a0 osd=9 3 2026-02-12T04:04:58.782 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.780+0000 7f9f17768640 15 client.30696.objecter _session_command_op_remove -1 2 2026-02-12T04:04:58.783 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.780+0000 7f9f17768640 20 client.30696.objecter get_session s=0x7f9ee00a43a0 osd=9 3 2026-02-12T04:04:58.783 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.780+0000 7f9f17768640 15 client.30696.objecter _session_command_op_assign 9 2 2026-02-12T04:04:58.783 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.780+0000 7f9f17768640 20 client.30696.objecter put_session s=0x7f9ee00a43a0 osd=9 4 2026-02-12T04:04:58.783 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.780+0000 7f9f17768640 10 client.30696.objecter _send_command 2 2026-02-12T04:04:58.783 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.780+0000 7f9f17768640 1 -- 10.20.193.91:0/949030140 --> v1:10.20.193.98:6801/4165741185 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9f10134680 con 0x7f9ee00a4a50 2026-02-12T04:04:58.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.788+0000 7f9efdffb640 1 -- 10.20.193.91:0/949030140 <== osd.9 v1:10.20.193.98:6801/4165741185 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f9f10134680 con 0x7f9ee00a4a50 2026-02-12T04:04:58.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.788+0000 7f9efdffb640 10 client.30696.objecter ms_dispatch2 0x7f9f10000b90 command_reply(tid 2: 0 ) 2026-02-12T04:04:58.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.788+0000 7f9efdffb640 10 client.30696.objecter _finish_command 2 = system:0 2026-02-12T04:04:58.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.788+0000 7f9efdffb640 20 client.30696.objecter put_session s=0x7f9ee00a43a0 osd=9 4 2026-02-12T04:04:58.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.788+0000 7f9efdffb640 15 client.30696.objecter _session_command_op_remove 9 2 2026-02-12T04:04:58.791 INFO:teuthology.orchestra.run.trial091.stdout:{ 2026-02-12T04:04:58.791 INFO:teuthology.orchestra.run.trial091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-12T04:04:58.791 INFO:teuthology.orchestra.run.trial091.stdout:} 2026-02-12T04:04:58.792 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.788+0000 7f9f17768640 10 librados: watch_flush enter 2026-02-12T04:04:58.792 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.788+0000 7f9f17768640 10 librados: watch_flush exit 2026-02-12T04:04:58.792 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.788+0000 7f9f17768640 10 client.30696.objecter close_session for osd.9 2026-02-12T04:04:58.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.788+0000 7f9f17768640 1 -- 10.20.193.91:0/949030140 >> v1:10.20.193.98:6801/4165741185 conn(0x7f9ee00a4a50 legacy=0x7f9ee00c4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:58.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.788+0000 7f9f17768640 20 client.30696.objecter put_session s=0x7f9ee00a43a0 osd=9 1 2026-02-12T04:04:58.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.788+0000 7f9f17768640 20 client.30696.objecter shutdown clearing up homeless session... 2026-02-12T04:04:58.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.788+0000 7f9f17768640 10 client.30696.objecter successfully canceled tick 2026-02-12T04:04:58.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.788+0000 7f9f17768640 1 -- 10.20.193.91:0/949030140 >> v1:10.20.193.91:6800/2929217192 conn(0x7f9ee007a0f0 legacy=0x7f9ee009a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:58.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.788+0000 7f9f17768640 10 monclient: shutdown 2026-02-12T04:04:58.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.788+0000 7f9f17768640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:58.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.788+0000 7f9f17768640 1 -- 10.20.193.91:0/949030140 >> v1:10.20.193.91:6789/0 conn(0x7f9f10163230 legacy=0x7f9f10137b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:58.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.788+0000 7f9f15cde640 1 -- 10.20.193.91:0/949030140 reap_dead start 2026-02-12T04:04:58.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.788+0000 7f9f17768640 1 -- 10.20.193.91:0/949030140 shutdown_connections 2026-02-12T04:04:58.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.788+0000 7f9f17768640 1 -- 10.20.193.91:0/949030140 >> 10.20.193.91:0/949030140 conn(0x7f9f100b6560 msgr2=0x7f9f101570a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:58.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.788+0000 7f9f17768640 1 -- 10.20.193.91:0/949030140 shutdown_connections 2026-02-12T04:04:58.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.788+0000 7f9f17768640 1 -- 10.20.193.91:0/949030140 wait complete. 2026-02-12T04:04:58.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.788+0000 7f9f17768640 1 librados: shutdown 2026-02-12T04:04:58.798 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 9 2026-02-12T04:04:58.864 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.863+0000 7f788be1a640 10 monclient: get_monmap_and_config 2026-02-12T04:04:58.865 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.863+0000 7f788be1a640 10 monclient: build_initial_monmap 2026-02-12T04:04:58.865 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.863+0000 7f788be1a640 10 monclient: monmap: 2026-02-12T04:04:58.865 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:58.865 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:58.865 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:04:58.863728+0000 2026-02-12T04:04:58.865 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:04:58.863728+0000 2026-02-12T04:04:58.865 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:58.865 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:58.865 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:58.866 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:58.866 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:58.866 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.867 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.863+0000 7f788be1a640 1 Processor -- start 2026-02-12T04:04:58.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.863+0000 7f788be1a640 1 -- start start 2026-02-12T04:04:58.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.863+0000 7f788be1a640 10 monclient: init 2026-02-12T04:04:58.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.864+0000 7f788be1a640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:58.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.864+0000 7f788be1a640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T04:04:58.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.864+0000 7f788be1a640 10 monclient(hunting): picked mon.noname-c con 0x7f78841575d0 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:58.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.864+0000 7f788be1a640 10 monclient(hunting): picked mon.noname-a con 0x7f7884163310 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:58.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.864+0000 7f788be1a640 10 monclient(hunting): picked mon.noname-b con 0x7f78840560d0 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:58.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.864+0000 7f788be1a640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78840b20b0 con 0x7f7884163310 2026-02-12T04:04:58.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.864+0000 7f788be1a640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78840b2390 con 0x7f78840560d0 2026-02-12T04:04:58.868 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.864+0000 7f788be1a640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78840b2670 con 0x7f78841575d0 2026-02-12T04:04:58.869 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.864+0000 7f788be1a640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:58.869 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.864+0000 7f788be1a640 10 monclient(hunting): authenticate will time out at 1501.607155s 2026-02-12T04:04:58.869 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.864+0000 7f788938e640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f7884163310 0x7f78840559c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:41632/0 (socket says 10.20.193.91:41632) 2026-02-12T04:04:58.869 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.864+0000 7f788938e640 1 -- 10.20.193.91:0/2957533711 learned_addr learned my addr 10.20.193.91:0/2957533711 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:58.869 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.865+0000 7f7888b8d640 1 -- 10.20.193.91:0/2957533711 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2736239488 0 0) 0x7f78840b20b0 con 0x7f7884163310 2026-02-12T04:04:58.869 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.865+0000 7f7888b8d640 10 monclient(hunting): _negotiate 2026-02-12T04:04:58.869 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.865+0000 7f7888b8d640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:58.869 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.865+0000 7f7888b8d640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:58.869 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.865+0000 7f7888b8d640 10 monclient(hunting): my global_id is 30699 2026-02-12T04:04:58.869 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.865+0000 7f7888b8d640 1 -- 10.20.193.91:0/2957533711 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f786c003610 con 0x7f7884163310 2026-02-12T04:04:58.869 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.866+0000 7f7888b8d640 1 -- 10.20.193.91:0/2957533711 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2874375511 0 0) 0x7f78840b2670 con 0x7f78841575d0 2026-02-12T04:04:58.870 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.866+0000 7f7888b8d640 10 monclient(hunting): _negotiate 2026-02-12T04:04:58.870 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.866+0000 7f7888b8d640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:58.870 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.866+0000 7f7888b8d640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:58.870 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.866+0000 7f7888b8d640 10 monclient(hunting): my global_id is 27536 2026-02-12T04:04:58.870 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.866+0000 7f7888b8d640 1 -- 10.20.193.91:0/2957533711 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78840b20b0 con 0x7f78841575d0 2026-02-12T04:04:58.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.866+0000 7f7888b8d640 1 -- 10.20.193.91:0/2957533711 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4052978791 0 0) 0x7f78840b2390 con 0x7f78840560d0 2026-02-12T04:04:58.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.866+0000 7f7888b8d640 10 monclient(hunting): _negotiate 2026-02-12T04:04:58.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.866+0000 7f7888b8d640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:58.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.866+0000 7f7888b8d640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:58.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.866+0000 7f7888b8d640 10 monclient(hunting): my global_id is 27841 2026-02-12T04:04:58.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.866+0000 7f7888b8d640 1 -- 10.20.193.91:0/2957533711 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78840b2670 con 0x7f78840560d0 2026-02-12T04:04:58.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.867+0000 7f7888b8d640 1 -- 10.20.193.91:0/2957533711 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 356827111 0 0) 0x7f786c003610 con 0x7f7884163310 2026-02-12T04:04:58.875 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.867+0000 7f7888b8d640 1 -- 10.20.193.91:0/2957533711 >> v1:10.20.193.111:6789/0 conn(0x7f78841575d0 legacy=0x7f7884162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:58.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.867+0000 7f7888b8d640 1 -- 10.20.193.91:0/2957533711 >> v1:10.20.193.98:6789/0 conn(0x7f78840560d0 legacy=0x7f78841c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:58.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.867+0000 7f7888b8d640 10 monclient: _finish_hunting 0 2026-02-12T04:04:58.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.867+0000 7f7888b8d640 1 monclient: found mon.noname-a 2026-02-12T04:04:58.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.867+0000 7f7888b8d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:58.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.867+0000 7f7888b8d640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.91:6789/0 2026-02-12T04:04:58.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.867+0000 7f7888b8d640 1 -- 10.20.193.91:0/2957533711 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7884162400 con 0x7f7884163310 2026-02-12T04:04:58.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.867+0000 7f7888b8d640 10 monclient: _finish_auth 0 2026-02-12T04:04:58.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.867+0000 7f7888b8d640 10 monclient: _check_auth_tickets 2026-02-12T04:04:58.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.867+0000 7f7888b8d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:58.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.867+0000 7f7888b8d640 1 -- 10.20.193.91:0/2957533711 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f7878002df0 con 0x7f7884163310 2026-02-12T04:04:58.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.867+0000 7f7888b8d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:58.876 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.867+0000 7f7888b8d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T04:04:58.877 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.867+0000 7f7888b8d640 10 monclient: dump: 2026-02-12T04:04:58.877 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:58.877 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:58.877 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.877 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.877 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:58.877 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:58.877 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:58.877 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:58.877 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:58.877 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.867+0000 7f788be1a640 5 monclient: authenticate success, global_id 30699 2026-02-12T04:04:58.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.867+0000 7f788be1a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:04:58.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.868+0000 7f7888b8d640 1 -- 10.20.193.91:0/2957533711 <== mon.0 v1:10.20.193.91:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7878002fc0 con 0x7f7884163310 2026-02-12T04:04:58.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.868+0000 7f7888b8d640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:58.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.868+0000 7f7888b8d640 1 -- 10.20.193.91:0/2957533711 <== mon.0 v1:10.20.193.91:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f7878003400 con 0x7f7884163310 2026-02-12T04:04:58.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.868+0000 7f788be1a640 10 monclient: get_monmap_and_config success 2026-02-12T04:04:58.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.868+0000 7f788be1a640 4 set_mon_vals no callback set 2026-02-12T04:04:58.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.868+0000 7f7888b8d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:58.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.868+0000 7f7888b8d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T04:04:58.878 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.868+0000 7f7888b8d640 10 monclient: dump: 2026-02-12T04:04:58.878 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:58.878 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:58.878 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.879 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.879 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:58.879 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:58.879 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:58.879 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:58.879 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:58.879 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.868+0000 7f788be1a640 10 monclient: shutdown 2026-02-12T04:04:58.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.868+0000 7f788be1a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:58.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.868+0000 7f788be1a640 1 -- 10.20.193.91:0/2957533711 >> v1:10.20.193.91:6789/0 conn(0x7f7884163310 legacy=0x7f78840559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:58.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.868+0000 7f788be1a640 1 -- 10.20.193.91:0/2957533711 shutdown_connections 2026-02-12T04:04:58.879 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.868+0000 7f788be1a640 1 -- 10.20.193.91:0/2957533711 >> 10.20.193.91:0/2957533711 conn(0x7f78840b6560 msgr2=0x7f78840b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:58.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.868+0000 7f788be1a640 1 -- 10.20.193.91:0/2957533711 shutdown_connections 2026-02-12T04:04:58.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.868+0000 7f788be1a640 1 -- 10.20.193.91:0/2957533711 wait complete. 2026-02-12T04:04:58.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.869+0000 7f788be1a640 10 monclient: build_initial_monmap 2026-02-12T04:04:58.880 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.869+0000 7f788be1a640 10 monclient: monmap: 2026-02-12T04:04:58.880 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:58.880 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:04:58.880 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:04:58.880 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:04:58.880 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:58.880 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:04:58.880 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:58.880 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:58.880 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:58.881 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.869+0000 7f788be1a640 1 librados: starting msgr at 2026-02-12T04:04:58.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.869+0000 7f788be1a640 1 librados: starting objecter 2026-02-12T04:04:58.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.869+0000 7f788be1a640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:04:58.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.869+0000 7f788be1a640 1 Processor -- start 2026-02-12T04:04:58.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.869+0000 7f788be1a640 1 -- start start 2026-02-12T04:04:58.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.869+0000 7f788be1a640 1 librados: setting wanted keys 2026-02-12T04:04:58.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.869+0000 7f788be1a640 1 librados: calling monclient init 2026-02-12T04:04:58.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.869+0000 7f788be1a640 10 monclient: init 2026-02-12T04:04:58.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.869+0000 7f788be1a640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:58.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.869+0000 7f788be1a640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T04:04:58.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.869+0000 7f788be1a640 10 monclient(hunting): picked mon.noname-c con 0x7f78840560d0 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:58.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.869+0000 7f788be1a640 10 monclient(hunting): picked mon.noname-a con 0x7f78841575d0 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:58.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.869+0000 7f788be1a640 10 monclient(hunting): picked mon.noname-b con 0x7f7884163310 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:58.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.869+0000 7f788be1a640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f788411c540 con 0x7f78841575d0 2026-02-12T04:04:58.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.869+0000 7f788be1a640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7884151cc0 con 0x7f7884163310 2026-02-12T04:04:58.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.869+0000 7f788be1a640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7884151fa0 con 0x7f78840560d0 2026-02-12T04:04:58.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.869+0000 7f788be1a640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:58.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.869+0000 7f788be1a640 10 monclient(hunting): authenticate will time out at 1501.612945s 2026-02-12T04:04:58.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.870+0000 7f7889b8f640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f78840560d0 0x7f78840ad860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:44406/0 (socket says 10.20.193.91:44406) 2026-02-12T04:04:58.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.870+0000 7f7889b8f640 1 -- 10.20.193.91:0/2869062469 learned_addr learned my addr 10.20.193.91:0/2869062469 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:58.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.870+0000 7f78727fc640 10 client.?.objecter ms_handle_connect 0x7f7884163310 2026-02-12T04:04:58.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.870+0000 7f78727fc640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:58.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.870+0000 7f78727fc640 10 client.?.objecter ms_handle_connect 0x7f78840560d0 2026-02-12T04:04:58.882 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.870+0000 7f78727fc640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:58.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.870+0000 7f78727fc640 10 client.?.objecter ms_handle_connect 0x7f78841575d0 2026-02-12T04:04:58.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.870+0000 7f78727fc640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:58.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.871+0000 7f78727fc640 1 -- 10.20.193.91:0/2869062469 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 521673351 0 0) 0x7f7884151cc0 con 0x7f7884163310 2026-02-12T04:04:58.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.871+0000 7f78727fc640 10 monclient(hunting): _negotiate 2026-02-12T04:04:58.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.871+0000 7f78727fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:58.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.871+0000 7f78727fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:58.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.871+0000 7f78727fc640 10 monclient(hunting): my global_id is 27844 2026-02-12T04:04:58.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.871+0000 7f78727fc640 1 -- 10.20.193.91:0/2869062469 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7854003610 con 0x7f7884163310 2026-02-12T04:04:58.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.871+0000 7f78727fc640 1 -- 10.20.193.91:0/2869062469 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1111496256 0 0) 0x7f7884151fa0 con 0x7f78840560d0 2026-02-12T04:04:58.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.871+0000 7f78727fc640 10 monclient(hunting): _negotiate 2026-02-12T04:04:58.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.871+0000 7f78727fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:58.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.871+0000 7f78727fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:58.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.871+0000 7f78727fc640 10 monclient(hunting): my global_id is 27539 2026-02-12T04:04:58.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.871+0000 7f78727fc640 1 -- 10.20.193.91:0/2869062469 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7884151cc0 con 0x7f78840560d0 2026-02-12T04:04:58.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.871+0000 7f78727fc640 1 -- 10.20.193.91:0/2869062469 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2761936841 0 0) 0x7f788411c540 con 0x7f78841575d0 2026-02-12T04:04:58.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.871+0000 7f78727fc640 10 monclient(hunting): _negotiate 2026-02-12T04:04:58.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.871+0000 7f78727fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:58.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.871+0000 7f78727fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:58.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.871+0000 7f78727fc640 10 monclient(hunting): my global_id is 30702 2026-02-12T04:04:58.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.871+0000 7f78727fc640 1 -- 10.20.193.91:0/2869062469 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7884151fa0 con 0x7f78841575d0 2026-02-12T04:04:58.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.874+0000 7f78727fc640 1 -- 10.20.193.91:0/2869062469 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2370697639 0 0) 0x7f7854003610 con 0x7f7884163310 2026-02-12T04:04:58.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.874+0000 7f78727fc640 1 -- 10.20.193.91:0/2869062469 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f788411c540 con 0x7f7884163310 2026-02-12T04:04:58.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.874+0000 7f78727fc640 1 -- 10.20.193.91:0/2869062469 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f7880003410 con 0x7f7884163310 2026-02-12T04:04:58.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.874+0000 7f78727fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:58.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.874+0000 7f78727fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T04:04:58.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.874+0000 7f78727fc640 10 monclient(hunting): dump: 2026-02-12T04:04:58.888 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:58.889 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:58.889 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.889 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.889 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:58.889 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:58.889 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:58.889 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:58.889 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:58.889 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.874+0000 7f78727fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:04:58.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.874+0000 7f78727fc640 1 -- 10.20.193.91:0/2869062469 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4124307229 0 0) 0x7f7884151cc0 con 0x7f78840560d0 2026-02-12T04:04:58.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.874+0000 7f78727fc640 1 -- 10.20.193.91:0/2869062469 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7854003610 con 0x7f78840560d0 2026-02-12T04:04:58.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.874+0000 7f78727fc640 1 -- 10.20.193.91:0/2869062469 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f7874003170 con 0x7f78840560d0 2026-02-12T04:04:58.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.874+0000 7f78727fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:58.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.874+0000 7f78727fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T04:04:58.890 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.874+0000 7f78727fc640 10 monclient(hunting): dump: 2026-02-12T04:04:58.890 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:58.890 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:58.890 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.890 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.890 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:58.890 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:58.890 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:58.891 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:58.891 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:58.891 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.874+0000 7f78727fc640 1 -- 10.20.193.91:0/2869062469 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 762038634 0 0) 0x7f7884151fa0 con 0x7f78841575d0 2026-02-12T04:04:58.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.874+0000 7f78727fc640 1 -- 10.20.193.91:0/2869062469 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7884151cc0 con 0x7f78841575d0 2026-02-12T04:04:58.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.874+0000 7f78727fc640 1 -- 10.20.193.91:0/2869062469 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f7878003310 con 0x7f78841575d0 2026-02-12T04:04:58.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.874+0000 7f78727fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:58.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.874+0000 7f78727fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T04:04:58.891 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.874+0000 7f78727fc640 10 monclient(hunting): dump: 2026-02-12T04:04:58.891 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:58.891 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:58.891 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.892 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.892 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:58.892 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:58.892 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:58.892 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:58.892 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:58.892 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.876+0000 7f78727fc640 1 -- 10.20.193.91:0/2869062469 <== mon.2 v1:10.20.193.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 900483029 0 0) 0x7f7854003610 con 0x7f78840560d0 2026-02-12T04:04:58.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.876+0000 7f78727fc640 1 -- 10.20.193.91:0/2869062469 >> v1:10.20.193.98:6789/0 conn(0x7f7884163310 legacy=0x7f78841255b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:58.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.876+0000 7f78727fc640 1 -- 10.20.193.91:0/2869062469 >> v1:10.20.193.91:6789/0 conn(0x7f78841575d0 legacy=0x7f788411be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:58.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.876+0000 7f78727fc640 10 monclient: _finish_hunting 0 2026-02-12T04:04:58.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.876+0000 7f78727fc640 1 monclient: found mon.c 2026-02-12T04:04:58.892 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.876+0000 7f78727fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:58.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.876+0000 7f78727fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:04:58.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.876+0000 7f78727fc640 1 -- 10.20.193.91:0/2869062469 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7884152280 con 0x7f78840560d0 2026-02-12T04:04:58.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.876+0000 7f78727fc640 10 monclient: _finish_auth 0 2026-02-12T04:04:58.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.876+0000 7f78727fc640 10 monclient: _check_auth_tickets 2026-02-12T04:04:58.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.876+0000 7f78727fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:58.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.876+0000 7f788be1a640 5 monclient: authenticate success, global_id 27539 2026-02-12T04:04:58.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.876+0000 7f788be1a640 10 monclient: _renew_subs 2026-02-12T04:04:58.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.876+0000 7f788be1a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:04:58.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.876+0000 7f788be1a640 1 -- 10.20.193.91:0/2869062469 --> v1:10.20.193.111:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7884152560 con 0x7f78840560d0 2026-02-12T04:04:58.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.876+0000 7f788be1a640 10 client.27539.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:04:58.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.876+0000 7f788be1a640 10 monclient: _renew_subs 2026-02-12T04:04:58.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.876+0000 7f788be1a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:04:58.893 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.876+0000 7f788be1a640 1 -- 10.20.193.91:0/2869062469 --> v1:10.20.193.111:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f78841295d0 con 0x7f78840560d0 2026-02-12T04:04:58.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.876+0000 7f788be1a640 1 librados: init done 2026-02-12T04:04:58.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.876+0000 7f788be1a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:58.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.876+0000 7f788be1a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:58.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.876+0000 7f788be1a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:04:58.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.876+0000 7f788be1a640 1 -- 10.20.193.91:0/2869062469 --> v1:10.20.193.111:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78841389b0 con 0x7f78840560d0 2026-02-12T04:04:58.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.880+0000 7f78727fc640 1 -- 10.20.193.91:0/2869062469 <== mon.2 v1:10.20.193.111:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7874003450 con 0x7f78840560d0 2026-02-12T04:04:58.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.880+0000 7f78727fc640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:58.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.880+0000 7f78727fc640 1 -- 10.20.193.91:0/2869062469 <== mon.2 v1:10.20.193.111:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f7874003b50 con 0x7f78840560d0 2026-02-12T04:04:58.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.880+0000 7f78727fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:58.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.880+0000 7f78727fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T04:04:58.894 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.880+0000 7f78727fc640 10 monclient: dump: 2026-02-12T04:04:58.894 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:58.895 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:58.895 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.895 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:58.895 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:58.895 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:58.895 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:58.895 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:58.895 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:58.895 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:58.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.880+0000 7f7873fff640 4 set_mon_vals no callback set 2026-02-12T04:04:58.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.885+0000 7f78727fc640 1 -- 10.20.193.91:0/2869062469 <== mon.2 v1:10.20.193.111:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f7874003b50 con 0x7f78840560d0 2026-02-12T04:04:58.895 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.885+0000 7f788938e640 10 monclient: get_auth_request con 0x7f785407a070 auth_method 0 2026-02-12T04:04:58.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.885+0000 7f78727fc640 10 client.27539.objecter ms_handle_connect 0x7f785407a070 2026-02-12T04:04:58.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.886+0000 7f78727fc640 1 -- 10.20.193.91:0/2869062469 <== mon.2 v1:10.20.193.111:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7f7874095a60 con 0x7f78840560d0 2026-02-12T04:04:58.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.886+0000 7f78727fc640 10 client.27539.objecter ms_dispatch2 0x7f7884000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:04:58.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.886+0000 7f78727fc640 3 client.27539.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:04:58.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.886+0000 7f78727fc640 3 client.27539.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:04:58.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.886+0000 7f78727fc640 20 client.27539.objecter dump_active .. 0 homeless 2026-02-12T04:04:58.978 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.977+0000 7f78727fc640 1 -- 10.20.193.91:0/2869062469 <== mon.2 v1:10.20.193.111:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f787405f3c0 con 0x7f78840560d0 2026-02-12T04:04:58.978 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.977+0000 7f78727fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:58.978 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:58.977+0000 7f78727fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T04:04:59.083 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.081+0000 7f788be1a640 1 -- 10.20.193.91:0/2869062469 --> v1:10.20.193.91:6800/2929217192 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "9", "target": ["mon-mgr", ""]}) -- 0x7f78841264e0 con 0x7f785407a070 2026-02-12T04:04:59.083 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.081+0000 7f78727fc640 1 -- 10.20.193.91:0/2869062469 <== mgr.4113 v1:10.20.193.91:6800/2929217192 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 9 to deep-scrub) ==== 41+0+0 (unknown 795720238 0 0) 0x7f78841264e0 con 0x7f785407a070 2026-02-12T04:04:59.083 INFO:teuthology.orchestra.run.trial091.stderr:instructed osd(s) 9 to deep-scrub 2026-02-12T04:04:59.085 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.082+0000 7f788be1a640 10 librados: watch_flush enter 2026-02-12T04:04:59.085 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.083+0000 7f788be1a640 10 librados: watch_flush exit 2026-02-12T04:04:59.085 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.083+0000 7f788be1a640 20 client.27539.objecter shutdown clearing up homeless session... 2026-02-12T04:04:59.086 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.083+0000 7f788be1a640 10 client.27539.objecter successfully canceled tick 2026-02-12T04:04:59.086 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.083+0000 7f788be1a640 1 -- 10.20.193.91:0/2869062469 >> v1:10.20.193.91:6800/2929217192 conn(0x7f785407a070 legacy=0x7f785409a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:59.086 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.083+0000 7f788be1a640 10 monclient: shutdown 2026-02-12T04:04:59.086 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.083+0000 7f788be1a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:59.086 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.083+0000 7f788be1a640 1 -- 10.20.193.91:0/2869062469 >> v1:10.20.193.111:6789/0 conn(0x7f78840560d0 legacy=0x7f78840ad860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:59.086 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.083+0000 7f788be1a640 1 -- 10.20.193.91:0/2869062469 shutdown_connections 2026-02-12T04:04:59.086 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.083+0000 7f788be1a640 1 -- 10.20.193.91:0/2869062469 >> 10.20.193.91:0/2869062469 conn(0x7f78840b6560 msgr2=0x7f78840b18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:59.086 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.083+0000 7f788be1a640 1 -- 10.20.193.91:0/2869062469 shutdown_connections 2026-02-12T04:04:59.086 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.083+0000 7f788be1a640 1 -- 10.20.193.91:0/2869062469 wait complete. 2026-02-12T04:04:59.086 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.083+0000 7f788be1a640 1 librados: shutdown 2026-02-12T04:04:59.093 INFO:tasks.ceph:Scrubbing osd.13 2026-02-12T04:04:59.093 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.13 config set osd_debug_deep_scrub_sleep 0 2026-02-12T04:04:59.162 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.161+0000 7faff4050640 10 monclient: get_monmap_and_config 2026-02-12T04:04:59.163 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.161+0000 7faff4050640 10 monclient: build_initial_monmap 2026-02-12T04:04:59.163 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.161+0000 7faff4050640 10 monclient: monmap: 2026-02-12T04:04:59.163 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:59.163 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:59.163 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:04:59.161621+0000 2026-02-12T04:04:59.163 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:04:59.161621+0000 2026-02-12T04:04:59.163 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:59.164 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:59.164 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:59.164 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:59.164 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:59.164 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:59.166 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.161+0000 7faff4050640 1 Processor -- start 2026-02-12T04:04:59.166 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.161+0000 7faff4050640 1 -- start start 2026-02-12T04:04:59.166 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.161+0000 7faff4050640 10 monclient: init 2026-02-12T04:04:59.167 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.161+0000 7faff4050640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:59.167 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.162+0000 7faff4050640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T04:04:59.167 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.162+0000 7faff4050640 10 monclient(hunting): picked mon.noname-b con 0x7fafec055c30 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:59.167 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.162+0000 7faff4050640 10 monclient(hunting): picked mon.noname-a con 0x7fafec160f80 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:59.167 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.162+0000 7faff4050640 10 monclient(hunting): picked mon.noname-c con 0x7fafec163230 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:59.167 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.162+0000 7faff4050640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafec0b1fc0 con 0x7fafec160f80 2026-02-12T04:04:59.167 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.162+0000 7faff4050640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafec0b22a0 con 0x7fafec055c30 2026-02-12T04:04:59.167 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.162+0000 7faff4050640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafec0b2580 con 0x7fafec163230 2026-02-12T04:04:59.167 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.162+0000 7faff4050640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:59.167 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.162+0000 7faff4050640 10 monclient(hunting): authenticate will time out at 1501.905069s 2026-02-12T04:04:59.167 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.162+0000 7faff15c4640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7fafec160f80 0x7fafec1572d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:41640/0 (socket says 10.20.193.91:41640) 2026-02-12T04:04:59.168 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.162+0000 7faff15c4640 1 -- 10.20.193.91:0/3547232403 learned_addr learned my addr 10.20.193.91:0/3547232403 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:59.168 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.163+0000 7faff0dc3640 1 -- 10.20.193.91:0/3547232403 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2669915158 0 0) 0x7fafec0b22a0 con 0x7fafec055c30 2026-02-12T04:04:59.168 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.163+0000 7faff0dc3640 10 monclient(hunting): _negotiate 2026-02-12T04:04:59.168 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.163+0000 7faff0dc3640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:59.168 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.163+0000 7faff0dc3640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:59.168 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.163+0000 7faff0dc3640 10 monclient(hunting): my global_id is 27847 2026-02-12T04:04:59.168 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.163+0000 7faff0dc3640 1 -- 10.20.193.91:0/3547232403 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafd4003610 con 0x7fafec055c30 2026-02-12T04:04:59.168 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.163+0000 7faff0dc3640 1 -- 10.20.193.91:0/3547232403 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3406400678 0 0) 0x7fafec0b1fc0 con 0x7fafec160f80 2026-02-12T04:04:59.168 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.163+0000 7faff0dc3640 10 monclient(hunting): _negotiate 2026-02-12T04:04:59.168 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.163+0000 7faff0dc3640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:59.169 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.163+0000 7faff0dc3640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:59.169 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.163+0000 7faff0dc3640 10 monclient(hunting): my global_id is 30705 2026-02-12T04:04:59.169 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.163+0000 7faff0dc3640 1 -- 10.20.193.91:0/3547232403 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafec0b22a0 con 0x7fafec160f80 2026-02-12T04:04:59.169 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.163+0000 7faff0dc3640 1 -- 10.20.193.91:0/3547232403 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2342717475 0 0) 0x7fafec0b2580 con 0x7fafec163230 2026-02-12T04:04:59.169 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.164+0000 7faff0dc3640 10 monclient(hunting): _negotiate 2026-02-12T04:04:59.169 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.164+0000 7faff0dc3640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:59.169 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.164+0000 7faff0dc3640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:59.169 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.164+0000 7faff0dc3640 10 monclient(hunting): my global_id is 27542 2026-02-12T04:04:59.169 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.164+0000 7faff0dc3640 1 -- 10.20.193.91:0/3547232403 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafec0b1fc0 con 0x7fafec163230 2026-02-12T04:04:59.176 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.165+0000 7faff0dc3640 1 -- 10.20.193.91:0/3547232403 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2848961413 0 0) 0x7fafd4003610 con 0x7fafec055c30 2026-02-12T04:04:59.177 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.165+0000 7faff0dc3640 1 -- 10.20.193.91:0/3547232403 >> v1:10.20.193.111:6789/0 conn(0x7fafec163230 legacy=0x7fafec1c57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:59.177 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.165+0000 7faff0dc3640 1 -- 10.20.193.91:0/3547232403 >> v1:10.20.193.91:6789/0 conn(0x7fafec160f80 legacy=0x7fafec1572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:59.177 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.165+0000 7faff0dc3640 10 monclient: _finish_hunting 0 2026-02-12T04:04:59.177 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.165+0000 7faff0dc3640 1 monclient: found mon.noname-b 2026-02-12T04:04:59.177 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.165+0000 7faff0dc3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:59.177 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.165+0000 7faff0dc3640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T04:04:59.177 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.165+0000 7faff0dc3640 1 -- 10.20.193.91:0/3547232403 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafec0b2860 con 0x7fafec055c30 2026-02-12T04:04:59.177 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.165+0000 7faff0dc3640 10 monclient: _finish_auth 0 2026-02-12T04:04:59.177 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.165+0000 7faff0dc3640 10 monclient: _check_auth_tickets 2026-02-12T04:04:59.177 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.165+0000 7faff0dc3640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:59.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.165+0000 7faff0dc3640 1 -- 10.20.193.91:0/3547232403 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fafdc002df0 con 0x7fafec055c30 2026-02-12T04:04:59.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.165+0000 7faff0dc3640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:59.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.165+0000 7faff0dc3640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T04:04:59.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.165+0000 7faff0dc3640 10 monclient: dump: 2026-02-12T04:04:59.178 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:59.178 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:59.178 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.178 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.178 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:59.178 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:59.179 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:59.179 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:59.179 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:59.179 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:59.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.165+0000 7faff4050640 5 monclient: authenticate success, global_id 27847 2026-02-12T04:04:59.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.165+0000 7faff4050640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:04:59.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.166+0000 7faff0dc3640 1 -- 10.20.193.91:0/3547232403 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fafdc002f90 con 0x7fafec055c30 2026-02-12T04:04:59.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.166+0000 7faff0dc3640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:59.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.166+0000 7faff0dc3640 1 -- 10.20.193.91:0/3547232403 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fafdc0033d0 con 0x7fafec055c30 2026-02-12T04:04:59.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.166+0000 7faff0dc3640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:59.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.166+0000 7faff0dc3640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T04:04:59.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.166+0000 7faff0dc3640 10 monclient: dump: 2026-02-12T04:04:59.180 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:59.180 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:59.180 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.180 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.180 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:59.180 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:59.180 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:59.180 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:59.180 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:59.180 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:59.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.166+0000 7faff4050640 10 monclient: get_monmap_and_config success 2026-02-12T04:04:59.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.166+0000 7faff4050640 4 set_mon_vals no callback set 2026-02-12T04:04:59.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.166+0000 7faff4050640 10 monclient: shutdown 2026-02-12T04:04:59.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.166+0000 7faff4050640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:59.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.166+0000 7faff4050640 1 -- 10.20.193.91:0/3547232403 >> v1:10.20.193.98:6789/0 conn(0x7fafec055c30 legacy=0x7fafec162b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:59.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.166+0000 7faff4050640 1 -- 10.20.193.91:0/3547232403 shutdown_connections 2026-02-12T04:04:59.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.166+0000 7faff4050640 1 -- 10.20.193.91:0/3547232403 >> 10.20.193.91:0/3547232403 conn(0x7fafec0b6560 msgr2=0x7fafec0b6930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:59.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.166+0000 7faff4050640 1 -- 10.20.193.91:0/3547232403 shutdown_connections 2026-02-12T04:04:59.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.166+0000 7faff4050640 1 -- 10.20.193.91:0/3547232403 wait complete. 2026-02-12T04:04:59.181 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.167+0000 7faff4050640 10 monclient: build_initial_monmap 2026-02-12T04:04:59.182 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.167+0000 7faff4050640 10 monclient: monmap: 2026-02-12T04:04:59.182 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:59.182 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:04:59.182 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:04:59.182 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:04:59.182 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:59.182 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:04:59.182 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:59.182 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:59.182 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:59.182 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:59.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.167+0000 7faff4050640 1 librados: starting msgr at 2026-02-12T04:04:59.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.167+0000 7faff4050640 1 librados: starting objecter 2026-02-12T04:04:59.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.167+0000 7faff4050640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:04:59.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.167+0000 7faff4050640 1 Processor -- start 2026-02-12T04:04:59.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.167+0000 7faff4050640 1 -- start start 2026-02-12T04:04:59.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.167+0000 7faff4050640 1 librados: setting wanted keys 2026-02-12T04:04:59.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.167+0000 7faff4050640 1 librados: calling monclient init 2026-02-12T04:04:59.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.167+0000 7faff4050640 10 monclient: init 2026-02-12T04:04:59.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.168+0000 7faff4050640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:59.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.168+0000 7faff4050640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T04:04:59.183 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.168+0000 7faff4050640 10 monclient(hunting): picked mon.noname-b con 0x7fafec055c30 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:59.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.168+0000 7faff4050640 10 monclient(hunting): picked mon.noname-a con 0x7fafec160f80 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:59.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.168+0000 7faff4050640 10 monclient(hunting): picked mon.noname-c con 0x7fafec163230 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:59.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.168+0000 7faff4050640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafec05cdc0 con 0x7fafec160f80 2026-02-12T04:04:59.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.168+0000 7faff4050640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafec05d0a0 con 0x7fafec055c30 2026-02-12T04:04:59.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.168+0000 7faff4050640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafec0ad770 con 0x7fafec163230 2026-02-12T04:04:59.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.168+0000 7faff4050640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:59.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.168+0000 7faff4050640 10 monclient(hunting): authenticate will time out at 1501.911145s 2026-02-12T04:04:59.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.168+0000 7faff15c4640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7fafec160f80 0x7fafec152800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:41646/0 (socket says 10.20.193.91:41646) 2026-02-12T04:04:59.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.168+0000 7faff15c4640 1 -- 10.20.193.91:0/2653956976 learned_addr learned my addr 10.20.193.91:0/2653956976 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:59.184 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.168+0000 7fafda7fc640 10 client.?.objecter ms_handle_connect 0x7fafec160f80 2026-02-12T04:04:59.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.168+0000 7fafda7fc640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:59.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.168+0000 7fafda7fc640 10 client.?.objecter ms_handle_connect 0x7fafec055c30 2026-02-12T04:04:59.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.168+0000 7fafda7fc640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:59.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.168+0000 7fafda7fc640 10 client.?.objecter ms_handle_connect 0x7fafec163230 2026-02-12T04:04:59.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.168+0000 7fafda7fc640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:59.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.169+0000 7fafda7fc640 1 -- 10.20.193.91:0/2653956976 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 373316602 0 0) 0x7fafec05cdc0 con 0x7fafec160f80 2026-02-12T04:04:59.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.169+0000 7fafda7fc640 10 monclient(hunting): _negotiate 2026-02-12T04:04:59.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.169+0000 7fafda7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:59.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.169+0000 7fafda7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:59.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.169+0000 7fafda7fc640 10 monclient(hunting): my global_id is 30708 2026-02-12T04:04:59.185 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.169+0000 7fafda7fc640 1 -- 10.20.193.91:0/2653956976 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafbc003610 con 0x7fafec160f80 2026-02-12T04:04:59.186 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.169+0000 7fafda7fc640 1 -- 10.20.193.91:0/2653956976 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1389277458 0 0) 0x7fafec0ad770 con 0x7fafec163230 2026-02-12T04:04:59.186 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.169+0000 7fafda7fc640 10 monclient(hunting): _negotiate 2026-02-12T04:04:59.186 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.169+0000 7fafda7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:59.186 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.169+0000 7fafda7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:59.186 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.169+0000 7fafda7fc640 10 monclient(hunting): my global_id is 27545 2026-02-12T04:04:59.186 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.169+0000 7fafda7fc640 1 -- 10.20.193.91:0/2653956976 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafec05cdc0 con 0x7fafec163230 2026-02-12T04:04:59.186 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.170+0000 7fafda7fc640 1 -- 10.20.193.91:0/2653956976 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2778483326 0 0) 0x7fafec05d0a0 con 0x7fafec055c30 2026-02-12T04:04:59.186 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.170+0000 7fafda7fc640 10 monclient(hunting): _negotiate 2026-02-12T04:04:59.186 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.170+0000 7fafda7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:59.186 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.170+0000 7fafda7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:59.187 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.170+0000 7fafda7fc640 10 monclient(hunting): my global_id is 27850 2026-02-12T04:04:59.187 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.170+0000 7fafda7fc640 1 -- 10.20.193.91:0/2653956976 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafec0ad770 con 0x7fafec055c30 2026-02-12T04:04:59.187 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.172+0000 7fafda7fc640 1 -- 10.20.193.91:0/2653956976 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1766761510 0 0) 0x7fafbc003610 con 0x7fafec160f80 2026-02-12T04:04:59.187 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.172+0000 7fafda7fc640 1 -- 10.20.193.91:0/2653956976 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fafec05d0a0 con 0x7fafec160f80 2026-02-12T04:04:59.187 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.172+0000 7fafda7fc640 1 -- 10.20.193.91:0/2653956976 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fafe00031c0 con 0x7fafec160f80 2026-02-12T04:04:59.187 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.172+0000 7fafda7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:59.187 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.172+0000 7fafda7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T04:04:59.187 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.172+0000 7fafda7fc640 10 monclient(hunting): dump: 2026-02-12T04:04:59.187 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:59.187 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:59.188 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.188 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.188 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:59.188 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:59.188 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:59.188 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:59.188 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:59.188 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:59.188 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.172+0000 7fafda7fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:04:59.188 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.172+0000 7fafda7fc640 1 -- 10.20.193.91:0/2653956976 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2718311327 0 0) 0x7fafec05cdc0 con 0x7fafec163230 2026-02-12T04:04:59.188 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.172+0000 7fafda7fc640 1 -- 10.20.193.91:0/2653956976 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fafbc003610 con 0x7fafec163230 2026-02-12T04:04:59.189 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.172+0000 7fafda7fc640 1 -- 10.20.193.91:0/2653956976 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fafe8003330 con 0x7fafec163230 2026-02-12T04:04:59.189 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.172+0000 7fafda7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:59.189 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.172+0000 7fafda7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T04:04:59.189 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.172+0000 7fafda7fc640 10 monclient(hunting): dump: 2026-02-12T04:04:59.189 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:59.189 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:59.189 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.189 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.189 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:59.189 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:59.189 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:59.190 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:59.190 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:59.190 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:59.190 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.172+0000 7fafda7fc640 1 -- 10.20.193.91:0/2653956976 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2509585021 0 0) 0x7fafec0ad770 con 0x7fafec055c30 2026-02-12T04:04:59.190 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.172+0000 7fafda7fc640 1 -- 10.20.193.91:0/2653956976 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fafec05cdc0 con 0x7fafec055c30 2026-02-12T04:04:59.190 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.172+0000 7fafda7fc640 1 -- 10.20.193.91:0/2653956976 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fafdc0032e0 con 0x7fafec055c30 2026-02-12T04:04:59.190 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.172+0000 7fafda7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:59.190 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.172+0000 7fafda7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T04:04:59.190 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.172+0000 7fafda7fc640 10 monclient(hunting): dump: 2026-02-12T04:04:59.190 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:59.190 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:59.191 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.191 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.191 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:59.191 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:59.191 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:59.191 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:59.191 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:59.191 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:59.191 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.174+0000 7fafda7fc640 1 -- 10.20.193.91:0/2653956976 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 958957339 0 0) 0x7fafec05d0a0 con 0x7fafec160f80 2026-02-12T04:04:59.191 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.174+0000 7fafda7fc640 1 -- 10.20.193.91:0/2653956976 >> v1:10.20.193.111:6789/0 conn(0x7fafec163230 legacy=0x7fafec05c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:59.191 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.174+0000 7fafda7fc640 1 -- 10.20.193.91:0/2653956976 >> v1:10.20.193.98:6789/0 conn(0x7fafec055c30 legacy=0x7fafec0ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:59.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.174+0000 7fafda7fc640 10 monclient: _finish_hunting 0 2026-02-12T04:04:59.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.174+0000 7fafda7fc640 1 monclient: found mon.a 2026-02-12T04:04:59.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.174+0000 7fafda7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:59.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.174+0000 7fafda7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:59.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.174+0000 7fafda7fc640 1 -- 10.20.193.91:0/2653956976 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafec0ada50 con 0x7fafec160f80 2026-02-12T04:04:59.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.174+0000 7fafda7fc640 10 monclient: _finish_auth 0 2026-02-12T04:04:59.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.174+0000 7fafda7fc640 10 monclient: _check_auth_tickets 2026-02-12T04:04:59.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.174+0000 7fafda7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:59.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.174+0000 7faff4050640 5 monclient: authenticate success, global_id 30708 2026-02-12T04:04:59.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.174+0000 7faff4050640 10 monclient: _renew_subs 2026-02-12T04:04:59.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.174+0000 7faff4050640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:59.192 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.174+0000 7faff4050640 1 -- 10.20.193.91:0/2653956976 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fafec0add30 con 0x7fafec160f80 2026-02-12T04:04:59.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.174+0000 7faff4050640 10 client.30708.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:04:59.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.174+0000 7faff4050640 10 monclient: _renew_subs 2026-02-12T04:04:59.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.174+0000 7faff4050640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:59.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.174+0000 7faff4050640 1 -- 10.20.193.91:0/2653956976 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fafec1534d0 con 0x7fafec160f80 2026-02-12T04:04:59.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.174+0000 7faff4050640 1 librados: init done 2026-02-12T04:04:59.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.174+0000 7faff4050640 10 client.30708.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:59.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.174+0000 7faff4050640 15 client.30708.objecter _session_command_op_assign -1 1 2026-02-12T04:04:59.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.174+0000 7faff4050640 20 client.30708.objecter _get_session osd=-1 returning homeless 2026-02-12T04:04:59.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.174+0000 7faff4050640 10 client.30708.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:04:59.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.174+0000 7faff4050640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:59.193 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.174+0000 7faff4050640 1 -- 10.20.193.91:0/2653956976 --> v1:10.20.193.91:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fafec057920 con 0x7fafec160f80 2026-02-12T04:04:59.196 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.183+0000 7fafda7fc640 1 -- 10.20.193.91:0/2653956976 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fafec057920 con 0x7fafec160f80 2026-02-12T04:04:59.196 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.183+0000 7fafda7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:59.196 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.183+0000 7fafda7fc640 1 -- 10.20.193.91:0/2653956976 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fafe0004a70 con 0x7fafec160f80 2026-02-12T04:04:59.197 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.183+0000 7fafda7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:59.197 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.183+0000 7fafda7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T04:04:59.197 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.183+0000 7fafda7fc640 10 monclient: dump: 2026-02-12T04:04:59.197 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:59.197 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:59.197 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.197 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.197 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:59.197 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:59.197 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:59.197 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:59.198 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:59.198 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:59.198 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.183+0000 7fafdbfff640 4 set_mon_vals no callback set 2026-02-12T04:04:59.198 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.183+0000 7fafda7fc640 1 -- 10.20.193.91:0/2653956976 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7fafe0004c50 con 0x7fafec160f80 2026-02-12T04:04:59.198 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.184+0000 7faff1dc5640 10 monclient: get_auth_request con 0x7fafbc07a0f0 auth_method 0 2026-02-12T04:04:59.198 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.184+0000 7fafda7fc640 10 client.30708.objecter ms_handle_connect 0x7fafbc07a0f0 2026-02-12T04:04:59.198 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.185+0000 7fafda7fc640 1 -- 10.20.193.91:0/2653956976 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7fafe0095960 con 0x7fafec160f80 2026-02-12T04:04:59.198 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.185+0000 7fafda7fc640 10 client.30708.objecter ms_dispatch2 0x7fafec000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:04:59.198 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.185+0000 7fafda7fc640 3 client.30708.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:04:59.198 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.185+0000 7fafda7fc640 3 client.30708.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:04:59.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.185+0000 7fafda7fc640 10 client.30708.objecter checking command 1 2026-02-12T04:04:59.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.185+0000 7fafda7fc640 20 client.30708.objecter _get_session s=0x7fafbc0a4380 osd=13 3 2026-02-12T04:04:59.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.185+0000 7fafda7fc640 20 client.30708.objecter put_session s=0x7fafbc0a4380 osd=13 3 2026-02-12T04:04:59.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.185+0000 7fafda7fc640 15 client.30708.objecter _session_command_op_remove -1 1 2026-02-12T04:04:59.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.185+0000 7fafda7fc640 20 client.30708.objecter _get_session s=0x7fafbc0a4380 osd=13 3 2026-02-12T04:04:59.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.185+0000 7fafda7fc640 20 client.30708.objecter get_session s=0x7fafbc0a4380 osd=13 3 2026-02-12T04:04:59.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.185+0000 7fafda7fc640 15 client.30708.objecter _session_command_op_assign 13 1 2026-02-12T04:04:59.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.185+0000 7fafda7fc640 20 client.30708.objecter put_session s=0x7fafbc0a4380 osd=13 4 2026-02-12T04:04:59.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.185+0000 7fafda7fc640 10 client.30708.objecter _send_command 1 2026-02-12T04:04:59.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.185+0000 7fafda7fc640 1 -- 10.20.193.91:0/2653956976 --> v1:10.20.193.98:6800/1665089474 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fafbc0c6690 con 0x7fafbc0a4a30 2026-02-12T04:04:59.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.185+0000 7fafda7fc640 20 client.30708.objecter dump_active .. 0 homeless 2026-02-12T04:04:59.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.185+0000 7fafda7fc640 1 -- 10.20.193.91:0/2653956976 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_get_version_reply(handle=1 version=344) ==== 24+0+0 (unknown 1403447244 0 0) 0x7fafe005e990 con 0x7fafec160f80 2026-02-12T04:04:59.199 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.185+0000 7fafda7fc640 10 monclient: handle_get_version_reply finishing 1 version 344 2026-02-12T04:04:59.200 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.186+0000 7faff25c6640 10 monclient: get_auth_request con 0x7fafbc0a4a30 auth_method 0 2026-02-12T04:04:59.200 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.187+0000 7fafda7fc640 10 client.30708.objecter ms_handle_connect 0x7fafbc0a4a30 2026-02-12T04:04:59.200 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.196+0000 7fafda7fc640 1 -- 10.20.193.91:0/2653956976 <== osd.13 v1:10.20.193.98:6800/1665089474 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fafbc0c6690 con 0x7fafbc0a4a30 2026-02-12T04:04:59.200 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.196+0000 7fafda7fc640 10 client.30708.objecter ms_dispatch2 0x7fafec000b90 command_reply(tid 1: 0 ) 2026-02-12T04:04:59.200 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.196+0000 7fafda7fc640 10 client.30708.objecter _finish_command 1 = system:0 2026-02-12T04:04:59.200 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.196+0000 7fafda7fc640 20 client.30708.objecter put_session s=0x7fafbc0a4380 osd=13 4 2026-02-12T04:04:59.201 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.196+0000 7fafda7fc640 15 client.30708.objecter _session_command_op_remove 13 1 2026-02-12T04:04:59.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.204+0000 7faff4050640 10 client.30708.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-12T04:04:59.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.204+0000 7faff4050640 15 client.30708.objecter _session_command_op_assign -1 2 2026-02-12T04:04:59.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.204+0000 7faff4050640 20 client.30708.objecter _get_session s=0x7fafbc0a4380 osd=13 3 2026-02-12T04:04:59.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.204+0000 7faff4050640 20 client.30708.objecter put_session s=0x7fafbc0a4380 osd=13 3 2026-02-12T04:04:59.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.204+0000 7faff4050640 20 client.30708.objecter _get_session s=0x7fafbc0a4380 osd=13 3 2026-02-12T04:04:59.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.204+0000 7faff4050640 15 client.30708.objecter _session_command_op_remove -1 2 2026-02-12T04:04:59.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.204+0000 7faff4050640 20 client.30708.objecter get_session s=0x7fafbc0a4380 osd=13 3 2026-02-12T04:04:59.206 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.204+0000 7faff4050640 15 client.30708.objecter _session_command_op_assign 13 2 2026-02-12T04:04:59.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.204+0000 7faff4050640 20 client.30708.objecter put_session s=0x7fafbc0a4380 osd=13 4 2026-02-12T04:04:59.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.204+0000 7faff4050640 10 client.30708.objecter _send_command 2 2026-02-12T04:04:59.207 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.204+0000 7faff4050640 1 -- 10.20.193.91:0/2653956976 --> v1:10.20.193.98:6800/1665089474 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fafec0b0990 con 0x7fafbc0a4a30 2026-02-12T04:04:59.214 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.212+0000 7fafda7fc640 1 -- 10.20.193.91:0/2653956976 <== osd.13 v1:10.20.193.98:6800/1665089474 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fafec0b0990 con 0x7fafbc0a4a30 2026-02-12T04:04:59.214 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.212+0000 7fafda7fc640 10 client.30708.objecter ms_dispatch2 0x7fafec000b90 command_reply(tid 2: 0 ) 2026-02-12T04:04:59.214 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.212+0000 7fafda7fc640 10 client.30708.objecter _finish_command 2 = system:0 2026-02-12T04:04:59.215 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.212+0000 7fafda7fc640 20 client.30708.objecter put_session s=0x7fafbc0a4380 osd=13 4 2026-02-12T04:04:59.215 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.212+0000 7fafda7fc640 15 client.30708.objecter _session_command_op_remove 13 2 2026-02-12T04:04:59.215 INFO:teuthology.orchestra.run.trial091.stdout:{ 2026-02-12T04:04:59.215 INFO:teuthology.orchestra.run.trial091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-12T04:04:59.215 INFO:teuthology.orchestra.run.trial091.stdout:} 2026-02-12T04:04:59.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.212+0000 7faff4050640 10 librados: watch_flush enter 2026-02-12T04:04:59.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.213+0000 7faff4050640 10 librados: watch_flush exit 2026-02-12T04:04:59.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.213+0000 7faff4050640 10 client.30708.objecter close_session for osd.13 2026-02-12T04:04:59.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.213+0000 7faff4050640 1 -- 10.20.193.91:0/2653956976 >> v1:10.20.193.98:6800/1665089474 conn(0x7fafbc0a4a30 legacy=0x7fafbc0c4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:59.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.213+0000 7faff4050640 20 client.30708.objecter put_session s=0x7fafbc0a4380 osd=13 1 2026-02-12T04:04:59.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.213+0000 7faff4050640 20 client.30708.objecter shutdown clearing up homeless session... 2026-02-12T04:04:59.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.213+0000 7faff4050640 10 client.30708.objecter successfully canceled tick 2026-02-12T04:04:59.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.213+0000 7faff4050640 1 -- 10.20.193.91:0/2653956976 >> v1:10.20.193.91:6800/2929217192 conn(0x7fafbc07a0f0 legacy=0x7fafbc09a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:59.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.213+0000 7faff4050640 10 monclient: shutdown 2026-02-12T04:04:59.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.213+0000 7faff4050640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:59.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.213+0000 7faff4050640 1 -- 10.20.193.91:0/2653956976 >> v1:10.20.193.91:6789/0 conn(0x7fafec160f80 legacy=0x7fafec152800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:59.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.213+0000 7faff25c6640 1 -- 10.20.193.91:0/2653956976 reap_dead start 2026-02-12T04:04:59.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.213+0000 7faff4050640 1 -- 10.20.193.91:0/2653956976 shutdown_connections 2026-02-12T04:04:59.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.213+0000 7faff4050640 1 -- 10.20.193.91:0/2653956976 >> 10.20.193.91:0/2653956976 conn(0x7fafec0b6560 msgr2=0x7fafec162b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:59.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.213+0000 7faff4050640 1 -- 10.20.193.91:0/2653956976 shutdown_connections 2026-02-12T04:04:59.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.213+0000 7faff4050640 1 -- 10.20.193.91:0/2653956976 wait complete. 2026-02-12T04:04:59.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.213+0000 7faff4050640 1 librados: shutdown 2026-02-12T04:04:59.223 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 13 2026-02-12T04:04:59.292 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.290+0000 7f7160ea6640 10 monclient: get_monmap_and_config 2026-02-12T04:04:59.292 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.290+0000 7f7160ea6640 10 monclient: build_initial_monmap 2026-02-12T04:04:59.293 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.290+0000 7f7160ea6640 10 monclient: monmap: 2026-02-12T04:04:59.293 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:59.293 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:59.293 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:04:59.291341+0000 2026-02-12T04:04:59.293 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:04:59.291341+0000 2026-02-12T04:04:59.293 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:59.293 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:59.293 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:59.293 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:59.294 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:59.294 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:59.296 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.291+0000 7f7160ea6640 1 Processor -- start 2026-02-12T04:04:59.296 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.291+0000 7f7160ea6640 1 -- start start 2026-02-12T04:04:59.296 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.291+0000 7f7160ea6640 10 monclient: init 2026-02-12T04:04:59.297 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.291+0000 7f7160ea6640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:59.297 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.291+0000 7f7160ea6640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T04:04:59.297 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.291+0000 7f7160ea6640 10 monclient(hunting): picked mon.noname-b con 0x7f715c1575d0 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:59.297 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.291+0000 7f7160ea6640 10 monclient(hunting): picked mon.noname-a con 0x7f715c163310 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:59.297 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.291+0000 7f7160ea6640 10 monclient(hunting): picked mon.noname-c con 0x7f715c0560d0 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:59.297 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.291+0000 7f7160ea6640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f715c0b20b0 con 0x7f715c163310 2026-02-12T04:04:59.297 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.291+0000 7f7160ea6640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f715c0b2390 con 0x7f715c1575d0 2026-02-12T04:04:59.297 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.291+0000 7f7160ea6640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f715c0b2670 con 0x7f715c0560d0 2026-02-12T04:04:59.297 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.291+0000 7f7160ea6640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:59.297 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.291+0000 7f7160ea6640 10 monclient(hunting): authenticate will time out at 1502.034871s 2026-02-12T04:04:59.298 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.292+0000 7f715a575640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f715c1575d0 0x7f715c162c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:45650/0 (socket says 10.20.193.91:45650) 2026-02-12T04:04:59.298 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.292+0000 7f715a575640 1 -- 10.20.193.91:0/485918709 learned_addr learned my addr 10.20.193.91:0/485918709 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:59.298 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.293+0000 7f7159573640 1 -- 10.20.193.91:0/485918709 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1911305211 0 0) 0x7f715c0b2390 con 0x7f715c1575d0 2026-02-12T04:04:59.298 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.293+0000 7f7159573640 10 monclient(hunting): _negotiate 2026-02-12T04:04:59.298 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.293+0000 7f7159573640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:59.298 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.293+0000 7f7159573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:59.298 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.293+0000 7f7159573640 10 monclient(hunting): my global_id is 27853 2026-02-12T04:04:59.298 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.293+0000 7f7159573640 1 -- 10.20.193.91:0/485918709 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7148003610 con 0x7f715c1575d0 2026-02-12T04:04:59.298 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.293+0000 7f7159573640 1 -- 10.20.193.91:0/485918709 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3473227597 0 0) 0x7f715c0b20b0 con 0x7f715c163310 2026-02-12T04:04:59.298 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.293+0000 7f7159573640 10 monclient(hunting): _negotiate 2026-02-12T04:04:59.299 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.293+0000 7f7159573640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:59.299 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.293+0000 7f7159573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:59.299 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.293+0000 7f7159573640 10 monclient(hunting): my global_id is 30711 2026-02-12T04:04:59.299 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.293+0000 7f7159573640 1 -- 10.20.193.91:0/485918709 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f715c0b2390 con 0x7f715c163310 2026-02-12T04:04:59.299 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.293+0000 7f7159573640 1 -- 10.20.193.91:0/485918709 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3862408563 0 0) 0x7f715c0b2670 con 0x7f715c0560d0 2026-02-12T04:04:59.299 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.293+0000 7f7159573640 10 monclient(hunting): _negotiate 2026-02-12T04:04:59.299 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.293+0000 7f7159573640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:59.299 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.293+0000 7f7159573640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:59.299 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.293+0000 7f7159573640 10 monclient(hunting): my global_id is 27548 2026-02-12T04:04:59.299 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.293+0000 7f7159573640 1 -- 10.20.193.91:0/485918709 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f715c0b20b0 con 0x7f715c0560d0 2026-02-12T04:04:59.308 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.295+0000 7f7159573640 1 -- 10.20.193.91:0/485918709 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1431002262 0 0) 0x7f715c0b20b0 con 0x7f715c0560d0 2026-02-12T04:04:59.308 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.295+0000 7f7159573640 1 -- 10.20.193.91:0/485918709 >> v1:10.20.193.98:6789/0 conn(0x7f715c1575d0 legacy=0x7f715c162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:59.308 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.295+0000 7f7159573640 1 -- 10.20.193.91:0/485918709 >> v1:10.20.193.91:6789/0 conn(0x7f715c163310 legacy=0x7f715c0559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:59.308 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.295+0000 7f7159573640 10 monclient: _finish_hunting 0 2026-02-12T04:04:59.309 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.295+0000 7f7159573640 1 monclient: found mon.noname-c 2026-02-12T04:04:59.309 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.295+0000 7f7159573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:59.309 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.295+0000 7f7159573640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.111:6789/0 2026-02-12T04:04:59.309 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.295+0000 7f7159573640 1 -- 10.20.193.91:0/485918709 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f715c162400 con 0x7f715c0560d0 2026-02-12T04:04:59.309 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.295+0000 7f7159573640 10 monclient: _finish_auth 0 2026-02-12T04:04:59.309 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.295+0000 7f7159573640 10 monclient: _check_auth_tickets 2026-02-12T04:04:59.309 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.295+0000 7f7159573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:59.309 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.295+0000 7f7159573640 1 -- 10.20.193.91:0/485918709 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f714c003150 con 0x7f715c0560d0 2026-02-12T04:04:59.309 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.295+0000 7f7159573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:59.309 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.295+0000 7f7159573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T04:04:59.309 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.295+0000 7f7159573640 10 monclient: dump: 2026-02-12T04:04:59.310 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:59.310 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:59.310 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.310 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.310 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:59.310 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:59.310 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:59.310 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:59.310 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:59.310 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:59.311 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.295+0000 7f7160ea6640 5 monclient: authenticate success, global_id 27548 2026-02-12T04:04:59.311 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.295+0000 7f7160ea6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:04:59.311 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.296+0000 7f7159573640 1 -- 10.20.193.91:0/485918709 <== mon.2 v1:10.20.193.111:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f714c003320 con 0x7f715c0560d0 2026-02-12T04:04:59.311 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.296+0000 7f7159573640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:59.311 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.296+0000 7f7160ea6640 10 monclient: get_monmap_and_config success 2026-02-12T04:04:59.311 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.296+0000 7f7159573640 1 -- 10.20.193.91:0/485918709 <== mon.2 v1:10.20.193.111:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f714c003760 con 0x7f715c0560d0 2026-02-12T04:04:59.311 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.296+0000 7f7160ea6640 4 set_mon_vals no callback set 2026-02-12T04:04:59.311 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.296+0000 7f7159573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:59.311 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.296+0000 7f7159573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T04:04:59.311 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.296+0000 7f7159573640 10 monclient: dump: 2026-02-12T04:04:59.312 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:59.312 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:59.312 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.312 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.312 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:59.312 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:59.312 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:59.312 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:59.312 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:59.312 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:59.312 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.296+0000 7f7160ea6640 10 monclient: shutdown 2026-02-12T04:04:59.313 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.296+0000 7f7160ea6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:59.313 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.296+0000 7f7160ea6640 1 -- 10.20.193.91:0/485918709 >> v1:10.20.193.111:6789/0 conn(0x7f715c0560d0 legacy=0x7f715c1c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:59.313 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.296+0000 7f7160ea6640 1 -- 10.20.193.91:0/485918709 shutdown_connections 2026-02-12T04:04:59.313 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.296+0000 7f7160ea6640 1 -- 10.20.193.91:0/485918709 >> 10.20.193.91:0/485918709 conn(0x7f715c0b6560 msgr2=0x7f715c0b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:59.313 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.296+0000 7f7160ea6640 1 -- 10.20.193.91:0/485918709 shutdown_connections 2026-02-12T04:04:59.313 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.296+0000 7f7160ea6640 1 -- 10.20.193.91:0/485918709 wait complete. 2026-02-12T04:04:59.313 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.297+0000 7f7160ea6640 10 monclient: build_initial_monmap 2026-02-12T04:04:59.313 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.297+0000 7f7160ea6640 10 monclient: monmap: 2026-02-12T04:04:59.313 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:59.313 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:04:59.314 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:04:59.314 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:04:59.314 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:59.314 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:04:59.314 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:59.314 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:59.314 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:59.314 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:59.314 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.297+0000 7f7160ea6640 1 librados: starting msgr at 2026-02-12T04:04:59.314 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.297+0000 7f7160ea6640 1 librados: starting objecter 2026-02-12T04:04:59.314 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.297+0000 7f7160ea6640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:04:59.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.297+0000 7f7160ea6640 1 Processor -- start 2026-02-12T04:04:59.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.297+0000 7f7160ea6640 1 -- start start 2026-02-12T04:04:59.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.297+0000 7f7160ea6640 1 librados: setting wanted keys 2026-02-12T04:04:59.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.297+0000 7f7160ea6640 1 librados: calling monclient init 2026-02-12T04:04:59.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.297+0000 7f7160ea6640 10 monclient: init 2026-02-12T04:04:59.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.297+0000 7f7160ea6640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:59.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.297+0000 7f7160ea6640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T04:04:59.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.297+0000 7f7160ea6640 10 monclient(hunting): picked mon.noname-a con 0x7f715c0560d0 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:59.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.297+0000 7f7160ea6640 10 monclient(hunting): picked mon.noname-b con 0x7f715c1575d0 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:59.315 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.297+0000 7f7160ea6640 10 monclient(hunting): picked mon.noname-c con 0x7f715c163310 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:59.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.297+0000 7f7160ea6640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f715c15fb00 con 0x7f715c0560d0 2026-02-12T04:04:59.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.297+0000 7f7160ea6640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f715c15fde0 con 0x7f715c1575d0 2026-02-12T04:04:59.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.297+0000 7f7160ea6640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f715c1600c0 con 0x7f715c163310 2026-02-12T04:04:59.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.297+0000 7f7160ea6640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:59.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.297+0000 7f7160ea6640 10 monclient(hunting): authenticate will time out at 1502.040806s 2026-02-12T04:04:59.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.298+0000 7f715ad76640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f715c163310 0x7f715c15f0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:44448/0 (socket says 10.20.193.91:44448) 2026-02-12T04:04:59.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.298+0000 7f715ad76640 1 -- 10.20.193.91:0/254447548 learned_addr learned my addr 10.20.193.91:0/254447548 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:59.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.298+0000 7f7142ffd640 10 client.?.objecter ms_handle_connect 0x7f715c163310 2026-02-12T04:04:59.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.298+0000 7f7142ffd640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:59.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.298+0000 7f7142ffd640 10 client.?.objecter ms_handle_connect 0x7f715c0560d0 2026-02-12T04:04:59.316 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.298+0000 7f7142ffd640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:59.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.298+0000 7f7142ffd640 10 client.?.objecter ms_handle_connect 0x7f715c1575d0 2026-02-12T04:04:59.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.298+0000 7f7142ffd640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:59.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.299+0000 7f7142ffd640 1 -- 10.20.193.91:0/254447548 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1295255250 0 0) 0x7f715c1600c0 con 0x7f715c163310 2026-02-12T04:04:59.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.299+0000 7f7142ffd640 10 monclient(hunting): _negotiate 2026-02-12T04:04:59.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.299+0000 7f7142ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:59.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.299+0000 7f7142ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:59.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.299+0000 7f7142ffd640 10 monclient(hunting): my global_id is 27551 2026-02-12T04:04:59.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.299+0000 7f7142ffd640 1 -- 10.20.193.91:0/254447548 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7128003610 con 0x7f715c163310 2026-02-12T04:04:59.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.299+0000 7f7142ffd640 1 -- 10.20.193.91:0/254447548 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3549827686 0 0) 0x7f715c15fb00 con 0x7f715c0560d0 2026-02-12T04:04:59.317 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.299+0000 7f7142ffd640 10 monclient(hunting): _negotiate 2026-02-12T04:04:59.318 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.299+0000 7f7142ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:59.318 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.299+0000 7f7142ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:59.318 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.299+0000 7f7142ffd640 10 monclient(hunting): my global_id is 30714 2026-02-12T04:04:59.318 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.299+0000 7f7142ffd640 1 -- 10.20.193.91:0/254447548 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f715c1600c0 con 0x7f715c0560d0 2026-02-12T04:04:59.318 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.299+0000 7f7142ffd640 1 -- 10.20.193.91:0/254447548 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3966489330 0 0) 0x7f715c15fde0 con 0x7f715c1575d0 2026-02-12T04:04:59.318 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.299+0000 7f7142ffd640 10 monclient(hunting): _negotiate 2026-02-12T04:04:59.318 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.299+0000 7f7142ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:59.318 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.299+0000 7f7142ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:59.318 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.299+0000 7f7142ffd640 10 monclient(hunting): my global_id is 27856 2026-02-12T04:04:59.318 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.299+0000 7f7142ffd640 1 -- 10.20.193.91:0/254447548 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f715c15fb00 con 0x7f715c1575d0 2026-02-12T04:04:59.318 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.302+0000 7f7142ffd640 1 -- 10.20.193.91:0/254447548 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3256115234 0 0) 0x7f715c1600c0 con 0x7f715c0560d0 2026-02-12T04:04:59.319 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.302+0000 7f7142ffd640 1 -- 10.20.193.91:0/254447548 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f715c15fde0 con 0x7f715c0560d0 2026-02-12T04:04:59.319 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.302+0000 7f7142ffd640 1 -- 10.20.193.91:0/254447548 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f71500030b0 con 0x7f715c0560d0 2026-02-12T04:04:59.319 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.302+0000 7f7142ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:59.319 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.302+0000 7f7142ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T04:04:59.319 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.302+0000 7f7142ffd640 10 monclient(hunting): dump: 2026-02-12T04:04:59.319 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:59.319 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:59.319 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.319 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.319 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:59.319 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:59.320 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:59.320 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:59.320 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:59.320 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:59.320 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.302+0000 7f7142ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:04:59.320 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.302+0000 7f7142ffd640 1 -- 10.20.193.91:0/254447548 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3203670786 0 0) 0x7f715c15fb00 con 0x7f715c1575d0 2026-02-12T04:04:59.320 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.302+0000 7f7142ffd640 1 -- 10.20.193.91:0/254447548 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f715c1600c0 con 0x7f715c1575d0 2026-02-12T04:04:59.320 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.302+0000 7f7142ffd640 1 -- 10.20.193.91:0/254447548 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f7144002fc0 con 0x7f715c1575d0 2026-02-12T04:04:59.320 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.302+0000 7f7142ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:59.320 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.302+0000 7f7142ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T04:04:59.320 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.302+0000 7f7142ffd640 10 monclient(hunting): dump: 2026-02-12T04:04:59.321 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:59.321 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:59.321 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.321 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.321 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:59.321 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:59.321 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:59.321 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:59.321 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:59.321 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:59.321 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.303+0000 7f7142ffd640 1 -- 10.20.193.91:0/254447548 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 786415519 0 0) 0x7f7128003610 con 0x7f715c163310 2026-02-12T04:04:59.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.303+0000 7f7142ffd640 1 -- 10.20.193.91:0/254447548 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f715c15fb00 con 0x7f715c163310 2026-02-12T04:04:59.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.303+0000 7f7142ffd640 1 -- 10.20.193.91:0/254447548 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f714c003670 con 0x7f715c163310 2026-02-12T04:04:59.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.303+0000 7f7142ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:59.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.303+0000 7f7142ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T04:04:59.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.303+0000 7f7142ffd640 10 monclient(hunting): dump: 2026-02-12T04:04:59.322 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:59.322 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:59.322 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.322 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.322 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:59.322 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:59.322 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:59.323 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:59.323 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:59.323 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:59.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.303+0000 7f7142ffd640 1 -- 10.20.193.91:0/254447548 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3407996670 0 0) 0x7f715c15fde0 con 0x7f715c0560d0 2026-02-12T04:04:59.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.303+0000 7f7142ffd640 1 -- 10.20.193.91:0/254447548 >> v1:10.20.193.111:6789/0 conn(0x7f715c163310 legacy=0x7f715c15f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:59.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.303+0000 7f7142ffd640 1 -- 10.20.193.91:0/254447548 >> v1:10.20.193.98:6789/0 conn(0x7f715c1575d0 legacy=0x7f715c15e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:59.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.303+0000 7f7142ffd640 10 monclient: _finish_hunting 0 2026-02-12T04:04:59.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.303+0000 7f7142ffd640 1 monclient: found mon.a 2026-02-12T04:04:59.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.303+0000 7f7142ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:59.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.303+0000 7f7142ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:59.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.303+0000 7f7142ffd640 1 -- 10.20.193.91:0/254447548 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f715c1603a0 con 0x7f715c0560d0 2026-02-12T04:04:59.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.303+0000 7f7142ffd640 10 monclient: _finish_auth 0 2026-02-12T04:04:59.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.303+0000 7f7142ffd640 10 monclient: _check_auth_tickets 2026-02-12T04:04:59.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.303+0000 7f7142ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:59.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.303+0000 7f7160ea6640 5 monclient: authenticate success, global_id 30714 2026-02-12T04:04:59.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.303+0000 7f7160ea6640 10 monclient: _renew_subs 2026-02-12T04:04:59.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.303+0000 7f7160ea6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:59.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.303+0000 7f7160ea6640 1 -- 10.20.193.91:0/254447548 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f715c143490 con 0x7f715c0560d0 2026-02-12T04:04:59.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.303+0000 7f7160ea6640 10 client.30714.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:04:59.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.303+0000 7f7160ea6640 10 monclient: _renew_subs 2026-02-12T04:04:59.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.303+0000 7f7160ea6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:59.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.303+0000 7f7160ea6640 1 -- 10.20.193.91:0/254447548 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f715c145530 con 0x7f715c0560d0 2026-02-12T04:04:59.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.303+0000 7f7160ea6640 1 librados: init done 2026-02-12T04:04:59.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.304+0000 7f7160ea6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:59.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.304+0000 7f7160ea6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:59.325 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.304+0000 7f7160ea6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:04:59.325 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.304+0000 7f7160ea6640 1 -- 10.20.193.91:0/254447548 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f715c055b50 con 0x7f715c0560d0 2026-02-12T04:04:59.326 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.312+0000 7f7142ffd640 1 -- 10.20.193.91:0/254447548 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f71500048d0 con 0x7f715c0560d0 2026-02-12T04:04:59.326 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.312+0000 7f7142ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:59.326 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.312+0000 7f7142ffd640 1 -- 10.20.193.91:0/254447548 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f7150004c20 con 0x7f715c0560d0 2026-02-12T04:04:59.326 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.312+0000 7f7142ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:59.326 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.312+0000 7f7142ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T04:04:59.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.312+0000 7f7142ffd640 10 monclient: dump: 2026-02-12T04:04:59.327 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:59.327 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:59.327 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.327 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.327 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:59.327 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:59.327 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:59.327 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:59.327 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:59.327 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:59.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.312+0000 7f7158d72640 4 set_mon_vals no callback set 2026-02-12T04:04:59.328 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.313+0000 7f7142ffd640 1 -- 10.20.193.91:0/254447548 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f715001e100 con 0x7f715c0560d0 2026-02-12T04:04:59.328 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.313+0000 7f7159d74640 10 monclient: get_auth_request con 0x7f712807a090 auth_method 0 2026-02-12T04:04:59.328 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.313+0000 7f7142ffd640 10 client.30714.objecter ms_handle_connect 0x7f712807a090 2026-02-12T04:04:59.328 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.314+0000 7f7142ffd640 1 -- 10.20.193.91:0/254447548 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7f7150095a40 con 0x7f715c0560d0 2026-02-12T04:04:59.328 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.314+0000 7f7142ffd640 10 client.30714.objecter ms_dispatch2 0x7f715c000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:04:59.328 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.314+0000 7f7142ffd640 3 client.30714.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:04:59.328 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.314+0000 7f7142ffd640 3 client.30714.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:04:59.328 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.314+0000 7f7142ffd640 20 client.30714.objecter dump_active .. 0 homeless 2026-02-12T04:04:59.402 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.401+0000 7f7142ffd640 1 -- 10.20.193.91:0/254447548 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f715005f3a0 con 0x7f715c0560d0 2026-02-12T04:04:59.403 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.401+0000 7f7142ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:59.403 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.401+0000 7f7142ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T04:04:59.511 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.508+0000 7f7160ea6640 1 -- 10.20.193.91:0/254447548 --> v1:10.20.193.91:6800/2929217192 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "13", "target": ["mon-mgr", ""]}) -- 0x7f715c0b7290 con 0x7f712807a090 2026-02-12T04:04:59.511 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.509+0000 7f7142ffd640 1 -- 10.20.193.91:0/254447548 <== mgr.4113 v1:10.20.193.91:6800/2929217192 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 13 to deep-scrub) ==== 42+0+0 (unknown 1087616222 0 0) 0x7f715c0b7290 con 0x7f712807a090 2026-02-12T04:04:59.511 INFO:teuthology.orchestra.run.trial091.stderr:instructed osd(s) 13 to deep-scrub 2026-02-12T04:04:59.512 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.510+0000 7f7160ea6640 10 librados: watch_flush enter 2026-02-12T04:04:59.513 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.510+0000 7f7160ea6640 10 librados: watch_flush exit 2026-02-12T04:04:59.513 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.510+0000 7f7160ea6640 20 client.30714.objecter shutdown clearing up homeless session... 2026-02-12T04:04:59.513 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.510+0000 7f7160ea6640 10 client.30714.objecter successfully canceled tick 2026-02-12T04:04:59.513 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.510+0000 7f7160ea6640 1 -- 10.20.193.91:0/254447548 >> v1:10.20.193.91:6800/2929217192 conn(0x7f712807a090 legacy=0x7f712809a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:59.513 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.510+0000 7f7160ea6640 10 monclient: shutdown 2026-02-12T04:04:59.513 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.510+0000 7f7160ea6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:59.513 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.510+0000 7f7160ea6640 1 -- 10.20.193.91:0/254447548 >> v1:10.20.193.91:6789/0 conn(0x7f715c0560d0 legacy=0x7f715c058910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:59.513 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.510+0000 7f7160ea6640 1 -- 10.20.193.91:0/254447548 shutdown_connections 2026-02-12T04:04:59.513 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.510+0000 7f7160ea6640 1 -- 10.20.193.91:0/254447548 >> 10.20.193.91:0/254447548 conn(0x7f715c0b6560 msgr2=0x7f715c0b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:59.514 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.510+0000 7f7160ea6640 1 -- 10.20.193.91:0/254447548 shutdown_connections 2026-02-12T04:04:59.514 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.510+0000 7f7160ea6640 1 -- 10.20.193.91:0/254447548 wait complete. 2026-02-12T04:04:59.514 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.510+0000 7f7160ea6640 1 librados: shutdown 2026-02-12T04:04:59.520 INFO:tasks.ceph:Scrubbing osd.2 2026-02-12T04:04:59.520 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-12T04:04:59.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.589+0000 7f8a51002640 10 monclient: get_monmap_and_config 2026-02-12T04:04:59.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.589+0000 7f8a51002640 10 monclient: build_initial_monmap 2026-02-12T04:04:59.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.589+0000 7f8a51002640 10 monclient: monmap: 2026-02-12T04:04:59.591 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:59.592 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:59.592 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:04:59.590028+0000 2026-02-12T04:04:59.592 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:04:59.590028+0000 2026-02-12T04:04:59.592 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:59.592 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:59.592 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:59.592 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:59.592 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:59.592 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:59.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.589+0000 7f8a51002640 1 Processor -- start 2026-02-12T04:04:59.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.589+0000 7f8a51002640 1 -- start start 2026-02-12T04:04:59.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.589+0000 7f8a51002640 10 monclient: init 2026-02-12T04:04:59.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.590+0000 7f8a51002640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:59.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.590+0000 7f8a51002640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T04:04:59.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.590+0000 7f8a51002640 10 monclient(hunting): picked mon.noname-a con 0x7f8a4c055c30 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:59.596 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.590+0000 7f8a51002640 10 monclient(hunting): picked mon.noname-b con 0x7f8a4c160f80 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:59.597 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.590+0000 7f8a51002640 10 monclient(hunting): picked mon.noname-c con 0x7f8a4c163230 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:59.597 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.590+0000 7f8a51002640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a4c0b1fc0 con 0x7f8a4c055c30 2026-02-12T04:04:59.597 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.590+0000 7f8a51002640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a4c0b22a0 con 0x7f8a4c160f80 2026-02-12T04:04:59.597 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.590+0000 7f8a51002640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a4c0b2580 con 0x7f8a4c163230 2026-02-12T04:04:59.597 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.590+0000 7f8a51002640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:59.597 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.590+0000 7f8a51002640 10 monclient(hunting): authenticate will time out at 1502.333478s 2026-02-12T04:04:59.597 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.590+0000 7f8a4a575640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f8a4c160f80 0x7f8a4c1572d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:45666/0 (socket says 10.20.193.91:45666) 2026-02-12T04:04:59.597 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.590+0000 7f8a4a575640 1 -- 10.20.193.91:0/3532727262 learned_addr learned my addr 10.20.193.91:0/3532727262 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:59.597 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.592+0000 7f8a49d74640 1 -- 10.20.193.91:0/3532727262 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2346720420 0 0) 0x7f8a4c0b2580 con 0x7f8a4c163230 2026-02-12T04:04:59.597 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.592+0000 7f8a49d74640 10 monclient(hunting): _negotiate 2026-02-12T04:04:59.598 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.592+0000 7f8a49d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:59.598 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.592+0000 7f8a49d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:59.598 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.592+0000 7f8a49d74640 10 monclient(hunting): my global_id is 27554 2026-02-12T04:04:59.598 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.592+0000 7f8a49d74640 1 -- 10.20.193.91:0/3532727262 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a38003610 con 0x7f8a4c163230 2026-02-12T04:04:59.598 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.592+0000 7f8a49d74640 1 -- 10.20.193.91:0/3532727262 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3768034083 0 0) 0x7f8a4c0b22a0 con 0x7f8a4c160f80 2026-02-12T04:04:59.598 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.592+0000 7f8a49d74640 10 monclient(hunting): _negotiate 2026-02-12T04:04:59.598 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.592+0000 7f8a49d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:59.598 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.592+0000 7f8a49d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:59.598 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.592+0000 7f8a49d74640 10 monclient(hunting): my global_id is 27859 2026-02-12T04:04:59.598 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.592+0000 7f8a49d74640 1 -- 10.20.193.91:0/3532727262 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a4c0b2580 con 0x7f8a4c160f80 2026-02-12T04:04:59.599 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.592+0000 7f8a49d74640 1 -- 10.20.193.91:0/3532727262 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 412280578 0 0) 0x7f8a4c0b1fc0 con 0x7f8a4c055c30 2026-02-12T04:04:59.599 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.592+0000 7f8a49d74640 10 monclient(hunting): _negotiate 2026-02-12T04:04:59.599 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.592+0000 7f8a49d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:59.599 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.592+0000 7f8a49d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:59.599 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.592+0000 7f8a49d74640 10 monclient(hunting): my global_id is 30717 2026-02-12T04:04:59.599 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.592+0000 7f8a49d74640 1 -- 10.20.193.91:0/3532727262 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a4c0b22a0 con 0x7f8a4c055c30 2026-02-12T04:04:59.599 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.593+0000 7f8a49d74640 1 -- 10.20.193.91:0/3532727262 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1155694324 0 0) 0x7f8a38003610 con 0x7f8a4c163230 2026-02-12T04:04:59.599 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.593+0000 7f8a49d74640 1 -- 10.20.193.91:0/3532727262 >> v1:10.20.193.98:6789/0 conn(0x7f8a4c160f80 legacy=0x7f8a4c1572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:59.599 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.593+0000 7f8a49d74640 1 -- 10.20.193.91:0/3532727262 >> v1:10.20.193.91:6789/0 conn(0x7f8a4c055c30 legacy=0x7f8a4c162b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:59.599 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.593+0000 7f8a49d74640 10 monclient: _finish_hunting 0 2026-02-12T04:04:59.600 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.593+0000 7f8a49d74640 1 monclient: found mon.noname-c 2026-02-12T04:04:59.600 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.593+0000 7f8a49d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:59.600 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.593+0000 7f8a49d74640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.111:6789/0 2026-02-12T04:04:59.600 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.593+0000 7f8a49d74640 1 -- 10.20.193.91:0/3532727262 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a4c0b2860 con 0x7f8a4c163230 2026-02-12T04:04:59.600 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.593+0000 7f8a49d74640 10 monclient: _finish_auth 0 2026-02-12T04:04:59.600 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.593+0000 7f8a49d74640 10 monclient: _check_auth_tickets 2026-02-12T04:04:59.600 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.593+0000 7f8a49d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:59.600 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.593+0000 7f8a49d74640 1 -- 10.20.193.91:0/3532727262 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8a3c003170 con 0x7f8a4c163230 2026-02-12T04:04:59.600 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.593+0000 7f8a49d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:59.600 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.593+0000 7f8a49d74640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T04:04:59.601 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.593+0000 7f8a49d74640 10 monclient: dump: 2026-02-12T04:04:59.601 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:59.601 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:59.601 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.601 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.601 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:59.601 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:59.601 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:59.601 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:59.601 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:59.601 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:59.602 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.593+0000 7f8a51002640 5 monclient: authenticate success, global_id 27554 2026-02-12T04:04:59.602 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.593+0000 7f8a51002640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:04:59.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.594+0000 7f8a49d74640 1 -- 10.20.193.91:0/3532727262 <== mon.2 v1:10.20.193.111:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8a3c003340 con 0x7f8a4c163230 2026-02-12T04:04:59.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.594+0000 7f8a49d74640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:59.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.594+0000 7f8a49d74640 1 -- 10.20.193.91:0/3532727262 <== mon.2 v1:10.20.193.111:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8a3c003780 con 0x7f8a4c163230 2026-02-12T04:04:59.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.594+0000 7f8a49d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:59.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.594+0000 7f8a49d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T04:04:59.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.594+0000 7f8a49d74640 10 monclient: dump: 2026-02-12T04:04:59.610 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:59.610 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:59.610 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.610 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.610 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:59.610 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:59.610 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:59.610 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:59.610 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:59.610 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:59.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.594+0000 7f8a51002640 10 monclient: get_monmap_and_config success 2026-02-12T04:04:59.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.594+0000 7f8a51002640 4 set_mon_vals no callback set 2026-02-12T04:04:59.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.594+0000 7f8a51002640 10 monclient: shutdown 2026-02-12T04:04:59.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.594+0000 7f8a51002640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:59.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.594+0000 7f8a51002640 1 -- 10.20.193.91:0/3532727262 >> v1:10.20.193.111:6789/0 conn(0x7f8a4c163230 legacy=0x7f8a4c1c57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:59.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.594+0000 7f8a51002640 1 -- 10.20.193.91:0/3532727262 shutdown_connections 2026-02-12T04:04:59.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.594+0000 7f8a51002640 1 -- 10.20.193.91:0/3532727262 >> 10.20.193.91:0/3532727262 conn(0x7f8a4c0b6560 msgr2=0x7f8a4c0b6930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:59.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.594+0000 7f8a51002640 1 -- 10.20.193.91:0/3532727262 shutdown_connections 2026-02-12T04:04:59.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.594+0000 7f8a51002640 1 -- 10.20.193.91:0/3532727262 wait complete. 2026-02-12T04:04:59.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.595+0000 7f8a51002640 10 monclient: build_initial_monmap 2026-02-12T04:04:59.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.595+0000 7f8a51002640 10 monclient: monmap: 2026-02-12T04:04:59.612 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:59.612 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:04:59.612 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:04:59.612 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:04:59.612 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:59.612 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:04:59.612 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:59.612 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:59.612 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:59.613 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:59.613 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.595+0000 7f8a51002640 1 librados: starting msgr at 2026-02-12T04:04:59.613 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.595+0000 7f8a51002640 1 librados: starting objecter 2026-02-12T04:04:59.613 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.595+0000 7f8a51002640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:04:59.613 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.595+0000 7f8a51002640 1 Processor -- start 2026-02-12T04:04:59.613 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.595+0000 7f8a51002640 1 -- start start 2026-02-12T04:04:59.613 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.595+0000 7f8a51002640 1 librados: setting wanted keys 2026-02-12T04:04:59.613 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.595+0000 7f8a51002640 1 librados: calling monclient init 2026-02-12T04:04:59.613 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.595+0000 7f8a51002640 10 monclient: init 2026-02-12T04:04:59.613 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.595+0000 7f8a51002640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:59.614 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.595+0000 7f8a51002640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T04:04:59.614 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.595+0000 7f8a51002640 10 monclient(hunting): picked mon.noname-b con 0x7f8a4c055c30 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:59.614 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.595+0000 7f8a51002640 10 monclient(hunting): picked mon.noname-c con 0x7f8a4c160f80 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:59.614 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.596+0000 7f8a51002640 10 monclient(hunting): picked mon.noname-a con 0x7f8a4c163230 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:59.614 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.596+0000 7f8a51002640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a4c144130 con 0x7f8a4c163230 2026-02-12T04:04:59.614 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.596+0000 7f8a51002640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a4c11a6f0 con 0x7f8a4c055c30 2026-02-12T04:04:59.614 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.596+0000 7f8a51002640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a4c1434a0 con 0x7f8a4c160f80 2026-02-12T04:04:59.614 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.596+0000 7f8a51002640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:59.614 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.596+0000 7f8a51002640 10 monclient(hunting): authenticate will time out at 1502.339015s 2026-02-12T04:04:59.614 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.596+0000 7f8a4b577640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f8a4c163230 0x7f8a4c0b0010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:41682/0 (socket says 10.20.193.91:41682) 2026-02-12T04:04:59.615 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.596+0000 7f8a4b577640 1 -- 10.20.193.91:0/1592252415 learned_addr learned my addr 10.20.193.91:0/1592252415 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:59.615 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.596+0000 7f8a2b7fe640 10 client.?.objecter ms_handle_connect 0x7f8a4c163230 2026-02-12T04:04:59.615 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.596+0000 7f8a2b7fe640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:59.615 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.596+0000 7f8a2b7fe640 10 client.?.objecter ms_handle_connect 0x7f8a4c055c30 2026-02-12T04:04:59.615 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.596+0000 7f8a2b7fe640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:59.615 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.596+0000 7f8a2b7fe640 10 client.?.objecter ms_handle_connect 0x7f8a4c160f80 2026-02-12T04:04:59.615 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.596+0000 7f8a2b7fe640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:59.615 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.597+0000 7f8a2b7fe640 1 -- 10.20.193.91:0/1592252415 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 564668596 0 0) 0x7f8a4c11a6f0 con 0x7f8a4c055c30 2026-02-12T04:04:59.615 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.597+0000 7f8a2b7fe640 10 monclient(hunting): _negotiate 2026-02-12T04:04:59.615 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.597+0000 7f8a2b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:59.615 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.597+0000 7f8a2b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:59.616 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.597+0000 7f8a2b7fe640 10 monclient(hunting): my global_id is 27862 2026-02-12T04:04:59.616 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.597+0000 7f8a2b7fe640 1 -- 10.20.193.91:0/1592252415 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a18003610 con 0x7f8a4c055c30 2026-02-12T04:04:59.616 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.597+0000 7f8a2b7fe640 1 -- 10.20.193.91:0/1592252415 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3929806975 0 0) 0x7f8a4c144130 con 0x7f8a4c163230 2026-02-12T04:04:59.616 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.597+0000 7f8a2b7fe640 10 monclient(hunting): _negotiate 2026-02-12T04:04:59.616 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.597+0000 7f8a2b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:59.616 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.597+0000 7f8a2b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:59.616 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.597+0000 7f8a2b7fe640 10 monclient(hunting): my global_id is 30720 2026-02-12T04:04:59.616 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.597+0000 7f8a2b7fe640 1 -- 10.20.193.91:0/1592252415 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a4c11a6f0 con 0x7f8a4c163230 2026-02-12T04:04:59.616 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.597+0000 7f8a2b7fe640 1 -- 10.20.193.91:0/1592252415 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3781124700 0 0) 0x7f8a4c1434a0 con 0x7f8a4c160f80 2026-02-12T04:04:59.616 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.597+0000 7f8a2b7fe640 10 monclient(hunting): _negotiate 2026-02-12T04:04:59.616 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.597+0000 7f8a2b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:59.617 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.597+0000 7f8a2b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:59.617 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.597+0000 7f8a2b7fe640 10 monclient(hunting): my global_id is 27557 2026-02-12T04:04:59.617 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.597+0000 7f8a2b7fe640 1 -- 10.20.193.91:0/1592252415 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a4c144130 con 0x7f8a4c160f80 2026-02-12T04:04:59.617 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.599+0000 7f8a2b7fe640 1 -- 10.20.193.91:0/1592252415 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2297697151 0 0) 0x7f8a18003610 con 0x7f8a4c055c30 2026-02-12T04:04:59.617 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.599+0000 7f8a2b7fe640 1 -- 10.20.193.91:0/1592252415 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8a4c1434a0 con 0x7f8a4c055c30 2026-02-12T04:04:59.617 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.599+0000 7f8a2b7fe640 1 -- 10.20.193.91:0/1592252415 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8a400031e0 con 0x7f8a4c055c30 2026-02-12T04:04:59.617 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.599+0000 7f8a2b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:59.617 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.599+0000 7f8a2b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T04:04:59.617 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.599+0000 7f8a2b7fe640 10 monclient(hunting): dump: 2026-02-12T04:04:59.617 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:59.618 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:59.618 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.618 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.618 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:59.618 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:59.618 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:59.618 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:59.618 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:59.618 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:59.618 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.599+0000 7f8a2b7fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:04:59.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.600+0000 7f8a2b7fe640 1 -- 10.20.193.91:0/1592252415 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2422764025 0 0) 0x7f8a4c11a6f0 con 0x7f8a4c163230 2026-02-12T04:04:59.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.600+0000 7f8a2b7fe640 1 -- 10.20.193.91:0/1592252415 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8a18003610 con 0x7f8a4c163230 2026-02-12T04:04:59.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.600+0000 7f8a2b7fe640 1 -- 10.20.193.91:0/1592252415 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8a3c003690 con 0x7f8a4c163230 2026-02-12T04:04:59.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.600+0000 7f8a2b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:59.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.600+0000 7f8a2b7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T04:04:59.619 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.600+0000 7f8a2b7fe640 10 monclient(hunting): dump: 2026-02-12T04:04:59.619 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:59.619 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:59.619 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.619 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.619 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:59.620 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:59.620 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:59.620 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:59.620 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:59.620 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:59.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.600+0000 7f8a2b7fe640 1 -- 10.20.193.91:0/1592252415 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 402555842 0 0) 0x7f8a4c144130 con 0x7f8a4c160f80 2026-02-12T04:04:59.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.600+0000 7f8a2b7fe640 1 -- 10.20.193.91:0/1592252415 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8a4c11a6f0 con 0x7f8a4c160f80 2026-02-12T04:04:59.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.600+0000 7f8a2b7fe640 1 -- 10.20.193.91:0/1592252415 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8a34003080 con 0x7f8a4c160f80 2026-02-12T04:04:59.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.600+0000 7f8a2b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:59.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.600+0000 7f8a2b7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T04:04:59.620 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.600+0000 7f8a2b7fe640 10 monclient(hunting): dump: 2026-02-12T04:04:59.621 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:59.621 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:59.621 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.621 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.621 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:59.621 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:59.621 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:59.621 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:59.621 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:59.621 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:59.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.601+0000 7f8a2b7fe640 1 -- 10.20.193.91:0/1592252415 <== mon.1 v1:10.20.193.98:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 216598321 0 0) 0x7f8a4c1434a0 con 0x7f8a4c055c30 2026-02-12T04:04:59.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.601+0000 7f8a2b7fe640 1 -- 10.20.193.91:0/1592252415 >> v1:10.20.193.111:6789/0 conn(0x7f8a4c160f80 legacy=0x7f8a4c119fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:59.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.601+0000 7f8a2b7fe640 1 -- 10.20.193.91:0/1592252415 >> v1:10.20.193.91:6789/0 conn(0x7f8a4c163230 legacy=0x7f8a4c0b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:59.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.601+0000 7f8a2b7fe640 10 monclient: _finish_hunting 0 2026-02-12T04:04:59.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.601+0000 7f8a2b7fe640 1 monclient: found mon.b 2026-02-12T04:04:59.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.601+0000 7f8a2b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:59.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.601+0000 7f8a2b7fe640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:04:59.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.601+0000 7f8a2b7fe640 1 -- 10.20.193.91:0/1592252415 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a4c143780 con 0x7f8a4c055c30 2026-02-12T04:04:59.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.601+0000 7f8a2b7fe640 10 monclient: _finish_auth 0 2026-02-12T04:04:59.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.601+0000 7f8a2b7fe640 10 monclient: _check_auth_tickets 2026-02-12T04:04:59.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.601+0000 7f8a2b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:59.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.601+0000 7f8a51002640 5 monclient: authenticate success, global_id 27862 2026-02-12T04:04:59.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.601+0000 7f8a51002640 10 monclient: _renew_subs 2026-02-12T04:04:59.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.601+0000 7f8a51002640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:04:59.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.601+0000 7f8a51002640 1 -- 10.20.193.91:0/1592252415 --> v1:10.20.193.98:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8a4c143a60 con 0x7f8a4c055c30 2026-02-12T04:04:59.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.601+0000 7f8a51002640 10 client.27862.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:04:59.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.601+0000 7f8a51002640 10 monclient: _renew_subs 2026-02-12T04:04:59.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.601+0000 7f8a51002640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:04:59.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.601+0000 7f8a51002640 1 -- 10.20.193.91:0/1592252415 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8a4c0add90 con 0x7f8a4c055c30 2026-02-12T04:04:59.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.601+0000 7f8a51002640 1 librados: init done 2026-02-12T04:04:59.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.601+0000 7f8a51002640 10 client.27862.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:59.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.601+0000 7f8a51002640 15 client.27862.objecter _session_command_op_assign -1 1 2026-02-12T04:04:59.623 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.601+0000 7f8a51002640 20 client.27862.objecter _get_session osd=-1 returning homeless 2026-02-12T04:04:59.624 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.601+0000 7f8a51002640 10 client.27862.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:04:59.624 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.601+0000 7f8a51002640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:04:59.624 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.601+0000 7f8a51002640 1 -- 10.20.193.91:0/1592252415 --> v1:10.20.193.98:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f8a4c156690 con 0x7f8a4c055c30 2026-02-12T04:04:59.626 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.610+0000 7f8a2b7fe640 1 -- 10.20.193.91:0/1592252415 <== mon.1 v1:10.20.193.98:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8a4c156690 con 0x7f8a4c055c30 2026-02-12T04:04:59.626 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.610+0000 7f8a2b7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:59.626 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.610+0000 7f8a2b7fe640 1 -- 10.20.193.91:0/1592252415 <== mon.1 v1:10.20.193.98:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8a400038a0 con 0x7f8a4c055c30 2026-02-12T04:04:59.627 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.610+0000 7f8a2b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:59.627 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.610+0000 7f8a49573640 4 set_mon_vals no callback set 2026-02-12T04:04:59.627 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.610+0000 7f8a2b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T04:04:59.627 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.610+0000 7f8a2b7fe640 10 monclient: dump: 2026-02-12T04:04:59.627 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:59.627 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:59.627 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.627 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.627 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:59.627 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:59.627 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:59.627 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:59.628 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:59.628 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:59.628 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.610+0000 7f8a2b7fe640 1 -- 10.20.193.91:0/1592252415 <== mon.1 v1:10.20.193.98:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f8a4001cd80 con 0x7f8a4c055c30 2026-02-12T04:04:59.628 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.611+0000 7f8a4a575640 10 monclient: get_auth_request con 0x7f8a1807a050 auth_method 0 2026-02-12T04:04:59.628 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.611+0000 7f8a2b7fe640 10 client.27862.objecter ms_handle_connect 0x7f8a1807a050 2026-02-12T04:04:59.628 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.612+0000 7f8a2b7fe640 1 -- 10.20.193.91:0/1592252415 <== mon.1 v1:10.20.193.98:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7f8a40094710 con 0x7f8a4c055c30 2026-02-12T04:04:59.628 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.612+0000 7f8a2b7fe640 10 client.27862.objecter ms_dispatch2 0x7f8a4c000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:04:59.628 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.612+0000 7f8a2b7fe640 3 client.27862.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:04:59.628 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.612+0000 7f8a2b7fe640 3 client.27862.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:04:59.628 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.612+0000 7f8a2b7fe640 10 client.27862.objecter checking command 1 2026-02-12T04:04:59.628 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.612+0000 7f8a2b7fe640 20 client.27862.objecter _get_session s=0x7f8a180a4300 osd=2 3 2026-02-12T04:04:59.628 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.612+0000 7f8a2b7fe640 20 client.27862.objecter put_session s=0x7f8a180a4300 osd=2 3 2026-02-12T04:04:59.628 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.612+0000 7f8a2b7fe640 15 client.27862.objecter _session_command_op_remove -1 1 2026-02-12T04:04:59.628 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.612+0000 7f8a2b7fe640 20 client.27862.objecter _get_session s=0x7f8a180a4300 osd=2 3 2026-02-12T04:04:59.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.612+0000 7f8a2b7fe640 20 client.27862.objecter get_session s=0x7f8a180a4300 osd=2 3 2026-02-12T04:04:59.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.612+0000 7f8a2b7fe640 15 client.27862.objecter _session_command_op_assign 2 1 2026-02-12T04:04:59.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.612+0000 7f8a2b7fe640 20 client.27862.objecter put_session s=0x7f8a180a4300 osd=2 4 2026-02-12T04:04:59.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.612+0000 7f8a2b7fe640 10 client.27862.objecter _send_command 1 2026-02-12T04:04:59.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.612+0000 7f8a2b7fe640 1 -- 10.20.193.91:0/1592252415 --> v1:10.20.193.111:6812/350848222 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8a180c6610 con 0x7f8a180a49b0 2026-02-12T04:04:59.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.612+0000 7f8a2b7fe640 20 client.27862.objecter dump_active .. 0 homeless 2026-02-12T04:04:59.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.612+0000 7f8a2b7fe640 1 -- 10.20.193.91:0/1592252415 <== mon.1 v1:10.20.193.98:6789/0 9 ==== mon_get_version_reply(handle=1 version=344) ==== 24+0+0 (unknown 1403447244 0 0) 0x7f8a4005d740 con 0x7f8a4c055c30 2026-02-12T04:04:59.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.612+0000 7f8a2b7fe640 10 monclient: handle_get_version_reply finishing 1 version 344 2026-02-12T04:04:59.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.612+0000 7f8a4b577640 10 monclient: get_auth_request con 0x7f8a180a49b0 auth_method 0 2026-02-12T04:04:59.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.613+0000 7f8a2b7fe640 10 client.27862.objecter ms_handle_connect 0x7f8a180a49b0 2026-02-12T04:04:59.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.623+0000 7f8a2b7fe640 1 -- 10.20.193.91:0/1592252415 <== osd.2 v1:10.20.193.111:6812/350848222 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f8a180c6610 con 0x7f8a180a49b0 2026-02-12T04:04:59.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.623+0000 7f8a2b7fe640 10 client.27862.objecter ms_dispatch2 0x7f8a4c000b90 command_reply(tid 1: 0 ) 2026-02-12T04:04:59.629 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.623+0000 7f8a2b7fe640 10 client.27862.objecter _finish_command 1 = system:0 2026-02-12T04:04:59.630 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.623+0000 7f8a2b7fe640 20 client.27862.objecter put_session s=0x7f8a180a4300 osd=2 4 2026-02-12T04:04:59.630 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.623+0000 7f8a2b7fe640 15 client.27862.objecter _session_command_op_remove 2 1 2026-02-12T04:04:59.634 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.632+0000 7f8a51002640 10 client.27862.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-12T04:04:59.634 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.632+0000 7f8a51002640 15 client.27862.objecter _session_command_op_assign -1 2 2026-02-12T04:04:59.634 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.632+0000 7f8a51002640 20 client.27862.objecter _get_session s=0x7f8a180a4300 osd=2 3 2026-02-12T04:04:59.634 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.632+0000 7f8a51002640 20 client.27862.objecter put_session s=0x7f8a180a4300 osd=2 3 2026-02-12T04:04:59.634 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.632+0000 7f8a51002640 20 client.27862.objecter _get_session s=0x7f8a180a4300 osd=2 3 2026-02-12T04:04:59.634 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.632+0000 7f8a51002640 15 client.27862.objecter _session_command_op_remove -1 2 2026-02-12T04:04:59.634 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.632+0000 7f8a51002640 20 client.27862.objecter get_session s=0x7f8a180a4300 osd=2 3 2026-02-12T04:04:59.634 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.632+0000 7f8a51002640 15 client.27862.objecter _session_command_op_assign 2 2 2026-02-12T04:04:59.634 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.632+0000 7f8a51002640 20 client.27862.objecter put_session s=0x7f8a180a4300 osd=2 4 2026-02-12T04:04:59.635 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.632+0000 7f8a51002640 10 client.27862.objecter _send_command 2 2026-02-12T04:04:59.635 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.632+0000 7f8a51002640 1 -- 10.20.193.91:0/1592252415 --> v1:10.20.193.111:6812/350848222 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8a4c056eb0 con 0x7f8a180a49b0 2026-02-12T04:04:59.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.639+0000 7f8a2b7fe640 1 -- 10.20.193.91:0/1592252415 <== osd.2 v1:10.20.193.111:6812/350848222 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f8a4c056eb0 con 0x7f8a180a49b0 2026-02-12T04:04:59.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.639+0000 7f8a2b7fe640 10 client.27862.objecter ms_dispatch2 0x7f8a4c000b90 command_reply(tid 2: 0 ) 2026-02-12T04:04:59.641 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.639+0000 7f8a2b7fe640 10 client.27862.objecter _finish_command 2 = system:0 2026-02-12T04:04:59.642 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.639+0000 7f8a2b7fe640 20 client.27862.objecter put_session s=0x7f8a180a4300 osd=2 4 2026-02-12T04:04:59.642 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.639+0000 7f8a2b7fe640 15 client.27862.objecter _session_command_op_remove 2 2 2026-02-12T04:04:59.642 INFO:teuthology.orchestra.run.trial091.stdout:{ 2026-02-12T04:04:59.642 INFO:teuthology.orchestra.run.trial091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-12T04:04:59.642 INFO:teuthology.orchestra.run.trial091.stdout:} 2026-02-12T04:04:59.643 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.640+0000 7f8a51002640 10 librados: watch_flush enter 2026-02-12T04:04:59.644 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.640+0000 7f8a51002640 10 librados: watch_flush exit 2026-02-12T04:04:59.644 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.640+0000 7f8a51002640 10 client.27862.objecter close_session for osd.2 2026-02-12T04:04:59.644 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.640+0000 7f8a51002640 1 -- 10.20.193.91:0/1592252415 >> v1:10.20.193.111:6812/350848222 conn(0x7f8a180a49b0 legacy=0x7f8a180c4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:59.644 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.640+0000 7f8a51002640 20 client.27862.objecter put_session s=0x7f8a180a4300 osd=2 1 2026-02-12T04:04:59.644 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.640+0000 7f8a51002640 20 client.27862.objecter shutdown clearing up homeless session... 2026-02-12T04:04:59.644 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.640+0000 7f8a51002640 10 client.27862.objecter successfully canceled tick 2026-02-12T04:04:59.644 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.640+0000 7f8a51002640 1 -- 10.20.193.91:0/1592252415 >> v1:10.20.193.91:6800/2929217192 conn(0x7f8a1807a050 legacy=0x7f8a1809a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:59.644 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.640+0000 7f8a51002640 10 monclient: shutdown 2026-02-12T04:04:59.644 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.640+0000 7f8a51002640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:59.644 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.640+0000 7f8a51002640 1 -- 10.20.193.91:0/1592252415 >> v1:10.20.193.98:6789/0 conn(0x7f8a4c055c30 legacy=0x7f8a4c142cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:59.645 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.640+0000 7f8a4b577640 1 -- 10.20.193.91:0/1592252415 reap_dead start 2026-02-12T04:04:59.645 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.640+0000 7f8a51002640 1 -- 10.20.193.91:0/1592252415 shutdown_connections 2026-02-12T04:04:59.645 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.640+0000 7f8a51002640 1 -- 10.20.193.91:0/1592252415 >> 10.20.193.91:0/1592252415 conn(0x7f8a4c0b6560 msgr2=0x7f8a4c0b6930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:59.645 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.640+0000 7f8a51002640 1 -- 10.20.193.91:0/1592252415 shutdown_connections 2026-02-12T04:04:59.645 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.640+0000 7f8a51002640 1 -- 10.20.193.91:0/1592252415 wait complete. 2026-02-12T04:04:59.645 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.640+0000 7f8a51002640 1 librados: shutdown 2026-02-12T04:04:59.650 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-12T04:04:59.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.716+0000 7faf89d67640 10 monclient: get_monmap_and_config 2026-02-12T04:04:59.719 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.716+0000 7faf89d67640 10 monclient: build_initial_monmap 2026-02-12T04:04:59.719 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.716+0000 7faf89d67640 10 monclient: monmap: 2026-02-12T04:04:59.719 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:59.719 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:59.719 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:04:59.717501+0000 2026-02-12T04:04:59.719 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:04:59.717501+0000 2026-02-12T04:04:59.719 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:59.719 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:59.719 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:59.720 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:59.720 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:59.720 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:59.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.717+0000 7faf89d67640 1 Processor -- start 2026-02-12T04:04:59.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.717+0000 7faf89d67640 1 -- start start 2026-02-12T04:04:59.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.717+0000 7faf89d67640 10 monclient: init 2026-02-12T04:04:59.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.717+0000 7faf89d67640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:59.723 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.717+0000 7faf89d67640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T04:04:59.723 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.717+0000 7faf89d67640 10 monclient(hunting): picked mon.noname-a con 0x7faf841575d0 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:59.723 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.717+0000 7faf89d67640 10 monclient(hunting): picked mon.noname-b con 0x7faf84163310 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:59.723 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.717+0000 7faf89d67640 10 monclient(hunting): picked mon.noname-c con 0x7faf840560d0 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:59.723 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.717+0000 7faf89d67640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf840b20b0 con 0x7faf841575d0 2026-02-12T04:04:59.723 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.717+0000 7faf89d67640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf840b2390 con 0x7faf84163310 2026-02-12T04:04:59.723 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.717+0000 7faf89d67640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf840b2670 con 0x7faf840560d0 2026-02-12T04:04:59.723 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.717+0000 7faf89d67640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:59.723 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.717+0000 7faf89d67640 10 monclient(hunting): authenticate will time out at 1502.460952s 2026-02-12T04:04:59.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.718+0000 7faf837fe640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7faf841575d0 0x7faf84162c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:41684/0 (socket says 10.20.193.91:41684) 2026-02-12T04:04:59.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.718+0000 7faf837fe640 1 -- 10.20.193.91:0/31660598 learned_addr learned my addr 10.20.193.91:0/31660598 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:59.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.719+0000 7faf827fc640 1 -- 10.20.193.91:0/31660598 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3413612828 0 0) 0x7faf840b20b0 con 0x7faf841575d0 2026-02-12T04:04:59.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.719+0000 7faf827fc640 10 monclient(hunting): _negotiate 2026-02-12T04:04:59.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.719+0000 7faf827fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:59.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.719+0000 7faf827fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:59.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.719+0000 7faf827fc640 10 monclient(hunting): my global_id is 30723 2026-02-12T04:04:59.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.719+0000 7faf827fc640 1 -- 10.20.193.91:0/31660598 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf68003610 con 0x7faf841575d0 2026-02-12T04:04:59.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.719+0000 7faf827fc640 1 -- 10.20.193.91:0/31660598 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2899253149 0 0) 0x7faf840b2390 con 0x7faf84163310 2026-02-12T04:04:59.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.719+0000 7faf827fc640 10 monclient(hunting): _negotiate 2026-02-12T04:04:59.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.719+0000 7faf827fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:59.725 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.719+0000 7faf827fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:59.725 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.719+0000 7faf827fc640 10 monclient(hunting): my global_id is 27865 2026-02-12T04:04:59.725 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.719+0000 7faf827fc640 1 -- 10.20.193.91:0/31660598 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf840b20b0 con 0x7faf84163310 2026-02-12T04:04:59.725 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.719+0000 7faf827fc640 1 -- 10.20.193.91:0/31660598 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3617254258 0 0) 0x7faf840b2670 con 0x7faf840560d0 2026-02-12T04:04:59.725 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.719+0000 7faf827fc640 10 monclient(hunting): _negotiate 2026-02-12T04:04:59.725 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.719+0000 7faf827fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:59.725 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.719+0000 7faf827fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:59.725 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.719+0000 7faf827fc640 10 monclient(hunting): my global_id is 27560 2026-02-12T04:04:59.725 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.719+0000 7faf827fc640 1 -- 10.20.193.91:0/31660598 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf840b2390 con 0x7faf840560d0 2026-02-12T04:04:59.733 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.721+0000 7faf827fc640 1 -- 10.20.193.91:0/31660598 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 130871825 0 0) 0x7faf840b2390 con 0x7faf840560d0 2026-02-12T04:04:59.733 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.721+0000 7faf827fc640 1 -- 10.20.193.91:0/31660598 >> v1:10.20.193.98:6789/0 conn(0x7faf84163310 legacy=0x7faf840559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:59.733 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.721+0000 7faf827fc640 1 -- 10.20.193.91:0/31660598 >> v1:10.20.193.91:6789/0 conn(0x7faf841575d0 legacy=0x7faf84162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:59.733 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.721+0000 7faf827fc640 10 monclient: _finish_hunting 0 2026-02-12T04:04:59.733 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.721+0000 7faf827fc640 1 monclient: found mon.noname-c 2026-02-12T04:04:59.733 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.721+0000 7faf827fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:59.733 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.721+0000 7faf827fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.111:6789/0 2026-02-12T04:04:59.733 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.721+0000 7faf827fc640 1 -- 10.20.193.91:0/31660598 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf84162400 con 0x7faf840560d0 2026-02-12T04:04:59.733 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.721+0000 7faf827fc640 10 monclient: _finish_auth 0 2026-02-12T04:04:59.733 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.721+0000 7faf827fc640 10 monclient: _check_auth_tickets 2026-02-12T04:04:59.734 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.721+0000 7faf827fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:59.734 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.721+0000 7faf827fc640 1 -- 10.20.193.91:0/31660598 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7faf78003150 con 0x7faf840560d0 2026-02-12T04:04:59.734 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.721+0000 7faf827fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:59.734 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.721+0000 7faf827fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T04:04:59.734 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.721+0000 7faf827fc640 10 monclient: dump: 2026-02-12T04:04:59.734 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:59.734 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:59.734 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.734 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.734 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:59.734 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:59.734 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:59.735 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:59.735 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:59.735 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:59.735 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.721+0000 7faf89d67640 5 monclient: authenticate success, global_id 27560 2026-02-12T04:04:59.735 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.721+0000 7faf89d67640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:04:59.735 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.722+0000 7faf827fc640 1 -- 10.20.193.91:0/31660598 <== mon.2 v1:10.20.193.111:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faf78003320 con 0x7faf840560d0 2026-02-12T04:04:59.735 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.722+0000 7faf827fc640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:59.735 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.722+0000 7faf827fc640 1 -- 10.20.193.91:0/31660598 <== mon.2 v1:10.20.193.111:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7faf78003760 con 0x7faf840560d0 2026-02-12T04:04:59.735 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.722+0000 7faf827fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:59.736 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.722+0000 7faf827fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T04:04:59.736 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.722+0000 7faf827fc640 10 monclient: dump: 2026-02-12T04:04:59.736 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:59.736 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:59.736 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.736 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.736 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:59.736 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:59.736 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:59.736 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:59.737 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:59.737 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:59.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.722+0000 7faf89d67640 10 monclient: get_monmap_and_config success 2026-02-12T04:04:59.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.722+0000 7faf89d67640 4 set_mon_vals no callback set 2026-02-12T04:04:59.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.722+0000 7faf89d67640 10 monclient: shutdown 2026-02-12T04:04:59.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.722+0000 7faf89d67640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:59.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.722+0000 7faf89d67640 1 -- 10.20.193.91:0/31660598 >> v1:10.20.193.111:6789/0 conn(0x7faf840560d0 legacy=0x7faf841c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:59.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.722+0000 7faf89d67640 1 -- 10.20.193.91:0/31660598 shutdown_connections 2026-02-12T04:04:59.737 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.722+0000 7faf89d67640 1 -- 10.20.193.91:0/31660598 >> 10.20.193.91:0/31660598 conn(0x7faf840b6560 msgr2=0x7faf840b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:59.738 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.722+0000 7faf89d67640 1 -- 10.20.193.91:0/31660598 shutdown_connections 2026-02-12T04:04:59.738 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.722+0000 7faf89d67640 1 -- 10.20.193.91:0/31660598 wait complete. 2026-02-12T04:04:59.738 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.723+0000 7faf89d67640 10 monclient: build_initial_monmap 2026-02-12T04:04:59.738 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.723+0000 7faf89d67640 10 monclient: monmap: 2026-02-12T04:04:59.738 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:04:59.738 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:04:59.738 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:04:59.738 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:04:59.738 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:04:59.738 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:04:59.738 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:04:59.738 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:04:59.739 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:04:59.739 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:59.739 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.723+0000 7faf89d67640 1 librados: starting msgr at 2026-02-12T04:04:59.739 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.723+0000 7faf89d67640 1 librados: starting objecter 2026-02-12T04:04:59.739 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.723+0000 7faf89d67640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:04:59.739 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.723+0000 7faf89d67640 1 Processor -- start 2026-02-12T04:04:59.739 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.723+0000 7faf89d67640 1 -- start start 2026-02-12T04:04:59.739 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.723+0000 7faf89d67640 1 librados: setting wanted keys 2026-02-12T04:04:59.739 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.723+0000 7faf89d67640 1 librados: calling monclient init 2026-02-12T04:04:59.739 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.723+0000 7faf89d67640 10 monclient: init 2026-02-12T04:04:59.739 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.723+0000 7faf89d67640 10 monclient: _reopen_session rank -1 2026-02-12T04:04:59.739 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.723+0000 7faf89d67640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T04:04:59.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.723+0000 7faf89d67640 10 monclient(hunting): picked mon.noname-b con 0x7faf840560d0 addr v1:10.20.193.98:6789/0 2026-02-12T04:04:59.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.723+0000 7faf89d67640 10 monclient(hunting): picked mon.noname-a con 0x7faf841575d0 addr v1:10.20.193.91:6789/0 2026-02-12T04:04:59.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.723+0000 7faf89d67640 10 monclient(hunting): picked mon.noname-c con 0x7faf84163310 addr v1:10.20.193.111:6789/0 2026-02-12T04:04:59.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.723+0000 7faf89d67640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf8411d510 con 0x7faf841575d0 2026-02-12T04:04:59.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.723+0000 7faf89d67640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf840af350 con 0x7faf840560d0 2026-02-12T04:04:59.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.723+0000 7faf89d67640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf840af630 con 0x7faf84163310 2026-02-12T04:04:59.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.723+0000 7faf89d67640 10 monclient(hunting): _renew_subs 2026-02-12T04:04:59.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.723+0000 7faf89d67640 10 monclient(hunting): authenticate will time out at 1502.466901s 2026-02-12T04:04:59.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.724+0000 7faf82ffd640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7faf841575d0 0x7faf8405bb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:41698/0 (socket says 10.20.193.91:41698) 2026-02-12T04:04:59.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.724+0000 7faf82ffd640 1 -- 10.20.193.91:0/570678269 learned_addr learned my addr 10.20.193.91:0/570678269 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:04:59.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.724+0000 7faf5ffff640 10 client.?.objecter ms_handle_connect 0x7faf841575d0 2026-02-12T04:04:59.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.724+0000 7faf5ffff640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:59.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.724+0000 7faf5ffff640 10 client.?.objecter ms_handle_connect 0x7faf840560d0 2026-02-12T04:04:59.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.724+0000 7faf5ffff640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:59.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.724+0000 7faf5ffff640 10 client.?.objecter ms_handle_connect 0x7faf84163310 2026-02-12T04:04:59.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.724+0000 7faf5ffff640 10 client.?.objecter resend_mon_ops 2026-02-12T04:04:59.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.725+0000 7faf5ffff640 1 -- 10.20.193.91:0/570678269 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2628941161 0 0) 0x7faf8411d510 con 0x7faf841575d0 2026-02-12T04:04:59.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.725+0000 7faf5ffff640 10 monclient(hunting): _negotiate 2026-02-12T04:04:59.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.725+0000 7faf5ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:59.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.725+0000 7faf5ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:59.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.725+0000 7faf5ffff640 10 monclient(hunting): my global_id is 30726 2026-02-12T04:04:59.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.725+0000 7faf5ffff640 1 -- 10.20.193.91:0/570678269 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf54003610 con 0x7faf841575d0 2026-02-12T04:04:59.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.725+0000 7faf5ffff640 1 -- 10.20.193.91:0/570678269 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1874004744 0 0) 0x7faf840af350 con 0x7faf840560d0 2026-02-12T04:04:59.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.725+0000 7faf5ffff640 10 monclient(hunting): _negotiate 2026-02-12T04:04:59.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.725+0000 7faf5ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:59.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.725+0000 7faf5ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:59.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.725+0000 7faf5ffff640 10 monclient(hunting): my global_id is 27868 2026-02-12T04:04:59.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.725+0000 7faf5ffff640 1 -- 10.20.193.91:0/570678269 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf8411d510 con 0x7faf840560d0 2026-02-12T04:04:59.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.725+0000 7faf5ffff640 1 -- 10.20.193.91:0/570678269 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1969691980 0 0) 0x7faf840af630 con 0x7faf84163310 2026-02-12T04:04:59.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.725+0000 7faf5ffff640 10 monclient(hunting): _negotiate 2026-02-12T04:04:59.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.725+0000 7faf5ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:04:59.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.725+0000 7faf5ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:04:59.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.725+0000 7faf5ffff640 10 monclient(hunting): my global_id is 27563 2026-02-12T04:04:59.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.725+0000 7faf5ffff640 1 -- 10.20.193.91:0/570678269 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf840af350 con 0x7faf84163310 2026-02-12T04:04:59.742 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.727+0000 7faf5ffff640 1 -- 10.20.193.91:0/570678269 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3532347117 0 0) 0x7faf54003610 con 0x7faf841575d0 2026-02-12T04:04:59.743 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.727+0000 7faf5ffff640 1 -- 10.20.193.91:0/570678269 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faf840af630 con 0x7faf841575d0 2026-02-12T04:04:59.743 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.727+0000 7faf5ffff640 1 -- 10.20.193.91:0/570678269 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7faf740030b0 con 0x7faf841575d0 2026-02-12T04:04:59.743 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.727+0000 7faf5ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:59.743 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.727+0000 7faf5ffff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T04:04:59.743 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.727+0000 7faf5ffff640 10 monclient(hunting): dump: 2026-02-12T04:04:59.743 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:59.743 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:59.743 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.743 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.743 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:59.743 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:59.743 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:59.743 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:59.744 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:59.744 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:59.744 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.727+0000 7faf5ffff640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:04:59.744 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.728+0000 7faf5ffff640 1 -- 10.20.193.91:0/570678269 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 940450409 0 0) 0x7faf8411d510 con 0x7faf840560d0 2026-02-12T04:04:59.744 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.728+0000 7faf5ffff640 1 -- 10.20.193.91:0/570678269 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faf54003610 con 0x7faf840560d0 2026-02-12T04:04:59.744 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.728+0000 7faf5ffff640 1 -- 10.20.193.91:0/570678269 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7faf700030b0 con 0x7faf840560d0 2026-02-12T04:04:59.744 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.728+0000 7faf5ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:59.744 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.728+0000 7faf5ffff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T04:04:59.744 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.728+0000 7faf5ffff640 10 monclient(hunting): dump: 2026-02-12T04:04:59.744 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:59.744 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:59.745 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.745 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.745 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:59.745 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:59.745 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:59.745 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:59.745 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:59.745 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:59.745 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.728+0000 7faf5ffff640 1 -- 10.20.193.91:0/570678269 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3994336605 0 0) 0x7faf840af350 con 0x7faf84163310 2026-02-12T04:04:59.745 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.728+0000 7faf5ffff640 1 -- 10.20.193.91:0/570678269 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faf8411d510 con 0x7faf84163310 2026-02-12T04:04:59.745 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.728+0000 7faf5ffff640 1 -- 10.20.193.91:0/570678269 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7faf78003670 con 0x7faf84163310 2026-02-12T04:04:59.745 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.728+0000 7faf5ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:04:59.745 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.728+0000 7faf5ffff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T04:04:59.746 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.728+0000 7faf5ffff640 10 monclient(hunting): dump: 2026-02-12T04:04:59.746 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:59.746 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:59.746 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.746 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.746 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:59.746 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:59.746 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:59.746 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:59.746 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:59.746 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:59.746 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.729+0000 7faf5ffff640 1 -- 10.20.193.91:0/570678269 <== mon.1 v1:10.20.193.98:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3712447305 0 0) 0x7faf54003610 con 0x7faf840560d0 2026-02-12T04:04:59.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.729+0000 7faf5ffff640 1 -- 10.20.193.91:0/570678269 >> v1:10.20.193.111:6789/0 conn(0x7faf84163310 legacy=0x7faf84146510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:59.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.729+0000 7faf5ffff640 1 -- 10.20.193.91:0/570678269 >> v1:10.20.193.91:6789/0 conn(0x7faf841575d0 legacy=0x7faf8405bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:59.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.729+0000 7faf5ffff640 10 monclient: _finish_hunting 0 2026-02-12T04:04:59.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.729+0000 7faf5ffff640 1 monclient: found mon.b 2026-02-12T04:04:59.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.729+0000 7faf5ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:04:59.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.729+0000 7faf5ffff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:04:59.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.729+0000 7faf5ffff640 1 -- 10.20.193.91:0/570678269 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf840af910 con 0x7faf840560d0 2026-02-12T04:04:59.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.729+0000 7faf5ffff640 10 monclient: _finish_auth 0 2026-02-12T04:04:59.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.729+0000 7faf5ffff640 10 monclient: _check_auth_tickets 2026-02-12T04:04:59.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.729+0000 7faf5ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:04:59.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.729+0000 7faf89d67640 5 monclient: authenticate success, global_id 27868 2026-02-12T04:04:59.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.729+0000 7faf89d67640 10 monclient: _renew_subs 2026-02-12T04:04:59.747 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.729+0000 7faf89d67640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:04:59.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.729+0000 7faf89d67640 1 -- 10.20.193.91:0/570678269 --> v1:10.20.193.98:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7faf840afbf0 con 0x7faf840560d0 2026-02-12T04:04:59.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.729+0000 7faf89d67640 10 client.27868.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:04:59.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.729+0000 7faf89d67640 10 monclient: _renew_subs 2026-02-12T04:04:59.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.729+0000 7faf89d67640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:04:59.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.729+0000 7faf89d67640 1 -- 10.20.193.91:0/570678269 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7faf840b06d0 con 0x7faf840560d0 2026-02-12T04:04:59.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.729+0000 7faf89d67640 1 librados: init done 2026-02-12T04:04:59.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.730+0000 7faf89d67640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:59.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.730+0000 7faf89d67640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:59.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.730+0000 7faf89d67640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:04:59.748 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.730+0000 7faf89d67640 1 -- 10.20.193.91:0/570678269 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf8415e790 con 0x7faf840560d0 2026-02-12T04:04:59.750 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.737+0000 7faf5ffff640 1 -- 10.20.193.91:0/570678269 <== mon.1 v1:10.20.193.98:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faf700048d0 con 0x7faf840560d0 2026-02-12T04:04:59.750 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.737+0000 7faf5ffff640 10 monclient: handle_config config(0 keys) 2026-02-12T04:04:59.750 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.737+0000 7faf5ffff640 1 -- 10.20.193.91:0/570678269 <== mon.1 v1:10.20.193.98:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7faf70004a80 con 0x7faf840560d0 2026-02-12T04:04:59.750 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.737+0000 7faf5ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:04:59.750 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.737+0000 7faf5ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T04:04:59.750 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.737+0000 7faf5ffff640 10 monclient: dump: 2026-02-12T04:04:59.750 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:04:59.750 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:04:59.750 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.750 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:04:59.750 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:04:59.751 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:04:59.751 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:04:59.751 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:04:59.751 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:04:59.751 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:04:59.751 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.737+0000 7faf81ffb640 4 set_mon_vals no callback set 2026-02-12T04:04:59.751 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.738+0000 7faf5ffff640 1 -- 10.20.193.91:0/570678269 <== mon.1 v1:10.20.193.98:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7faf7001df60 con 0x7faf840560d0 2026-02-12T04:04:59.751 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.738+0000 7faf82ffd640 10 monclient: get_auth_request con 0x7faf5407a080 auth_method 0 2026-02-12T04:04:59.751 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.738+0000 7faf5ffff640 10 client.27868.objecter ms_handle_connect 0x7faf5407a080 2026-02-12T04:04:59.751 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.739+0000 7faf5ffff640 1 -- 10.20.193.91:0/570678269 <== mon.1 v1:10.20.193.98:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7faf70095980 con 0x7faf840560d0 2026-02-12T04:04:59.751 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.739+0000 7faf5ffff640 10 client.27868.objecter ms_dispatch2 0x7faf84000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:04:59.751 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.739+0000 7faf5ffff640 3 client.27868.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:04:59.751 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.739+0000 7faf5ffff640 3 client.27868.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:04:59.752 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.739+0000 7faf5ffff640 20 client.27868.objecter dump_active .. 0 homeless 2026-02-12T04:04:59.829 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.827+0000 7faf5ffff640 1 -- 10.20.193.91:0/570678269 <== mon.1 v1:10.20.193.98:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7faf7005f2e0 con 0x7faf840560d0 2026-02-12T04:04:59.829 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.827+0000 7faf5ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:04:59.829 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.827+0000 7faf5ffff640 10 monclient: _finish_command 1 = system:0 2026-02-12T04:04:59.939 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.937+0000 7faf89d67640 1 -- 10.20.193.91:0/570678269 --> v1:10.20.193.91:6800/2929217192 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7faf840b7290 con 0x7faf5407a080 2026-02-12T04:04:59.939 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.937+0000 7faf5ffff640 1 -- 10.20.193.91:0/570678269 <== mgr.4113 v1:10.20.193.91:6800/2929217192 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (unknown 3049115190 0 0) 0x7faf840b7290 con 0x7faf5407a080 2026-02-12T04:04:59.939 INFO:teuthology.orchestra.run.trial091.stderr:instructed osd(s) 2 to deep-scrub 2026-02-12T04:04:59.941 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.939+0000 7faf89d67640 10 librados: watch_flush enter 2026-02-12T04:04:59.941 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.939+0000 7faf89d67640 10 librados: watch_flush exit 2026-02-12T04:04:59.941 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.939+0000 7faf89d67640 20 client.27868.objecter shutdown clearing up homeless session... 2026-02-12T04:04:59.941 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.939+0000 7faf89d67640 10 client.27868.objecter successfully canceled tick 2026-02-12T04:04:59.941 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.939+0000 7faf89d67640 1 -- 10.20.193.91:0/570678269 >> v1:10.20.193.91:6800/2929217192 conn(0x7faf5407a080 legacy=0x7faf5409a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:59.942 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.939+0000 7faf89d67640 10 monclient: shutdown 2026-02-12T04:04:59.942 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.939+0000 7faf89d67640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:04:59.942 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.939+0000 7faf89d67640 1 -- 10.20.193.91:0/570678269 >> v1:10.20.193.98:6789/0 conn(0x7faf840560d0 legacy=0x7faf8411ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:04:59.942 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.939+0000 7faf89d67640 1 -- 10.20.193.91:0/570678269 shutdown_connections 2026-02-12T04:04:59.942 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.939+0000 7faf89d67640 1 -- 10.20.193.91:0/570678269 >> 10.20.193.91:0/570678269 conn(0x7faf840b6560 msgr2=0x7faf84154df0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:04:59.942 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.939+0000 7faf89d67640 1 -- 10.20.193.91:0/570678269 shutdown_connections 2026-02-12T04:04:59.942 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.939+0000 7faf89d67640 1 -- 10.20.193.91:0/570678269 wait complete. 2026-02-12T04:04:59.942 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:04:59.939+0000 7faf89d67640 1 librados: shutdown 2026-02-12T04:04:59.949 INFO:tasks.ceph:Scrubbing osd.6 2026-02-12T04:04:59.949 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2026-02-12T04:05:00.020 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.019+0000 7f65ec957640 10 monclient: get_monmap_and_config 2026-02-12T04:05:00.021 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.019+0000 7f65ec957640 10 monclient: build_initial_monmap 2026-02-12T04:05:00.021 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.019+0000 7f65ec957640 10 monclient: monmap: 2026-02-12T04:05:00.021 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:05:00.021 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:00.021 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:05:00.019633+0000 2026-02-12T04:05:00.021 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:05:00.019633+0000 2026-02-12T04:05:00.021 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:05:00.021 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:00.021 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:05:00.021 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:05:00.021 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:05:00.022 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.019+0000 7f65ec957640 1 Processor -- start 2026-02-12T04:05:00.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.019+0000 7f65ec957640 1 -- start start 2026-02-12T04:05:00.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.019+0000 7f65ec957640 10 monclient: init 2026-02-12T04:05:00.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.020+0000 7f65ec957640 10 monclient: _reopen_session rank -1 2026-02-12T04:05:00.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.020+0000 7f65ec957640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T04:05:00.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.020+0000 7f65ec957640 10 monclient(hunting): picked mon.noname-c con 0x7f65e4166a30 addr v1:10.20.193.111:6789/0 2026-02-12T04:05:00.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.020+0000 7f65ec957640 10 monclient(hunting): picked mon.noname-b con 0x7f65e40b5420 addr v1:10.20.193.98:6789/0 2026-02-12T04:05:00.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.020+0000 7f65ec957640 10 monclient(hunting): picked mon.noname-a con 0x7f65e40b6c60 addr v1:10.20.193.91:6789/0 2026-02-12T04:05:00.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.020+0000 7f65ec957640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65e40b58e0 con 0x7f65e40b6c60 2026-02-12T04:05:00.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.020+0000 7f65ec957640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65e40b5bc0 con 0x7f65e40b5420 2026-02-12T04:05:00.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.020+0000 7f65ec957640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65e40b5ea0 con 0x7f65e4166a30 2026-02-12T04:05:00.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.020+0000 7f65ec957640 10 monclient(hunting): _renew_subs 2026-02-12T04:05:00.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.020+0000 7f65ec957640 10 monclient(hunting): authenticate will time out at 1502.763243s 2026-02-12T04:05:00.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.020+0000 7f65e9ecb640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f65e40b5420 0x7f65e415ce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:38212/0 (socket says 10.20.193.91:38212) 2026-02-12T04:05:00.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.020+0000 7f65e9ecb640 1 -- 10.20.193.91:0/1383665201 learned_addr learned my addr 10.20.193.91:0/1383665201 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:05:00.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.021+0000 7f65e96ca640 1 -- 10.20.193.91:0/1383665201 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3127741871 0 0) 0x7f65e40b5bc0 con 0x7f65e40b5420 2026-02-12T04:05:00.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.021+0000 7f65e96ca640 10 monclient(hunting): _negotiate 2026-02-12T04:05:00.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.021+0000 7f65e96ca640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:00.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.021+0000 7f65e96ca640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:00.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.021+0000 7f65e96ca640 10 monclient(hunting): my global_id is 27871 2026-02-12T04:05:00.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.021+0000 7f65e96ca640 1 -- 10.20.193.91:0/1383665201 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65d4003610 con 0x7f65e40b5420 2026-02-12T04:05:00.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.022+0000 7f65e96ca640 1 -- 10.20.193.91:0/1383665201 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2976732757 0 0) 0x7f65e40b5ea0 con 0x7f65e4166a30 2026-02-12T04:05:00.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.022+0000 7f65e96ca640 10 monclient(hunting): _negotiate 2026-02-12T04:05:00.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.022+0000 7f65e96ca640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:00.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.022+0000 7f65e96ca640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:00.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.022+0000 7f65e96ca640 10 monclient(hunting): my global_id is 27566 2026-02-12T04:05:00.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.022+0000 7f65e96ca640 1 -- 10.20.193.91:0/1383665201 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65e40b5bc0 con 0x7f65e4166a30 2026-02-12T04:05:00.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.023+0000 7f65e96ca640 1 -- 10.20.193.91:0/1383665201 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3585718375 0 0) 0x7f65e40b58e0 con 0x7f65e40b6c60 2026-02-12T04:05:00.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.023+0000 7f65e96ca640 10 monclient(hunting): _negotiate 2026-02-12T04:05:00.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.023+0000 7f65e96ca640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:00.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.023+0000 7f65e96ca640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:00.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.023+0000 7f65e96ca640 10 monclient(hunting): my global_id is 30729 2026-02-12T04:05:00.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.023+0000 7f65e96ca640 1 -- 10.20.193.91:0/1383665201 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65e40b5ea0 con 0x7f65e40b6c60 2026-02-12T04:05:00.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.024+0000 7f65e96ca640 1 -- 10.20.193.91:0/1383665201 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1015516416 0 0) 0x7f65e40b5bc0 con 0x7f65e4166a30 2026-02-12T04:05:00.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.024+0000 7f65e96ca640 1 -- 10.20.193.91:0/1383665201 >> v1:10.20.193.98:6789/0 conn(0x7f65e40b5420 legacy=0x7f65e415ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:00.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.024+0000 7f65e96ca640 1 -- 10.20.193.91:0/1383665201 >> v1:10.20.193.91:6789/0 conn(0x7f65e40b6c60 legacy=0x7f65e41c7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:00.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.024+0000 7f65e96ca640 10 monclient: _finish_hunting 0 2026-02-12T04:05:00.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.024+0000 7f65e96ca640 1 monclient: found mon.noname-c 2026-02-12T04:05:00.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.024+0000 7f65e96ca640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:05:00.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.024+0000 7f65e96ca640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.111:6789/0 2026-02-12T04:05:00.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.024+0000 7f65e96ca640 1 -- 10.20.193.91:0/1383665201 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65e40b6180 con 0x7f65e4166a30 2026-02-12T04:05:00.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.024+0000 7f65e96ca640 10 monclient: _finish_auth 0 2026-02-12T04:05:00.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.024+0000 7f65e96ca640 10 monclient: _check_auth_tickets 2026-02-12T04:05:00.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.024+0000 7f65e96ca640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:05:00.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.024+0000 7f65ec957640 5 monclient: authenticate success, global_id 27566 2026-02-12T04:05:00.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.024+0000 7f65ec957640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:05:00.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.024+0000 7f65e96ca640 1 -- 10.20.193.91:0/1383665201 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f65dc002df0 con 0x7f65e4166a30 2026-02-12T04:05:00.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.024+0000 7f65e96ca640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:00.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.024+0000 7f65e96ca640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T04:05:00.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.024+0000 7f65e96ca640 10 monclient: dump: 2026-02-12T04:05:00.034 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:00.034 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:00.034 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.034 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.034 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:00.034 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:00.034 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:00.034 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:00.034 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:00.034 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.034 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.024+0000 7f65ec957640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:05:00.034 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.025+0000 7f65e96ca640 1 -- 10.20.193.91:0/1383665201 <== mon.2 v1:10.20.193.111:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f65dc003040 con 0x7f65e4166a30 2026-02-12T04:05:00.035 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.025+0000 7f65e96ca640 10 monclient: handle_config config(0 keys) 2026-02-12T04:05:00.035 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.025+0000 7f65e96ca640 1 -- 10.20.193.91:0/1383665201 <== mon.2 v1:10.20.193.111:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f65dc003440 con 0x7f65e4166a30 2026-02-12T04:05:00.035 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.025+0000 7f65e96ca640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:00.035 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.025+0000 7f65e96ca640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T04:05:00.035 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.025+0000 7f65e96ca640 10 monclient: dump: 2026-02-12T04:05:00.035 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:00.035 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:00.035 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.035 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.035 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:00.035 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:00.035 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:00.036 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:00.036 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:00.036 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.036 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.025+0000 7f65ec957640 10 monclient: get_monmap_and_config success 2026-02-12T04:05:00.036 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.025+0000 7f65ec957640 4 set_mon_vals no callback set 2026-02-12T04:05:00.036 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.025+0000 7f65ec957640 10 monclient: shutdown 2026-02-12T04:05:00.036 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.025+0000 7f65ec957640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:05:00.036 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.025+0000 7f65ec957640 1 -- 10.20.193.91:0/1383665201 >> v1:10.20.193.111:6789/0 conn(0x7f65e4166a30 legacy=0x7f65e41646c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:00.036 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.025+0000 7f65ec957640 1 -- 10.20.193.91:0/1383665201 shutdown_connections 2026-02-12T04:05:00.036 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.025+0000 7f65ec957640 1 -- 10.20.193.91:0/1383665201 >> 10.20.193.91:0/1383665201 conn(0x7f65e40baaa0 msgr2=0x7f65e40baea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:05:00.036 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.025+0000 7f65ec957640 1 -- 10.20.193.91:0/1383665201 shutdown_connections 2026-02-12T04:05:00.036 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.025+0000 7f65ec957640 1 -- 10.20.193.91:0/1383665201 wait complete. 2026-02-12T04:05:00.036 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.026+0000 7f65ec957640 10 monclient: build_initial_monmap 2026-02-12T04:05:00.037 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.026+0000 7f65ec957640 10 monclient: monmap: 2026-02-12T04:05:00.037 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:05:00.037 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:05:00.037 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:05:00.037 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:05:00.037 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:05:00.037 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:05:00.037 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:05:00.037 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:05:00.037 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:05:00.037 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.037 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.026+0000 7f65ec957640 1 librados: starting msgr at 2026-02-12T04:05:00.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.026+0000 7f65ec957640 1 librados: starting objecter 2026-02-12T04:05:00.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.026+0000 7f65ec957640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:05:00.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.026+0000 7f65ec957640 1 Processor -- start 2026-02-12T04:05:00.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.026+0000 7f65ec957640 1 -- start start 2026-02-12T04:05:00.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.026+0000 7f65ec957640 1 librados: setting wanted keys 2026-02-12T04:05:00.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.026+0000 7f65ec957640 1 librados: calling monclient init 2026-02-12T04:05:00.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.026+0000 7f65ec957640 10 monclient: init 2026-02-12T04:05:00.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.026+0000 7f65ec957640 10 monclient: _reopen_session rank -1 2026-02-12T04:05:00.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.026+0000 7f65ec957640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T04:05:00.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.026+0000 7f65ec957640 10 monclient(hunting): picked mon.noname-a con 0x7f65e40b5420 addr v1:10.20.193.91:6789/0 2026-02-12T04:05:00.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.026+0000 7f65ec957640 10 monclient(hunting): picked mon.noname-c con 0x7f65e40b6c60 addr v1:10.20.193.111:6789/0 2026-02-12T04:05:00.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.026+0000 7f65ec957640 10 monclient(hunting): picked mon.noname-b con 0x7f65e4166a30 addr v1:10.20.193.98:6789/0 2026-02-12T04:05:00.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.026+0000 7f65ec957640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65e40b9540 con 0x7f65e40b5420 2026-02-12T04:05:00.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.026+0000 7f65ec957640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65e40b9820 con 0x7f65e4166a30 2026-02-12T04:05:00.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.027+0000 7f65ec957640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65e40b9b00 con 0x7f65e40b6c60 2026-02-12T04:05:00.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.027+0000 7f65ec957640 10 monclient(hunting): _renew_subs 2026-02-12T04:05:00.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.027+0000 7f65ec957640 10 monclient(hunting): authenticate will time out at 1502.770022s 2026-02-12T04:05:00.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.027+0000 7f65ea6cc640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f65e40b5420 0x7f65e411d4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:39814/0 (socket says 10.20.193.91:39814) 2026-02-12T04:05:00.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.027+0000 7f65ea6cc640 1 -- 10.20.193.91:0/930259652 learned_addr learned my addr 10.20.193.91:0/930259652 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:05:00.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.027+0000 7f65ceffd640 10 client.?.objecter ms_handle_connect 0x7f65e40b5420 2026-02-12T04:05:00.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.027+0000 7f65ceffd640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:00.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.027+0000 7f65ceffd640 10 client.?.objecter ms_handle_connect 0x7f65e40b6c60 2026-02-12T04:05:00.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.027+0000 7f65ceffd640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:00.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.027+0000 7f65ceffd640 10 client.?.objecter ms_handle_connect 0x7f65e4166a30 2026-02-12T04:05:00.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.027+0000 7f65ceffd640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:00.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.028+0000 7f65ceffd640 1 -- 10.20.193.91:0/930259652 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4028011098 0 0) 0x7f65e40b9540 con 0x7f65e40b5420 2026-02-12T04:05:00.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.028+0000 7f65ceffd640 10 monclient(hunting): _negotiate 2026-02-12T04:05:00.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.028+0000 7f65ceffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:00.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.028+0000 7f65ceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:00.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.028+0000 7f65ceffd640 10 monclient(hunting): my global_id is 30732 2026-02-12T04:05:00.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.028+0000 7f65ceffd640 1 -- 10.20.193.91:0/930259652 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65b4003610 con 0x7f65e40b5420 2026-02-12T04:05:00.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.028+0000 7f65ceffd640 1 -- 10.20.193.91:0/930259652 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1066025742 0 0) 0x7f65e40b9b00 con 0x7f65e40b6c60 2026-02-12T04:05:00.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.028+0000 7f65ceffd640 10 monclient(hunting): _negotiate 2026-02-12T04:05:00.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.028+0000 7f65ceffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:00.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.028+0000 7f65ceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:00.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.028+0000 7f65ceffd640 10 monclient(hunting): my global_id is 27569 2026-02-12T04:05:00.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.028+0000 7f65ceffd640 1 -- 10.20.193.91:0/930259652 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65e40b9540 con 0x7f65e40b6c60 2026-02-12T04:05:00.040 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.029+0000 7f65ceffd640 1 -- 10.20.193.91:0/930259652 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1978872510 0 0) 0x7f65e40b9820 con 0x7f65e4166a30 2026-02-12T04:05:00.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.029+0000 7f65ceffd640 10 monclient(hunting): _negotiate 2026-02-12T04:05:00.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.029+0000 7f65ceffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:00.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.029+0000 7f65ceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:00.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.029+0000 7f65ceffd640 10 monclient(hunting): my global_id is 27874 2026-02-12T04:05:00.041 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.029+0000 7f65ceffd640 1 -- 10.20.193.91:0/930259652 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65e40b9b00 con 0x7f65e4166a30 2026-02-12T04:05:00.044 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.031+0000 7f65ceffd640 1 -- 10.20.193.91:0/930259652 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2874427157 0 0) 0x7f65b4003610 con 0x7f65e40b5420 2026-02-12T04:05:00.044 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.031+0000 7f65ceffd640 1 -- 10.20.193.91:0/930259652 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f65e40b9820 con 0x7f65e40b5420 2026-02-12T04:05:00.044 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.031+0000 7f65ceffd640 1 -- 10.20.193.91:0/930259652 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f65dc0033d0 con 0x7f65e40b5420 2026-02-12T04:05:00.044 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.031+0000 7f65ceffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:00.044 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.031+0000 7f65ceffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T04:05:00.044 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.031+0000 7f65ceffd640 10 monclient(hunting): dump: 2026-02-12T04:05:00.045 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:00.045 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:00.045 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.045 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.045 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:00.045 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:00.045 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:00.045 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:00.045 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:00.045 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.045 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.031+0000 7f65ceffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:05:00.046 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.031+0000 7f65ceffd640 1 -- 10.20.193.91:0/930259652 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2640533485 0 0) 0x7f65e40b9b00 con 0x7f65e4166a30 2026-02-12T04:05:00.046 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.031+0000 7f65ceffd640 1 -- 10.20.193.91:0/930259652 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f65b4003610 con 0x7f65e4166a30 2026-02-12T04:05:00.046 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.031+0000 7f65ceffd640 1 -- 10.20.193.91:0/930259652 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f65d8003410 con 0x7f65e4166a30 2026-02-12T04:05:00.046 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.031+0000 7f65ceffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:00.046 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.031+0000 7f65ceffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T04:05:00.046 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.031+0000 7f65ceffd640 10 monclient(hunting): dump: 2026-02-12T04:05:00.046 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:00.046 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:00.046 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.046 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.046 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:00.046 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:00.047 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:00.047 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:00.047 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:00.047 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.047 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.031+0000 7f65ceffd640 1 -- 10.20.193.91:0/930259652 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2793453628 0 0) 0x7f65e40b9540 con 0x7f65e40b6c60 2026-02-12T04:05:00.047 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.031+0000 7f65ceffd640 1 -- 10.20.193.91:0/930259652 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f65e40b9b00 con 0x7f65e40b6c60 2026-02-12T04:05:00.047 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.031+0000 7f65ceffd640 1 -- 10.20.193.91:0/930259652 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f65d0003080 con 0x7f65e40b6c60 2026-02-12T04:05:00.047 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.031+0000 7f65ceffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:00.047 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.031+0000 7f65ceffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T04:05:00.047 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.031+0000 7f65ceffd640 10 monclient(hunting): dump: 2026-02-12T04:05:00.047 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:00.047 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:00.048 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.048 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.048 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:00.048 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:00.048 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:00.048 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:00.048 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:00.048 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.048 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.033+0000 7f65ceffd640 1 -- 10.20.193.91:0/930259652 <== mon.1 v1:10.20.193.98:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2455729537 0 0) 0x7f65b4003610 con 0x7f65e4166a30 2026-02-12T04:05:00.048 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.033+0000 7f65ceffd640 1 -- 10.20.193.91:0/930259652 >> v1:10.20.193.111:6789/0 conn(0x7f65e40b6c60 legacy=0x7f65e40b88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:00.048 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.033+0000 7f65ceffd640 1 -- 10.20.193.91:0/930259652 >> v1:10.20.193.91:6789/0 conn(0x7f65e40b5420 legacy=0x7f65e411d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:00.048 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.033+0000 7f65ceffd640 10 monclient: _finish_hunting 0 2026-02-12T04:05:00.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.033+0000 7f65ceffd640 1 monclient: found mon.b 2026-02-12T04:05:00.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.033+0000 7f65ceffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:05:00.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.033+0000 7f65ceffd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:05:00.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.033+0000 7f65ceffd640 1 -- 10.20.193.91:0/930259652 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65e40b9de0 con 0x7f65e4166a30 2026-02-12T04:05:00.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.033+0000 7f65ceffd640 10 monclient: _finish_auth 0 2026-02-12T04:05:00.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.033+0000 7f65ceffd640 10 monclient: _check_auth_tickets 2026-02-12T04:05:00.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.033+0000 7f65ceffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:05:00.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.033+0000 7f65ec957640 5 monclient: authenticate success, global_id 27874 2026-02-12T04:05:00.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.033+0000 7f65ec957640 10 monclient: _renew_subs 2026-02-12T04:05:00.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.033+0000 7f65ec957640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:05:00.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.033+0000 7f65ec957640 1 -- 10.20.193.91:0/930259652 --> v1:10.20.193.98:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f65e40ba0c0 con 0x7f65e4166a30 2026-02-12T04:05:00.049 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.033+0000 7f65ec957640 10 client.27874.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:05:00.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.033+0000 7f65ec957640 10 monclient: _renew_subs 2026-02-12T04:05:00.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.033+0000 7f65ec957640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:05:00.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.033+0000 7f65ec957640 1 -- 10.20.193.91:0/930259652 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f65e411dbe0 con 0x7f65e4166a30 2026-02-12T04:05:00.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.033+0000 7f65ec957640 1 librados: init done 2026-02-12T04:05:00.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.033+0000 7f65ec957640 10 client.27874.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:05:00.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.033+0000 7f65ec957640 15 client.27874.objecter _session_command_op_assign -1 1 2026-02-12T04:05:00.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.033+0000 7f65ec957640 20 client.27874.objecter _get_session osd=-1 returning homeless 2026-02-12T04:05:00.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.033+0000 7f65ec957640 10 client.27874.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:05:00.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.033+0000 7f65ec957640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:05:00.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.033+0000 7f65ec957640 1 -- 10.20.193.91:0/930259652 --> v1:10.20.193.98:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f65e4061730 con 0x7f65e4166a30 2026-02-12T04:05:00.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.038+0000 7f65ceffd640 1 -- 10.20.193.91:0/930259652 <== mon.1 v1:10.20.193.98:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f65e4061730 con 0x7f65e4166a30 2026-02-12T04:05:00.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.038+0000 7f65ceffd640 10 monclient: handle_config config(0 keys) 2026-02-12T04:05:00.050 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.038+0000 7f65e8ec9640 4 set_mon_vals no callback set 2026-02-12T04:05:00.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.041+0000 7f65ceffd640 1 -- 10.20.193.91:0/930259652 <== mon.1 v1:10.20.193.98:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f65d8003c20 con 0x7f65e4166a30 2026-02-12T04:05:00.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.041+0000 7f65ceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:00.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.041+0000 7f65ceffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T04:05:00.051 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.041+0000 7f65ceffd640 10 monclient: dump: 2026-02-12T04:05:00.051 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:00.051 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:00.051 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.051 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.051 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:00.051 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:00.051 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:00.051 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:00.051 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:00.052 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.052 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.042+0000 7f65ceffd640 1 -- 10.20.193.91:0/930259652 <== mon.1 v1:10.20.193.98:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f65d801d100 con 0x7f65e4166a30 2026-02-12T04:05:00.053 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.043+0000 7f65ea6cc640 10 monclient: get_auth_request con 0x7f65b407a0c0 auth_method 0 2026-02-12T04:05:00.053 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.043+0000 7f65ceffd640 10 client.27874.objecter ms_handle_connect 0x7f65b407a0c0 2026-02-12T04:05:00.053 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.043+0000 7f65ceffd640 1 -- 10.20.193.91:0/930259652 <== mon.1 v1:10.20.193.98:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7f65d8059c00 con 0x7f65e4166a30 2026-02-12T04:05:00.053 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.043+0000 7f65ceffd640 10 client.27874.objecter ms_dispatch2 0x7f65e4000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:05:00.053 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.043+0000 7f65ceffd640 3 client.27874.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:05:00.054 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.043+0000 7f65ceffd640 3 client.27874.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:05:00.054 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.044+0000 7f65ceffd640 10 client.27874.objecter checking command 1 2026-02-12T04:05:00.054 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.044+0000 7f65ceffd640 20 client.27874.objecter _get_session s=0x7f65b40a4370 osd=6 3 2026-02-12T04:05:00.054 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.044+0000 7f65ceffd640 20 client.27874.objecter put_session s=0x7f65b40a4370 osd=6 3 2026-02-12T04:05:00.054 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.044+0000 7f65ceffd640 15 client.27874.objecter _session_command_op_remove -1 1 2026-02-12T04:05:00.054 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.044+0000 7f65ceffd640 20 client.27874.objecter _get_session s=0x7f65b40a4370 osd=6 3 2026-02-12T04:05:00.054 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.044+0000 7f65ceffd640 20 client.27874.objecter get_session s=0x7f65b40a4370 osd=6 3 2026-02-12T04:05:00.054 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.044+0000 7f65ceffd640 15 client.27874.objecter _session_command_op_assign 6 1 2026-02-12T04:05:00.054 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.044+0000 7f65ceffd640 20 client.27874.objecter put_session s=0x7f65b40a4370 osd=6 4 2026-02-12T04:05:00.054 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.044+0000 7f65ceffd640 10 client.27874.objecter _send_command 1 2026-02-12T04:05:00.054 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.044+0000 7f65ceffd640 1 -- 10.20.193.91:0/930259652 --> v1:10.20.193.111:6804/727190484 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f65b40c6720 con 0x7f65b40a4a20 2026-02-12T04:05:00.054 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.044+0000 7f65ceffd640 20 client.27874.objecter dump_active .. 0 homeless 2026-02-12T04:05:00.054 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.044+0000 7f65e9ecb640 10 monclient: get_auth_request con 0x7f65b40a4a20 auth_method 0 2026-02-12T04:05:00.055 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.044+0000 7f65ceffd640 1 -- 10.20.193.91:0/930259652 <== mon.1 v1:10.20.193.98:6789/0 9 ==== mon_get_version_reply(handle=1 version=344) ==== 24+0+0 (unknown 1403447244 0 0) 0x7f65d8059fe0 con 0x7f65e4166a30 2026-02-12T04:05:00.055 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.044+0000 7f65ceffd640 10 monclient: handle_get_version_reply finishing 1 version 344 2026-02-12T04:05:00.055 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.045+0000 7f65ceffd640 10 client.27874.objecter ms_handle_connect 0x7f65b40a4a20 2026-02-12T04:05:00.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.055+0000 7f65ceffd640 1 -- 10.20.193.91:0/930259652 <== osd.6 v1:10.20.193.111:6804/727190484 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f65b40c6720 con 0x7f65b40a4a20 2026-02-12T04:05:00.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.055+0000 7f65ceffd640 10 client.27874.objecter ms_dispatch2 0x7f65e4000b90 command_reply(tid 1: 0 ) 2026-02-12T04:05:00.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.055+0000 7f65ceffd640 10 client.27874.objecter _finish_command 1 = system:0 2026-02-12T04:05:00.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.055+0000 7f65ceffd640 20 client.27874.objecter put_session s=0x7f65b40a4370 osd=6 4 2026-02-12T04:05:00.057 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.055+0000 7f65ceffd640 15 client.27874.objecter _session_command_op_remove 6 1 2026-02-12T04:05:00.064 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.062+0000 7f65ec957640 10 client.27874.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-12T04:05:00.065 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.062+0000 7f65ec957640 15 client.27874.objecter _session_command_op_assign -1 2 2026-02-12T04:05:00.065 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.062+0000 7f65ec957640 20 client.27874.objecter _get_session s=0x7f65b40a4370 osd=6 3 2026-02-12T04:05:00.065 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.062+0000 7f65ec957640 20 client.27874.objecter put_session s=0x7f65b40a4370 osd=6 3 2026-02-12T04:05:00.065 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.062+0000 7f65ec957640 20 client.27874.objecter _get_session s=0x7f65b40a4370 osd=6 3 2026-02-12T04:05:00.065 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.062+0000 7f65ec957640 15 client.27874.objecter _session_command_op_remove -1 2 2026-02-12T04:05:00.065 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.062+0000 7f65ec957640 20 client.27874.objecter get_session s=0x7f65b40a4370 osd=6 3 2026-02-12T04:05:00.065 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.062+0000 7f65ec957640 15 client.27874.objecter _session_command_op_assign 6 2 2026-02-12T04:05:00.065 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.062+0000 7f65ec957640 20 client.27874.objecter put_session s=0x7f65b40a4370 osd=6 4 2026-02-12T04:05:00.065 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.062+0000 7f65ec957640 10 client.27874.objecter _send_command 2 2026-02-12T04:05:00.065 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.062+0000 7f65ec957640 1 -- 10.20.193.91:0/930259652 --> v1:10.20.193.111:6804/727190484 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f65e415ce50 con 0x7f65b40a4a20 2026-02-12T04:05:00.072 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.070+0000 7f65ceffd640 1 -- 10.20.193.91:0/930259652 <== osd.6 v1:10.20.193.111:6804/727190484 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f65e415ce50 con 0x7f65b40a4a20 2026-02-12T04:05:00.072 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.070+0000 7f65ceffd640 10 client.27874.objecter ms_dispatch2 0x7f65e4000b90 command_reply(tid 2: 0 ) 2026-02-12T04:05:00.072 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.070+0000 7f65ceffd640 10 client.27874.objecter _finish_command 2 = system:0 2026-02-12T04:05:00.072 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.070+0000 7f65ceffd640 20 client.27874.objecter put_session s=0x7f65b40a4370 osd=6 4 2026-02-12T04:05:00.072 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.070+0000 7f65ceffd640 15 client.27874.objecter _session_command_op_remove 6 2 2026-02-12T04:05:00.072 INFO:teuthology.orchestra.run.trial091.stdout:{ 2026-02-12T04:05:00.072 INFO:teuthology.orchestra.run.trial091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-12T04:05:00.073 INFO:teuthology.orchestra.run.trial091.stdout:} 2026-02-12T04:05:00.074 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.070+0000 7f65ec957640 10 librados: watch_flush enter 2026-02-12T04:05:00.074 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.070+0000 7f65ec957640 10 librados: watch_flush exit 2026-02-12T04:05:00.074 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.070+0000 7f65ec957640 10 client.27874.objecter close_session for osd.6 2026-02-12T04:05:00.074 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.070+0000 7f65ec957640 1 -- 10.20.193.91:0/930259652 >> v1:10.20.193.111:6804/727190484 conn(0x7f65b40a4a20 legacy=0x7f65b40c4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:00.074 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.070+0000 7f65ec957640 20 client.27874.objecter put_session s=0x7f65b40a4370 osd=6 1 2026-02-12T04:05:00.074 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.070+0000 7f65ec957640 20 client.27874.objecter shutdown clearing up homeless session... 2026-02-12T04:05:00.074 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.070+0000 7f65ec957640 10 client.27874.objecter successfully canceled tick 2026-02-12T04:05:00.074 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.070+0000 7f65ec957640 1 -- 10.20.193.91:0/930259652 >> v1:10.20.193.91:6800/2929217192 conn(0x7f65b407a0c0 legacy=0x7f65b409a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:00.075 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.070+0000 7f65ec957640 10 monclient: shutdown 2026-02-12T04:05:00.075 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.070+0000 7f65ec957640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:05:00.075 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.070+0000 7f65ec957640 1 -- 10.20.193.91:0/930259652 >> v1:10.20.193.98:6789/0 conn(0x7f65e4166a30 legacy=0x7f65e4143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:00.075 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.070+0000 7f65eaecd640 1 -- 10.20.193.91:0/930259652 reap_dead start 2026-02-12T04:05:00.075 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.070+0000 7f65ec957640 1 -- 10.20.193.91:0/930259652 shutdown_connections 2026-02-12T04:05:00.075 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.070+0000 7f65ec957640 1 -- 10.20.193.91:0/930259652 >> 10.20.193.91:0/930259652 conn(0x7f65e40baaa0 msgr2=0x7f65e415b430 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:05:00.075 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.070+0000 7f65ec957640 1 -- 10.20.193.91:0/930259652 shutdown_connections 2026-02-12T04:05:00.075 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.070+0000 7f65ec957640 1 -- 10.20.193.91:0/930259652 wait complete. 2026-02-12T04:05:00.075 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.070+0000 7f65ec957640 1 librados: shutdown 2026-02-12T04:05:00.080 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2026-02-12T04:05:00.151 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.149+0000 7f2cd14d0640 10 monclient: get_monmap_and_config 2026-02-12T04:05:00.152 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.149+0000 7f2cd14d0640 10 monclient: build_initial_monmap 2026-02-12T04:05:00.152 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.150+0000 7f2cd14d0640 10 monclient: monmap: 2026-02-12T04:05:00.152 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:05:00.152 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:00.152 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:05:00.150582+0000 2026-02-12T04:05:00.152 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:05:00.150582+0000 2026-02-12T04:05:00.152 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:05:00.152 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:00.152 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:05:00.152 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:05:00.153 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:05:00.153 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.155 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.150+0000 7f2cd14d0640 1 Processor -- start 2026-02-12T04:05:00.155 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.150+0000 7f2cd14d0640 1 -- start start 2026-02-12T04:05:00.155 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.150+0000 7f2cd14d0640 10 monclient: init 2026-02-12T04:05:00.155 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.151+0000 7f2cd14d0640 10 monclient: _reopen_session rank -1 2026-02-12T04:05:00.155 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.151+0000 7f2cd14d0640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T04:05:00.155 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.151+0000 7f2cd14d0640 10 monclient(hunting): picked mon.noname-a con 0x7f2ccc1599b0 addr v1:10.20.193.91:6789/0 2026-02-12T04:05:00.156 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.151+0000 7f2cd14d0640 10 monclient(hunting): picked mon.noname-b con 0x7f2ccc05d180 addr v1:10.20.193.98:6789/0 2026-02-12T04:05:00.156 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.151+0000 7f2cd14d0640 10 monclient(hunting): picked mon.noname-c con 0x7f2ccc166580 addr v1:10.20.193.111:6789/0 2026-02-12T04:05:00.156 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.151+0000 7f2cd14d0640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ccc05c0e0 con 0x7f2ccc1599b0 2026-02-12T04:05:00.156 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.151+0000 7f2cd14d0640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ccc05c3c0 con 0x7f2ccc05d180 2026-02-12T04:05:00.156 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.151+0000 7f2cd14d0640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ccc05c6a0 con 0x7f2ccc166580 2026-02-12T04:05:00.156 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.151+0000 7f2cd14d0640 10 monclient(hunting): _renew_subs 2026-02-12T04:05:00.156 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.151+0000 7f2cd14d0640 10 monclient(hunting): authenticate will time out at 1502.894085s 2026-02-12T04:05:00.156 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.151+0000 7f2ccaffd640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f2ccc1599b0 0x7f2ccc05b730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:39828/0 (socket says 10.20.193.91:39828) 2026-02-12T04:05:00.156 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.151+0000 7f2ccaffd640 1 -- 10.20.193.91:0/1248056494 learned_addr learned my addr 10.20.193.91:0/1248056494 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:05:00.156 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.152+0000 7f2cc9ffb640 1 -- 10.20.193.91:0/1248056494 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4124723929 0 0) 0x7f2ccc05c3c0 con 0x7f2ccc05d180 2026-02-12T04:05:00.156 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.152+0000 7f2cc9ffb640 10 monclient(hunting): _negotiate 2026-02-12T04:05:00.156 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.152+0000 7f2cc9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:00.157 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.152+0000 7f2cc9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:00.157 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.152+0000 7f2cc9ffb640 10 monclient(hunting): my global_id is 27877 2026-02-12T04:05:00.157 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.152+0000 7f2cc9ffb640 1 -- 10.20.193.91:0/1248056494 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cb8003610 con 0x7f2ccc05d180 2026-02-12T04:05:00.157 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.152+0000 7f2cc9ffb640 1 -- 10.20.193.91:0/1248056494 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4020074502 0 0) 0x7f2ccc05c6a0 con 0x7f2ccc166580 2026-02-12T04:05:00.157 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.152+0000 7f2cc9ffb640 10 monclient(hunting): _negotiate 2026-02-12T04:05:00.157 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.152+0000 7f2cc9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:00.157 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.152+0000 7f2cc9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:00.157 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.152+0000 7f2cc9ffb640 10 monclient(hunting): my global_id is 27572 2026-02-12T04:05:00.157 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.152+0000 7f2cc9ffb640 1 -- 10.20.193.91:0/1248056494 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ccc05c3c0 con 0x7f2ccc166580 2026-02-12T04:05:00.157 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.152+0000 7f2cc9ffb640 1 -- 10.20.193.91:0/1248056494 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2714466786 0 0) 0x7f2ccc05c0e0 con 0x7f2ccc1599b0 2026-02-12T04:05:00.157 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.152+0000 7f2cc9ffb640 10 monclient(hunting): _negotiate 2026-02-12T04:05:00.157 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.152+0000 7f2cc9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:00.158 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.152+0000 7f2cc9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:00.158 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.152+0000 7f2cc9ffb640 10 monclient(hunting): my global_id is 30735 2026-02-12T04:05:00.158 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.152+0000 7f2cc9ffb640 1 -- 10.20.193.91:0/1248056494 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ccc05c6a0 con 0x7f2ccc1599b0 2026-02-12T04:05:00.163 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.154+0000 7f2cc9ffb640 1 -- 10.20.193.91:0/1248056494 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2600029473 0 0) 0x7f2cb8003610 con 0x7f2ccc05d180 2026-02-12T04:05:00.164 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.154+0000 7f2cc9ffb640 1 -- 10.20.193.91:0/1248056494 >> v1:10.20.193.111:6789/0 conn(0x7f2ccc166580 legacy=0x7f2ccc1669a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:00.164 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.154+0000 7f2cc9ffb640 1 -- 10.20.193.91:0/1248056494 >> v1:10.20.193.91:6789/0 conn(0x7f2ccc1599b0 legacy=0x7f2ccc05b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:00.164 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.154+0000 7f2cc9ffb640 10 monclient: _finish_hunting 0 2026-02-12T04:05:00.164 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.154+0000 7f2cc9ffb640 1 monclient: found mon.noname-b 2026-02-12T04:05:00.164 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.154+0000 7f2cc9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:05:00.164 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.154+0000 7f2cc9ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T04:05:00.164 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.154+0000 7f2cc9ffb640 1 -- 10.20.193.91:0/1248056494 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ccc05c980 con 0x7f2ccc05d180 2026-02-12T04:05:00.164 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.154+0000 7f2cc9ffb640 10 monclient: _finish_auth 0 2026-02-12T04:05:00.164 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.154+0000 7f2cc9ffb640 10 monclient: _check_auth_tickets 2026-02-12T04:05:00.164 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.154+0000 7f2cc9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:05:00.165 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.154+0000 7f2cd14d0640 5 monclient: authenticate success, global_id 27877 2026-02-12T04:05:00.165 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.154+0000 7f2cd14d0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:05:00.165 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.154+0000 7f2cc9ffb640 1 -- 10.20.193.91:0/1248056494 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f2cb4002df0 con 0x7f2ccc05d180 2026-02-12T04:05:00.165 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.154+0000 7f2cc9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:00.165 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.154+0000 7f2cc9ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T04:05:00.165 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.154+0000 7f2cc9ffb640 10 monclient: dump: 2026-02-12T04:05:00.165 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:00.165 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:00.165 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.165 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.165 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:00.165 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:00.166 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:00.166 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:00.166 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:00.166 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.166 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.154+0000 7f2cd14d0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:05:00.166 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.155+0000 7f2cc9ffb640 1 -- 10.20.193.91:0/1248056494 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2cb4003040 con 0x7f2ccc05d180 2026-02-12T04:05:00.166 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.155+0000 7f2cc9ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T04:05:00.166 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.155+0000 7f2cc9ffb640 1 -- 10.20.193.91:0/1248056494 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f2cb4003440 con 0x7f2ccc05d180 2026-02-12T04:05:00.166 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.155+0000 7f2cc9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:00.166 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.155+0000 7f2cc9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T04:05:00.166 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.155+0000 7f2cc9ffb640 10 monclient: dump: 2026-02-12T04:05:00.166 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:00.167 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:00.167 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.167 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.167 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:00.167 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:00.167 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:00.167 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:00.167 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:00.167 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.167 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.155+0000 7f2cd14d0640 10 monclient: get_monmap_and_config success 2026-02-12T04:05:00.167 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.155+0000 7f2cd14d0640 4 set_mon_vals no callback set 2026-02-12T04:05:00.167 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.155+0000 7f2cd14d0640 10 monclient: shutdown 2026-02-12T04:05:00.168 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.155+0000 7f2cd14d0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:05:00.168 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.155+0000 7f2cd14d0640 1 -- 10.20.193.91:0/1248056494 >> v1:10.20.193.98:6789/0 conn(0x7f2ccc05d180 legacy=0x7f2ccc05d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:00.168 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.155+0000 7f2cd14d0640 1 -- 10.20.193.91:0/1248056494 shutdown_connections 2026-02-12T04:05:00.168 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.155+0000 7f2cd14d0640 1 -- 10.20.193.91:0/1248056494 >> 10.20.193.91:0/1248056494 conn(0x7f2ccc0b6560 msgr2=0x7f2ccc0b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:05:00.168 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.155+0000 7f2cd14d0640 1 -- 10.20.193.91:0/1248056494 shutdown_connections 2026-02-12T04:05:00.168 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.156+0000 7f2cd14d0640 1 -- 10.20.193.91:0/1248056494 wait complete. 2026-02-12T04:05:00.168 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.156+0000 7f2cd14d0640 10 monclient: build_initial_monmap 2026-02-12T04:05:00.168 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.156+0000 7f2cd14d0640 10 monclient: monmap: 2026-02-12T04:05:00.168 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:05:00.168 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:05:00.168 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:05:00.168 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:05:00.168 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:05:00.169 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:05:00.169 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:05:00.169 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:05:00.169 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:05:00.169 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.169 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.156+0000 7f2cd14d0640 1 librados: starting msgr at 2026-02-12T04:05:00.169 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.156+0000 7f2cd14d0640 1 librados: starting objecter 2026-02-12T04:05:00.169 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.156+0000 7f2cd14d0640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:05:00.169 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.156+0000 7f2cd14d0640 1 Processor -- start 2026-02-12T04:05:00.169 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.156+0000 7f2cd14d0640 1 -- start start 2026-02-12T04:05:00.169 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.156+0000 7f2cd14d0640 1 librados: setting wanted keys 2026-02-12T04:05:00.169 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.156+0000 7f2cd14d0640 1 librados: calling monclient init 2026-02-12T04:05:00.170 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.156+0000 7f2cd14d0640 10 monclient: init 2026-02-12T04:05:00.170 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.157+0000 7f2cd14d0640 10 monclient: _reopen_session rank -1 2026-02-12T04:05:00.170 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.157+0000 7f2cd14d0640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T04:05:00.170 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.157+0000 7f2cd14d0640 10 monclient(hunting): picked mon.noname-c con 0x7f2ccc05d180 addr v1:10.20.193.111:6789/0 2026-02-12T04:05:00.170 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.157+0000 7f2cd14d0640 10 monclient(hunting): picked mon.noname-a con 0x7f2ccc1599b0 addr v1:10.20.193.91:6789/0 2026-02-12T04:05:00.170 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.157+0000 7f2cd14d0640 10 monclient(hunting): picked mon.noname-b con 0x7f2ccc166580 addr v1:10.20.193.98:6789/0 2026-02-12T04:05:00.170 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.157+0000 7f2cd14d0640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ccc136a10 con 0x7f2ccc1599b0 2026-02-12T04:05:00.170 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.157+0000 7f2cd14d0640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ccc11c320 con 0x7f2ccc166580 2026-02-12T04:05:00.170 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.157+0000 7f2cd14d0640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ccc135c50 con 0x7f2ccc05d180 2026-02-12T04:05:00.170 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.157+0000 7f2cd14d0640 10 monclient(hunting): _renew_subs 2026-02-12T04:05:00.170 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.157+0000 7f2cd14d0640 10 monclient(hunting): authenticate will time out at 1502.900192s 2026-02-12T04:05:00.170 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.157+0000 7f2cca7fc640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f2ccc1599b0 0x7f2ccc1324c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:39844/0 (socket says 10.20.193.91:39844) 2026-02-12T04:05:00.170 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.157+0000 7f2cca7fc640 1 -- 10.20.193.91:0/809951538 learned_addr learned my addr 10.20.193.91:0/809951538 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:05:00.171 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.157+0000 7f2cab7fe640 10 client.?.objecter ms_handle_connect 0x7f2ccc1599b0 2026-02-12T04:05:00.171 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.157+0000 7f2cab7fe640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:00.171 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.157+0000 7f2cab7fe640 10 client.?.objecter ms_handle_connect 0x7f2ccc05d180 2026-02-12T04:05:00.171 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.157+0000 7f2cab7fe640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:00.171 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.158+0000 7f2cab7fe640 10 client.?.objecter ms_handle_connect 0x7f2ccc166580 2026-02-12T04:05:00.171 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.158+0000 7f2cab7fe640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:00.171 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.158+0000 7f2cab7fe640 1 -- 10.20.193.91:0/809951538 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2266724252 0 0) 0x7f2ccc136a10 con 0x7f2ccc1599b0 2026-02-12T04:05:00.171 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.158+0000 7f2cab7fe640 10 monclient(hunting): _negotiate 2026-02-12T04:05:00.171 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.158+0000 7f2cab7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:00.171 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.158+0000 7f2cab7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:00.171 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.158+0000 7f2cab7fe640 10 monclient(hunting): my global_id is 30738 2026-02-12T04:05:00.171 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.158+0000 7f2cab7fe640 1 -- 10.20.193.91:0/809951538 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c98003610 con 0x7f2ccc1599b0 2026-02-12T04:05:00.172 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.158+0000 7f2cab7fe640 1 -- 10.20.193.91:0/809951538 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1297855835 0 0) 0x7f2ccc135c50 con 0x7f2ccc05d180 2026-02-12T04:05:00.172 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.158+0000 7f2cab7fe640 10 monclient(hunting): _negotiate 2026-02-12T04:05:00.172 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.158+0000 7f2cab7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:00.172 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.158+0000 7f2cab7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:00.172 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.158+0000 7f2cab7fe640 10 monclient(hunting): my global_id is 27575 2026-02-12T04:05:00.172 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.158+0000 7f2cab7fe640 1 -- 10.20.193.91:0/809951538 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ccc136a10 con 0x7f2ccc05d180 2026-02-12T04:05:00.172 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.159+0000 7f2cab7fe640 1 -- 10.20.193.91:0/809951538 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2399183365 0 0) 0x7f2ccc11c320 con 0x7f2ccc166580 2026-02-12T04:05:00.172 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.159+0000 7f2cab7fe640 10 monclient(hunting): _negotiate 2026-02-12T04:05:00.172 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.159+0000 7f2cab7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:00.172 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.159+0000 7f2cab7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:00.172 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.159+0000 7f2cab7fe640 10 monclient(hunting): my global_id is 27880 2026-02-12T04:05:00.172 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.159+0000 7f2cab7fe640 1 -- 10.20.193.91:0/809951538 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ccc135c50 con 0x7f2ccc166580 2026-02-12T04:05:00.172 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.161+0000 7f2cab7fe640 1 -- 10.20.193.91:0/809951538 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4292549691 0 0) 0x7f2c98003610 con 0x7f2ccc1599b0 2026-02-12T04:05:00.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.161+0000 7f2cab7fe640 1 -- 10.20.193.91:0/809951538 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2ccc11c320 con 0x7f2ccc1599b0 2026-02-12T04:05:00.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.161+0000 7f2cab7fe640 1 -- 10.20.193.91:0/809951538 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f2cb40033d0 con 0x7f2ccc1599b0 2026-02-12T04:05:00.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.161+0000 7f2cab7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:00.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.161+0000 7f2cab7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T04:05:00.173 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.161+0000 7f2cab7fe640 10 monclient(hunting): dump: 2026-02-12T04:05:00.173 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:00.173 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:00.173 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.173 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.173 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:00.173 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:00.173 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:00.173 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:00.174 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:00.174 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.161+0000 7f2cab7fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:05:00.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.161+0000 7f2cab7fe640 1 -- 10.20.193.91:0/809951538 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1608913159 0 0) 0x7f2ccc136a10 con 0x7f2ccc05d180 2026-02-12T04:05:00.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.161+0000 7f2cab7fe640 1 -- 10.20.193.91:0/809951538 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2c98003610 con 0x7f2ccc05d180 2026-02-12T04:05:00.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.161+0000 7f2cab7fe640 1 -- 10.20.193.91:0/809951538 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f2cc0002f50 con 0x7f2ccc05d180 2026-02-12T04:05:00.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.161+0000 7f2cab7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:00.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.161+0000 7f2cab7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T04:05:00.174 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.161+0000 7f2cab7fe640 10 monclient(hunting): dump: 2026-02-12T04:05:00.174 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:00.174 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:00.174 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.175 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.175 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:00.175 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:00.175 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:00.175 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:00.175 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:00.175 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.161+0000 7f2cab7fe640 1 -- 10.20.193.91:0/809951538 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 838138240 0 0) 0x7f2ccc135c50 con 0x7f2ccc166580 2026-02-12T04:05:00.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.161+0000 7f2cab7fe640 1 -- 10.20.193.91:0/809951538 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2ccc136a10 con 0x7f2ccc166580 2026-02-12T04:05:00.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.161+0000 7f2cab7fe640 1 -- 10.20.193.91:0/809951538 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f2cbc003370 con 0x7f2ccc166580 2026-02-12T04:05:00.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.161+0000 7f2cab7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:00.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.161+0000 7f2cab7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T04:05:00.175 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.161+0000 7f2cab7fe640 10 monclient(hunting): dump: 2026-02-12T04:05:00.176 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:00.176 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:00.176 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.176 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.176 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:00.176 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:00.176 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:00.176 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:00.176 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:00.176 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.163+0000 7f2cab7fe640 1 -- 10.20.193.91:0/809951538 <== mon.2 v1:10.20.193.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1918338343 0 0) 0x7f2c98003610 con 0x7f2ccc05d180 2026-02-12T04:05:00.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.163+0000 7f2cab7fe640 1 -- 10.20.193.91:0/809951538 >> v1:10.20.193.98:6789/0 conn(0x7f2ccc166580 legacy=0x7f2ccc134a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:00.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.163+0000 7f2cab7fe640 1 -- 10.20.193.91:0/809951538 >> v1:10.20.193.91:6789/0 conn(0x7f2ccc1599b0 legacy=0x7f2ccc1324c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:00.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.163+0000 7f2cab7fe640 10 monclient: _finish_hunting 0 2026-02-12T04:05:00.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.163+0000 7f2cab7fe640 1 monclient: found mon.c 2026-02-12T04:05:00.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.163+0000 7f2cab7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:05:00.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.163+0000 7f2cab7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:05:00.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.163+0000 7f2cab7fe640 1 -- 10.20.193.91:0/809951538 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ccc135f30 con 0x7f2ccc05d180 2026-02-12T04:05:00.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.163+0000 7f2cab7fe640 10 monclient: _finish_auth 0 2026-02-12T04:05:00.178 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.163+0000 7f2cab7fe640 10 monclient: _check_auth_tickets 2026-02-12T04:05:00.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.163+0000 7f2cab7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:05:00.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.163+0000 7f2cd14d0640 5 monclient: authenticate success, global_id 27575 2026-02-12T04:05:00.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.163+0000 7f2cd14d0640 10 monclient: _renew_subs 2026-02-12T04:05:00.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.163+0000 7f2cd14d0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:05:00.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.163+0000 7f2cd14d0640 1 -- 10.20.193.91:0/809951538 --> v1:10.20.193.111:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2ccc136210 con 0x7f2ccc05d180 2026-02-12T04:05:00.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.163+0000 7f2cd14d0640 10 client.27575.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:05:00.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.163+0000 7f2cd14d0640 10 monclient: _renew_subs 2026-02-12T04:05:00.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.163+0000 7f2cd14d0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:05:00.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.163+0000 7f2cd14d0640 1 -- 10.20.193.91:0/809951538 --> v1:10.20.193.111:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2ccc132bd0 con 0x7f2ccc05d180 2026-02-12T04:05:00.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.163+0000 7f2cd14d0640 1 librados: init done 2026-02-12T04:05:00.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.163+0000 7f2cd14d0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T04:05:00.179 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.163+0000 7f2cd14d0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:05:00.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.163+0000 7f2cd14d0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:05:00.180 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.163+0000 7f2cd14d0640 1 -- 10.20.193.91:0/809951538 --> v1:10.20.193.111:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ccc1387e0 con 0x7f2ccc05d180 2026-02-12T04:05:00.264 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.262+0000 7f2cab7fe640 1 -- 10.20.193.91:0/809951538 <== mon.2 v1:10.20.193.111:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2cc0003440 con 0x7f2ccc05d180 2026-02-12T04:05:00.264 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.262+0000 7f2cab7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T04:05:00.264 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.262+0000 7f2cab7fe640 1 -- 10.20.193.91:0/809951538 <== mon.2 v1:10.20.193.111:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f2cc0004a70 con 0x7f2ccc05d180 2026-02-12T04:05:00.264 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.262+0000 7f2cab7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:00.264 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.262+0000 7f2cab7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T04:05:00.265 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.262+0000 7f2cab7fe640 10 monclient: dump: 2026-02-12T04:05:00.265 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:00.265 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:00.265 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.265 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.265 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:00.265 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:00.265 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:00.265 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:00.265 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:00.265 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.265 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.262+0000 7f2cc97fa640 4 set_mon_vals no callback set 2026-02-12T04:05:00.266 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.263+0000 7f2cab7fe640 1 -- 10.20.193.91:0/809951538 <== mon.2 v1:10.20.193.111:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f2cc001df50 con 0x7f2ccc05d180 2026-02-12T04:05:00.266 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.264+0000 7f2cca7fc640 10 monclient: get_auth_request con 0x7f2c9807a160 auth_method 0 2026-02-12T04:05:00.267 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.264+0000 7f2cab7fe640 10 client.27575.objecter ms_handle_connect 0x7f2c9807a160 2026-02-12T04:05:00.267 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.264+0000 7f2cab7fe640 1 -- 10.20.193.91:0/809951538 <== mon.2 v1:10.20.193.111:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7f2cc00958b0 con 0x7f2ccc05d180 2026-02-12T04:05:00.267 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.264+0000 7f2cab7fe640 10 client.27575.objecter ms_dispatch2 0x7f2ccc000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:05:00.267 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.264+0000 7f2cab7fe640 3 client.27575.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:05:00.267 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.264+0000 7f2cab7fe640 3 client.27575.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:05:00.267 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.264+0000 7f2cab7fe640 20 client.27575.objecter dump_active .. 0 homeless 2026-02-12T04:05:00.268 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.266+0000 7f2cab7fe640 1 -- 10.20.193.91:0/809951538 <== mon.2 v1:10.20.193.111:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f2cc005f210 con 0x7f2ccc05d180 2026-02-12T04:05:00.268 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.266+0000 7f2cab7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:05:00.268 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.266+0000 7f2cab7fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T04:05:00.375 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.373+0000 7f2cd14d0640 1 -- 10.20.193.91:0/809951538 --> v1:10.20.193.91:6800/2929217192 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f2ccc138500 con 0x7f2c9807a160 2026-02-12T04:05:00.375 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.373+0000 7f2cab7fe640 1 -- 10.20.193.91:0/809951538 <== mgr.4113 v1:10.20.193.91:6800/2929217192 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (unknown 778718403 0 0) 0x7f2ccc138500 con 0x7f2c9807a160 2026-02-12T04:05:00.375 INFO:teuthology.orchestra.run.trial091.stderr:instructed osd(s) 6 to deep-scrub 2026-02-12T04:05:00.377 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.375+0000 7f2cd14d0640 10 librados: watch_flush enter 2026-02-12T04:05:00.378 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.375+0000 7f2cd14d0640 10 librados: watch_flush exit 2026-02-12T04:05:00.378 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.375+0000 7f2cd14d0640 20 client.27575.objecter shutdown clearing up homeless session... 2026-02-12T04:05:00.378 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.375+0000 7f2cd14d0640 10 client.27575.objecter successfully canceled tick 2026-02-12T04:05:00.378 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.375+0000 7f2cd14d0640 1 -- 10.20.193.91:0/809951538 >> v1:10.20.193.91:6800/2929217192 conn(0x7f2c9807a160 legacy=0x7f2c9809a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:00.378 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.375+0000 7f2cd14d0640 10 monclient: shutdown 2026-02-12T04:05:00.378 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.375+0000 7f2cd14d0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:05:00.378 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.375+0000 7f2cd14d0640 1 -- 10.20.193.91:0/809951538 >> v1:10.20.193.111:6789/0 conn(0x7f2ccc05d180 legacy=0x7f2ccc1551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:00.378 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.375+0000 7f2cd14d0640 1 -- 10.20.193.91:0/809951538 shutdown_connections 2026-02-12T04:05:00.378 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.375+0000 7f2cd14d0640 1 -- 10.20.193.91:0/809951538 >> 10.20.193.91:0/809951538 conn(0x7f2ccc0b6560 msgr2=0x7f2ccc05b730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:05:00.378 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.375+0000 7f2cd14d0640 1 -- 10.20.193.91:0/809951538 shutdown_connections 2026-02-12T04:05:00.378 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.375+0000 7f2cd14d0640 1 -- 10.20.193.91:0/809951538 wait complete. 2026-02-12T04:05:00.378 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.375+0000 7f2cd14d0640 1 librados: shutdown 2026-02-12T04:05:00.385 INFO:tasks.ceph:Scrubbing osd.10 2026-02-12T04:05:00.385 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 config set osd_debug_deep_scrub_sleep 0 2026-02-12T04:05:00.458 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.456+0000 7f2253962640 10 monclient: get_monmap_and_config 2026-02-12T04:05:00.458 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.456+0000 7f2253962640 10 monclient: build_initial_monmap 2026-02-12T04:05:00.458 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.456+0000 7f2253962640 10 monclient: monmap: 2026-02-12T04:05:00.458 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:05:00.458 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:00.458 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:05:00.456984+0000 2026-02-12T04:05:00.458 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:05:00.456984+0000 2026-02-12T04:05:00.458 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:05:00.459 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:00.459 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:05:00.459 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:05:00.459 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:05:00.459 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.460 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.456+0000 7f2253962640 1 Processor -- start 2026-02-12T04:05:00.460 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.456+0000 7f2253962640 1 -- start start 2026-02-12T04:05:00.460 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.456+0000 7f2253962640 10 monclient: init 2026-02-12T04:05:00.460 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.457+0000 7f2253962640 10 monclient: _reopen_session rank -1 2026-02-12T04:05:00.461 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.457+0000 7f2253962640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T04:05:00.461 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.457+0000 7f2253962640 10 monclient(hunting): picked mon.noname-c con 0x7f224c055c30 addr v1:10.20.193.111:6789/0 2026-02-12T04:05:00.461 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.457+0000 7f2253962640 10 monclient(hunting): picked mon.noname-a con 0x7f224c160f80 addr v1:10.20.193.91:6789/0 2026-02-12T04:05:00.461 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.457+0000 7f2253962640 10 monclient(hunting): picked mon.noname-b con 0x7f224c163230 addr v1:10.20.193.98:6789/0 2026-02-12T04:05:00.461 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.457+0000 7f2253962640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f224c0b1fc0 con 0x7f224c160f80 2026-02-12T04:05:00.461 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.457+0000 7f2253962640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f224c0b22a0 con 0x7f224c163230 2026-02-12T04:05:00.461 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.457+0000 7f2253962640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f224c0b2580 con 0x7f224c055c30 2026-02-12T04:05:00.461 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.457+0000 7f2253962640 10 monclient(hunting): _renew_subs 2026-02-12T04:05:00.461 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.457+0000 7f2253962640 10 monclient(hunting): authenticate will time out at 1503.200527s 2026-02-12T04:05:00.461 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.457+0000 7f22516d7640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f224c055c30 0x7f224c162b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:55920/0 (socket says 10.20.193.91:55920) 2026-02-12T04:05:00.461 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.457+0000 7f22516d7640 1 -- 10.20.193.91:0/432860741 learned_addr learned my addr 10.20.193.91:0/432860741 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:05:00.467 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.459+0000 7f223bfff640 1 -- 10.20.193.91:0/432860741 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 248721919 0 0) 0x7f224c0b2580 con 0x7f224c055c30 2026-02-12T04:05:00.467 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.459+0000 7f223bfff640 10 monclient(hunting): _negotiate 2026-02-12T04:05:00.467 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.459+0000 7f223bfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:00.467 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.459+0000 7f223bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:00.467 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.459+0000 7f223bfff640 10 monclient(hunting): my global_id is 27578 2026-02-12T04:05:00.467 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.459+0000 7f223bfff640 1 -- 10.20.193.91:0/432860741 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2234003610 con 0x7f224c055c30 2026-02-12T04:05:00.468 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.459+0000 7f223bfff640 1 -- 10.20.193.91:0/432860741 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2827102602 0 0) 0x7f224c0b1fc0 con 0x7f224c160f80 2026-02-12T04:05:00.468 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.459+0000 7f223bfff640 10 monclient(hunting): _negotiate 2026-02-12T04:05:00.468 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.459+0000 7f223bfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:00.468 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.459+0000 7f223bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:00.468 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.459+0000 7f223bfff640 10 monclient(hunting): my global_id is 30741 2026-02-12T04:05:00.468 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.459+0000 7f223bfff640 1 -- 10.20.193.91:0/432860741 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f224c0b2580 con 0x7f224c160f80 2026-02-12T04:05:00.468 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.459+0000 7f223bfff640 1 -- 10.20.193.91:0/432860741 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 438786212 0 0) 0x7f224c0b22a0 con 0x7f224c163230 2026-02-12T04:05:00.468 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.459+0000 7f223bfff640 10 monclient(hunting): _negotiate 2026-02-12T04:05:00.468 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.459+0000 7f223bfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:00.468 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.459+0000 7f223bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:00.468 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.459+0000 7f223bfff640 10 monclient(hunting): my global_id is 27883 2026-02-12T04:05:00.469 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.459+0000 7f223bfff640 1 -- 10.20.193.91:0/432860741 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f224c0b1fc0 con 0x7f224c163230 2026-02-12T04:05:00.469 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.461+0000 7f223bfff640 1 -- 10.20.193.91:0/432860741 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2632929178 0 0) 0x7f2234003610 con 0x7f224c055c30 2026-02-12T04:05:00.469 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.461+0000 7f223bfff640 1 -- 10.20.193.91:0/432860741 >> v1:10.20.193.98:6789/0 conn(0x7f224c163230 legacy=0x7f224c1c57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:00.469 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.461+0000 7f223bfff640 1 -- 10.20.193.91:0/432860741 >> v1:10.20.193.91:6789/0 conn(0x7f224c160f80 legacy=0x7f224c1572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:00.469 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.461+0000 7f223bfff640 10 monclient: _finish_hunting 0 2026-02-12T04:05:00.469 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.461+0000 7f223bfff640 1 monclient: found mon.noname-c 2026-02-12T04:05:00.469 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.461+0000 7f223bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:05:00.469 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.461+0000 7f223bfff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.111:6789/0 2026-02-12T04:05:00.469 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.461+0000 7f223bfff640 1 -- 10.20.193.91:0/432860741 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f224c0b2860 con 0x7f224c055c30 2026-02-12T04:05:00.469 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.461+0000 7f223bfff640 10 monclient: _finish_auth 0 2026-02-12T04:05:00.469 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.461+0000 7f223bfff640 10 monclient: _check_auth_tickets 2026-02-12T04:05:00.470 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.461+0000 7f223bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:05:00.470 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.461+0000 7f223bfff640 1 -- 10.20.193.91:0/432860741 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f223c002df0 con 0x7f224c055c30 2026-02-12T04:05:00.470 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.461+0000 7f223bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:00.470 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.461+0000 7f223bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T04:05:00.470 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.461+0000 7f223bfff640 10 monclient: dump: 2026-02-12T04:05:00.470 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:00.470 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:00.470 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.470 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.470 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:00.470 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:00.470 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:00.471 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:00.471 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:00.471 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.471 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.461+0000 7f2253962640 5 monclient: authenticate success, global_id 27578 2026-02-12T04:05:00.471 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.461+0000 7f2253962640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:05:00.471 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.462+0000 7f223bfff640 1 -- 10.20.193.91:0/432860741 <== mon.2 v1:10.20.193.111:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f223c002fc0 con 0x7f224c055c30 2026-02-12T04:05:00.471 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.462+0000 7f223bfff640 10 monclient: handle_config config(0 keys) 2026-02-12T04:05:00.471 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.462+0000 7f223bfff640 1 -- 10.20.193.91:0/432860741 <== mon.2 v1:10.20.193.111:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f223c003400 con 0x7f224c055c30 2026-02-12T04:05:00.471 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.462+0000 7f223bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:00.471 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.462+0000 7f223bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T04:05:00.471 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.462+0000 7f223bfff640 10 monclient: dump: 2026-02-12T04:05:00.472 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:00.472 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:00.472 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.472 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.472 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:00.472 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:00.472 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:00.472 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:00.472 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:00.472 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.472 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.462+0000 7f2253962640 10 monclient: get_monmap_and_config success 2026-02-12T04:05:00.472 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.462+0000 7f2253962640 4 set_mon_vals no callback set 2026-02-12T04:05:00.472 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.462+0000 7f2253962640 10 monclient: shutdown 2026-02-12T04:05:00.473 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.462+0000 7f2253962640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:05:00.473 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.462+0000 7f2253962640 1 -- 10.20.193.91:0/432860741 >> v1:10.20.193.111:6789/0 conn(0x7f224c055c30 legacy=0x7f224c162b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:00.473 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.462+0000 7f2253962640 1 -- 10.20.193.91:0/432860741 shutdown_connections 2026-02-12T04:05:00.473 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.462+0000 7f2253962640 1 -- 10.20.193.91:0/432860741 >> 10.20.193.91:0/432860741 conn(0x7f224c0b6560 msgr2=0x7f224c0b6930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:05:00.473 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.462+0000 7f2253962640 1 -- 10.20.193.91:0/432860741 shutdown_connections 2026-02-12T04:05:00.473 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.462+0000 7f2253962640 1 -- 10.20.193.91:0/432860741 wait complete. 2026-02-12T04:05:00.473 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.462+0000 7f2253962640 10 monclient: build_initial_monmap 2026-02-12T04:05:00.473 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.462+0000 7f2253962640 10 monclient: monmap: 2026-02-12T04:05:00.473 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:05:00.473 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:05:00.473 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:05:00.473 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:05:00.473 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:05:00.474 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:05:00.474 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:05:00.474 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:05:00.474 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:05:00.474 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.474 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.463+0000 7f2253962640 1 librados: starting msgr at 2026-02-12T04:05:00.474 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.463+0000 7f2253962640 1 librados: starting objecter 2026-02-12T04:05:00.474 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.463+0000 7f2253962640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:05:00.474 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.463+0000 7f2253962640 1 Processor -- start 2026-02-12T04:05:00.474 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.463+0000 7f2253962640 1 -- start start 2026-02-12T04:05:00.474 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.463+0000 7f2253962640 1 librados: setting wanted keys 2026-02-12T04:05:00.474 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.463+0000 7f2253962640 1 librados: calling monclient init 2026-02-12T04:05:00.475 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.463+0000 7f2253962640 10 monclient: init 2026-02-12T04:05:00.475 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.463+0000 7f2253962640 10 monclient: _reopen_session rank -1 2026-02-12T04:05:00.475 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.463+0000 7f2253962640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T04:05:00.475 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.463+0000 7f2253962640 10 monclient(hunting): picked mon.noname-a con 0x7f224c055c30 addr v1:10.20.193.91:6789/0 2026-02-12T04:05:00.475 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.463+0000 7f2253962640 10 monclient(hunting): picked mon.noname-b con 0x7f224c160f80 addr v1:10.20.193.98:6789/0 2026-02-12T04:05:00.475 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.463+0000 7f2253962640 10 monclient(hunting): picked mon.noname-c con 0x7f224c163230 addr v1:10.20.193.111:6789/0 2026-02-12T04:05:00.475 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.463+0000 7f2253962640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f224c13b810 con 0x7f224c055c30 2026-02-12T04:05:00.475 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.463+0000 7f2253962640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f224c1fb580 con 0x7f224c160f80 2026-02-12T04:05:00.475 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.463+0000 7f2253962640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f224c1fb860 con 0x7f224c163230 2026-02-12T04:05:00.475 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.463+0000 7f2253962640 10 monclient(hunting): _renew_subs 2026-02-12T04:05:00.475 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.463+0000 7f2253962640 10 monclient(hunting): authenticate will time out at 1503.206671s 2026-02-12T04:05:00.475 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.463+0000 7f22516d7640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f224c055c30 0x7f224c0af790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:39860/0 (socket says 10.20.193.91:39860) 2026-02-12T04:05:00.476 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.463+0000 7f22516d7640 1 -- 10.20.193.91:0/4060589265 learned_addr learned my addr 10.20.193.91:0/4060589265 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:05:00.476 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.464+0000 7f2239ffb640 10 client.?.objecter ms_handle_connect 0x7f224c055c30 2026-02-12T04:05:00.476 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.464+0000 7f2239ffb640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:00.476 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.464+0000 7f2239ffb640 10 client.?.objecter ms_handle_connect 0x7f224c163230 2026-02-12T04:05:00.476 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.464+0000 7f2239ffb640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:00.476 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.464+0000 7f2239ffb640 10 client.?.objecter ms_handle_connect 0x7f224c160f80 2026-02-12T04:05:00.476 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.464+0000 7f2239ffb640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:00.476 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.465+0000 7f2239ffb640 1 -- 10.20.193.91:0/4060589265 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 333957035 0 0) 0x7f224c1fb860 con 0x7f224c163230 2026-02-12T04:05:00.476 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.465+0000 7f2239ffb640 10 monclient(hunting): _negotiate 2026-02-12T04:05:00.476 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.465+0000 7f2239ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:00.476 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.465+0000 7f2239ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:00.476 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.465+0000 7f2239ffb640 10 monclient(hunting): my global_id is 27581 2026-02-12T04:05:00.476 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.465+0000 7f2239ffb640 1 -- 10.20.193.91:0/4060589265 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f221c003610 con 0x7f224c163230 2026-02-12T04:05:00.477 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.465+0000 7f2239ffb640 1 -- 10.20.193.91:0/4060589265 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 782127705 0 0) 0x7f224c13b810 con 0x7f224c055c30 2026-02-12T04:05:00.477 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.465+0000 7f2239ffb640 10 monclient(hunting): _negotiate 2026-02-12T04:05:00.477 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.465+0000 7f2239ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:00.477 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.465+0000 7f2239ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:00.477 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.465+0000 7f2239ffb640 10 monclient(hunting): my global_id is 30744 2026-02-12T04:05:00.477 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.465+0000 7f2239ffb640 1 -- 10.20.193.91:0/4060589265 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f224c1fb860 con 0x7f224c055c30 2026-02-12T04:05:00.480 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.466+0000 7f2239ffb640 1 -- 10.20.193.91:0/4060589265 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1988606799 0 0) 0x7f224c1fb580 con 0x7f224c160f80 2026-02-12T04:05:00.480 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.466+0000 7f2239ffb640 10 monclient(hunting): _negotiate 2026-02-12T04:05:00.480 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.466+0000 7f2239ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:00.480 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.466+0000 7f2239ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:00.481 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.466+0000 7f2239ffb640 10 monclient(hunting): my global_id is 27886 2026-02-12T04:05:00.481 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.466+0000 7f2239ffb640 1 -- 10.20.193.91:0/4060589265 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f224c13b810 con 0x7f224c160f80 2026-02-12T04:05:00.481 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.467+0000 7f2239ffb640 1 -- 10.20.193.91:0/4060589265 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 657382805 0 0) 0x7f221c003610 con 0x7f224c163230 2026-02-12T04:05:00.481 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.467+0000 7f2239ffb640 1 -- 10.20.193.91:0/4060589265 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f224c1fb580 con 0x7f224c163230 2026-02-12T04:05:00.481 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.467+0000 7f2239ffb640 1 -- 10.20.193.91:0/4060589265 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f2248003330 con 0x7f224c163230 2026-02-12T04:05:00.481 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.467+0000 7f2239ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:00.481 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.467+0000 7f2239ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T04:05:00.481 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.467+0000 7f2239ffb640 10 monclient(hunting): dump: 2026-02-12T04:05:00.481 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:00.481 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:00.481 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.482 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.482 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:00.482 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:00.482 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:00.482 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:00.482 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:00.482 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.482 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.467+0000 7f2239ffb640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:05:00.482 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.468+0000 7f2239ffb640 1 -- 10.20.193.91:0/4060589265 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3336513001 0 0) 0x7f224c1fb860 con 0x7f224c055c30 2026-02-12T04:05:00.482 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.468+0000 7f2239ffb640 1 -- 10.20.193.91:0/4060589265 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f221c003610 con 0x7f224c055c30 2026-02-12T04:05:00.482 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.468+0000 7f2239ffb640 1 -- 10.20.193.91:0/4060589265 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f223c003310 con 0x7f224c055c30 2026-02-12T04:05:00.483 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.468+0000 7f2239ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:00.483 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.468+0000 7f2239ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T04:05:00.483 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.468+0000 7f2239ffb640 10 monclient(hunting): dump: 2026-02-12T04:05:00.483 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:00.483 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:00.483 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.483 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.483 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:00.483 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:00.483 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:00.483 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:00.483 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:00.483 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.484 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.468+0000 7f2239ffb640 1 -- 10.20.193.91:0/4060589265 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2671837890 0 0) 0x7f224c13b810 con 0x7f224c160f80 2026-02-12T04:05:00.484 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.468+0000 7f2239ffb640 1 -- 10.20.193.91:0/4060589265 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f224c1fb860 con 0x7f224c160f80 2026-02-12T04:05:00.484 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.468+0000 7f2239ffb640 1 -- 10.20.193.91:0/4060589265 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f2240003080 con 0x7f224c160f80 2026-02-12T04:05:00.484 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.468+0000 7f2239ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:00.484 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.468+0000 7f2239ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T04:05:00.484 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.468+0000 7f2239ffb640 10 monclient(hunting): dump: 2026-02-12T04:05:00.484 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:00.484 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:00.484 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.484 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.484 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:00.484 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:00.485 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:00.485 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:00.485 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:00.485 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.485 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.469+0000 7f2239ffb640 1 -- 10.20.193.91:0/4060589265 <== mon.2 v1:10.20.193.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 301196738 0 0) 0x7f224c1fb580 con 0x7f224c163230 2026-02-12T04:05:00.485 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.469+0000 7f2239ffb640 1 -- 10.20.193.91:0/4060589265 >> v1:10.20.193.98:6789/0 conn(0x7f224c160f80 legacy=0x7f224c153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:00.485 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.469+0000 7f2239ffb640 1 -- 10.20.193.91:0/4060589265 >> v1:10.20.193.91:6789/0 conn(0x7f224c055c30 legacy=0x7f224c0af790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:00.485 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.469+0000 7f2239ffb640 10 monclient: _finish_hunting 0 2026-02-12T04:05:00.485 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.469+0000 7f2239ffb640 1 monclient: found mon.c 2026-02-12T04:05:00.485 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.469+0000 7f2239ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:05:00.485 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.469+0000 7f2239ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:05:00.485 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.469+0000 7f2239ffb640 1 -- 10.20.193.91:0/4060589265 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f224c1fbb40 con 0x7f224c163230 2026-02-12T04:05:00.486 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.469+0000 7f2239ffb640 10 monclient: _finish_auth 0 2026-02-12T04:05:00.486 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.469+0000 7f2239ffb640 10 monclient: _check_auth_tickets 2026-02-12T04:05:00.486 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.469+0000 7f2239ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:05:00.486 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.469+0000 7f2253962640 5 monclient: authenticate success, global_id 27581 2026-02-12T04:05:00.486 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.469+0000 7f2253962640 10 monclient: _renew_subs 2026-02-12T04:05:00.486 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.469+0000 7f2253962640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:05:00.486 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.469+0000 7f2253962640 1 -- 10.20.193.91:0/4060589265 --> v1:10.20.193.111:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f224c1fbe20 con 0x7f224c163230 2026-02-12T04:05:00.486 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.469+0000 7f2253962640 10 client.27581.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:05:00.486 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.469+0000 7f2253962640 10 monclient: _renew_subs 2026-02-12T04:05:00.486 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.469+0000 7f2253962640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:05:00.486 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.469+0000 7f2253962640 1 -- 10.20.193.91:0/4060589265 --> v1:10.20.193.111:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f224c0adae0 con 0x7f224c163230 2026-02-12T04:05:00.486 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.469+0000 7f2253962640 1 librados: init done 2026-02-12T04:05:00.486 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.469+0000 7f2253962640 10 client.27581.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:05:00.487 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.469+0000 7f2253962640 15 client.27581.objecter _session_command_op_assign -1 1 2026-02-12T04:05:00.487 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.469+0000 7f2253962640 20 client.27581.objecter _get_session osd=-1 returning homeless 2026-02-12T04:05:00.487 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.469+0000 7f2253962640 10 client.27581.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:05:00.487 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.469+0000 7f2253962640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:05:00.487 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.469+0000 7f2253962640 1 -- 10.20.193.91:0/4060589265 --> v1:10.20.193.111:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f224c0addc0 con 0x7f224c163230 2026-02-12T04:05:00.487 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.478+0000 7f2239ffb640 1 -- 10.20.193.91:0/4060589265 <== mon.2 v1:10.20.193.111:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f224c0addc0 con 0x7f224c163230 2026-02-12T04:05:00.487 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.478+0000 7f2239ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T04:05:00.487 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.478+0000 7f2239ffb640 1 -- 10.20.193.91:0/4060589265 <== mon.2 v1:10.20.193.111:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f2248003c20 con 0x7f224c163230 2026-02-12T04:05:00.487 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.478+0000 7f2239ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:00.487 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.478+0000 7f2239ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T04:05:00.487 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.478+0000 7f2239ffb640 10 monclient: dump: 2026-02-12T04:05:00.487 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:00.488 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:00.488 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.488 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.488 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:00.488 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:00.488 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:00.488 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:00.488 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:00.488 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.488 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.478+0000 7f223b7fe640 4 set_mon_vals no callback set 2026-02-12T04:05:00.490 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.479+0000 7f2239ffb640 1 -- 10.20.193.91:0/4060589265 <== mon.2 v1:10.20.193.111:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f224801d100 con 0x7f224c163230 2026-02-12T04:05:00.490 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.480+0000 7f22516d7640 10 monclient: get_auth_request con 0x7f221c07a090 auth_method 0 2026-02-12T04:05:00.490 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.480+0000 7f2239ffb640 10 client.27581.objecter ms_handle_connect 0x7f221c07a090 2026-02-12T04:05:00.490 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.481+0000 7f2239ffb640 1 -- 10.20.193.91:0/4060589265 <== mon.2 v1:10.20.193.111:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7f2248094980 con 0x7f224c163230 2026-02-12T04:05:00.490 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.481+0000 7f2239ffb640 10 client.27581.objecter ms_dispatch2 0x7f224c000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:05:00.490 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.481+0000 7f2239ffb640 3 client.27581.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:05:00.491 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.481+0000 7f2239ffb640 3 client.27581.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:05:00.491 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.481+0000 7f2239ffb640 10 client.27581.objecter checking command 1 2026-02-12T04:05:00.491 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.481+0000 7f2239ffb640 20 client.27581.objecter _get_session s=0x7f221c0a4340 osd=10 3 2026-02-12T04:05:00.491 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.481+0000 7f2239ffb640 20 client.27581.objecter put_session s=0x7f221c0a4340 osd=10 3 2026-02-12T04:05:00.491 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.481+0000 7f2239ffb640 15 client.27581.objecter _session_command_op_remove -1 1 2026-02-12T04:05:00.491 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.481+0000 7f2239ffb640 20 client.27581.objecter _get_session s=0x7f221c0a4340 osd=10 3 2026-02-12T04:05:00.491 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.481+0000 7f2239ffb640 20 client.27581.objecter get_session s=0x7f221c0a4340 osd=10 3 2026-02-12T04:05:00.491 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.481+0000 7f2239ffb640 15 client.27581.objecter _session_command_op_assign 10 1 2026-02-12T04:05:00.491 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.481+0000 7f2239ffb640 20 client.27581.objecter put_session s=0x7f221c0a4340 osd=10 4 2026-02-12T04:05:00.491 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.481+0000 7f2239ffb640 10 client.27581.objecter _send_command 1 2026-02-12T04:05:00.491 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.481+0000 7f2239ffb640 1 -- 10.20.193.91:0/4060589265 --> v1:10.20.193.111:6808/1268343515 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f221c0c6650 con 0x7f221c0a49f0 2026-02-12T04:05:00.491 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.481+0000 7f2239ffb640 20 client.27581.objecter dump_active .. 0 homeless 2026-02-12T04:05:00.491 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.481+0000 7f2239ffb640 1 -- 10.20.193.91:0/4060589265 <== mon.2 v1:10.20.193.111:6789/0 9 ==== mon_get_version_reply(handle=1 version=344) ==== 24+0+0 (unknown 1403447244 0 0) 0x7f2248059f50 con 0x7f224c163230 2026-02-12T04:05:00.492 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.481+0000 7f2239ffb640 10 monclient: handle_get_version_reply finishing 1 version 344 2026-02-12T04:05:00.492 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.481+0000 7f2250ed6640 10 monclient: get_auth_request con 0x7f221c0a49f0 auth_method 0 2026-02-12T04:05:00.492 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.482+0000 7f2239ffb640 10 client.27581.objecter ms_handle_connect 0x7f221c0a49f0 2026-02-12T04:05:00.494 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.492+0000 7f2239ffb640 1 -- 10.20.193.91:0/4060589265 <== osd.10 v1:10.20.193.111:6808/1268343515 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f221c0c6650 con 0x7f221c0a49f0 2026-02-12T04:05:00.494 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.492+0000 7f2239ffb640 10 client.27581.objecter ms_dispatch2 0x7f224c000b90 command_reply(tid 1: 0 ) 2026-02-12T04:05:00.494 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.492+0000 7f2239ffb640 10 client.27581.objecter _finish_command 1 = system:0 2026-02-12T04:05:00.494 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.492+0000 7f2239ffb640 20 client.27581.objecter put_session s=0x7f221c0a4340 osd=10 4 2026-02-12T04:05:00.494 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.492+0000 7f2239ffb640 15 client.27581.objecter _session_command_op_remove 10 1 2026-02-12T04:05:00.501 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.499+0000 7f2253962640 10 client.27581.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-12T04:05:00.501 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.499+0000 7f2253962640 15 client.27581.objecter _session_command_op_assign -1 2 2026-02-12T04:05:00.501 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.499+0000 7f2253962640 20 client.27581.objecter _get_session s=0x7f221c0a4340 osd=10 3 2026-02-12T04:05:00.502 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.499+0000 7f2253962640 20 client.27581.objecter put_session s=0x7f221c0a4340 osd=10 3 2026-02-12T04:05:00.502 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.499+0000 7f2253962640 20 client.27581.objecter _get_session s=0x7f221c0a4340 osd=10 3 2026-02-12T04:05:00.502 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.499+0000 7f2253962640 15 client.27581.objecter _session_command_op_remove -1 2 2026-02-12T04:05:00.502 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.499+0000 7f2253962640 20 client.27581.objecter get_session s=0x7f221c0a4340 osd=10 3 2026-02-12T04:05:00.502 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.499+0000 7f2253962640 15 client.27581.objecter _session_command_op_assign 10 2 2026-02-12T04:05:00.502 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.499+0000 7f2253962640 20 client.27581.objecter put_session s=0x7f221c0a4340 osd=10 4 2026-02-12T04:05:00.502 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.499+0000 7f2253962640 10 client.27581.objecter _send_command 2 2026-02-12T04:05:00.502 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.499+0000 7f2253962640 1 -- 10.20.193.91:0/4060589265 --> v1:10.20.193.111:6808/1268343515 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f224c15fcb0 con 0x7f221c0a49f0 2026-02-12T04:05:00.509 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.507+0000 7f2239ffb640 1 -- 10.20.193.91:0/4060589265 <== osd.10 v1:10.20.193.111:6808/1268343515 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f224c15fcb0 con 0x7f221c0a49f0 2026-02-12T04:05:00.509 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.507+0000 7f2239ffb640 10 client.27581.objecter ms_dispatch2 0x7f224c000b90 command_reply(tid 2: 0 ) 2026-02-12T04:05:00.509 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.507+0000 7f2239ffb640 10 client.27581.objecter _finish_command 2 = system:0 2026-02-12T04:05:00.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.507+0000 7f2239ffb640 20 client.27581.objecter put_session s=0x7f221c0a4340 osd=10 4 2026-02-12T04:05:00.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.507+0000 7f2239ffb640 15 client.27581.objecter _session_command_op_remove 10 2 2026-02-12T04:05:00.510 INFO:teuthology.orchestra.run.trial091.stdout:{ 2026-02-12T04:05:00.510 INFO:teuthology.orchestra.run.trial091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-12T04:05:00.510 INFO:teuthology.orchestra.run.trial091.stdout:} 2026-02-12T04:05:00.511 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.507+0000 7f2253962640 10 librados: watch_flush enter 2026-02-12T04:05:00.512 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.507+0000 7f2253962640 10 librados: watch_flush exit 2026-02-12T04:05:00.512 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.507+0000 7f2253962640 10 client.27581.objecter close_session for osd.10 2026-02-12T04:05:00.512 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.507+0000 7f2253962640 1 -- 10.20.193.91:0/4060589265 >> v1:10.20.193.111:6808/1268343515 conn(0x7f221c0a49f0 legacy=0x7f221c0c4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:00.512 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.507+0000 7f2253962640 20 client.27581.objecter put_session s=0x7f221c0a4340 osd=10 1 2026-02-12T04:05:00.512 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.507+0000 7f2253962640 20 client.27581.objecter shutdown clearing up homeless session... 2026-02-12T04:05:00.512 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.507+0000 7f2253962640 10 client.27581.objecter successfully canceled tick 2026-02-12T04:05:00.512 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.507+0000 7f2253962640 1 -- 10.20.193.91:0/4060589265 >> v1:10.20.193.91:6800/2929217192 conn(0x7f221c07a090 legacy=0x7f221c09a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:00.512 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.507+0000 7f2253962640 10 monclient: shutdown 2026-02-12T04:05:00.512 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.507+0000 7f2253962640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:05:00.512 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.507+0000 7f2253962640 1 -- 10.20.193.91:0/4060589265 >> v1:10.20.193.111:6789/0 conn(0x7f224c163230 legacy=0x7f224c0ad3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:00.512 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.507+0000 7f2251ed8640 1 -- 10.20.193.91:0/4060589265 reap_dead start 2026-02-12T04:05:00.513 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.507+0000 7f2253962640 1 -- 10.20.193.91:0/4060589265 shutdown_connections 2026-02-12T04:05:00.513 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.507+0000 7f2253962640 1 -- 10.20.193.91:0/4060589265 >> 10.20.193.91:0/4060589265 conn(0x7f224c0b6560 msgr2=0x7f224c1613b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:05:00.513 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.507+0000 7f2253962640 1 -- 10.20.193.91:0/4060589265 shutdown_connections 2026-02-12T04:05:00.513 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.507+0000 7f2253962640 1 -- 10.20.193.91:0/4060589265 wait complete. 2026-02-12T04:05:00.513 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.507+0000 7f2253962640 1 librados: shutdown 2026-02-12T04:05:00.517 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 10 2026-02-12T04:05:00.584 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.582+0000 7fa715c4d640 10 monclient: get_monmap_and_config 2026-02-12T04:05:00.584 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.582+0000 7fa715c4d640 10 monclient: build_initial_monmap 2026-02-12T04:05:00.584 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.582+0000 7fa715c4d640 10 monclient: monmap: 2026-02-12T04:05:00.584 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:05:00.584 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:00.585 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:05:00.583166+0000 2026-02-12T04:05:00.585 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:05:00.583166+0000 2026-02-12T04:05:00.585 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:05:00.585 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:00.585 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:05:00.585 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:05:00.585 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:05:00.585 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.588 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.583+0000 7fa715c4d640 1 Processor -- start 2026-02-12T04:05:00.588 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.583+0000 7fa715c4d640 1 -- start start 2026-02-12T04:05:00.588 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.583+0000 7fa715c4d640 10 monclient: init 2026-02-12T04:05:00.588 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.583+0000 7fa715c4d640 10 monclient: _reopen_session rank -1 2026-02-12T04:05:00.588 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.583+0000 7fa715c4d640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T04:05:00.588 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.583+0000 7fa715c4d640 10 monclient(hunting): picked mon.noname-a con 0x7fa7101575d0 addr v1:10.20.193.91:6789/0 2026-02-12T04:05:00.588 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.583+0000 7fa715c4d640 10 monclient(hunting): picked mon.noname-c con 0x7fa710163310 addr v1:10.20.193.111:6789/0 2026-02-12T04:05:00.588 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.583+0000 7fa715c4d640 10 monclient(hunting): picked mon.noname-b con 0x7fa7100560d0 addr v1:10.20.193.98:6789/0 2026-02-12T04:05:00.588 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.583+0000 7fa715c4d640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7100b20b0 con 0x7fa7101575d0 2026-02-12T04:05:00.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.583+0000 7fa715c4d640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7100b2390 con 0x7fa7100560d0 2026-02-12T04:05:00.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.583+0000 7fa715c4d640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7100b2670 con 0x7fa710163310 2026-02-12T04:05:00.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.583+0000 7fa715c4d640 10 monclient(hunting): _renew_subs 2026-02-12T04:05:00.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.583+0000 7fa715c4d640 10 monclient(hunting): authenticate will time out at 1503.326586s 2026-02-12T04:05:00.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.583+0000 7fa70f7fe640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7fa7101575d0 0x7fa710162c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:39872/0 (socket says 10.20.193.91:39872) 2026-02-12T04:05:00.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.583+0000 7fa70f7fe640 1 -- 10.20.193.91:0/120060714 learned_addr learned my addr 10.20.193.91:0/120060714 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:05:00.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.585+0000 7fa70e7fc640 1 -- 10.20.193.91:0/120060714 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1207039582 0 0) 0x7fa7100b20b0 con 0x7fa7101575d0 2026-02-12T04:05:00.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.585+0000 7fa70e7fc640 10 monclient(hunting): _negotiate 2026-02-12T04:05:00.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.585+0000 7fa70e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:00.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.585+0000 7fa70e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:00.589 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.585+0000 7fa70e7fc640 10 monclient(hunting): my global_id is 30747 2026-02-12T04:05:00.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.585+0000 7fa70e7fc640 1 -- 10.20.193.91:0/120060714 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6f4003610 con 0x7fa7101575d0 2026-02-12T04:05:00.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.585+0000 7fa70e7fc640 1 -- 10.20.193.91:0/120060714 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3881938829 0 0) 0x7fa7100b2390 con 0x7fa7100560d0 2026-02-12T04:05:00.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.585+0000 7fa70e7fc640 10 monclient(hunting): _negotiate 2026-02-12T04:05:00.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.585+0000 7fa70e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:00.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.585+0000 7fa70e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:00.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.585+0000 7fa70e7fc640 10 monclient(hunting): my global_id is 27889 2026-02-12T04:05:00.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.585+0000 7fa70e7fc640 1 -- 10.20.193.91:0/120060714 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7100b20b0 con 0x7fa7100560d0 2026-02-12T04:05:00.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.585+0000 7fa70e7fc640 1 -- 10.20.193.91:0/120060714 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1863763161 0 0) 0x7fa7100b2670 con 0x7fa710163310 2026-02-12T04:05:00.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.585+0000 7fa70e7fc640 10 monclient(hunting): _negotiate 2026-02-12T04:05:00.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.585+0000 7fa70e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:00.590 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.585+0000 7fa70e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:00.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.585+0000 7fa70e7fc640 10 monclient(hunting): my global_id is 27584 2026-02-12T04:05:00.591 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.585+0000 7fa70e7fc640 1 -- 10.20.193.91:0/120060714 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7100b2390 con 0x7fa710163310 2026-02-12T04:05:00.597 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.586+0000 7fa70e7fc640 1 -- 10.20.193.91:0/120060714 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 996813770 0 0) 0x7fa6f4003610 con 0x7fa7101575d0 2026-02-12T04:05:00.597 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.586+0000 7fa70e7fc640 1 -- 10.20.193.91:0/120060714 >> v1:10.20.193.111:6789/0 conn(0x7fa710163310 legacy=0x7fa7100559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:00.598 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.586+0000 7fa70e7fc640 1 -- 10.20.193.91:0/120060714 >> v1:10.20.193.98:6789/0 conn(0x7fa7100560d0 legacy=0x7fa7101c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:00.598 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.586+0000 7fa70e7fc640 10 monclient: _finish_hunting 0 2026-02-12T04:05:00.598 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.586+0000 7fa70e7fc640 1 monclient: found mon.noname-a 2026-02-12T04:05:00.598 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.586+0000 7fa70e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:05:00.598 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.586+0000 7fa70e7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.91:6789/0 2026-02-12T04:05:00.598 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.586+0000 7fa70e7fc640 1 -- 10.20.193.91:0/120060714 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa710162400 con 0x7fa7101575d0 2026-02-12T04:05:00.598 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.586+0000 7fa70e7fc640 10 monclient: _finish_auth 0 2026-02-12T04:05:00.598 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.586+0000 7fa70e7fc640 10 monclient: _check_auth_tickets 2026-02-12T04:05:00.598 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.586+0000 7fa70e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:05:00.598 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.586+0000 7fa70e7fc640 1 -- 10.20.193.91:0/120060714 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fa6fc002df0 con 0x7fa7101575d0 2026-02-12T04:05:00.598 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.586+0000 7fa70e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:00.599 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.586+0000 7fa70e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T04:05:00.599 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.587+0000 7fa70e7fc640 10 monclient: dump: 2026-02-12T04:05:00.599 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:00.599 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:00.599 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.599 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.599 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:00.599 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:00.599 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:00.599 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:00.599 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:00.599 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.600 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.587+0000 7fa715c4d640 5 monclient: authenticate success, global_id 30747 2026-02-12T04:05:00.600 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.587+0000 7fa715c4d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:05:00.600 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.587+0000 7fa70e7fc640 1 -- 10.20.193.91:0/120060714 <== mon.0 v1:10.20.193.91:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa6fc002fc0 con 0x7fa7101575d0 2026-02-12T04:05:00.600 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.587+0000 7fa70e7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T04:05:00.600 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.587+0000 7fa70e7fc640 1 -- 10.20.193.91:0/120060714 <== mon.0 v1:10.20.193.91:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fa6fc003400 con 0x7fa7101575d0 2026-02-12T04:05:00.600 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.587+0000 7fa70e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:00.600 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.587+0000 7fa70e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T04:05:00.600 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.587+0000 7fa70e7fc640 10 monclient: dump: 2026-02-12T04:05:00.600 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:00.600 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:00.600 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.600 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.601 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:00.601 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:00.601 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:00.601 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:00.601 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:00.601 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.601 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.587+0000 7fa715c4d640 10 monclient: get_monmap_and_config success 2026-02-12T04:05:00.601 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.587+0000 7fa715c4d640 4 set_mon_vals no callback set 2026-02-12T04:05:00.601 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.588+0000 7fa715c4d640 10 monclient: shutdown 2026-02-12T04:05:00.601 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.588+0000 7fa715c4d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:05:00.601 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.588+0000 7fa715c4d640 1 -- 10.20.193.91:0/120060714 >> v1:10.20.193.91:6789/0 conn(0x7fa7101575d0 legacy=0x7fa710162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:00.601 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.588+0000 7fa715c4d640 1 -- 10.20.193.91:0/120060714 shutdown_connections 2026-02-12T04:05:00.602 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.588+0000 7fa715c4d640 1 -- 10.20.193.91:0/120060714 >> 10.20.193.91:0/120060714 conn(0x7fa7100b6560 msgr2=0x7fa7100b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:05:00.602 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.588+0000 7fa715c4d640 1 -- 10.20.193.91:0/120060714 shutdown_connections 2026-02-12T04:05:00.602 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.588+0000 7fa715c4d640 1 -- 10.20.193.91:0/120060714 wait complete. 2026-02-12T04:05:00.602 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.588+0000 7fa715c4d640 10 monclient: build_initial_monmap 2026-02-12T04:05:00.602 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.588+0000 7fa715c4d640 10 monclient: monmap: 2026-02-12T04:05:00.602 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:05:00.602 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:05:00.602 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:05:00.602 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:05:00.602 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:05:00.602 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:05:00.602 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:05:00.602 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:05:00.603 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:05:00.603 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.603 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.588+0000 7fa715c4d640 1 librados: starting msgr at 2026-02-12T04:05:00.603 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.588+0000 7fa715c4d640 1 librados: starting objecter 2026-02-12T04:05:00.603 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.588+0000 7fa715c4d640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:05:00.603 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.588+0000 7fa715c4d640 1 Processor -- start 2026-02-12T04:05:00.603 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.588+0000 7fa715c4d640 1 -- start start 2026-02-12T04:05:00.603 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.588+0000 7fa715c4d640 1 librados: setting wanted keys 2026-02-12T04:05:00.603 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.588+0000 7fa715c4d640 1 librados: calling monclient init 2026-02-12T04:05:00.603 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.588+0000 7fa715c4d640 10 monclient: init 2026-02-12T04:05:00.603 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.589+0000 7fa715c4d640 10 monclient: _reopen_session rank -1 2026-02-12T04:05:00.603 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.589+0000 7fa715c4d640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T04:05:00.604 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.589+0000 7fa715c4d640 10 monclient(hunting): picked mon.noname-b con 0x7fa7100560d0 addr v1:10.20.193.98:6789/0 2026-02-12T04:05:00.604 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.589+0000 7fa715c4d640 10 monclient(hunting): picked mon.noname-c con 0x7fa7101575d0 addr v1:10.20.193.111:6789/0 2026-02-12T04:05:00.604 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.589+0000 7fa715c4d640 10 monclient(hunting): picked mon.noname-a con 0x7fa710163310 addr v1:10.20.193.91:6789/0 2026-02-12T04:05:00.604 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.589+0000 7fa715c4d640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa710144070 con 0x7fa710163310 2026-02-12T04:05:00.604 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.589+0000 7fa715c4d640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa710143d90 con 0x7fa7100560d0 2026-02-12T04:05:00.604 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.589+0000 7fa715c4d640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa710157e20 con 0x7fa7101575d0 2026-02-12T04:05:00.604 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.589+0000 7fa715c4d640 10 monclient(hunting): _renew_subs 2026-02-12T04:05:00.604 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.589+0000 7fa715c4d640 10 monclient(hunting): authenticate will time out at 1503.332339s 2026-02-12T04:05:00.604 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.589+0000 7fa70ffff640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7fa710163310 0x7fa710153730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:39882/0 (socket says 10.20.193.91:39882) 2026-02-12T04:05:00.604 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.589+0000 7fa70ffff640 1 -- 10.20.193.91:0/1994760017 learned_addr learned my addr 10.20.193.91:0/1994760017 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:05:00.604 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.589+0000 7fa6ebfff640 10 client.?.objecter ms_handle_connect 0x7fa710163310 2026-02-12T04:05:00.604 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.589+0000 7fa6ebfff640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:00.604 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.589+0000 7fa6ebfff640 10 client.?.objecter ms_handle_connect 0x7fa7101575d0 2026-02-12T04:05:00.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.589+0000 7fa6ebfff640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:00.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.589+0000 7fa6ebfff640 10 client.?.objecter ms_handle_connect 0x7fa7100560d0 2026-02-12T04:05:00.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.589+0000 7fa6ebfff640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:00.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.590+0000 7fa6ebfff640 1 -- 10.20.193.91:0/1994760017 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2581200695 0 0) 0x7fa710144070 con 0x7fa710163310 2026-02-12T04:05:00.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.590+0000 7fa6ebfff640 10 monclient(hunting): _negotiate 2026-02-12T04:05:00.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.590+0000 7fa6ebfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:00.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.590+0000 7fa6ebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:00.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.590+0000 7fa6ebfff640 10 monclient(hunting): my global_id is 30750 2026-02-12T04:05:00.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.590+0000 7fa6ebfff640 1 -- 10.20.193.91:0/1994760017 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6e0003610 con 0x7fa710163310 2026-02-12T04:05:00.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.591+0000 7fa6ebfff640 1 -- 10.20.193.91:0/1994760017 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2745217409 0 0) 0x7fa710157e20 con 0x7fa7101575d0 2026-02-12T04:05:00.605 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.591+0000 7fa6ebfff640 10 monclient(hunting): _negotiate 2026-02-12T04:05:00.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.591+0000 7fa6ebfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:00.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.591+0000 7fa6ebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:00.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.591+0000 7fa6ebfff640 10 monclient(hunting): my global_id is 27587 2026-02-12T04:05:00.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.591+0000 7fa6ebfff640 1 -- 10.20.193.91:0/1994760017 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa710144070 con 0x7fa7101575d0 2026-02-12T04:05:00.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.591+0000 7fa6ebfff640 1 -- 10.20.193.91:0/1994760017 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4160914890 0 0) 0x7fa710143d90 con 0x7fa7100560d0 2026-02-12T04:05:00.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.591+0000 7fa6ebfff640 10 monclient(hunting): _negotiate 2026-02-12T04:05:00.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.591+0000 7fa6ebfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:00.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.591+0000 7fa6ebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:00.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.591+0000 7fa6ebfff640 10 monclient(hunting): my global_id is 27892 2026-02-12T04:05:00.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.591+0000 7fa6ebfff640 1 -- 10.20.193.91:0/1994760017 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa710157e20 con 0x7fa7100560d0 2026-02-12T04:05:00.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.593+0000 7fa6ebfff640 1 -- 10.20.193.91:0/1994760017 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 565032560 0 0) 0x7fa710157e20 con 0x7fa7100560d0 2026-02-12T04:05:00.606 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.593+0000 7fa6ebfff640 1 -- 10.20.193.91:0/1994760017 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa710143d90 con 0x7fa7100560d0 2026-02-12T04:05:00.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.593+0000 7fa6ebfff640 1 -- 10.20.193.91:0/1994760017 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fa6fc003310 con 0x7fa7100560d0 2026-02-12T04:05:00.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.593+0000 7fa6ebfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:00.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.593+0000 7fa6ebfff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T04:05:00.607 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.593+0000 7fa6ebfff640 10 monclient(hunting): dump: 2026-02-12T04:05:00.607 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:00.607 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:00.607 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.607 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.607 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:00.607 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:00.607 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:00.607 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:00.608 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:00.608 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.593+0000 7fa6ebfff640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:05:00.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.593+0000 7fa6ebfff640 1 -- 10.20.193.91:0/1994760017 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3066431285 0 0) 0x7fa710144070 con 0x7fa7101575d0 2026-02-12T04:05:00.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.593+0000 7fa6ebfff640 1 -- 10.20.193.91:0/1994760017 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa710157e20 con 0x7fa7101575d0 2026-02-12T04:05:00.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.593+0000 7fa6ebfff640 1 -- 10.20.193.91:0/1994760017 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fa700002fb0 con 0x7fa7101575d0 2026-02-12T04:05:00.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.593+0000 7fa6ebfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:00.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.593+0000 7fa6ebfff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T04:05:00.608 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.593+0000 7fa6ebfff640 10 monclient(hunting): dump: 2026-02-12T04:05:00.608 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:00.608 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:00.608 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.609 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.609 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:00.609 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:00.609 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:00.609 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:00.609 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:00.609 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.593+0000 7fa6ebfff640 1 -- 10.20.193.91:0/1994760017 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2307210084 0 0) 0x7fa6e0003610 con 0x7fa710163310 2026-02-12T04:05:00.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.593+0000 7fa6ebfff640 1 -- 10.20.193.91:0/1994760017 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa710144070 con 0x7fa710163310 2026-02-12T04:05:00.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.593+0000 7fa6ebfff640 1 -- 10.20.193.91:0/1994760017 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fa704003410 con 0x7fa710163310 2026-02-12T04:05:00.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.593+0000 7fa6ebfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:00.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.593+0000 7fa6ebfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T04:05:00.609 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.593+0000 7fa6ebfff640 10 monclient(hunting): dump: 2026-02-12T04:05:00.610 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:00.610 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:00.610 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.610 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.610 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:00.610 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:00.610 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:00.610 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:00.610 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:00.610 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.595+0000 7fa6ebfff640 1 -- 10.20.193.91:0/1994760017 <== mon.1 v1:10.20.193.98:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2878565242 0 0) 0x7fa710143d90 con 0x7fa7100560d0 2026-02-12T04:05:00.610 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.595+0000 7fa6ebfff640 1 -- 10.20.193.91:0/1994760017 >> v1:10.20.193.111:6789/0 conn(0x7fa7101575d0 legacy=0x7fa710136cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:00.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.595+0000 7fa6ebfff640 1 -- 10.20.193.91:0/1994760017 >> v1:10.20.193.91:6789/0 conn(0x7fa710163310 legacy=0x7fa710153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:00.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.595+0000 7fa6ebfff640 10 monclient: _finish_hunting 0 2026-02-12T04:05:00.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.595+0000 7fa6ebfff640 1 monclient: found mon.b 2026-02-12T04:05:00.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.595+0000 7fa6ebfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:05:00.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.595+0000 7fa6ebfff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:05:00.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.595+0000 7fa6ebfff640 1 -- 10.20.193.91:0/1994760017 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa710158100 con 0x7fa7100560d0 2026-02-12T04:05:00.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.595+0000 7fa6ebfff640 10 monclient: _finish_auth 0 2026-02-12T04:05:00.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.595+0000 7fa6ebfff640 10 monclient: _check_auth_tickets 2026-02-12T04:05:00.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.595+0000 7fa6ebfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:05:00.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.595+0000 7fa715c4d640 5 monclient: authenticate success, global_id 27892 2026-02-12T04:05:00.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.595+0000 7fa715c4d640 10 monclient: _renew_subs 2026-02-12T04:05:00.611 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.595+0000 7fa715c4d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:05:00.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.595+0000 7fa715c4d640 1 -- 10.20.193.91:0/1994760017 --> v1:10.20.193.98:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa7101583e0 con 0x7fa7100560d0 2026-02-12T04:05:00.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.595+0000 7fa715c4d640 10 client.27892.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:05:00.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.595+0000 7fa715c4d640 10 monclient: _renew_subs 2026-02-12T04:05:00.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.595+0000 7fa715c4d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:05:00.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.595+0000 7fa715c4d640 1 -- 10.20.193.91:0/1994760017 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa71015a1e0 con 0x7fa7100560d0 2026-02-12T04:05:00.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.595+0000 7fa715c4d640 1 librados: init done 2026-02-12T04:05:00.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.595+0000 7fa715c4d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T04:05:00.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.595+0000 7fa715c4d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:05:00.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.595+0000 7fa715c4d640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:05:00.612 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.595+0000 7fa715c4d640 1 -- 10.20.193.91:0/1994760017 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7100b7290 con 0x7fa7100560d0 2026-02-12T04:05:00.614 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.603+0000 7fa6ebfff640 1 -- 10.20.193.91:0/1994760017 <== mon.1 v1:10.20.193.98:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa6fc002fc0 con 0x7fa7100560d0 2026-02-12T04:05:00.614 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.603+0000 7fa6ebfff640 10 monclient: handle_config config(0 keys) 2026-02-12T04:05:00.614 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.603+0000 7fa6ebfff640 1 -- 10.20.193.91:0/1994760017 <== mon.1 v1:10.20.193.98:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fa6fc004b80 con 0x7fa7100560d0 2026-02-12T04:05:00.614 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.603+0000 7fa6ebfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:00.614 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.603+0000 7fa6ebfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T04:05:00.614 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.603+0000 7fa6ebfff640 10 monclient: dump: 2026-02-12T04:05:00.614 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:00.614 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:00.615 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.615 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.615 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:00.615 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:00.615 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:00.615 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:00.615 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:00.615 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.615 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.603+0000 7fa70dffb640 4 set_mon_vals no callback set 2026-02-12T04:05:00.615 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.603+0000 7fa6ebfff640 1 -- 10.20.193.91:0/1994760017 <== mon.1 v1:10.20.193.98:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7fa6fc01e060 con 0x7fa7100560d0 2026-02-12T04:05:00.615 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.604+0000 7fa70effd640 10 monclient: get_auth_request con 0x7fa6e007a0e0 auth_method 0 2026-02-12T04:05:00.615 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.604+0000 7fa6ebfff640 10 client.27892.objecter ms_handle_connect 0x7fa6e007a0e0 2026-02-12T04:05:00.615 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.604+0000 7fa6ebfff640 1 -- 10.20.193.91:0/1994760017 <== mon.1 v1:10.20.193.98:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7fa6fc095970 con 0x7fa7100560d0 2026-02-12T04:05:00.616 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.604+0000 7fa6ebfff640 10 client.27892.objecter ms_dispatch2 0x7fa710000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:05:00.616 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.604+0000 7fa6ebfff640 3 client.27892.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:05:00.616 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.604+0000 7fa6ebfff640 3 client.27892.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:05:00.616 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.604+0000 7fa6ebfff640 20 client.27892.objecter dump_active .. 0 homeless 2026-02-12T04:05:00.693 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.691+0000 7fa6ebfff640 1 -- 10.20.193.91:0/1994760017 <== mon.1 v1:10.20.193.98:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7fa6fc05f2d0 con 0x7fa7100560d0 2026-02-12T04:05:00.693 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.691+0000 7fa6ebfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:05:00.693 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.691+0000 7fa6ebfff640 10 monclient: _finish_command 1 = system:0 2026-02-12T04:05:00.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.800+0000 7fa715c4d640 1 -- 10.20.193.91:0/1994760017 --> v1:10.20.193.91:6800/2929217192 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "10", "target": ["mon-mgr", ""]}) -- 0x7fa710138070 con 0x7fa6e007a0e0 2026-02-12T04:05:00.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.800+0000 7fa6ebfff640 1 -- 10.20.193.91:0/1994760017 <== mgr.4113 v1:10.20.193.91:6800/2929217192 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 10 to deep-scrub) ==== 42+0+0 (unknown 3896554461 0 0) 0x7fa710138070 con 0x7fa6e007a0e0 2026-02-12T04:05:00.802 INFO:teuthology.orchestra.run.trial091.stderr:instructed osd(s) 10 to deep-scrub 2026-02-12T04:05:00.804 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.801+0000 7fa715c4d640 10 librados: watch_flush enter 2026-02-12T04:05:00.804 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.802+0000 7fa715c4d640 10 librados: watch_flush exit 2026-02-12T04:05:00.804 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.802+0000 7fa715c4d640 20 client.27892.objecter shutdown clearing up homeless session... 2026-02-12T04:05:00.804 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.802+0000 7fa715c4d640 10 client.27892.objecter successfully canceled tick 2026-02-12T04:05:00.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.802+0000 7fa715c4d640 1 -- 10.20.193.91:0/1994760017 >> v1:10.20.193.91:6800/2929217192 conn(0x7fa6e007a0e0 legacy=0x7fa6e009a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:00.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.802+0000 7fa715c4d640 10 monclient: shutdown 2026-02-12T04:05:00.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.802+0000 7fa715c4d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:05:00.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.802+0000 7fa715c4d640 1 -- 10.20.193.91:0/1994760017 >> v1:10.20.193.98:6789/0 conn(0x7fa7100560d0 legacy=0x7fa710158be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:00.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.802+0000 7fa715c4d640 1 -- 10.20.193.91:0/1994760017 shutdown_connections 2026-02-12T04:05:00.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.802+0000 7fa715c4d640 1 -- 10.20.193.91:0/1994760017 >> 10.20.193.91:0/1994760017 conn(0x7fa7100b6560 msgr2=0x7fa7101560f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:05:00.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.802+0000 7fa715c4d640 1 -- 10.20.193.91:0/1994760017 shutdown_connections 2026-02-12T04:05:00.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.802+0000 7fa715c4d640 1 -- 10.20.193.91:0/1994760017 wait complete. 2026-02-12T04:05:00.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.802+0000 7fa715c4d640 1 librados: shutdown 2026-02-12T04:05:00.812 INFO:tasks.ceph:Scrubbing osd.14 2026-02-12T04:05:00.813 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.14 config set osd_debug_deep_scrub_sleep 0 2026-02-12T04:05:00.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.881+0000 7fd07e384640 10 monclient: get_monmap_and_config 2026-02-12T04:05:00.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.881+0000 7fd07e384640 10 monclient: build_initial_monmap 2026-02-12T04:05:00.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.881+0000 7fd07e384640 10 monclient: monmap: 2026-02-12T04:05:00.883 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:05:00.883 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:00.883 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:05:00.881868+0000 2026-02-12T04:05:00.883 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:05:00.881868+0000 2026-02-12T04:05:00.883 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:05:00.884 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:00.884 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:05:00.884 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:05:00.884 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:05:00.884 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.881+0000 7fd07e384640 1 Processor -- start 2026-02-12T04:05:00.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.881+0000 7fd07e384640 1 -- start start 2026-02-12T04:05:00.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.881+0000 7fd07e384640 10 monclient: init 2026-02-12T04:05:00.886 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.882+0000 7fd07e384640 10 monclient: _reopen_session rank -1 2026-02-12T04:05:00.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.882+0000 7fd07e384640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T04:05:00.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.882+0000 7fd07e384640 10 monclient(hunting): picked mon.noname-b con 0x7fd0781599b0 addr v1:10.20.193.98:6789/0 2026-02-12T04:05:00.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.882+0000 7fd07e384640 10 monclient(hunting): picked mon.noname-c con 0x7fd078159d80 addr v1:10.20.193.111:6789/0 2026-02-12T04:05:00.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.882+0000 7fd07e384640 10 monclient(hunting): picked mon.noname-a con 0x7fd0780b1f80 addr v1:10.20.193.91:6789/0 2026-02-12T04:05:00.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.882+0000 7fd07e384640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0780aea80 con 0x7fd0780b1f80 2026-02-12T04:05:00.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.882+0000 7fd07e384640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0780aed10 con 0x7fd0781599b0 2026-02-12T04:05:00.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.882+0000 7fd07e384640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0780aeff0 con 0x7fd078159d80 2026-02-12T04:05:00.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.882+0000 7fd07e384640 10 monclient(hunting): _renew_subs 2026-02-12T04:05:00.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.882+0000 7fd07e384640 10 monclient(hunting): authenticate will time out at 1503.625315s 2026-02-12T04:05:00.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.882+0000 7fd077fff640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7fd0781599b0 0x7fd07805b870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:38298/0 (socket says 10.20.193.91:38298) 2026-02-12T04:05:00.887 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.882+0000 7fd077fff640 1 -- 10.20.193.91:0/1952559128 learned_addr learned my addr 10.20.193.91:0/1952559128 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:05:00.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.884+0000 7fd076ffd640 1 -- 10.20.193.91:0/1952559128 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3013154996 0 0) 0x7fd0780aed10 con 0x7fd0781599b0 2026-02-12T04:05:00.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.884+0000 7fd076ffd640 10 monclient(hunting): _negotiate 2026-02-12T04:05:00.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.884+0000 7fd076ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:00.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.884+0000 7fd076ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:00.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.884+0000 7fd076ffd640 10 monclient(hunting): my global_id is 27895 2026-02-12T04:05:00.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.884+0000 7fd076ffd640 1 -- 10.20.193.91:0/1952559128 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd05c003610 con 0x7fd0781599b0 2026-02-12T04:05:00.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.884+0000 7fd076ffd640 1 -- 10.20.193.91:0/1952559128 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 206831742 0 0) 0x7fd0780aeff0 con 0x7fd078159d80 2026-02-12T04:05:00.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.884+0000 7fd076ffd640 10 monclient(hunting): _negotiate 2026-02-12T04:05:00.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.884+0000 7fd076ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:00.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.884+0000 7fd076ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:00.888 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.884+0000 7fd076ffd640 10 monclient(hunting): my global_id is 27590 2026-02-12T04:05:00.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.884+0000 7fd076ffd640 1 -- 10.20.193.91:0/1952559128 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0780aed10 con 0x7fd078159d80 2026-02-12T04:05:00.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.884+0000 7fd076ffd640 1 -- 10.20.193.91:0/1952559128 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 106497739 0 0) 0x7fd0780aea80 con 0x7fd0780b1f80 2026-02-12T04:05:00.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.884+0000 7fd076ffd640 10 monclient(hunting): _negotiate 2026-02-12T04:05:00.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.884+0000 7fd076ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:00.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.884+0000 7fd076ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:00.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.884+0000 7fd076ffd640 10 monclient(hunting): my global_id is 30753 2026-02-12T04:05:00.889 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.884+0000 7fd076ffd640 1 -- 10.20.193.91:0/1952559128 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0780aeff0 con 0x7fd0780b1f80 2026-02-12T04:05:00.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.885+0000 7fd076ffd640 1 -- 10.20.193.91:0/1952559128 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3251870183 0 0) 0x7fd05c003610 con 0x7fd0781599b0 2026-02-12T04:05:00.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.885+0000 7fd076ffd640 1 -- 10.20.193.91:0/1952559128 >> v1:10.20.193.111:6789/0 conn(0x7fd078159d80 legacy=0x7fd0780ae370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:00.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.885+0000 7fd076ffd640 1 -- 10.20.193.91:0/1952559128 >> v1:10.20.193.91:6789/0 conn(0x7fd0780b1f80 legacy=0x7fd078166700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:00.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.885+0000 7fd076ffd640 10 monclient: _finish_hunting 0 2026-02-12T04:05:00.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.885+0000 7fd076ffd640 1 monclient: found mon.noname-b 2026-02-12T04:05:00.896 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.885+0000 7fd076ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:05:00.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.885+0000 7fd076ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T04:05:00.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.885+0000 7fd076ffd640 1 -- 10.20.193.91:0/1952559128 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0780b0ee0 con 0x7fd0781599b0 2026-02-12T04:05:00.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.886+0000 7fd076ffd640 10 monclient: _finish_auth 0 2026-02-12T04:05:00.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.886+0000 7fd076ffd640 10 monclient: _check_auth_tickets 2026-02-12T04:05:00.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.886+0000 7fd076ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:05:00.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.886+0000 7fd076ffd640 1 -- 10.20.193.91:0/1952559128 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd064002df0 con 0x7fd0781599b0 2026-02-12T04:05:00.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.886+0000 7fd076ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:00.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.886+0000 7fd076ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T04:05:00.897 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.886+0000 7fd076ffd640 10 monclient: dump: 2026-02-12T04:05:00.897 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:00.897 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:00.897 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.897 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.898 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:00.898 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:00.898 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:00.898 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:00.898 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:00.898 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.886+0000 7fd07e384640 5 monclient: authenticate success, global_id 27895 2026-02-12T04:05:00.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.886+0000 7fd07e384640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:05:00.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.886+0000 7fd076ffd640 1 -- 10.20.193.91:0/1952559128 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd064002fc0 con 0x7fd0781599b0 2026-02-12T04:05:00.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.886+0000 7fd076ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T04:05:00.898 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.886+0000 7fd076ffd640 1 -- 10.20.193.91:0/1952559128 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd064003400 con 0x7fd0781599b0 2026-02-12T04:05:00.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.886+0000 7fd07e384640 10 monclient: get_monmap_and_config success 2026-02-12T04:05:00.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.886+0000 7fd07e384640 4 set_mon_vals no callback set 2026-02-12T04:05:00.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.886+0000 7fd076ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:00.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.886+0000 7fd076ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T04:05:00.899 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.886+0000 7fd076ffd640 10 monclient: dump: 2026-02-12T04:05:00.899 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:00.899 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:00.899 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.899 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.899 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:00.899 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:00.899 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:00.899 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:00.900 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:00.900 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.887+0000 7fd07e384640 10 monclient: shutdown 2026-02-12T04:05:00.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.887+0000 7fd07e384640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:05:00.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.887+0000 7fd07e384640 1 -- 10.20.193.91:0/1952559128 >> v1:10.20.193.98:6789/0 conn(0x7fd0781599b0 legacy=0x7fd07805b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:00.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.887+0000 7fd07e384640 1 -- 10.20.193.91:0/1952559128 shutdown_connections 2026-02-12T04:05:00.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.887+0000 7fd07e384640 1 -- 10.20.193.91:0/1952559128 >> 10.20.193.91:0/1952559128 conn(0x7fd0780b6560 msgr2=0x7fd0780b6930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:05:00.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.887+0000 7fd07e384640 1 -- 10.20.193.91:0/1952559128 shutdown_connections 2026-02-12T04:05:00.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.887+0000 7fd07e384640 1 -- 10.20.193.91:0/1952559128 wait complete. 2026-02-12T04:05:00.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.887+0000 7fd07e384640 10 monclient: build_initial_monmap 2026-02-12T04:05:00.900 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.887+0000 7fd07e384640 10 monclient: monmap: 2026-02-12T04:05:00.900 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:05:00.901 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:05:00.901 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:05:00.901 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:05:00.901 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:05:00.901 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:05:00.901 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:05:00.901 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:05:00.901 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:05:00.901 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.887+0000 7fd07e384640 1 librados: starting msgr at 2026-02-12T04:05:00.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.887+0000 7fd07e384640 1 librados: starting objecter 2026-02-12T04:05:00.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.887+0000 7fd07e384640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:05:00.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.887+0000 7fd07e384640 1 Processor -- start 2026-02-12T04:05:00.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.887+0000 7fd07e384640 1 -- start start 2026-02-12T04:05:00.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.887+0000 7fd07e384640 1 librados: setting wanted keys 2026-02-12T04:05:00.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.887+0000 7fd07e384640 1 librados: calling monclient init 2026-02-12T04:05:00.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.887+0000 7fd07e384640 10 monclient: init 2026-02-12T04:05:00.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.888+0000 7fd07e384640 10 monclient: _reopen_session rank -1 2026-02-12T04:05:00.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.888+0000 7fd07e384640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T04:05:00.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.888+0000 7fd07e384640 10 monclient(hunting): picked mon.noname-a con 0x7fd0780b1f80 addr v1:10.20.193.91:6789/0 2026-02-12T04:05:00.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.888+0000 7fd07e384640 10 monclient(hunting): picked mon.noname-c con 0x7fd0781599b0 addr v1:10.20.193.111:6789/0 2026-02-12T04:05:00.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.888+0000 7fd07e384640 10 monclient(hunting): picked mon.noname-b con 0x7fd078159d80 addr v1:10.20.193.98:6789/0 2026-02-12T04:05:00.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.888+0000 7fd07e384640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd078130f00 con 0x7fd0780b1f80 2026-02-12T04:05:00.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.888+0000 7fd07e384640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0781311e0 con 0x7fd078159d80 2026-02-12T04:05:00.902 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.888+0000 7fd07e384640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0781314c0 con 0x7fd0781599b0 2026-02-12T04:05:00.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.888+0000 7fd07e384640 10 monclient(hunting): _renew_subs 2026-02-12T04:05:00.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.888+0000 7fd07e384640 10 monclient(hunting): authenticate will time out at 1503.631242s 2026-02-12T04:05:00.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.888+0000 7fd077fff640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7fd0780b1f80 0x7fd078160380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:39904/0 (socket says 10.20.193.91:39904) 2026-02-12T04:05:00.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.888+0000 7fd077fff640 1 -- 10.20.193.91:0/3614673019 learned_addr learned my addr 10.20.193.91:0/3614673019 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:05:00.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.888+0000 7fd074ff9640 10 client.?.objecter ms_handle_connect 0x7fd0780b1f80 2026-02-12T04:05:00.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.888+0000 7fd074ff9640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:00.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.888+0000 7fd074ff9640 10 client.?.objecter ms_handle_connect 0x7fd0781599b0 2026-02-12T04:05:00.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.888+0000 7fd074ff9640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:00.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.888+0000 7fd074ff9640 10 client.?.objecter ms_handle_connect 0x7fd078159d80 2026-02-12T04:05:00.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.888+0000 7fd074ff9640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:00.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.889+0000 7fd074ff9640 1 -- 10.20.193.91:0/3614673019 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2373171255 0 0) 0x7fd078130f00 con 0x7fd0780b1f80 2026-02-12T04:05:00.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.889+0000 7fd074ff9640 10 monclient(hunting): _negotiate 2026-02-12T04:05:00.903 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.889+0000 7fd074ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:00.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.889+0000 7fd074ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:00.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.889+0000 7fd074ff9640 10 monclient(hunting): my global_id is 30756 2026-02-12T04:05:00.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.889+0000 7fd074ff9640 1 -- 10.20.193.91:0/3614673019 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd048003610 con 0x7fd0780b1f80 2026-02-12T04:05:00.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.889+0000 7fd074ff9640 1 -- 10.20.193.91:0/3614673019 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4207028147 0 0) 0x7fd0781311e0 con 0x7fd078159d80 2026-02-12T04:05:00.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.889+0000 7fd074ff9640 10 monclient(hunting): _negotiate 2026-02-12T04:05:00.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.889+0000 7fd074ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:00.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.889+0000 7fd074ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:00.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.889+0000 7fd074ff9640 10 monclient(hunting): my global_id is 27898 2026-02-12T04:05:00.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.889+0000 7fd074ff9640 1 -- 10.20.193.91:0/3614673019 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd078130f00 con 0x7fd078159d80 2026-02-12T04:05:00.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.890+0000 7fd074ff9640 1 -- 10.20.193.91:0/3614673019 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 340340099 0 0) 0x7fd0781314c0 con 0x7fd0781599b0 2026-02-12T04:05:00.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.890+0000 7fd074ff9640 10 monclient(hunting): _negotiate 2026-02-12T04:05:00.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.890+0000 7fd074ff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:00.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.890+0000 7fd074ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:00.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.890+0000 7fd074ff9640 10 monclient(hunting): my global_id is 27593 2026-02-12T04:05:00.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.890+0000 7fd074ff9640 1 -- 10.20.193.91:0/3614673019 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0781311e0 con 0x7fd0781599b0 2026-02-12T04:05:00.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.891+0000 7fd074ff9640 1 -- 10.20.193.91:0/3614673019 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1901902442 0 0) 0x7fd048003610 con 0x7fd0780b1f80 2026-02-12T04:05:00.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.891+0000 7fd074ff9640 1 -- 10.20.193.91:0/3614673019 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd0781314c0 con 0x7fd0780b1f80 2026-02-12T04:05:00.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.891+0000 7fd074ff9640 1 -- 10.20.193.91:0/3614673019 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd0640033f0 con 0x7fd0780b1f80 2026-02-12T04:05:00.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.891+0000 7fd074ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:00.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.891+0000 7fd074ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T04:05:00.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.891+0000 7fd074ff9640 10 monclient(hunting): dump: 2026-02-12T04:05:00.905 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:00.905 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:00.906 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.906 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.906 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:00.906 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:00.906 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:00.906 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:00.906 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:00.906 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.891+0000 7fd074ff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:05:00.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.892+0000 7fd074ff9640 1 -- 10.20.193.91:0/3614673019 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1732969024 0 0) 0x7fd078130f00 con 0x7fd078159d80 2026-02-12T04:05:00.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.892+0000 7fd074ff9640 1 -- 10.20.193.91:0/3614673019 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd048003610 con 0x7fd078159d80 2026-02-12T04:05:00.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.892+0000 7fd074ff9640 1 -- 10.20.193.91:0/3614673019 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd06c003410 con 0x7fd078159d80 2026-02-12T04:05:00.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.892+0000 7fd074ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:00.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.892+0000 7fd074ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T04:05:00.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.892+0000 7fd074ff9640 10 monclient(hunting): dump: 2026-02-12T04:05:00.907 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:00.907 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:00.907 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.907 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.907 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:00.907 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:00.907 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:00.907 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:00.907 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:00.908 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.892+0000 7fd074ff9640 1 -- 10.20.193.91:0/3614673019 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 498839211 0 0) 0x7fd0781311e0 con 0x7fd0781599b0 2026-02-12T04:05:00.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.892+0000 7fd074ff9640 1 -- 10.20.193.91:0/3614673019 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd078130f00 con 0x7fd0781599b0 2026-02-12T04:05:00.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.892+0000 7fd074ff9640 1 -- 10.20.193.91:0/3614673019 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd068002ff0 con 0x7fd0781599b0 2026-02-12T04:05:00.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.892+0000 7fd074ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:00.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.892+0000 7fd074ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T04:05:00.908 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.892+0000 7fd074ff9640 10 monclient(hunting): dump: 2026-02-12T04:05:00.908 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:00.908 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:00.908 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.908 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.908 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:00.908 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:00.909 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:00.909 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:00.909 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:00.909 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.893+0000 7fd074ff9640 1 -- 10.20.193.91:0/3614673019 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3306186969 0 0) 0x7fd0781314c0 con 0x7fd0780b1f80 2026-02-12T04:05:00.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.893+0000 7fd074ff9640 1 -- 10.20.193.91:0/3614673019 >> v1:10.20.193.111:6789/0 conn(0x7fd0781599b0 legacy=0x7fd0781302f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:00.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.893+0000 7fd074ff9640 1 -- 10.20.193.91:0/3614673019 >> v1:10.20.193.98:6789/0 conn(0x7fd078159d80 legacy=0x7fd07815ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:00.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.893+0000 7fd074ff9640 10 monclient: _finish_hunting 0 2026-02-12T04:05:00.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.893+0000 7fd074ff9640 1 monclient: found mon.a 2026-02-12T04:05:00.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.893+0000 7fd074ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:05:00.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.893+0000 7fd074ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:05:00.909 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.893+0000 7fd074ff9640 1 -- 10.20.193.91:0/3614673019 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0781317a0 con 0x7fd0780b1f80 2026-02-12T04:05:00.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.893+0000 7fd074ff9640 10 monclient: _finish_auth 0 2026-02-12T04:05:00.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.893+0000 7fd074ff9640 10 monclient: _check_auth_tickets 2026-02-12T04:05:00.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.893+0000 7fd074ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:05:00.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.893+0000 7fd07e384640 5 monclient: authenticate success, global_id 30756 2026-02-12T04:05:00.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.893+0000 7fd07e384640 10 monclient: _renew_subs 2026-02-12T04:05:00.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.893+0000 7fd07e384640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:05:00.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.893+0000 7fd07e384640 1 -- 10.20.193.91:0/3614673019 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd078131a80 con 0x7fd0780b1f80 2026-02-12T04:05:00.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.893+0000 7fd07e384640 10 client.30756.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:05:00.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.893+0000 7fd07e384640 10 monclient: _renew_subs 2026-02-12T04:05:00.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.893+0000 7fd07e384640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:05:00.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.893+0000 7fd07e384640 1 -- 10.20.193.91:0/3614673019 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd078131d60 con 0x7fd0780b1f80 2026-02-12T04:05:00.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.893+0000 7fd07e384640 1 librados: init done 2026-02-12T04:05:00.910 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.893+0000 7fd07e384640 10 client.30756.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:05:00.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.893+0000 7fd07e384640 15 client.30756.objecter _session_command_op_assign -1 1 2026-02-12T04:05:00.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.893+0000 7fd07e384640 20 client.30756.objecter _get_session osd=-1 returning homeless 2026-02-12T04:05:00.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.893+0000 7fd07e384640 10 client.30756.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:05:00.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.893+0000 7fd07e384640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:05:00.911 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.893+0000 7fd07e384640 1 -- 10.20.193.91:0/3614673019 --> v1:10.20.193.91:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fd078135a90 con 0x7fd0780b1f80 2026-02-12T04:05:00.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.902+0000 7fd074ff9640 1 -- 10.20.193.91:0/3614673019 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd078135a90 con 0x7fd0780b1f80 2026-02-12T04:05:00.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.902+0000 7fd074ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T04:05:00.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.902+0000 7fd074ff9640 1 -- 10.20.193.91:0/3614673019 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd064004b80 con 0x7fd0780b1f80 2026-02-12T04:05:00.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.902+0000 7fd074ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:00.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.902+0000 7fd074ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T04:05:00.914 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.902+0000 7fd074ff9640 10 monclient: dump: 2026-02-12T04:05:00.914 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:00.914 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:00.914 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.914 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:00.914 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:00.914 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:00.914 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:00.914 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:00.914 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:00.914 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:00.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.902+0000 7fd0767fc640 4 set_mon_vals no callback set 2026-02-12T04:05:00.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.903+0000 7fd074ff9640 1 -- 10.20.193.91:0/3614673019 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7fd06401e060 con 0x7fd0780b1f80 2026-02-12T04:05:00.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.904+0000 7fd0777fe640 10 monclient: get_auth_request con 0x7fd04807a070 auth_method 0 2026-02-12T04:05:00.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.904+0000 7fd074ff9640 10 client.30756.objecter ms_handle_connect 0x7fd04807a070 2026-02-12T04:05:00.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.904+0000 7fd074ff9640 1 -- 10.20.193.91:0/3614673019 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7fd0640958a0 con 0x7fd0780b1f80 2026-02-12T04:05:00.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.904+0000 7fd074ff9640 10 client.30756.objecter ms_dispatch2 0x7fd078000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:05:00.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.904+0000 7fd074ff9640 3 client.30756.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:05:00.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.904+0000 7fd074ff9640 3 client.30756.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:05:00.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.904+0000 7fd074ff9640 10 client.30756.objecter checking command 1 2026-02-12T04:05:00.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.904+0000 7fd074ff9640 20 client.30756.objecter _get_session s=0x7fd0480a4320 osd=14 3 2026-02-12T04:05:00.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.904+0000 7fd074ff9640 20 client.30756.objecter put_session s=0x7fd0480a4320 osd=14 3 2026-02-12T04:05:00.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.904+0000 7fd074ff9640 15 client.30756.objecter _session_command_op_remove -1 1 2026-02-12T04:05:00.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.904+0000 7fd074ff9640 20 client.30756.objecter _get_session s=0x7fd0480a4320 osd=14 3 2026-02-12T04:05:00.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.904+0000 7fd074ff9640 20 client.30756.objecter get_session s=0x7fd0480a4320 osd=14 3 2026-02-12T04:05:00.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.904+0000 7fd074ff9640 15 client.30756.objecter _session_command_op_assign 14 1 2026-02-12T04:05:00.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.904+0000 7fd074ff9640 20 client.30756.objecter put_session s=0x7fd0480a4320 osd=14 4 2026-02-12T04:05:00.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.904+0000 7fd074ff9640 10 client.30756.objecter _send_command 1 2026-02-12T04:05:00.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.904+0000 7fd074ff9640 1 -- 10.20.193.91:0/3614673019 --> v1:10.20.193.111:6800/1665676360 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd0480c6630 con 0x7fd0480a49d0 2026-02-12T04:05:00.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.904+0000 7fd074ff9640 20 client.30756.objecter dump_active .. 0 homeless 2026-02-12T04:05:00.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.904+0000 7fd074ff9640 1 -- 10.20.193.91:0/3614673019 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_get_version_reply(handle=1 version=344) ==== 24+0+0 (unknown 1403447244 0 0) 0x7fd06405ae70 con 0x7fd0780b1f80 2026-02-12T04:05:00.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.904+0000 7fd074ff9640 10 monclient: handle_get_version_reply finishing 1 version 344 2026-02-12T04:05:00.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.905+0000 7fd07c8fa640 10 monclient: get_auth_request con 0x7fd0480a49d0 auth_method 0 2026-02-12T04:05:00.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.906+0000 7fd074ff9640 10 client.30756.objecter ms_handle_connect 0x7fd0480a49d0 2026-02-12T04:05:00.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.916+0000 7fd074ff9640 1 -- 10.20.193.91:0/3614673019 <== osd.14 v1:10.20.193.111:6800/1665676360 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fd0480c6630 con 0x7fd0480a49d0 2026-02-12T04:05:00.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.916+0000 7fd074ff9640 10 client.30756.objecter ms_dispatch2 0x7fd078000b90 command_reply(tid 1: 0 ) 2026-02-12T04:05:00.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.916+0000 7fd074ff9640 10 client.30756.objecter _finish_command 1 = system:0 2026-02-12T04:05:00.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.916+0000 7fd074ff9640 20 client.30756.objecter put_session s=0x7fd0480a4320 osd=14 4 2026-02-12T04:05:00.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.916+0000 7fd074ff9640 15 client.30756.objecter _session_command_op_remove 14 1 2026-02-12T04:05:00.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.923+0000 7fd07e384640 10 client.30756.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-12T04:05:00.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.923+0000 7fd07e384640 15 client.30756.objecter _session_command_op_assign -1 2 2026-02-12T04:05:00.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.923+0000 7fd07e384640 20 client.30756.objecter _get_session s=0x7fd0480a4320 osd=14 3 2026-02-12T04:05:00.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.923+0000 7fd07e384640 20 client.30756.objecter put_session s=0x7fd0480a4320 osd=14 3 2026-02-12T04:05:00.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.923+0000 7fd07e384640 20 client.30756.objecter _get_session s=0x7fd0480a4320 osd=14 3 2026-02-12T04:05:00.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.923+0000 7fd07e384640 15 client.30756.objecter _session_command_op_remove -1 2 2026-02-12T04:05:00.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.923+0000 7fd07e384640 20 client.30756.objecter get_session s=0x7fd0480a4320 osd=14 3 2026-02-12T04:05:00.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.923+0000 7fd07e384640 15 client.30756.objecter _session_command_op_assign 14 2 2026-02-12T04:05:00.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.923+0000 7fd07e384640 20 client.30756.objecter put_session s=0x7fd0480a4320 osd=14 4 2026-02-12T04:05:00.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.923+0000 7fd07e384640 10 client.30756.objecter _send_command 2 2026-02-12T04:05:00.926 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.923+0000 7fd07e384640 1 -- 10.20.193.91:0/3614673019 --> v1:10.20.193.111:6800/1665676360 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd07805d7e0 con 0x7fd0480a49d0 2026-02-12T04:05:00.933 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.931+0000 7fd074ff9640 1 -- 10.20.193.91:0/3614673019 <== osd.14 v1:10.20.193.111:6800/1665676360 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fd07805d7e0 con 0x7fd0480a49d0 2026-02-12T04:05:00.933 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.931+0000 7fd074ff9640 10 client.30756.objecter ms_dispatch2 0x7fd078000b90 command_reply(tid 2: 0 ) 2026-02-12T04:05:00.933 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.931+0000 7fd074ff9640 10 client.30756.objecter _finish_command 2 = system:0 2026-02-12T04:05:00.933 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.931+0000 7fd074ff9640 20 client.30756.objecter put_session s=0x7fd0480a4320 osd=14 4 2026-02-12T04:05:00.933 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.931+0000 7fd074ff9640 15 client.30756.objecter _session_command_op_remove 14 2 2026-02-12T04:05:00.934 INFO:teuthology.orchestra.run.trial091.stdout:{ 2026-02-12T04:05:00.934 INFO:teuthology.orchestra.run.trial091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-12T04:05:00.934 INFO:teuthology.orchestra.run.trial091.stdout:} 2026-02-12T04:05:00.935 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.931+0000 7fd07e384640 10 librados: watch_flush enter 2026-02-12T04:05:00.935 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.931+0000 7fd07e384640 10 librados: watch_flush exit 2026-02-12T04:05:00.935 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.931+0000 7fd07e384640 10 client.30756.objecter close_session for osd.14 2026-02-12T04:05:00.935 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.931+0000 7fd07e384640 1 -- 10.20.193.91:0/3614673019 >> v1:10.20.193.111:6800/1665676360 conn(0x7fd0480a49d0 legacy=0x7fd0480c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:00.936 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.931+0000 7fd07e384640 20 client.30756.objecter put_session s=0x7fd0480a4320 osd=14 1 2026-02-12T04:05:00.936 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.931+0000 7fd07e384640 20 client.30756.objecter shutdown clearing up homeless session... 2026-02-12T04:05:00.936 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.931+0000 7fd07e384640 10 client.30756.objecter successfully canceled tick 2026-02-12T04:05:00.936 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.931+0000 7fd07e384640 1 -- 10.20.193.91:0/3614673019 >> v1:10.20.193.91:6800/2929217192 conn(0x7fd04807a070 legacy=0x7fd04809a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:00.936 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.931+0000 7fd07e384640 10 monclient: shutdown 2026-02-12T04:05:00.936 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.931+0000 7fd07e384640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:05:00.936 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.931+0000 7fd07e384640 1 -- 10.20.193.91:0/3614673019 >> v1:10.20.193.91:6789/0 conn(0x7fd0780b1f80 legacy=0x7fd078160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:00.936 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.931+0000 7fd07c8fa640 1 -- 10.20.193.91:0/3614673019 reap_dead start 2026-02-12T04:05:00.936 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.931+0000 7fd07e384640 1 -- 10.20.193.91:0/3614673019 shutdown_connections 2026-02-12T04:05:00.936 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.931+0000 7fd07e384640 1 -- 10.20.193.91:0/3614673019 >> 10.20.193.91:0/3614673019 conn(0x7fd0780b6560 msgr2=0x7fd0780b6930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:05:00.936 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.931+0000 7fd07e384640 1 -- 10.20.193.91:0/3614673019 shutdown_connections 2026-02-12T04:05:00.936 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.931+0000 7fd07e384640 1 -- 10.20.193.91:0/3614673019 wait complete. 2026-02-12T04:05:00.937 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:00.931+0000 7fd07e384640 1 librados: shutdown 2026-02-12T04:05:00.940 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 14 2026-02-12T04:05:01.007 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.006+0000 7fdcc91ef640 10 monclient: get_monmap_and_config 2026-02-12T04:05:01.008 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.006+0000 7fdcc91ef640 10 monclient: build_initial_monmap 2026-02-12T04:05:01.008 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.006+0000 7fdcc91ef640 10 monclient: monmap: 2026-02-12T04:05:01.008 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:05:01.008 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:01.008 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:05:01.006739+0000 2026-02-12T04:05:01.008 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:05:01.006739+0000 2026-02-12T04:05:01.008 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:05:01.008 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:01.008 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:05:01.009 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:05:01.009 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:05:01.009 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.006+0000 7fdcc91ef640 1 Processor -- start 2026-02-12T04:05:01.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.006+0000 7fdcc91ef640 1 -- start start 2026-02-12T04:05:01.011 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.006+0000 7fdcc91ef640 10 monclient: init 2026-02-12T04:05:01.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.007+0000 7fdcc91ef640 10 monclient: _reopen_session rank -1 2026-02-12T04:05:01.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.007+0000 7fdcc91ef640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T04:05:01.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.007+0000 7fdcc91ef640 10 monclient(hunting): picked mon.noname-b con 0x7fdcc41575d0 addr v1:10.20.193.98:6789/0 2026-02-12T04:05:01.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.007+0000 7fdcc91ef640 10 monclient(hunting): picked mon.noname-a con 0x7fdcc4163310 addr v1:10.20.193.91:6789/0 2026-02-12T04:05:01.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.007+0000 7fdcc91ef640 10 monclient(hunting): picked mon.noname-c con 0x7fdcc40560d0 addr v1:10.20.193.111:6789/0 2026-02-12T04:05:01.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.007+0000 7fdcc91ef640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcc40b20b0 con 0x7fdcc4163310 2026-02-12T04:05:01.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.007+0000 7fdcc91ef640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcc40b2390 con 0x7fdcc41575d0 2026-02-12T04:05:01.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.007+0000 7fdcc91ef640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcc40b2670 con 0x7fdcc40560d0 2026-02-12T04:05:01.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.007+0000 7fdcc91ef640 10 monclient(hunting): _renew_subs 2026-02-12T04:05:01.012 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.007+0000 7fdcc91ef640 10 monclient(hunting): authenticate will time out at 1503.750199s 2026-02-12T04:05:01.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.007+0000 7fdcc2575640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7fdcc4163310 0x7fdcc40559c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:39916/0 (socket says 10.20.193.91:39916) 2026-02-12T04:05:01.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.007+0000 7fdcc3577640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7fdcc40560d0 0x7fdcc41c56f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:55970/0 (socket says 10.20.193.91:55970) 2026-02-12T04:05:01.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.007+0000 7fdcc2575640 1 -- 10.20.193.91:0/2755977163 learned_addr learned my addr 10.20.193.91:0/2755977163 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:05:01.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.008+0000 7fdcc1d74640 1 -- 10.20.193.91:0/2755977163 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2237567856 0 0) 0x7fdcc40b20b0 con 0x7fdcc4163310 2026-02-12T04:05:01.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.008+0000 7fdcc1d74640 10 monclient(hunting): _negotiate 2026-02-12T04:05:01.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.008+0000 7fdcc1d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:01.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.008+0000 7fdcc1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:01.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.008+0000 7fdcc1d74640 10 monclient(hunting): my global_id is 30759 2026-02-12T04:05:01.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.008+0000 7fdcc1d74640 1 -- 10.20.193.91:0/2755977163 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdcb0003610 con 0x7fdcc4163310 2026-02-12T04:05:01.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.009+0000 7fdcc1d74640 1 -- 10.20.193.91:0/2755977163 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 569747551 0 0) 0x7fdcc40b2670 con 0x7fdcc40560d0 2026-02-12T04:05:01.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.009+0000 7fdcc1d74640 10 monclient(hunting): _negotiate 2026-02-12T04:05:01.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.009+0000 7fdcc1d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:01.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.009+0000 7fdcc1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:01.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.009+0000 7fdcc1d74640 10 monclient(hunting): my global_id is 27596 2026-02-12T04:05:01.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.009+0000 7fdcc1d74640 1 -- 10.20.193.91:0/2755977163 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdcc40b20b0 con 0x7fdcc40560d0 2026-02-12T04:05:01.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.009+0000 7fdcc1d74640 1 -- 10.20.193.91:0/2755977163 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3017816143 0 0) 0x7fdcc40b2390 con 0x7fdcc41575d0 2026-02-12T04:05:01.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.009+0000 7fdcc1d74640 10 monclient(hunting): _negotiate 2026-02-12T04:05:01.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.009+0000 7fdcc1d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:01.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.009+0000 7fdcc1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:01.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.009+0000 7fdcc1d74640 10 monclient(hunting): my global_id is 27901 2026-02-12T04:05:01.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.009+0000 7fdcc1d74640 1 -- 10.20.193.91:0/2755977163 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdcc40b2670 con 0x7fdcc41575d0 2026-02-12T04:05:01.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.010+0000 7fdcc1d74640 1 -- 10.20.193.91:0/2755977163 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1545903358 0 0) 0x7fdcb0003610 con 0x7fdcc4163310 2026-02-12T04:05:01.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.010+0000 7fdcc1d74640 1 -- 10.20.193.91:0/2755977163 >> v1:10.20.193.111:6789/0 conn(0x7fdcc40560d0 legacy=0x7fdcc41c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:01.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.010+0000 7fdcc1d74640 1 -- 10.20.193.91:0/2755977163 >> v1:10.20.193.98:6789/0 conn(0x7fdcc41575d0 legacy=0x7fdcc4162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:01.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.010+0000 7fdcc1d74640 10 monclient: _finish_hunting 0 2026-02-12T04:05:01.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.010+0000 7fdcc1d74640 1 monclient: found mon.noname-a 2026-02-12T04:05:01.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.010+0000 7fdcc1d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:05:01.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.010+0000 7fdcc1d74640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.91:6789/0 2026-02-12T04:05:01.022 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.010+0000 7fdcc1d74640 1 -- 10.20.193.91:0/2755977163 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc4162400 con 0x7fdcc4163310 2026-02-12T04:05:01.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.010+0000 7fdcc1d74640 10 monclient: _finish_auth 0 2026-02-12T04:05:01.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.010+0000 7fdcc1d74640 10 monclient: _check_auth_tickets 2026-02-12T04:05:01.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.010+0000 7fdcc1d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:05:01.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.010+0000 7fdcc1d74640 1 -- 10.20.193.91:0/2755977163 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fdcac002df0 con 0x7fdcc4163310 2026-02-12T04:05:01.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.010+0000 7fdcc1d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:01.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.010+0000 7fdcc1d74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T04:05:01.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.010+0000 7fdcc1d74640 10 monclient: dump: 2026-02-12T04:05:01.023 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:01.023 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:01.023 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.023 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.023 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:01.023 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:01.024 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:01.024 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:01.024 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:01.024 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.010+0000 7fdcc91ef640 5 monclient: authenticate success, global_id 30759 2026-02-12T04:05:01.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.010+0000 7fdcc91ef640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:05:01.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.011+0000 7fdcc1d74640 1 -- 10.20.193.91:0/2755977163 <== mon.0 v1:10.20.193.91:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdcac002fc0 con 0x7fdcc4163310 2026-02-12T04:05:01.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.011+0000 7fdcc1d74640 10 monclient: handle_config config(0 keys) 2026-02-12T04:05:01.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.011+0000 7fdcc1d74640 1 -- 10.20.193.91:0/2755977163 <== mon.0 v1:10.20.193.91:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fdcac003400 con 0x7fdcc4163310 2026-02-12T04:05:01.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.011+0000 7fdcc1d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:01.024 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.011+0000 7fdcc1d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T04:05:01.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.011+0000 7fdcc1d74640 10 monclient: dump: 2026-02-12T04:05:01.025 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:01.025 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:01.025 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.025 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.025 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:01.025 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:01.025 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:01.025 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:01.025 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:01.025 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.011+0000 7fdcc91ef640 10 monclient: get_monmap_and_config success 2026-02-12T04:05:01.025 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.011+0000 7fdcc91ef640 4 set_mon_vals no callback set 2026-02-12T04:05:01.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.012+0000 7fdcc91ef640 10 monclient: shutdown 2026-02-12T04:05:01.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.012+0000 7fdcc91ef640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:05:01.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.012+0000 7fdcc91ef640 1 -- 10.20.193.91:0/2755977163 >> v1:10.20.193.91:6789/0 conn(0x7fdcc4163310 legacy=0x7fdcc40559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:01.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.012+0000 7fdcc91ef640 1 -- 10.20.193.91:0/2755977163 shutdown_connections 2026-02-12T04:05:01.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.012+0000 7fdcc91ef640 1 -- 10.20.193.91:0/2755977163 >> 10.20.193.91:0/2755977163 conn(0x7fdcc40b6560 msgr2=0x7fdcc40b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:05:01.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.012+0000 7fdcc91ef640 1 -- 10.20.193.91:0/2755977163 shutdown_connections 2026-02-12T04:05:01.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.012+0000 7fdcc91ef640 1 -- 10.20.193.91:0/2755977163 wait complete. 2026-02-12T04:05:01.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.012+0000 7fdcc91ef640 10 monclient: build_initial_monmap 2026-02-12T04:05:01.026 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.012+0000 7fdcc91ef640 10 monclient: monmap: 2026-02-12T04:05:01.026 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:05:01.026 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:05:01.026 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:05:01.027 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:05:01.027 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:05:01.027 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:05:01.027 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:05:01.027 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:05:01.027 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:05:01.027 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.027 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.012+0000 7fdcc91ef640 1 librados: starting msgr at 2026-02-12T04:05:01.027 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.012+0000 7fdcc91ef640 1 librados: starting objecter 2026-02-12T04:05:01.027 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.012+0000 7fdcc91ef640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:05:01.027 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.012+0000 7fdcc91ef640 1 Processor -- start 2026-02-12T04:05:01.027 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.012+0000 7fdcc91ef640 1 -- start start 2026-02-12T04:05:01.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.012+0000 7fdcc91ef640 1 librados: setting wanted keys 2026-02-12T04:05:01.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.012+0000 7fdcc91ef640 1 librados: calling monclient init 2026-02-12T04:05:01.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.012+0000 7fdcc91ef640 10 monclient: init 2026-02-12T04:05:01.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.013+0000 7fdcc91ef640 10 monclient: _reopen_session rank -1 2026-02-12T04:05:01.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.013+0000 7fdcc91ef640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T04:05:01.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.013+0000 7fdcc91ef640 10 monclient(hunting): picked mon.noname-b con 0x7fdcc40560d0 addr v1:10.20.193.98:6789/0 2026-02-12T04:05:01.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.013+0000 7fdcc91ef640 10 monclient(hunting): picked mon.noname-c con 0x7fdcc41575d0 addr v1:10.20.193.111:6789/0 2026-02-12T04:05:01.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.013+0000 7fdcc91ef640 10 monclient(hunting): picked mon.noname-a con 0x7fdcc4163310 addr v1:10.20.193.91:6789/0 2026-02-12T04:05:01.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.013+0000 7fdcc91ef640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcc411c540 con 0x7fdcc4163310 2026-02-12T04:05:01.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.013+0000 7fdcc91ef640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcc4151cc0 con 0x7fdcc40560d0 2026-02-12T04:05:01.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.013+0000 7fdcc91ef640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcc4151fa0 con 0x7fdcc41575d0 2026-02-12T04:05:01.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.013+0000 7fdcc91ef640 10 monclient(hunting): _renew_subs 2026-02-12T04:05:01.028 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.013+0000 7fdcc91ef640 10 monclient(hunting): authenticate will time out at 1503.756302s 2026-02-12T04:05:01.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.013+0000 7fdcc2d76640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7fdcc40560d0 0x7fdcc40ad860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:38328/0 (socket says 10.20.193.91:38328) 2026-02-12T04:05:01.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.013+0000 7fdcc2d76640 1 -- 10.20.193.91:0/4078307806 learned_addr learned my addr 10.20.193.91:0/4078307806 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:05:01.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.013+0000 7fdca37fe640 10 client.?.objecter ms_handle_connect 0x7fdcc40560d0 2026-02-12T04:05:01.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.013+0000 7fdca37fe640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:01.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.014+0000 7fdca37fe640 10 client.?.objecter ms_handle_connect 0x7fdcc41575d0 2026-02-12T04:05:01.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.014+0000 7fdca37fe640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:01.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.014+0000 7fdca37fe640 1 -- 10.20.193.91:0/4078307806 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2577673395 0 0) 0x7fdcc4151cc0 con 0x7fdcc40560d0 2026-02-12T04:05:01.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.014+0000 7fdca37fe640 10 monclient(hunting): _negotiate 2026-02-12T04:05:01.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.014+0000 7fdca37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:01.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.014+0000 7fdca37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:01.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.014+0000 7fdca37fe640 10 monclient(hunting): my global_id is 27904 2026-02-12T04:05:01.029 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.014+0000 7fdca37fe640 1 -- 10.20.193.91:0/4078307806 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc90003610 con 0x7fdcc40560d0 2026-02-12T04:05:01.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.015+0000 7fdca37fe640 1 -- 10.20.193.91:0/4078307806 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3668164058 0 0) 0x7fdcc4151fa0 con 0x7fdcc41575d0 2026-02-12T04:05:01.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.015+0000 7fdca37fe640 10 monclient(hunting): _negotiate 2026-02-12T04:05:01.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.015+0000 7fdca37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:01.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.015+0000 7fdca37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:01.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.015+0000 7fdca37fe640 10 monclient(hunting): my global_id is 27599 2026-02-12T04:05:01.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.015+0000 7fdca37fe640 1 -- 10.20.193.91:0/4078307806 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdcc4151cc0 con 0x7fdcc41575d0 2026-02-12T04:05:01.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.015+0000 7fdca37fe640 10 client.?.objecter ms_handle_connect 0x7fdcc4163310 2026-02-12T04:05:01.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.015+0000 7fdca37fe640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:01.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.016+0000 7fdca37fe640 1 -- 10.20.193.91:0/4078307806 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3659947261 0 0) 0x7fdcc411c540 con 0x7fdcc4163310 2026-02-12T04:05:01.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.016+0000 7fdca37fe640 10 monclient(hunting): _negotiate 2026-02-12T04:05:01.030 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.016+0000 7fdca37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:01.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.016+0000 7fdca37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:01.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.016+0000 7fdca37fe640 10 monclient(hunting): my global_id is 30762 2026-02-12T04:05:01.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.016+0000 7fdca37fe640 1 -- 10.20.193.91:0/4078307806 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdcc4151fa0 con 0x7fdcc4163310 2026-02-12T04:05:01.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.017+0000 7fdca37fe640 1 -- 10.20.193.91:0/4078307806 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2887151486 0 0) 0x7fdcc4151cc0 con 0x7fdcc41575d0 2026-02-12T04:05:01.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.017+0000 7fdca37fe640 1 -- 10.20.193.91:0/4078307806 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdcc411c540 con 0x7fdcc41575d0 2026-02-12T04:05:01.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.017+0000 7fdca37fe640 1 -- 10.20.193.91:0/4078307806 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fdcac003310 con 0x7fdcc41575d0 2026-02-12T04:05:01.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.017+0000 7fdca37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:01.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.017+0000 7fdca37fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T04:05:01.031 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.017+0000 7fdca37fe640 10 monclient(hunting): dump: 2026-02-12T04:05:01.031 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:01.031 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:01.031 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.031 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.032 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:01.032 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:01.032 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:01.032 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:01.032 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:01.032 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.017+0000 7fdca37fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:05:01.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.017+0000 7fdca37fe640 1 -- 10.20.193.91:0/4078307806 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3299481697 0 0) 0x7fdc90003610 con 0x7fdcc40560d0 2026-02-12T04:05:01.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.017+0000 7fdca37fe640 1 -- 10.20.193.91:0/4078307806 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdcc4151cc0 con 0x7fdcc40560d0 2026-02-12T04:05:01.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.017+0000 7fdca37fe640 1 -- 10.20.193.91:0/4078307806 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fdcb8003170 con 0x7fdcc40560d0 2026-02-12T04:05:01.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.017+0000 7fdca37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:01.032 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.017+0000 7fdca37fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T04:05:01.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.017+0000 7fdca37fe640 10 monclient(hunting): dump: 2026-02-12T04:05:01.033 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:01.033 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:01.033 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.033 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.033 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:01.033 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:01.033 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:01.033 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:01.033 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:01.033 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.033 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.019+0000 7fdca37fe640 1 -- 10.20.193.91:0/4078307806 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3466993669 0 0) 0x7fdcc4151fa0 con 0x7fdcc4163310 2026-02-12T04:05:01.034 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.019+0000 7fdca37fe640 1 -- 10.20.193.91:0/4078307806 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdc90003610 con 0x7fdcc4163310 2026-02-12T04:05:01.034 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.019+0000 7fdca37fe640 1 -- 10.20.193.91:0/4078307806 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fdcb4003430 con 0x7fdcc4163310 2026-02-12T04:05:01.034 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.019+0000 7fdca37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:01.034 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.019+0000 7fdca37fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T04:05:01.034 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.019+0000 7fdca37fe640 10 monclient(hunting): dump: 2026-02-12T04:05:01.034 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:01.034 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:01.034 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.034 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.034 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:01.034 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:01.034 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:01.034 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:01.035 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:01.035 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.035 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.019+0000 7fdca37fe640 1 -- 10.20.193.91:0/4078307806 <== mon.2 v1:10.20.193.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3491403545 0 0) 0x7fdcc411c540 con 0x7fdcc41575d0 2026-02-12T04:05:01.035 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.019+0000 7fdca37fe640 1 -- 10.20.193.91:0/4078307806 >> v1:10.20.193.98:6789/0 conn(0x7fdcc40560d0 legacy=0x7fdcc40ad860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:01.035 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.019+0000 7fdca37fe640 1 -- 10.20.193.91:0/4078307806 >> v1:10.20.193.91:6789/0 conn(0x7fdcc4163310 legacy=0x7fdcc41255b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:01.035 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.019+0000 7fdca37fe640 10 monclient: _finish_hunting 0 2026-02-12T04:05:01.035 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.019+0000 7fdca37fe640 1 monclient: found mon.c 2026-02-12T04:05:01.035 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.019+0000 7fdca37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:05:01.035 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.019+0000 7fdca37fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:05:01.035 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.019+0000 7fdca37fe640 1 -- 10.20.193.91:0/4078307806 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcc4152280 con 0x7fdcc41575d0 2026-02-12T04:05:01.035 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.019+0000 7fdca37fe640 10 monclient: _finish_auth 0 2026-02-12T04:05:01.035 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.019+0000 7fdca37fe640 10 monclient: _check_auth_tickets 2026-02-12T04:05:01.036 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.019+0000 7fdca37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:05:01.036 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.019+0000 7fdcc91ef640 5 monclient: authenticate success, global_id 27599 2026-02-12T04:05:01.036 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.019+0000 7fdcc91ef640 10 monclient: _renew_subs 2026-02-12T04:05:01.036 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.019+0000 7fdcc91ef640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:05:01.036 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.019+0000 7fdcc91ef640 1 -- 10.20.193.91:0/4078307806 --> v1:10.20.193.111:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdcc4152560 con 0x7fdcc41575d0 2026-02-12T04:05:01.036 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.019+0000 7fdcc91ef640 10 client.27599.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:05:01.036 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.019+0000 7fdcc91ef640 10 monclient: _renew_subs 2026-02-12T04:05:01.036 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.019+0000 7fdcc91ef640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:05:01.036 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.019+0000 7fdcc91ef640 1 -- 10.20.193.91:0/4078307806 --> v1:10.20.193.111:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fdcc41295d0 con 0x7fdcc41575d0 2026-02-12T04:05:01.036 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.019+0000 7fdcc91ef640 1 librados: init done 2026-02-12T04:05:01.036 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.020+0000 7fdcc91ef640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T04:05:01.036 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.020+0000 7fdcc91ef640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:05:01.036 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.020+0000 7fdcc91ef640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:05:01.037 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.020+0000 7fdcc91ef640 1 -- 10.20.193.91:0/4078307806 --> v1:10.20.193.111:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcc41389b0 con 0x7fdcc41575d0 2026-02-12T04:05:01.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.028+0000 7fdca37fe640 1 -- 10.20.193.91:0/4078307806 <== mon.2 v1:10.20.193.111:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdcac002f70 con 0x7fdcc41575d0 2026-02-12T04:05:01.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.028+0000 7fdca37fe640 10 monclient: handle_config config(0 keys) 2026-02-12T04:05:01.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.028+0000 7fdca37fe640 1 -- 10.20.193.91:0/4078307806 <== mon.2 v1:10.20.193.111:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fdcac004b80 con 0x7fdcc41575d0 2026-02-12T04:05:01.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.028+0000 7fdca37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:01.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.028+0000 7fdca37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T04:05:01.038 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.028+0000 7fdca37fe640 10 monclient: dump: 2026-02-12T04:05:01.038 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:01.038 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:01.038 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.038 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.039 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:01.039 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:01.039 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:01.039 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:01.039 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:01.039 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.028+0000 7fdcc1573640 4 set_mon_vals no callback set 2026-02-12T04:05:01.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.029+0000 7fdca37fe640 1 -- 10.20.193.91:0/4078307806 <== mon.2 v1:10.20.193.111:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7fdcac01e060 con 0x7fdcc41575d0 2026-02-12T04:05:01.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.029+0000 7fdcc2d76640 10 monclient: get_auth_request con 0x7fdc9007a090 auth_method 0 2026-02-12T04:05:01.039 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.029+0000 7fdca37fe640 10 client.27599.objecter ms_handle_connect 0x7fdc9007a090 2026-02-12T04:05:01.119 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.117+0000 7fdca37fe640 1 -- 10.20.193.91:0/4078307806 <== mon.2 v1:10.20.193.111:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7fdcac0958e0 con 0x7fdcc41575d0 2026-02-12T04:05:01.119 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.117+0000 7fdca37fe640 10 client.27599.objecter ms_dispatch2 0x7fdcc4000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:05:01.119 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.117+0000 7fdca37fe640 3 client.27599.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:05:01.119 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.117+0000 7fdca37fe640 3 client.27599.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:05:01.119 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.117+0000 7fdca37fe640 20 client.27599.objecter dump_active .. 0 homeless 2026-02-12T04:05:01.121 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.119+0000 7fdca37fe640 1 -- 10.20.193.91:0/4078307806 <== mon.2 v1:10.20.193.111:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7fdcac05f240 con 0x7fdcc41575d0 2026-02-12T04:05:01.121 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.119+0000 7fdca37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:05:01.121 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.119+0000 7fdca37fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T04:05:01.226 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.224+0000 7fdcc91ef640 1 -- 10.20.193.91:0/4078307806 --> v1:10.20.193.91:6800/2929217192 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "14", "target": ["mon-mgr", ""]}) -- 0x7fdcc41264e0 con 0x7fdc9007a090 2026-02-12T04:05:01.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.225+0000 7fdca37fe640 1 -- 10.20.193.91:0/4078307806 <== mgr.4113 v1:10.20.193.91:6800/2929217192 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 14 to deep-scrub) ==== 42+0+0 (unknown 1939288360 0 0) 0x7fdcc41264e0 con 0x7fdc9007a090 2026-02-12T04:05:01.227 INFO:teuthology.orchestra.run.trial091.stderr:instructed osd(s) 14 to deep-scrub 2026-02-12T04:05:01.228 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.226+0000 7fdcc91ef640 10 librados: watch_flush enter 2026-02-12T04:05:01.228 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.226+0000 7fdcc91ef640 10 librados: watch_flush exit 2026-02-12T04:05:01.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.226+0000 7fdcc91ef640 20 client.27599.objecter shutdown clearing up homeless session... 2026-02-12T04:05:01.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.226+0000 7fdcc91ef640 10 client.27599.objecter successfully canceled tick 2026-02-12T04:05:01.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.226+0000 7fdcc91ef640 1 -- 10.20.193.91:0/4078307806 >> v1:10.20.193.91:6800/2929217192 conn(0x7fdc9007a090 legacy=0x7fdc9009a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:01.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.226+0000 7fdcc91ef640 10 monclient: shutdown 2026-02-12T04:05:01.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.226+0000 7fdcc91ef640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:05:01.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.226+0000 7fdcc91ef640 1 -- 10.20.193.91:0/4078307806 >> v1:10.20.193.111:6789/0 conn(0x7fdcc41575d0 legacy=0x7fdcc411be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:01.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.226+0000 7fdcc91ef640 1 -- 10.20.193.91:0/4078307806 shutdown_connections 2026-02-12T04:05:01.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.226+0000 7fdcc91ef640 1 -- 10.20.193.91:0/4078307806 >> 10.20.193.91:0/4078307806 conn(0x7fdcc40b6560 msgr2=0x7fdcc40b18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:05:01.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.226+0000 7fdcc91ef640 1 -- 10.20.193.91:0/4078307806 shutdown_connections 2026-02-12T04:05:01.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.226+0000 7fdcc91ef640 1 -- 10.20.193.91:0/4078307806 wait complete. 2026-02-12T04:05:01.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.226+0000 7fdcc91ef640 1 librados: shutdown 2026-02-12T04:05:01.236 INFO:tasks.ceph:Scrubbing osd.3 2026-02-12T04:05:01.236 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-12T04:05:01.306 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.304+0000 7ff95fd06640 10 monclient: get_monmap_and_config 2026-02-12T04:05:01.306 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.304+0000 7ff95fd06640 10 monclient: build_initial_monmap 2026-02-12T04:05:01.306 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.304+0000 7ff95fd06640 10 monclient: monmap: 2026-02-12T04:05:01.307 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:05:01.307 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:01.307 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:05:01.305406+0000 2026-02-12T04:05:01.307 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:05:01.305406+0000 2026-02-12T04:05:01.307 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:05:01.307 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:01.307 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:05:01.307 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:05:01.307 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:05:01.307 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.310 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.305+0000 7ff95fd06640 1 Processor -- start 2026-02-12T04:05:01.310 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.305+0000 7ff95fd06640 1 -- start start 2026-02-12T04:05:01.310 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.305+0000 7ff95fd06640 10 monclient: init 2026-02-12T04:05:01.310 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.305+0000 7ff95fd06640 10 monclient: _reopen_session rank -1 2026-02-12T04:05:01.310 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.305+0000 7ff95fd06640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T04:05:01.310 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.305+0000 7ff95fd06640 10 monclient(hunting): picked mon.noname-c con 0x7ff958055c30 addr v1:10.20.193.111:6789/0 2026-02-12T04:05:01.310 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.305+0000 7ff95fd06640 10 monclient(hunting): picked mon.noname-b con 0x7ff958160f80 addr v1:10.20.193.98:6789/0 2026-02-12T04:05:01.310 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.305+0000 7ff95fd06640 10 monclient(hunting): picked mon.noname-a con 0x7ff958163230 addr v1:10.20.193.91:6789/0 2026-02-12T04:05:01.311 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.305+0000 7ff95fd06640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9580b1fc0 con 0x7ff958163230 2026-02-12T04:05:01.311 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.305+0000 7ff95fd06640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9580b22a0 con 0x7ff958160f80 2026-02-12T04:05:01.311 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.305+0000 7ff95fd06640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9580b2580 con 0x7ff958055c30 2026-02-12T04:05:01.311 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.305+0000 7ff95fd06640 10 monclient(hunting): _renew_subs 2026-02-12T04:05:01.311 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.305+0000 7ff95fd06640 10 monclient(hunting): authenticate will time out at 1504.048830s 2026-02-12T04:05:01.311 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.306+0000 7ff95e27c640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7ff958163230 0x7ff9581c57b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:39924/0 (socket says 10.20.193.91:39924) 2026-02-12T04:05:01.311 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.306+0000 7ff95e27c640 1 -- 10.20.193.91:0/53655147 learned_addr learned my addr 10.20.193.91:0/53655147 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:05:01.311 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.307+0000 7ff95ca79640 1 -- 10.20.193.91:0/53655147 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2621290383 0 0) 0x7ff9580b1fc0 con 0x7ff958163230 2026-02-12T04:05:01.311 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.307+0000 7ff95ca79640 10 monclient(hunting): _negotiate 2026-02-12T04:05:01.311 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.307+0000 7ff95ca79640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:01.311 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.307+0000 7ff95ca79640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:01.312 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.307+0000 7ff95ca79640 10 monclient(hunting): my global_id is 30765 2026-02-12T04:05:01.312 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.307+0000 7ff95ca79640 1 -- 10.20.193.91:0/53655147 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff940003610 con 0x7ff958163230 2026-02-12T04:05:01.312 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.307+0000 7ff95ca79640 1 -- 10.20.193.91:0/53655147 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3802718886 0 0) 0x7ff9580b2580 con 0x7ff958055c30 2026-02-12T04:05:01.312 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.307+0000 7ff95ca79640 10 monclient(hunting): _negotiate 2026-02-12T04:05:01.312 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.307+0000 7ff95ca79640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:01.312 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.307+0000 7ff95ca79640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:01.312 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.307+0000 7ff95ca79640 10 monclient(hunting): my global_id is 27602 2026-02-12T04:05:01.312 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.307+0000 7ff95ca79640 1 -- 10.20.193.91:0/53655147 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9580b1fc0 con 0x7ff958055c30 2026-02-12T04:05:01.312 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.307+0000 7ff95ca79640 1 -- 10.20.193.91:0/53655147 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2514148162 0 0) 0x7ff9580b22a0 con 0x7ff958160f80 2026-02-12T04:05:01.312 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.307+0000 7ff95ca79640 10 monclient(hunting): _negotiate 2026-02-12T04:05:01.313 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.307+0000 7ff95ca79640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:01.313 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.307+0000 7ff95ca79640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:01.313 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.307+0000 7ff95ca79640 10 monclient(hunting): my global_id is 27907 2026-02-12T04:05:01.313 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.307+0000 7ff95ca79640 1 -- 10.20.193.91:0/53655147 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9580b2580 con 0x7ff958160f80 2026-02-12T04:05:01.320 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.309+0000 7ff95ca79640 1 -- 10.20.193.91:0/53655147 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2724157339 0 0) 0x7ff9580b2580 con 0x7ff958160f80 2026-02-12T04:05:01.320 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.309+0000 7ff95ca79640 1 -- 10.20.193.91:0/53655147 >> v1:10.20.193.111:6789/0 conn(0x7ff958055c30 legacy=0x7ff958162b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:01.320 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.309+0000 7ff95ca79640 1 -- 10.20.193.91:0/53655147 >> v1:10.20.193.91:6789/0 conn(0x7ff958163230 legacy=0x7ff9581c57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:01.320 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.309+0000 7ff95ca79640 10 monclient: _finish_hunting 0 2026-02-12T04:05:01.320 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.309+0000 7ff95ca79640 1 monclient: found mon.noname-b 2026-02-12T04:05:01.320 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.309+0000 7ff95ca79640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:05:01.320 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.309+0000 7ff95ca79640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T04:05:01.321 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.309+0000 7ff95ca79640 1 -- 10.20.193.91:0/53655147 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9580b2860 con 0x7ff958160f80 2026-02-12T04:05:01.321 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.309+0000 7ff95ca79640 10 monclient: _finish_auth 0 2026-02-12T04:05:01.321 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.309+0000 7ff95ca79640 10 monclient: _check_auth_tickets 2026-02-12T04:05:01.321 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.309+0000 7ff95ca79640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:05:01.321 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.309+0000 7ff95ca79640 1 -- 10.20.193.91:0/53655147 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7ff94c002dd0 con 0x7ff958160f80 2026-02-12T04:05:01.321 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.309+0000 7ff95ca79640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:01.321 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.309+0000 7ff95ca79640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T04:05:01.321 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.309+0000 7ff95ca79640 10 monclient: dump: 2026-02-12T04:05:01.321 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:01.321 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:01.321 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.321 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.322 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:01.322 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:01.322 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:01.322 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:01.322 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:01.322 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.309+0000 7ff95fd06640 5 monclient: authenticate success, global_id 27907 2026-02-12T04:05:01.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.309+0000 7ff95fd06640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:05:01.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.310+0000 7ff95ca79640 1 -- 10.20.193.91:0/53655147 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff94c002fa0 con 0x7ff958160f80 2026-02-12T04:05:01.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.310+0000 7ff95ca79640 10 monclient: handle_config config(0 keys) 2026-02-12T04:05:01.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.310+0000 7ff95ca79640 1 -- 10.20.193.91:0/53655147 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7ff94c0033e0 con 0x7ff958160f80 2026-02-12T04:05:01.322 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.310+0000 7ff95ca79640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:01.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.310+0000 7ff95ca79640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T04:05:01.323 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.310+0000 7ff95ca79640 10 monclient: dump: 2026-02-12T04:05:01.323 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:01.323 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:01.323 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.323 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.323 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:01.323 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:01.323 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:01.323 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:01.323 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:01.323 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.310+0000 7ff95fd06640 10 monclient: get_monmap_and_config success 2026-02-12T04:05:01.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.310+0000 7ff95fd06640 4 set_mon_vals no callback set 2026-02-12T04:05:01.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.310+0000 7ff95fd06640 10 monclient: shutdown 2026-02-12T04:05:01.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.310+0000 7ff95fd06640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:05:01.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.310+0000 7ff95fd06640 1 -- 10.20.193.91:0/53655147 >> v1:10.20.193.98:6789/0 conn(0x7ff958160f80 legacy=0x7ff9581572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:01.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.310+0000 7ff95fd06640 1 -- 10.20.193.91:0/53655147 shutdown_connections 2026-02-12T04:05:01.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.310+0000 7ff95fd06640 1 -- 10.20.193.91:0/53655147 >> 10.20.193.91:0/53655147 conn(0x7ff9580b6560 msgr2=0x7ff9580b6930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:05:01.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.310+0000 7ff95fd06640 1 -- 10.20.193.91:0/53655147 shutdown_connections 2026-02-12T04:05:01.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.310+0000 7ff95fd06640 1 -- 10.20.193.91:0/53655147 wait complete. 2026-02-12T04:05:01.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.311+0000 7ff95fd06640 10 monclient: build_initial_monmap 2026-02-12T04:05:01.324 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.311+0000 7ff95fd06640 10 monclient: monmap: 2026-02-12T04:05:01.324 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:05:01.325 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:05:01.325 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:05:01.325 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:05:01.325 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:05:01.325 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:05:01.325 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:05:01.325 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:05:01.325 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:05:01.325 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.325 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.311+0000 7ff95fd06640 1 librados: starting msgr at 2026-02-12T04:05:01.325 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.311+0000 7ff95fd06640 1 librados: starting objecter 2026-02-12T04:05:01.325 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.311+0000 7ff95fd06640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:05:01.325 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.311+0000 7ff95fd06640 1 Processor -- start 2026-02-12T04:05:01.326 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.311+0000 7ff95fd06640 1 -- start start 2026-02-12T04:05:01.326 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.311+0000 7ff95fd06640 1 librados: setting wanted keys 2026-02-12T04:05:01.326 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.311+0000 7ff95fd06640 1 librados: calling monclient init 2026-02-12T04:05:01.326 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.311+0000 7ff95fd06640 10 monclient: init 2026-02-12T04:05:01.326 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.311+0000 7ff95fd06640 10 monclient: _reopen_session rank -1 2026-02-12T04:05:01.326 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.311+0000 7ff95fd06640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T04:05:01.326 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.311+0000 7ff95fd06640 10 monclient(hunting): picked mon.noname-b con 0x7ff958055c30 addr v1:10.20.193.98:6789/0 2026-02-12T04:05:01.326 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.311+0000 7ff95fd06640 10 monclient(hunting): picked mon.noname-a con 0x7ff958160f80 addr v1:10.20.193.91:6789/0 2026-02-12T04:05:01.326 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.311+0000 7ff95fd06640 10 monclient(hunting): picked mon.noname-c con 0x7ff958163230 addr v1:10.20.193.111:6789/0 2026-02-12T04:05:01.326 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.311+0000 7ff95fd06640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff95805d7c0 con 0x7ff958160f80 2026-02-12T04:05:01.326 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.311+0000 7ff95fd06640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff958155e10 con 0x7ff958055c30 2026-02-12T04:05:01.326 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.311+0000 7ff95fd06640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff95805c440 con 0x7ff958163230 2026-02-12T04:05:01.326 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.311+0000 7ff95fd06640 10 monclient(hunting): _renew_subs 2026-02-12T04:05:01.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.311+0000 7ff95fd06640 10 monclient(hunting): authenticate will time out at 1504.054718s 2026-02-12T04:05:01.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.311+0000 7ff95d27a640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7ff958160f80 0x7ff958155700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:39930/0 (socket says 10.20.193.91:39930) 2026-02-12T04:05:01.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.311+0000 7ff95d27a640 1 -- 10.20.193.91:0/3990733847 learned_addr learned my addr 10.20.193.91:0/3990733847 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:05:01.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.312+0000 7ff9467fc640 10 client.?.objecter ms_handle_connect 0x7ff958160f80 2026-02-12T04:05:01.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.312+0000 7ff9467fc640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:01.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.312+0000 7ff9467fc640 10 client.?.objecter ms_handle_connect 0x7ff958055c30 2026-02-12T04:05:01.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.312+0000 7ff9467fc640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:01.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.312+0000 7ff9467fc640 10 client.?.objecter ms_handle_connect 0x7ff958163230 2026-02-12T04:05:01.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.312+0000 7ff9467fc640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:01.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.313+0000 7ff9467fc640 1 -- 10.20.193.91:0/3990733847 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 931141675 0 0) 0x7ff95805d7c0 con 0x7ff958160f80 2026-02-12T04:05:01.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.313+0000 7ff9467fc640 10 monclient(hunting): _negotiate 2026-02-12T04:05:01.327 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.313+0000 7ff9467fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:01.328 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.313+0000 7ff9467fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:01.328 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.313+0000 7ff9467fc640 10 monclient(hunting): my global_id is 30768 2026-02-12T04:05:01.328 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.313+0000 7ff9467fc640 1 -- 10.20.193.91:0/3990733847 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff928003610 con 0x7ff958160f80 2026-02-12T04:05:01.328 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.313+0000 7ff9467fc640 1 -- 10.20.193.91:0/3990733847 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 922611634 0 0) 0x7ff95805c440 con 0x7ff958163230 2026-02-12T04:05:01.328 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.313+0000 7ff9467fc640 10 monclient(hunting): _negotiate 2026-02-12T04:05:01.328 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.313+0000 7ff9467fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:01.328 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.313+0000 7ff9467fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:01.328 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.313+0000 7ff9467fc640 10 monclient(hunting): my global_id is 27605 2026-02-12T04:05:01.328 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.313+0000 7ff9467fc640 1 -- 10.20.193.91:0/3990733847 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff95805d7c0 con 0x7ff958163230 2026-02-12T04:05:01.328 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.313+0000 7ff9467fc640 1 -- 10.20.193.91:0/3990733847 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1192093313 0 0) 0x7ff958155e10 con 0x7ff958055c30 2026-02-12T04:05:01.328 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.313+0000 7ff9467fc640 10 monclient(hunting): _negotiate 2026-02-12T04:05:01.328 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.313+0000 7ff9467fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:01.329 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.313+0000 7ff9467fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:01.329 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.313+0000 7ff9467fc640 10 monclient(hunting): my global_id is 27910 2026-02-12T04:05:01.329 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.313+0000 7ff9467fc640 1 -- 10.20.193.91:0/3990733847 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff95805c440 con 0x7ff958055c30 2026-02-12T04:05:01.329 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.315+0000 7ff9467fc640 1 -- 10.20.193.91:0/3990733847 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3642671293 0 0) 0x7ff928003610 con 0x7ff958160f80 2026-02-12T04:05:01.329 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.315+0000 7ff9467fc640 1 -- 10.20.193.91:0/3990733847 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff958155e10 con 0x7ff958160f80 2026-02-12T04:05:01.329 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.315+0000 7ff9467fc640 1 -- 10.20.193.91:0/3990733847 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7ff94c0033b0 con 0x7ff958160f80 2026-02-12T04:05:01.329 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.315+0000 7ff9467fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:01.329 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.315+0000 7ff9467fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T04:05:01.329 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.315+0000 7ff9467fc640 10 monclient(hunting): dump: 2026-02-12T04:05:01.329 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:01.329 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:01.329 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.330 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.330 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:01.330 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:01.330 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:01.330 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:01.330 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:01.330 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.330 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.315+0000 7ff9467fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:05:01.330 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.315+0000 7ff9467fc640 1 -- 10.20.193.91:0/3990733847 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1550612176 0 0) 0x7ff95805d7c0 con 0x7ff958163230 2026-02-12T04:05:01.330 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.315+0000 7ff9467fc640 1 -- 10.20.193.91:0/3990733847 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff928003610 con 0x7ff958163230 2026-02-12T04:05:01.330 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.315+0000 7ff9467fc640 1 -- 10.20.193.91:0/3990733847 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7ff954003260 con 0x7ff958163230 2026-02-12T04:05:01.331 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.315+0000 7ff9467fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:01.331 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.315+0000 7ff9467fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T04:05:01.331 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.315+0000 7ff9467fc640 10 monclient(hunting): dump: 2026-02-12T04:05:01.331 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:01.331 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:01.331 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.331 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.331 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:01.331 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:01.331 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:01.331 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:01.331 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:01.331 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.332 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.315+0000 7ff9467fc640 1 -- 10.20.193.91:0/3990733847 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2937102769 0 0) 0x7ff95805c440 con 0x7ff958055c30 2026-02-12T04:05:01.332 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.315+0000 7ff9467fc640 1 -- 10.20.193.91:0/3990733847 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff95805d7c0 con 0x7ff958055c30 2026-02-12T04:05:01.332 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.315+0000 7ff9467fc640 1 -- 10.20.193.91:0/3990733847 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7ff9480030b0 con 0x7ff958055c30 2026-02-12T04:05:01.332 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.315+0000 7ff9467fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:01.332 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.315+0000 7ff9467fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T04:05:01.332 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.315+0000 7ff9467fc640 10 monclient(hunting): dump: 2026-02-12T04:05:01.332 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:01.332 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:01.332 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.332 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.332 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:01.332 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:01.333 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:01.333 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:01.333 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:01.333 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.317+0000 7ff9467fc640 1 -- 10.20.193.91:0/3990733847 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 110269360 0 0) 0x7ff958155e10 con 0x7ff958160f80 2026-02-12T04:05:01.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.317+0000 7ff9467fc640 1 -- 10.20.193.91:0/3990733847 >> v1:10.20.193.111:6789/0 conn(0x7ff958163230 legacy=0x7ff95815c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:01.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.317+0000 7ff9467fc640 1 -- 10.20.193.91:0/3990733847 >> v1:10.20.193.98:6789/0 conn(0x7ff958055c30 legacy=0x7ff95805bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:01.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.317+0000 7ff9467fc640 10 monclient: _finish_hunting 0 2026-02-12T04:05:01.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.317+0000 7ff9467fc640 1 monclient: found mon.a 2026-02-12T04:05:01.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.317+0000 7ff9467fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:05:01.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.317+0000 7ff9467fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:05:01.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.317+0000 7ff9467fc640 1 -- 10.20.193.91:0/3990733847 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff95805c720 con 0x7ff958160f80 2026-02-12T04:05:01.333 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.317+0000 7ff9467fc640 10 monclient: _finish_auth 0 2026-02-12T04:05:01.334 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.317+0000 7ff9467fc640 10 monclient: _check_auth_tickets 2026-02-12T04:05:01.334 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.317+0000 7ff9467fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:05:01.334 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.317+0000 7ff95fd06640 5 monclient: authenticate success, global_id 30768 2026-02-12T04:05:01.334 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.317+0000 7ff95fd06640 10 monclient: _renew_subs 2026-02-12T04:05:01.334 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.317+0000 7ff95fd06640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:05:01.334 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.317+0000 7ff95fd06640 1 -- 10.20.193.91:0/3990733847 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff95805ca00 con 0x7ff958160f80 2026-02-12T04:05:01.334 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.317+0000 7ff95fd06640 10 client.30768.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:05:01.334 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.317+0000 7ff95fd06640 10 monclient: _renew_subs 2026-02-12T04:05:01.334 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.317+0000 7ff95fd06640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:05:01.334 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.317+0000 7ff95fd06640 1 -- 10.20.193.91:0/3990733847 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff95805cfc0 con 0x7ff958160f80 2026-02-12T04:05:01.334 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.317+0000 7ff95fd06640 1 librados: init done 2026-02-12T04:05:01.334 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.317+0000 7ff95fd06640 10 client.30768.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:05:01.334 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.317+0000 7ff95fd06640 15 client.30768.objecter _session_command_op_assign -1 1 2026-02-12T04:05:01.335 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.317+0000 7ff95fd06640 20 client.30768.objecter _get_session osd=-1 returning homeless 2026-02-12T04:05:01.335 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.317+0000 7ff95fd06640 10 client.30768.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:05:01.335 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.317+0000 7ff95fd06640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:05:01.335 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.317+0000 7ff95fd06640 1 -- 10.20.193.91:0/3990733847 --> v1:10.20.193.91:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7ff9580b0990 con 0x7ff958160f80 2026-02-12T04:05:01.337 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.326+0000 7ff9467fc640 1 -- 10.20.193.91:0/3990733847 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff9580b0990 con 0x7ff958160f80 2026-02-12T04:05:01.337 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.326+0000 7ff9467fc640 10 monclient: handle_config config(0 keys) 2026-02-12T04:05:01.337 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.326+0000 7ff9467fc640 1 -- 10.20.193.91:0/3990733847 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7ff94c003940 con 0x7ff958160f80 2026-02-12T04:05:01.338 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.326+0000 7ff9467fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:01.338 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.326+0000 7ff9467fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T04:05:01.338 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.326+0000 7ff9467fc640 10 monclient: dump: 2026-02-12T04:05:01.338 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:01.338 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:01.338 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.338 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.338 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:01.338 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:01.338 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:01.339 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:01.339 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:01.339 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.339 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.326+0000 7ff947fff640 4 set_mon_vals no callback set 2026-02-12T04:05:01.339 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.327+0000 7ff9467fc640 1 -- 10.20.193.91:0/3990733847 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7ff94c003b20 con 0x7ff958160f80 2026-02-12T04:05:01.339 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.327+0000 7ff95da7b640 10 monclient: get_auth_request con 0x7ff92807a0f0 auth_method 0 2026-02-12T04:05:01.339 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.327+0000 7ff9467fc640 10 client.30768.objecter ms_handle_connect 0x7ff92807a0f0 2026-02-12T04:05:01.339 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.329+0000 7ff9467fc640 1 -- 10.20.193.91:0/3990733847 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7ff94c095a40 con 0x7ff958160f80 2026-02-12T04:05:01.339 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.329+0000 7ff9467fc640 10 client.30768.objecter ms_dispatch2 0x7ff958000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:05:01.339 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.329+0000 7ff9467fc640 3 client.30768.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:05:01.339 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.329+0000 7ff9467fc640 3 client.30768.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:05:01.340 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.329+0000 7ff9467fc640 10 client.30768.objecter checking command 1 2026-02-12T04:05:01.340 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.329+0000 7ff9467fc640 20 client.30768.objecter _get_session s=0x7ff9280a43a0 osd=3 3 2026-02-12T04:05:01.340 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.329+0000 7ff9467fc640 20 client.30768.objecter put_session s=0x7ff9280a43a0 osd=3 3 2026-02-12T04:05:01.340 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.329+0000 7ff9467fc640 15 client.30768.objecter _session_command_op_remove -1 1 2026-02-12T04:05:01.340 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.329+0000 7ff9467fc640 20 client.30768.objecter _get_session s=0x7ff9280a43a0 osd=3 3 2026-02-12T04:05:01.340 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.329+0000 7ff9467fc640 20 client.30768.objecter get_session s=0x7ff9280a43a0 osd=3 3 2026-02-12T04:05:01.340 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.329+0000 7ff9467fc640 15 client.30768.objecter _session_command_op_assign 3 1 2026-02-12T04:05:01.340 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.329+0000 7ff9467fc640 20 client.30768.objecter put_session s=0x7ff9280a43a0 osd=3 4 2026-02-12T04:05:01.340 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.329+0000 7ff9467fc640 10 client.30768.objecter _send_command 1 2026-02-12T04:05:01.340 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.329+0000 7ff9467fc640 1 -- 10.20.193.91:0/3990733847 --> v1:10.20.193.154:6800/4779434 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff94c002fa0 con 0x7ff9280a4a50 2026-02-12T04:05:01.340 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.329+0000 7ff9467fc640 20 client.30768.objecter dump_active .. 0 homeless 2026-02-12T04:05:01.340 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.329+0000 7ff9467fc640 1 -- 10.20.193.91:0/3990733847 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_get_version_reply(handle=1 version=344) ==== 24+0+0 (unknown 1403447244 0 0) 0x7ff94c05b010 con 0x7ff958160f80 2026-02-12T04:05:01.341 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.329+0000 7ff9467fc640 10 monclient: handle_get_version_reply finishing 1 version 344 2026-02-12T04:05:01.341 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.329+0000 7ff95e27c640 10 monclient: get_auth_request con 0x7ff9280a4a50 auth_method 0 2026-02-12T04:05:01.341 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.330+0000 7ff9467fc640 10 client.30768.objecter ms_handle_connect 0x7ff9280a4a50 2026-02-12T04:05:01.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.341+0000 7ff9467fc640 1 -- 10.20.193.91:0/3990733847 <== osd.3 v1:10.20.193.154:6800/4779434 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7ff94c002fa0 con 0x7ff9280a4a50 2026-02-12T04:05:01.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.341+0000 7ff9467fc640 10 client.30768.objecter ms_dispatch2 0x7ff958000b90 command_reply(tid 1: 0 ) 2026-02-12T04:05:01.343 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.341+0000 7ff9467fc640 10 client.30768.objecter _finish_command 1 = system:0 2026-02-12T04:05:01.343 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.341+0000 7ff9467fc640 20 client.30768.objecter put_session s=0x7ff9280a43a0 osd=3 4 2026-02-12T04:05:01.343 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.341+0000 7ff9467fc640 15 client.30768.objecter _session_command_op_remove 3 1 2026-02-12T04:05:01.350 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.348+0000 7ff95fd06640 10 client.30768.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-12T04:05:01.350 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.348+0000 7ff95fd06640 15 client.30768.objecter _session_command_op_assign -1 2 2026-02-12T04:05:01.350 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.348+0000 7ff95fd06640 20 client.30768.objecter _get_session s=0x7ff9280a43a0 osd=3 3 2026-02-12T04:05:01.350 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.348+0000 7ff95fd06640 20 client.30768.objecter put_session s=0x7ff9280a43a0 osd=3 3 2026-02-12T04:05:01.350 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.348+0000 7ff95fd06640 20 client.30768.objecter _get_session s=0x7ff9280a43a0 osd=3 3 2026-02-12T04:05:01.350 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.348+0000 7ff95fd06640 15 client.30768.objecter _session_command_op_remove -1 2 2026-02-12T04:05:01.350 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.348+0000 7ff95fd06640 20 client.30768.objecter get_session s=0x7ff9280a43a0 osd=3 3 2026-02-12T04:05:01.350 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.348+0000 7ff95fd06640 15 client.30768.objecter _session_command_op_assign 3 2 2026-02-12T04:05:01.350 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.348+0000 7ff95fd06640 20 client.30768.objecter put_session s=0x7ff9280a43a0 osd=3 4 2026-02-12T04:05:01.350 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.348+0000 7ff95fd06640 10 client.30768.objecter _send_command 2 2026-02-12T04:05:01.350 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.348+0000 7ff95fd06640 1 -- 10.20.193.91:0/3990733847 --> v1:10.20.193.154:6800/4779434 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff958164780 con 0x7ff9280a4a50 2026-02-12T04:05:01.357 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.355+0000 7ff9467fc640 1 -- 10.20.193.91:0/3990733847 <== osd.3 v1:10.20.193.154:6800/4779434 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7ff958164780 con 0x7ff9280a4a50 2026-02-12T04:05:01.357 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.355+0000 7ff9467fc640 10 client.30768.objecter ms_dispatch2 0x7ff958000b90 command_reply(tid 2: 0 ) 2026-02-12T04:05:01.357 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.355+0000 7ff9467fc640 10 client.30768.objecter _finish_command 2 = system:0 2026-02-12T04:05:01.357 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.355+0000 7ff9467fc640 20 client.30768.objecter put_session s=0x7ff9280a43a0 osd=3 4 2026-02-12T04:05:01.357 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.355+0000 7ff9467fc640 15 client.30768.objecter _session_command_op_remove 3 2 2026-02-12T04:05:01.358 INFO:teuthology.orchestra.run.trial091.stdout:{ 2026-02-12T04:05:01.358 INFO:teuthology.orchestra.run.trial091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-12T04:05:01.358 INFO:teuthology.orchestra.run.trial091.stdout:} 2026-02-12T04:05:01.359 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.355+0000 7ff95fd06640 10 librados: watch_flush enter 2026-02-12T04:05:01.359 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.355+0000 7ff95fd06640 10 librados: watch_flush exit 2026-02-12T04:05:01.359 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.355+0000 7ff95fd06640 10 client.30768.objecter close_session for osd.3 2026-02-12T04:05:01.360 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.355+0000 7ff95fd06640 1 -- 10.20.193.91:0/3990733847 >> v1:10.20.193.154:6800/4779434 conn(0x7ff9280a4a50 legacy=0x7ff9280c4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:01.360 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.355+0000 7ff95fd06640 20 client.30768.objecter put_session s=0x7ff9280a43a0 osd=3 1 2026-02-12T04:05:01.360 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.355+0000 7ff95fd06640 20 client.30768.objecter shutdown clearing up homeless session... 2026-02-12T04:05:01.360 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.355+0000 7ff95fd06640 10 client.30768.objecter successfully canceled tick 2026-02-12T04:05:01.360 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.355+0000 7ff95fd06640 1 -- 10.20.193.91:0/3990733847 >> v1:10.20.193.91:6800/2929217192 conn(0x7ff92807a0f0 legacy=0x7ff92809a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:01.360 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.355+0000 7ff95fd06640 10 monclient: shutdown 2026-02-12T04:05:01.360 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.355+0000 7ff95fd06640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:05:01.360 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.355+0000 7ff95fd06640 1 -- 10.20.193.91:0/3990733847 >> v1:10.20.193.91:6789/0 conn(0x7ff958160f80 legacy=0x7ff958155700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:01.360 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.355+0000 7ff95e27c640 1 -- 10.20.193.91:0/3990733847 reap_dead start 2026-02-12T04:05:01.360 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.355+0000 7ff95fd06640 1 -- 10.20.193.91:0/3990733847 shutdown_connections 2026-02-12T04:05:01.360 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.355+0000 7ff95fd06640 1 -- 10.20.193.91:0/3990733847 >> 10.20.193.91:0/3990733847 conn(0x7ff9580b6560 msgr2=0x7ff9580b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:05:01.360 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.355+0000 7ff95fd06640 1 -- 10.20.193.91:0/3990733847 shutdown_connections 2026-02-12T04:05:01.361 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.355+0000 7ff95fd06640 1 -- 10.20.193.91:0/3990733847 wait complete. 2026-02-12T04:05:01.361 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.355+0000 7ff95fd06640 1 librados: shutdown 2026-02-12T04:05:01.365 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-12T04:05:01.434 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.433+0000 7fd5542e1640 10 monclient: get_monmap_and_config 2026-02-12T04:05:01.435 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.433+0000 7fd5542e1640 10 monclient: build_initial_monmap 2026-02-12T04:05:01.435 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.433+0000 7fd5542e1640 10 monclient: monmap: 2026-02-12T04:05:01.435 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:05:01.435 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:01.435 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:05:01.433643+0000 2026-02-12T04:05:01.435 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:05:01.433643+0000 2026-02-12T04:05:01.435 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:05:01.435 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:01.435 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:05:01.436 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:05:01.436 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:05:01.436 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.438 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.433+0000 7fd5542e1640 1 Processor -- start 2026-02-12T04:05:01.439 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.433+0000 7fd5542e1640 1 -- start start 2026-02-12T04:05:01.439 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.433+0000 7fd5542e1640 10 monclient: init 2026-02-12T04:05:01.439 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.434+0000 7fd5542e1640 10 monclient: _reopen_session rank -1 2026-02-12T04:05:01.439 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.434+0000 7fd5542e1640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T04:05:01.439 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.434+0000 7fd5542e1640 10 monclient(hunting): picked mon.noname-a con 0x7fd54c1599b0 addr v1:10.20.193.91:6789/0 2026-02-12T04:05:01.439 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.434+0000 7fd5542e1640 10 monclient(hunting): picked mon.noname-c con 0x7fd54c05d180 addr v1:10.20.193.111:6789/0 2026-02-12T04:05:01.439 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.434+0000 7fd5542e1640 10 monclient(hunting): picked mon.noname-b con 0x7fd54c166580 addr v1:10.20.193.98:6789/0 2026-02-12T04:05:01.439 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.434+0000 7fd5542e1640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd54c05c0e0 con 0x7fd54c1599b0 2026-02-12T04:05:01.439 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.434+0000 7fd5542e1640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd54c05c3c0 con 0x7fd54c166580 2026-02-12T04:05:01.439 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.434+0000 7fd5542e1640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd54c05c6a0 con 0x7fd54c05d180 2026-02-12T04:05:01.439 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.434+0000 7fd5542e1640 10 monclient(hunting): _renew_subs 2026-02-12T04:05:01.440 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.434+0000 7fd5542e1640 10 monclient(hunting): authenticate will time out at 1504.177178s 2026-02-12T04:05:01.440 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.434+0000 7fd552056640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7fd54c1599b0 0x7fd54c05b730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:39946/0 (socket says 10.20.193.91:39946) 2026-02-12T04:05:01.440 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.434+0000 7fd552056640 1 -- 10.20.193.91:0/1905204791 learned_addr learned my addr 10.20.193.91:0/1905204791 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:05:01.440 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.435+0000 7fd551054640 1 -- 10.20.193.91:0/1905204791 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 578358941 0 0) 0x7fd54c05c6a0 con 0x7fd54c05d180 2026-02-12T04:05:01.440 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.435+0000 7fd551054640 10 monclient(hunting): _negotiate 2026-02-12T04:05:01.440 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.435+0000 7fd551054640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:01.440 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.435+0000 7fd551054640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:01.440 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.435+0000 7fd551054640 10 monclient(hunting): my global_id is 27608 2026-02-12T04:05:01.440 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.435+0000 7fd551054640 1 -- 10.20.193.91:0/1905204791 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd534003610 con 0x7fd54c05d180 2026-02-12T04:05:01.440 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.436+0000 7fd551054640 1 -- 10.20.193.91:0/1905204791 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2778790795 0 0) 0x7fd54c05c0e0 con 0x7fd54c1599b0 2026-02-12T04:05:01.441 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.436+0000 7fd551054640 10 monclient(hunting): _negotiate 2026-02-12T04:05:01.441 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.436+0000 7fd551054640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:01.441 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.436+0000 7fd551054640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:01.441 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.436+0000 7fd551054640 10 monclient(hunting): my global_id is 30771 2026-02-12T04:05:01.441 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.436+0000 7fd551054640 1 -- 10.20.193.91:0/1905204791 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd54c05c6a0 con 0x7fd54c1599b0 2026-02-12T04:05:01.441 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.436+0000 7fd551054640 1 -- 10.20.193.91:0/1905204791 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 647174957 0 0) 0x7fd54c05c3c0 con 0x7fd54c166580 2026-02-12T04:05:01.441 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.436+0000 7fd551054640 10 monclient(hunting): _negotiate 2026-02-12T04:05:01.441 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.436+0000 7fd551054640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:01.441 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.436+0000 7fd551054640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:01.441 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.436+0000 7fd551054640 10 monclient(hunting): my global_id is 27913 2026-02-12T04:05:01.441 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.436+0000 7fd551054640 1 -- 10.20.193.91:0/1905204791 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd54c05c0e0 con 0x7fd54c166580 2026-02-12T04:05:01.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.437+0000 7fd551054640 1 -- 10.20.193.91:0/1905204791 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4032465475 0 0) 0x7fd534003610 con 0x7fd54c05d180 2026-02-12T04:05:01.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.437+0000 7fd551054640 1 -- 10.20.193.91:0/1905204791 >> v1:10.20.193.98:6789/0 conn(0x7fd54c166580 legacy=0x7fd54c1669a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:01.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.437+0000 7fd551054640 1 -- 10.20.193.91:0/1905204791 >> v1:10.20.193.91:6789/0 conn(0x7fd54c1599b0 legacy=0x7fd54c05b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:01.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.437+0000 7fd551054640 10 monclient: _finish_hunting 0 2026-02-12T04:05:01.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.437+0000 7fd551054640 1 monclient: found mon.noname-c 2026-02-12T04:05:01.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.437+0000 7fd551054640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:05:01.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.437+0000 7fd551054640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.111:6789/0 2026-02-12T04:05:01.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.437+0000 7fd551054640 1 -- 10.20.193.91:0/1905204791 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd54c05c980 con 0x7fd54c05d180 2026-02-12T04:05:01.450 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.437+0000 7fd551054640 10 monclient: _finish_auth 0 2026-02-12T04:05:01.450 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.437+0000 7fd551054640 10 monclient: _check_auth_tickets 2026-02-12T04:05:01.450 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.437+0000 7fd551054640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:05:01.450 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.437+0000 7fd551054640 1 -- 10.20.193.91:0/1905204791 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd540002d20 con 0x7fd54c05d180 2026-02-12T04:05:01.450 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.437+0000 7fd5542e1640 5 monclient: authenticate success, global_id 27608 2026-02-12T04:05:01.450 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.437+0000 7fd5542e1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:05:01.450 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.437+0000 7fd551054640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:01.450 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.437+0000 7fd551054640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T04:05:01.450 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.437+0000 7fd551054640 10 monclient: dump: 2026-02-12T04:05:01.450 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:01.450 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:01.450 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.451 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.451 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:01.451 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:01.451 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:01.451 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:01.451 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:01.451 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.437+0000 7fd5542e1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:05:01.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.438+0000 7fd551054640 1 -- 10.20.193.91:0/1905204791 <== mon.2 v1:10.20.193.111:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd540002ef0 con 0x7fd54c05d180 2026-02-12T04:05:01.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.438+0000 7fd551054640 10 monclient: handle_config config(0 keys) 2026-02-12T04:05:01.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.438+0000 7fd551054640 1 -- 10.20.193.91:0/1905204791 <== mon.2 v1:10.20.193.111:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd540003330 con 0x7fd54c05d180 2026-02-12T04:05:01.451 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.438+0000 7fd551054640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:01.452 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.438+0000 7fd551054640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T04:05:01.452 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.438+0000 7fd551054640 10 monclient: dump: 2026-02-12T04:05:01.452 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:01.452 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:01.452 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.452 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.452 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:01.452 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:01.452 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:01.452 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:01.452 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:01.452 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.452 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.438+0000 7fd5542e1640 10 monclient: get_monmap_and_config success 2026-02-12T04:05:01.453 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.438+0000 7fd5542e1640 4 set_mon_vals no callback set 2026-02-12T04:05:01.453 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.438+0000 7fd5542e1640 10 monclient: shutdown 2026-02-12T04:05:01.453 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.438+0000 7fd5542e1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:05:01.453 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.438+0000 7fd5542e1640 1 -- 10.20.193.91:0/1905204791 >> v1:10.20.193.111:6789/0 conn(0x7fd54c05d180 legacy=0x7fd54c05d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:01.453 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.438+0000 7fd5542e1640 1 -- 10.20.193.91:0/1905204791 shutdown_connections 2026-02-12T04:05:01.453 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.438+0000 7fd5542e1640 1 -- 10.20.193.91:0/1905204791 >> 10.20.193.91:0/1905204791 conn(0x7fd54c0b6560 msgr2=0x7fd54c0b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:05:01.453 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.438+0000 7fd5542e1640 1 -- 10.20.193.91:0/1905204791 shutdown_connections 2026-02-12T04:05:01.453 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.438+0000 7fd5542e1640 1 -- 10.20.193.91:0/1905204791 wait complete. 2026-02-12T04:05:01.453 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.439+0000 7fd5542e1640 10 monclient: build_initial_monmap 2026-02-12T04:05:01.453 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.439+0000 7fd5542e1640 10 monclient: monmap: 2026-02-12T04:05:01.453 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:05:01.453 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:05:01.454 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:05:01.454 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:05:01.454 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:05:01.454 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:05:01.454 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:05:01.454 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:05:01.454 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:05:01.454 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.454 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.439+0000 7fd5542e1640 1 librados: starting msgr at 2026-02-12T04:05:01.454 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.439+0000 7fd5542e1640 1 librados: starting objecter 2026-02-12T04:05:01.454 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.439+0000 7fd5542e1640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:05:01.454 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.439+0000 7fd5542e1640 1 Processor -- start 2026-02-12T04:05:01.455 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.439+0000 7fd5542e1640 1 -- start start 2026-02-12T04:05:01.455 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.439+0000 7fd5542e1640 1 librados: setting wanted keys 2026-02-12T04:05:01.455 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.439+0000 7fd5542e1640 1 librados: calling monclient init 2026-02-12T04:05:01.455 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.439+0000 7fd5542e1640 10 monclient: init 2026-02-12T04:05:01.455 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.439+0000 7fd5542e1640 10 monclient: _reopen_session rank -1 2026-02-12T04:05:01.455 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.439+0000 7fd5542e1640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T04:05:01.455 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.439+0000 7fd5542e1640 10 monclient(hunting): picked mon.noname-c con 0x7fd54c05d180 addr v1:10.20.193.111:6789/0 2026-02-12T04:05:01.455 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.439+0000 7fd5542e1640 10 monclient(hunting): picked mon.noname-b con 0x7fd54c1599b0 addr v1:10.20.193.98:6789/0 2026-02-12T04:05:01.455 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.439+0000 7fd5542e1640 10 monclient(hunting): picked mon.noname-a con 0x7fd54c166580 addr v1:10.20.193.91:6789/0 2026-02-12T04:05:01.455 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.439+0000 7fd5542e1640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd54c11cf50 con 0x7fd54c166580 2026-02-12T04:05:01.455 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.439+0000 7fd5542e1640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd54c11d230 con 0x7fd54c1599b0 2026-02-12T04:05:01.455 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.439+0000 7fd5542e1640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd54c11d510 con 0x7fd54c05d180 2026-02-12T04:05:01.455 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.439+0000 7fd5542e1640 10 monclient(hunting): _renew_subs 2026-02-12T04:05:01.455 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.439+0000 7fd5542e1640 10 monclient(hunting): authenticate will time out at 1504.182866s 2026-02-12T04:05:01.456 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.440+0000 7fd552857640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7fd54c166580 0x7fd54c143f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:39952/0 (socket says 10.20.193.91:39952) 2026-02-12T04:05:01.456 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.440+0000 7fd552857640 1 -- 10.20.193.91:0/800155492 learned_addr learned my addr 10.20.193.91:0/800155492 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:05:01.456 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.440+0000 7fd532ffd640 10 client.?.objecter ms_handle_connect 0x7fd54c166580 2026-02-12T04:05:01.456 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.440+0000 7fd532ffd640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:01.456 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.440+0000 7fd532ffd640 10 client.?.objecter ms_handle_connect 0x7fd54c05d180 2026-02-12T04:05:01.456 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.440+0000 7fd532ffd640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:01.456 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.441+0000 7fd532ffd640 10 client.?.objecter ms_handle_connect 0x7fd54c1599b0 2026-02-12T04:05:01.456 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.441+0000 7fd532ffd640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:01.456 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.441+0000 7fd532ffd640 1 -- 10.20.193.91:0/800155492 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4094700546 0 0) 0x7fd54c11cf50 con 0x7fd54c166580 2026-02-12T04:05:01.456 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.441+0000 7fd532ffd640 10 monclient(hunting): _negotiate 2026-02-12T04:05:01.456 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.441+0000 7fd532ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:01.456 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.441+0000 7fd532ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:01.457 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.441+0000 7fd532ffd640 10 monclient(hunting): my global_id is 30774 2026-02-12T04:05:01.457 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.441+0000 7fd532ffd640 1 -- 10.20.193.91:0/800155492 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd51c003610 con 0x7fd54c166580 2026-02-12T04:05:01.457 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.441+0000 7fd532ffd640 1 -- 10.20.193.91:0/800155492 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2650905376 0 0) 0x7fd54c11d510 con 0x7fd54c05d180 2026-02-12T04:05:01.457 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.441+0000 7fd532ffd640 10 monclient(hunting): _negotiate 2026-02-12T04:05:01.457 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.441+0000 7fd532ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:01.457 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.441+0000 7fd532ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:01.457 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.441+0000 7fd532ffd640 10 monclient(hunting): my global_id is 27611 2026-02-12T04:05:01.457 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.441+0000 7fd532ffd640 1 -- 10.20.193.91:0/800155492 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd54c11cf50 con 0x7fd54c05d180 2026-02-12T04:05:01.457 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.442+0000 7fd532ffd640 1 -- 10.20.193.91:0/800155492 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3319161018 0 0) 0x7fd54c11d230 con 0x7fd54c1599b0 2026-02-12T04:05:01.457 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.442+0000 7fd532ffd640 10 monclient(hunting): _negotiate 2026-02-12T04:05:01.457 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.442+0000 7fd532ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:01.457 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.442+0000 7fd532ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:01.458 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.442+0000 7fd532ffd640 10 monclient(hunting): my global_id is 27916 2026-02-12T04:05:01.458 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.442+0000 7fd532ffd640 1 -- 10.20.193.91:0/800155492 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd54c11d510 con 0x7fd54c1599b0 2026-02-12T04:05:01.458 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.444+0000 7fd532ffd640 1 -- 10.20.193.91:0/800155492 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2695045784 0 0) 0x7fd51c003610 con 0x7fd54c166580 2026-02-12T04:05:01.458 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.444+0000 7fd532ffd640 1 -- 10.20.193.91:0/800155492 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd54c11d230 con 0x7fd54c166580 2026-02-12T04:05:01.458 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.444+0000 7fd532ffd640 1 -- 10.20.193.91:0/800155492 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd5480033c0 con 0x7fd54c166580 2026-02-12T04:05:01.458 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.444+0000 7fd532ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:01.458 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.444+0000 7fd532ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T04:05:01.458 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.444+0000 7fd532ffd640 10 monclient(hunting): dump: 2026-02-12T04:05:01.458 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:01.458 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:01.458 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.458 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.459 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:01.459 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:01.459 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:01.459 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:01.459 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:01.459 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.459 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.444+0000 7fd532ffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:05:01.459 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.444+0000 7fd532ffd640 1 -- 10.20.193.91:0/800155492 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3783033308 0 0) 0x7fd54c11cf50 con 0x7fd54c05d180 2026-02-12T04:05:01.459 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.444+0000 7fd532ffd640 1 -- 10.20.193.91:0/800155492 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd51c003610 con 0x7fd54c05d180 2026-02-12T04:05:01.459 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.444+0000 7fd532ffd640 1 -- 10.20.193.91:0/800155492 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd53c0030b0 con 0x7fd54c05d180 2026-02-12T04:05:01.459 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.444+0000 7fd532ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:01.459 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.444+0000 7fd532ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T04:05:01.460 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.444+0000 7fd532ffd640 10 monclient(hunting): dump: 2026-02-12T04:05:01.460 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:01.460 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:01.460 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.460 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.460 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:01.460 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:01.460 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:01.460 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:01.460 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:01.460 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.460 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.444+0000 7fd532ffd640 1 -- 10.20.193.91:0/800155492 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2798902779 0 0) 0x7fd54c11d510 con 0x7fd54c1599b0 2026-02-12T04:05:01.460 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.444+0000 7fd532ffd640 1 -- 10.20.193.91:0/800155492 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd54c11cf50 con 0x7fd54c1599b0 2026-02-12T04:05:01.461 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.444+0000 7fd532ffd640 1 -- 10.20.193.91:0/800155492 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd540003240 con 0x7fd54c1599b0 2026-02-12T04:05:01.461 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.444+0000 7fd532ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:01.461 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.444+0000 7fd532ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T04:05:01.461 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.444+0000 7fd532ffd640 10 monclient(hunting): dump: 2026-02-12T04:05:01.461 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:01.461 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:01.461 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.461 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.461 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:01.461 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:01.461 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:01.461 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:01.461 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:01.462 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.462 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.445+0000 7fd532ffd640 1 -- 10.20.193.91:0/800155492 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 401720773 0 0) 0x7fd54c11d230 con 0x7fd54c166580 2026-02-12T04:05:01.462 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.445+0000 7fd532ffd640 1 -- 10.20.193.91:0/800155492 >> v1:10.20.193.111:6789/0 conn(0x7fd54c05d180 legacy=0x7fd54c11e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:01.462 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.445+0000 7fd532ffd640 1 -- 10.20.193.91:0/800155492 >> v1:10.20.193.98:6789/0 conn(0x7fd54c1599b0 legacy=0x7fd54c134bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:01.462 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.445+0000 7fd532ffd640 10 monclient: _finish_hunting 0 2026-02-12T04:05:01.462 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.445+0000 7fd532ffd640 1 monclient: found mon.a 2026-02-12T04:05:01.462 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.445+0000 7fd532ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:05:01.462 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.445+0000 7fd532ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:05:01.462 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.445+0000 7fd532ffd640 1 -- 10.20.193.91:0/800155492 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd54c11d7f0 con 0x7fd54c166580 2026-02-12T04:05:01.462 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.445+0000 7fd532ffd640 10 monclient: _finish_auth 0 2026-02-12T04:05:01.462 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.445+0000 7fd532ffd640 10 monclient: _check_auth_tickets 2026-02-12T04:05:01.462 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.445+0000 7fd532ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:05:01.463 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.445+0000 7fd5542e1640 5 monclient: authenticate success, global_id 30774 2026-02-12T04:05:01.463 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.445+0000 7fd5542e1640 10 monclient: _renew_subs 2026-02-12T04:05:01.463 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.445+0000 7fd5542e1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:05:01.463 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.445+0000 7fd5542e1640 1 -- 10.20.193.91:0/800155492 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd54c11dad0 con 0x7fd54c166580 2026-02-12T04:05:01.463 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.445+0000 7fd5542e1640 10 client.30774.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:05:01.463 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.445+0000 7fd5542e1640 10 monclient: _renew_subs 2026-02-12T04:05:01.463 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.445+0000 7fd5542e1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:05:01.463 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.445+0000 7fd5542e1640 1 -- 10.20.193.91:0/800155492 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd54c155c90 con 0x7fd54c166580 2026-02-12T04:05:01.463 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.445+0000 7fd5542e1640 1 librados: init done 2026-02-12T04:05:01.463 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.446+0000 7fd5542e1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T04:05:01.463 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.446+0000 7fd5542e1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:05:01.463 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.446+0000 7fd5542e1640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:05:01.463 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.446+0000 7fd5542e1640 1 -- 10.20.193.91:0/800155492 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd54c138a40 con 0x7fd54c166580 2026-02-12T04:05:01.545 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.543+0000 7fd532ffd640 1 -- 10.20.193.91:0/800155492 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd548003560 con 0x7fd54c166580 2026-02-12T04:05:01.545 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.543+0000 7fd532ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T04:05:01.545 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.543+0000 7fd532ffd640 1 -- 10.20.193.91:0/800155492 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fd548003c60 con 0x7fd54c166580 2026-02-12T04:05:01.546 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.543+0000 7fd532ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:01.546 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.543+0000 7fd532ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T04:05:01.546 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.543+0000 7fd550853640 4 set_mon_vals no callback set 2026-02-12T04:05:01.546 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.543+0000 7fd532ffd640 10 monclient: dump: 2026-02-12T04:05:01.546 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:01.546 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:01.546 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.546 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.546 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:01.546 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:01.546 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:01.547 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:01.547 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:01.547 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.544+0000 7fd532ffd640 1 -- 10.20.193.91:0/800155492 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7fd548003e40 con 0x7fd54c166580 2026-02-12T04:05:01.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.544+0000 7fd552056640 10 monclient: get_auth_request con 0x7fd51c07a090 auth_method 0 2026-02-12T04:05:01.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.544+0000 7fd532ffd640 10 client.30774.objecter ms_handle_connect 0x7fd51c07a090 2026-02-12T04:05:01.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.545+0000 7fd532ffd640 1 -- 10.20.193.91:0/800155492 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7fd548095d20 con 0x7fd54c166580 2026-02-12T04:05:01.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.545+0000 7fd532ffd640 10 client.30774.objecter ms_dispatch2 0x7fd54c000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:05:01.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.545+0000 7fd532ffd640 3 client.30774.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:05:01.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.545+0000 7fd532ffd640 3 client.30774.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:05:01.548 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.545+0000 7fd532ffd640 20 client.30774.objecter dump_active .. 0 homeless 2026-02-12T04:05:01.550 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.548+0000 7fd532ffd640 1 -- 10.20.193.91:0/800155492 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7fd54805f680 con 0x7fd54c166580 2026-02-12T04:05:01.550 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.548+0000 7fd532ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:05:01.550 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.548+0000 7fd532ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T04:05:01.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.658+0000 7fd5542e1640 1 -- 10.20.193.91:0/800155492 --> v1:10.20.193.91:6800/2929217192 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fd54c0ae340 con 0x7fd51c07a090 2026-02-12T04:05:01.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.658+0000 7fd532ffd640 1 -- 10.20.193.91:0/800155492 <== mgr.4113 v1:10.20.193.91:6800/2929217192 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (unknown 3526570807 0 0) 0x7fd54c0ae340 con 0x7fd51c07a090 2026-02-12T04:05:01.660 INFO:teuthology.orchestra.run.trial091.stderr:instructed osd(s) 3 to deep-scrub 2026-02-12T04:05:01.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.659+0000 7fd5542e1640 10 librados: watch_flush enter 2026-02-12T04:05:01.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.659+0000 7fd5542e1640 10 librados: watch_flush exit 2026-02-12T04:05:01.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.659+0000 7fd5542e1640 20 client.30774.objecter shutdown clearing up homeless session... 2026-02-12T04:05:01.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.659+0000 7fd5542e1640 10 client.30774.objecter successfully canceled tick 2026-02-12T04:05:01.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.659+0000 7fd5542e1640 1 -- 10.20.193.91:0/800155492 >> v1:10.20.193.91:6800/2929217192 conn(0x7fd51c07a090 legacy=0x7fd51c09a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:01.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.659+0000 7fd5542e1640 10 monclient: shutdown 2026-02-12T04:05:01.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.659+0000 7fd5542e1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:05:01.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.659+0000 7fd5542e1640 1 -- 10.20.193.91:0/800155492 >> v1:10.20.193.91:6789/0 conn(0x7fd54c166580 legacy=0x7fd54c143f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:01.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.659+0000 7fd5542e1640 1 -- 10.20.193.91:0/800155492 shutdown_connections 2026-02-12T04:05:01.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.659+0000 7fd5542e1640 1 -- 10.20.193.91:0/800155492 >> 10.20.193.91:0/800155492 conn(0x7fd54c0b6560 msgr2=0x7fd54c05d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:05:01.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.659+0000 7fd5542e1640 1 -- 10.20.193.91:0/800155492 shutdown_connections 2026-02-12T04:05:01.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.659+0000 7fd5542e1640 1 -- 10.20.193.91:0/800155492 wait complete. 2026-02-12T04:05:01.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.659+0000 7fd5542e1640 1 librados: shutdown 2026-02-12T04:05:01.669 INFO:tasks.ceph:Scrubbing osd.7 2026-02-12T04:05:01.670 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2026-02-12T04:05:01.740 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.738+0000 7facfed90640 10 monclient: get_monmap_and_config 2026-02-12T04:05:01.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.738+0000 7facfed90640 10 monclient: build_initial_monmap 2026-02-12T04:05:01.741 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.738+0000 7facfed90640 10 monclient: monmap: 2026-02-12T04:05:01.741 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:05:01.741 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:01.741 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:05:01.739473+0000 2026-02-12T04:05:01.741 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:05:01.739473+0000 2026-02-12T04:05:01.742 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:05:01.742 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:01.742 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:05:01.742 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:05:01.742 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:05:01.742 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.744 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.739+0000 7facfed90640 1 Processor -- start 2026-02-12T04:05:01.744 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.739+0000 7facfed90640 1 -- start start 2026-02-12T04:05:01.744 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.739+0000 7facfed90640 10 monclient: init 2026-02-12T04:05:01.744 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.739+0000 7facfed90640 10 monclient: _reopen_session rank -1 2026-02-12T04:05:01.744 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.739+0000 7facfed90640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T04:05:01.744 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.739+0000 7facfed90640 10 monclient(hunting): picked mon.noname-c con 0x7facf8166a30 addr v1:10.20.193.111:6789/0 2026-02-12T04:05:01.745 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.739+0000 7facfed90640 10 monclient(hunting): picked mon.noname-a con 0x7facf80b5420 addr v1:10.20.193.91:6789/0 2026-02-12T04:05:01.745 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.739+0000 7facfed90640 10 monclient(hunting): picked mon.noname-b con 0x7facf80b6c60 addr v1:10.20.193.98:6789/0 2026-02-12T04:05:01.745 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.739+0000 7facfed90640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facf80b58e0 con 0x7facf80b5420 2026-02-12T04:05:01.745 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.740+0000 7facfed90640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facf80b5bc0 con 0x7facf80b6c60 2026-02-12T04:05:01.745 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.740+0000 7facfed90640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facf80b5ea0 con 0x7facf8166a30 2026-02-12T04:05:01.745 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.740+0000 7facfed90640 10 monclient(hunting): _renew_subs 2026-02-12T04:05:01.745 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.740+0000 7facfed90640 10 monclient(hunting): authenticate will time out at 1504.483019s 2026-02-12T04:05:01.745 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.740+0000 7facfd306640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7facf80b6c60 0x7facf81c7b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:38378/0 (socket says 10.20.193.91:38378) 2026-02-12T04:05:01.746 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.740+0000 7facfd306640 1 -- 10.20.193.91:0/3719043888 learned_addr learned my addr 10.20.193.91:0/3719043888 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:05:01.776 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.774+0000 7facef7fe640 1 -- 10.20.193.91:0/3719043888 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1566239411 0 0) 0x7facf80b58e0 con 0x7facf80b5420 2026-02-12T04:05:01.792 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.774+0000 7facef7fe640 10 monclient(hunting): _negotiate 2026-02-12T04:05:01.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.774+0000 7facef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:01.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.774+0000 7facef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:01.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.774+0000 7facef7fe640 10 monclient(hunting): my global_id is 30777 2026-02-12T04:05:01.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.774+0000 7facef7fe640 1 -- 10.20.193.91:0/3719043888 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7face4003610 con 0x7facf80b5420 2026-02-12T04:05:01.801 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.776+0000 7facef7fe640 1 -- 10.20.193.91:0/3719043888 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3248607669 0 0) 0x7face4003610 con 0x7facf80b5420 2026-02-12T04:05:01.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.776+0000 7facef7fe640 1 -- 10.20.193.91:0/3719043888 >> v1:10.20.193.111:6789/0 conn(0x7facf8166a30 legacy=0x7facf81646c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:01.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.776+0000 7facef7fe640 1 -- 10.20.193.91:0/3719043888 >> v1:10.20.193.98:6789/0 conn(0x7facf80b6c60 legacy=0x7facf81c7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:01.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.776+0000 7facef7fe640 10 monclient: _finish_hunting 0 2026-02-12T04:05:01.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.776+0000 7facef7fe640 1 monclient: found mon.noname-a 2026-02-12T04:05:01.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.776+0000 7facef7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:05:01.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.776+0000 7facef7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.91:6789/0 2026-02-12T04:05:01.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.776+0000 7facef7fe640 1 -- 10.20.193.91:0/3719043888 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facf80b6180 con 0x7facf80b5420 2026-02-12T04:05:01.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.776+0000 7facef7fe640 10 monclient: _finish_auth 0 2026-02-12T04:05:01.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.776+0000 7facef7fe640 10 monclient: _check_auth_tickets 2026-02-12T04:05:01.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.776+0000 7facef7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:05:01.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.776+0000 7facef7fe640 1 -- 10.20.193.91:0/3719043888 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7face0002df0 con 0x7facf80b5420 2026-02-12T04:05:01.802 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.776+0000 7facfed90640 5 monclient: authenticate success, global_id 30777 2026-02-12T04:05:01.803 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.776+0000 7facfed90640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:05:01.803 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.776+0000 7facef7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:01.803 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.776+0000 7facef7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T04:05:01.803 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.776+0000 7facef7fe640 10 monclient: dump: 2026-02-12T04:05:01.803 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:01.803 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:01.803 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.803 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.803 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:01.803 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:01.803 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:01.804 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:01.804 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:01.804 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.804 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.776+0000 7facfed90640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:05:01.804 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.777+0000 7facef7fe640 1 -- 10.20.193.91:0/3719043888 <== mon.0 v1:10.20.193.91:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7face0003000 con 0x7facf80b5420 2026-02-12T04:05:01.804 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.777+0000 7facef7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T04:05:01.804 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.777+0000 7facef7fe640 1 -- 10.20.193.91:0/3719043888 <== mon.0 v1:10.20.193.91:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7face0003400 con 0x7facf80b5420 2026-02-12T04:05:01.804 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.777+0000 7facef7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:01.804 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.777+0000 7facef7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T04:05:01.804 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.777+0000 7facef7fe640 10 monclient: dump: 2026-02-12T04:05:01.804 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:01.804 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:01.805 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.805 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.805 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:01.805 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:01.805 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:01.805 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:01.805 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:01.805 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.777+0000 7facfed90640 10 monclient: get_monmap_and_config success 2026-02-12T04:05:01.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.777+0000 7facfed90640 4 set_mon_vals no callback set 2026-02-12T04:05:01.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.777+0000 7facfed90640 10 monclient: shutdown 2026-02-12T04:05:01.805 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.777+0000 7facfed90640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:05:01.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.777+0000 7facfed90640 1 -- 10.20.193.91:0/3719043888 >> v1:10.20.193.91:6789/0 conn(0x7facf80b5420 legacy=0x7facf815ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:01.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.777+0000 7facfed90640 1 -- 10.20.193.91:0/3719043888 shutdown_connections 2026-02-12T04:05:01.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.777+0000 7facfed90640 1 -- 10.20.193.91:0/3719043888 >> 10.20.193.91:0/3719043888 conn(0x7facf80baaa0 msgr2=0x7facf80baea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:05:01.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.777+0000 7facfed90640 1 -- 10.20.193.91:0/3719043888 shutdown_connections 2026-02-12T04:05:01.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.777+0000 7facfed90640 1 -- 10.20.193.91:0/3719043888 wait complete. 2026-02-12T04:05:01.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.778+0000 7facfed90640 10 monclient: build_initial_monmap 2026-02-12T04:05:01.806 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.778+0000 7facfed90640 10 monclient: monmap: 2026-02-12T04:05:01.806 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:05:01.806 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:05:01.806 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:05:01.806 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:05:01.806 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:05:01.806 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:05:01.807 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:05:01.807 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:05:01.807 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:05:01.807 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.778+0000 7facfed90640 1 librados: starting msgr at 2026-02-12T04:05:01.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.778+0000 7facfed90640 1 librados: starting objecter 2026-02-12T04:05:01.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.778+0000 7facfed90640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:05:01.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.778+0000 7facfed90640 1 Processor -- start 2026-02-12T04:05:01.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.778+0000 7facfed90640 1 -- start start 2026-02-12T04:05:01.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.778+0000 7facfed90640 1 librados: setting wanted keys 2026-02-12T04:05:01.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.778+0000 7facfed90640 1 librados: calling monclient init 2026-02-12T04:05:01.807 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.778+0000 7facfed90640 10 monclient: init 2026-02-12T04:05:01.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.778+0000 7facfed90640 10 monclient: _reopen_session rank -1 2026-02-12T04:05:01.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.778+0000 7facfed90640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T04:05:01.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.778+0000 7facfed90640 10 monclient(hunting): picked mon.noname-b con 0x7facf80b5420 addr v1:10.20.193.98:6789/0 2026-02-12T04:05:01.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.778+0000 7facfed90640 10 monclient(hunting): picked mon.noname-a con 0x7facf80b6c60 addr v1:10.20.193.91:6789/0 2026-02-12T04:05:01.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.778+0000 7facfed90640 10 monclient(hunting): picked mon.noname-c con 0x7facf8166a30 addr v1:10.20.193.111:6789/0 2026-02-12T04:05:01.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.778+0000 7facfed90640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facf80b90b0 con 0x7facf80b6c60 2026-02-12T04:05:01.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.778+0000 7facfed90640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facf80b9390 con 0x7facf80b5420 2026-02-12T04:05:01.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.778+0000 7facfed90640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facf80b9670 con 0x7facf8166a30 2026-02-12T04:05:01.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.778+0000 7facfed90640 10 monclient(hunting): _renew_subs 2026-02-12T04:05:01.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.778+0000 7facfed90640 10 monclient(hunting): authenticate will time out at 1504.521974s 2026-02-12T04:05:01.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.779+0000 7faceffff640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7facf80b6c60 0x7facf80b88a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:39970/0 (socket says 10.20.193.91:39970) 2026-02-12T04:05:01.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.779+0000 7faceffff640 1 -- 10.20.193.91:0/3733396941 learned_addr learned my addr 10.20.193.91:0/3733396941 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:05:01.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.779+0000 7faced7fa640 10 client.?.objecter ms_handle_connect 0x7facf80b5420 2026-02-12T04:05:01.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.779+0000 7faced7fa640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:01.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.779+0000 7faced7fa640 10 client.?.objecter ms_handle_connect 0x7facf80b6c60 2026-02-12T04:05:01.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.779+0000 7faced7fa640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:01.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.780+0000 7faced7fa640 10 client.?.objecter ms_handle_connect 0x7facf8166a30 2026-02-12T04:05:01.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.780+0000 7faced7fa640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:01.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.780+0000 7faced7fa640 1 -- 10.20.193.91:0/3733396941 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3232561802 0 0) 0x7facf80b90b0 con 0x7facf80b6c60 2026-02-12T04:05:01.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.780+0000 7faced7fa640 10 monclient(hunting): _negotiate 2026-02-12T04:05:01.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.780+0000 7faced7fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:01.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.780+0000 7faced7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:01.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.780+0000 7faced7fa640 10 monclient(hunting): my global_id is 30780 2026-02-12T04:05:01.809 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.780+0000 7faced7fa640 1 -- 10.20.193.91:0/3733396941 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7facc8003610 con 0x7facf80b6c60 2026-02-12T04:05:01.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.781+0000 7faced7fa640 1 -- 10.20.193.91:0/3733396941 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3053849802 0 0) 0x7facf80b9670 con 0x7facf8166a30 2026-02-12T04:05:01.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.781+0000 7faced7fa640 10 monclient(hunting): _negotiate 2026-02-12T04:05:01.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.781+0000 7faced7fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:01.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.781+0000 7faced7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:01.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.781+0000 7faced7fa640 10 monclient(hunting): my global_id is 27617 2026-02-12T04:05:01.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.781+0000 7faced7fa640 1 -- 10.20.193.91:0/3733396941 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7facf80b90b0 con 0x7facf8166a30 2026-02-12T04:05:01.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.781+0000 7faced7fa640 1 -- 10.20.193.91:0/3733396941 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2491462736 0 0) 0x7facf80b9390 con 0x7facf80b5420 2026-02-12T04:05:01.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.781+0000 7faced7fa640 10 monclient(hunting): _negotiate 2026-02-12T04:05:01.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.781+0000 7faced7fa640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:01.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.781+0000 7faced7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:01.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.781+0000 7faced7fa640 10 monclient(hunting): my global_id is 27919 2026-02-12T04:05:01.810 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.781+0000 7faced7fa640 1 -- 10.20.193.91:0/3733396941 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7facf80b9670 con 0x7facf80b5420 2026-02-12T04:05:01.811 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.784+0000 7faced7fa640 1 -- 10.20.193.91:0/3733396941 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2160661982 0 0) 0x7facf80b90b0 con 0x7facf8166a30 2026-02-12T04:05:01.811 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.784+0000 7faced7fa640 1 -- 10.20.193.91:0/3733396941 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7facf80b9390 con 0x7facf8166a30 2026-02-12T04:05:01.811 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.784+0000 7faced7fa640 1 -- 10.20.193.91:0/3733396941 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7facf4003250 con 0x7facf8166a30 2026-02-12T04:05:01.811 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.784+0000 7faced7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:01.811 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.784+0000 7faced7fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T04:05:01.811 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.784+0000 7faced7fa640 10 monclient(hunting): dump: 2026-02-12T04:05:01.811 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:01.811 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:01.811 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.811 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.811 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:01.811 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:01.811 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:01.812 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:01.812 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:01.812 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.784+0000 7faced7fa640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:05:01.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.784+0000 7faced7fa640 1 -- 10.20.193.91:0/3733396941 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4014656909 0 0) 0x7facf80b9670 con 0x7facf80b5420 2026-02-12T04:05:01.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.784+0000 7faced7fa640 1 -- 10.20.193.91:0/3733396941 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7facf80b90b0 con 0x7facf80b5420 2026-02-12T04:05:01.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.784+0000 7faced7fa640 1 -- 10.20.193.91:0/3733396941 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7face8002f70 con 0x7facf80b5420 2026-02-12T04:05:01.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.784+0000 7faced7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:01.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.784+0000 7faced7fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T04:05:01.812 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.784+0000 7faced7fa640 10 monclient(hunting): dump: 2026-02-12T04:05:01.812 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:01.812 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:01.813 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.813 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.813 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:01.813 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:01.813 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:01.813 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:01.813 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:01.813 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.784+0000 7faced7fa640 1 -- 10.20.193.91:0/3733396941 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2128905834 0 0) 0x7facc8003610 con 0x7facf80b6c60 2026-02-12T04:05:01.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.784+0000 7faced7fa640 1 -- 10.20.193.91:0/3733396941 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7facf80b9670 con 0x7facf80b6c60 2026-02-12T04:05:01.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.784+0000 7faced7fa640 1 -- 10.20.193.91:0/3733396941 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7face0002d80 con 0x7facf80b6c60 2026-02-12T04:05:01.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.784+0000 7faced7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:01.813 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.784+0000 7faced7fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T04:05:01.814 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.784+0000 7faced7fa640 10 monclient(hunting): dump: 2026-02-12T04:05:01.814 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:01.814 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:01.814 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.814 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.814 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:01.814 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:01.814 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:01.814 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:01.814 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:01.815 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.785+0000 7faced7fa640 1 -- 10.20.193.91:0/3733396941 <== mon.2 v1:10.20.193.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 296301151 0 0) 0x7facf80b9390 con 0x7facf8166a30 2026-02-12T04:05:01.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.785+0000 7faced7fa640 1 -- 10.20.193.91:0/3733396941 >> v1:10.20.193.98:6789/0 conn(0x7facf80b5420 legacy=0x7facf80b2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:01.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.785+0000 7faced7fa640 1 -- 10.20.193.91:0/3733396941 >> v1:10.20.193.91:6789/0 conn(0x7facf80b6c60 legacy=0x7facf80b88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:01.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.785+0000 7faced7fa640 10 monclient: _finish_hunting 0 2026-02-12T04:05:01.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.785+0000 7faced7fa640 1 monclient: found mon.c 2026-02-12T04:05:01.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.785+0000 7faced7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:05:01.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.785+0000 7faced7fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:05:01.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.785+0000 7faced7fa640 1 -- 10.20.193.91:0/3733396941 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facf8157d70 con 0x7facf8166a30 2026-02-12T04:05:01.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.785+0000 7faced7fa640 10 monclient: _finish_auth 0 2026-02-12T04:05:01.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.785+0000 7faced7fa640 10 monclient: _check_auth_tickets 2026-02-12T04:05:01.815 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.785+0000 7faced7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:05:01.816 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.785+0000 7facfed90640 5 monclient: authenticate success, global_id 27617 2026-02-12T04:05:01.816 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.785+0000 7facfed90640 10 monclient: _renew_subs 2026-02-12T04:05:01.816 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.785+0000 7facfed90640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:05:01.816 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.785+0000 7facfed90640 1 -- 10.20.193.91:0/3733396941 --> v1:10.20.193.111:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7facf8134000 con 0x7facf8166a30 2026-02-12T04:05:01.816 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.785+0000 7facfed90640 10 client.27617.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:05:01.816 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.785+0000 7facfed90640 10 monclient: _renew_subs 2026-02-12T04:05:01.816 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.785+0000 7facfed90640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:05:01.816 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.785+0000 7facfed90640 1 -- 10.20.193.91:0/3733396941 --> v1:10.20.193.111:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7facf8158e60 con 0x7facf8166a30 2026-02-12T04:05:01.816 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.785+0000 7facfed90640 1 librados: init done 2026-02-12T04:05:01.816 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.786+0000 7facfed90640 10 client.27617.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:05:01.816 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.786+0000 7facfed90640 15 client.27617.objecter _session_command_op_assign -1 1 2026-02-12T04:05:01.816 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.786+0000 7facfed90640 20 client.27617.objecter _get_session osd=-1 returning homeless 2026-02-12T04:05:01.817 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.786+0000 7facfed90640 10 client.27617.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:05:01.817 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.786+0000 7facfed90640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:05:01.817 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.786+0000 7facfed90640 1 -- 10.20.193.91:0/3733396941 --> v1:10.20.193.111:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7facf8061730 con 0x7facf8166a30 2026-02-12T04:05:01.817 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.794+0000 7faced7fa640 1 -- 10.20.193.91:0/3733396941 <== mon.2 v1:10.20.193.111:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7facf8061730 con 0x7facf8166a30 2026-02-12T04:05:01.817 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.794+0000 7faced7fa640 10 monclient: handle_config config(0 keys) 2026-02-12T04:05:01.817 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.794+0000 7faced7fa640 1 -- 10.20.193.91:0/3733396941 <== mon.2 v1:10.20.193.111:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7facf4004c50 con 0x7facf8166a30 2026-02-12T04:05:01.817 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.794+0000 7faced7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:01.817 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.794+0000 7faced7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T04:05:01.817 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.794+0000 7faced7fa640 10 monclient: dump: 2026-02-12T04:05:01.817 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:01.817 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:01.817 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.818 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.818 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:01.818 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:01.818 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:01.818 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:01.818 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:01.818 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.794+0000 7faceeffd640 4 set_mon_vals no callback set 2026-02-12T04:05:01.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.794+0000 7faced7fa640 1 -- 10.20.193.91:0/3733396941 <== mon.2 v1:10.20.193.111:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7facf4004e60 con 0x7facf8166a30 2026-02-12T04:05:01.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.795+0000 7facfcb05640 10 monclient: get_auth_request con 0x7facc807a0e0 auth_method 0 2026-02-12T04:05:01.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.795+0000 7faced7fa640 10 client.27617.objecter ms_handle_connect 0x7facc807a0e0 2026-02-12T04:05:01.818 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.795+0000 7faced7fa640 1 -- 10.20.193.91:0/3733396941 <== mon.2 v1:10.20.193.111:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7facf4004c50 con 0x7facf8166a30 2026-02-12T04:05:01.819 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.795+0000 7faced7fa640 10 client.27617.objecter ms_dispatch2 0x7facf8000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:05:01.819 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.795+0000 7faced7fa640 3 client.27617.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:05:01.819 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.795+0000 7faced7fa640 3 client.27617.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:05:01.819 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.796+0000 7faced7fa640 10 client.27617.objecter checking command 1 2026-02-12T04:05:01.819 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.796+0000 7faced7fa640 20 client.27617.objecter _get_session s=0x7facc80a4390 osd=7 3 2026-02-12T04:05:01.819 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.796+0000 7faced7fa640 20 client.27617.objecter put_session s=0x7facc80a4390 osd=7 3 2026-02-12T04:05:01.819 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.796+0000 7faced7fa640 15 client.27617.objecter _session_command_op_remove -1 1 2026-02-12T04:05:01.819 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.796+0000 7faced7fa640 20 client.27617.objecter _get_session s=0x7facc80a4390 osd=7 3 2026-02-12T04:05:01.819 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.796+0000 7faced7fa640 20 client.27617.objecter get_session s=0x7facc80a4390 osd=7 3 2026-02-12T04:05:01.819 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.796+0000 7faced7fa640 15 client.27617.objecter _session_command_op_assign 7 1 2026-02-12T04:05:01.819 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.796+0000 7faced7fa640 20 client.27617.objecter put_session s=0x7facc80a4390 osd=7 4 2026-02-12T04:05:01.819 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.796+0000 7faced7fa640 10 client.27617.objecter _send_command 1 2026-02-12T04:05:01.819 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.796+0000 7faced7fa640 1 -- 10.20.193.91:0/3733396941 --> v1:10.20.193.154:6808/903276772 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7facc80c66a0 con 0x7facc80a4a40 2026-02-12T04:05:01.820 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.796+0000 7faced7fa640 20 client.27617.objecter dump_active .. 0 homeless 2026-02-12T04:05:01.820 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.796+0000 7faceffff640 10 monclient: get_auth_request con 0x7facc80a4a40 auth_method 0 2026-02-12T04:05:01.820 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.796+0000 7faced7fa640 1 -- 10.20.193.91:0/3733396941 <== mon.2 v1:10.20.193.111:6789/0 9 ==== mon_get_version_reply(handle=1 version=344) ==== 24+0+0 (unknown 1403447244 0 0) 0x7facf405b120 con 0x7facf8166a30 2026-02-12T04:05:01.820 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.796+0000 7faced7fa640 10 monclient: handle_get_version_reply finishing 1 version 344 2026-02-12T04:05:01.820 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.797+0000 7faced7fa640 10 client.27617.objecter ms_handle_connect 0x7facc80a4a40 2026-02-12T04:05:01.821 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.807+0000 7faced7fa640 1 -- 10.20.193.91:0/3733396941 <== osd.7 v1:10.20.193.154:6808/903276772 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7facc80c66a0 con 0x7facc80a4a40 2026-02-12T04:05:01.821 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.807+0000 7faced7fa640 10 client.27617.objecter ms_dispatch2 0x7facf8000b90 command_reply(tid 1: 0 ) 2026-02-12T04:05:01.821 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.807+0000 7faced7fa640 10 client.27617.objecter _finish_command 1 = system:0 2026-02-12T04:05:01.821 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.807+0000 7faced7fa640 20 client.27617.objecter put_session s=0x7facc80a4390 osd=7 4 2026-02-12T04:05:01.821 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.807+0000 7faced7fa640 15 client.27617.objecter _session_command_op_remove 7 1 2026-02-12T04:05:01.821 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.814+0000 7facfed90640 10 client.27617.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-12T04:05:01.821 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.814+0000 7facfed90640 15 client.27617.objecter _session_command_op_assign -1 2 2026-02-12T04:05:01.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.814+0000 7facfed90640 20 client.27617.objecter _get_session s=0x7facc80a4390 osd=7 3 2026-02-12T04:05:01.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.814+0000 7facfed90640 20 client.27617.objecter put_session s=0x7facc80a4390 osd=7 3 2026-02-12T04:05:01.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.814+0000 7facfed90640 20 client.27617.objecter _get_session s=0x7facc80a4390 osd=7 3 2026-02-12T04:05:01.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.814+0000 7facfed90640 15 client.27617.objecter _session_command_op_remove -1 2 2026-02-12T04:05:01.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.814+0000 7facfed90640 20 client.27617.objecter get_session s=0x7facc80a4390 osd=7 3 2026-02-12T04:05:01.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.814+0000 7facfed90640 15 client.27617.objecter _session_command_op_assign 7 2 2026-02-12T04:05:01.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.814+0000 7facfed90640 20 client.27617.objecter put_session s=0x7facc80a4390 osd=7 4 2026-02-12T04:05:01.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.814+0000 7facfed90640 10 client.27617.objecter _send_command 2 2026-02-12T04:05:01.822 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.814+0000 7facfed90640 1 -- 10.20.193.91:0/3733396941 --> v1:10.20.193.154:6808/903276772 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7facf8157b60 con 0x7facc80a4a40 2026-02-12T04:05:01.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.822+0000 7faced7fa640 1 -- 10.20.193.91:0/3733396941 <== osd.7 v1:10.20.193.154:6808/903276772 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7facf8157b60 con 0x7facc80a4a40 2026-02-12T04:05:01.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.822+0000 7faced7fa640 10 client.27617.objecter ms_dispatch2 0x7facf8000b90 command_reply(tid 2: 0 ) 2026-02-12T04:05:01.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.822+0000 7faced7fa640 10 client.27617.objecter _finish_command 2 = system:0 2026-02-12T04:05:01.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.822+0000 7faced7fa640 20 client.27617.objecter put_session s=0x7facc80a4390 osd=7 4 2026-02-12T04:05:01.824 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.822+0000 7faced7fa640 15 client.27617.objecter _session_command_op_remove 7 2 2026-02-12T04:05:01.824 INFO:teuthology.orchestra.run.trial091.stdout:{ 2026-02-12T04:05:01.824 INFO:teuthology.orchestra.run.trial091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-12T04:05:01.825 INFO:teuthology.orchestra.run.trial091.stdout:} 2026-02-12T04:05:01.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.822+0000 7facfed90640 10 librados: watch_flush enter 2026-02-12T04:05:01.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.822+0000 7facfed90640 10 librados: watch_flush exit 2026-02-12T04:05:01.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.822+0000 7facfed90640 10 client.27617.objecter close_session for osd.7 2026-02-12T04:05:01.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.822+0000 7facfed90640 1 -- 10.20.193.91:0/3733396941 >> v1:10.20.193.154:6808/903276772 conn(0x7facc80a4a40 legacy=0x7facc80c4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:01.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.822+0000 7facfed90640 20 client.27617.objecter put_session s=0x7facc80a4390 osd=7 1 2026-02-12T04:05:01.826 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.822+0000 7facfed90640 20 client.27617.objecter shutdown clearing up homeless session... 2026-02-12T04:05:01.827 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.822+0000 7facfed90640 10 client.27617.objecter successfully canceled tick 2026-02-12T04:05:01.827 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.822+0000 7facfed90640 1 -- 10.20.193.91:0/3733396941 >> v1:10.20.193.91:6800/2929217192 conn(0x7facc807a0e0 legacy=0x7facc809a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:01.827 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.822+0000 7facfed90640 10 monclient: shutdown 2026-02-12T04:05:01.827 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.822+0000 7facfed90640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:05:01.827 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.822+0000 7facfed90640 1 -- 10.20.193.91:0/3733396941 >> v1:10.20.193.111:6789/0 conn(0x7facf8166a30 legacy=0x7facf8158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:01.827 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.822+0000 7facfd306640 1 -- 10.20.193.91:0/3733396941 reap_dead start 2026-02-12T04:05:01.827 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.822+0000 7facfed90640 1 -- 10.20.193.91:0/3733396941 shutdown_connections 2026-02-12T04:05:01.827 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.822+0000 7facfed90640 1 -- 10.20.193.91:0/3733396941 >> 10.20.193.91:0/3733396941 conn(0x7facf80baaa0 msgr2=0x7facf8153590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:05:01.827 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.822+0000 7facfed90640 1 -- 10.20.193.91:0/3733396941 shutdown_connections 2026-02-12T04:05:01.827 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.822+0000 7facfed90640 1 -- 10.20.193.91:0/3733396941 wait complete. 2026-02-12T04:05:01.827 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.822+0000 7facfed90640 1 librados: shutdown 2026-02-12T04:05:01.832 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2026-02-12T04:05:01.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.899+0000 7f6305d67640 10 monclient: get_monmap_and_config 2026-02-12T04:05:01.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.899+0000 7f6305d67640 10 monclient: build_initial_monmap 2026-02-12T04:05:01.901 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.899+0000 7f6305d67640 10 monclient: monmap: 2026-02-12T04:05:01.901 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:05:01.901 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:01.901 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:05:01.899869+0000 2026-02-12T04:05:01.901 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:05:01.899869+0000 2026-02-12T04:05:01.902 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:05:01.902 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:01.902 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:05:01.902 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:05:01.902 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:05:01.902 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.899+0000 7f6305d67640 1 Processor -- start 2026-02-12T04:05:01.904 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.899+0000 7f6305d67640 1 -- start start 2026-02-12T04:05:01.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.899+0000 7f6305d67640 10 monclient: init 2026-02-12T04:05:01.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.900+0000 7f6305d67640 10 monclient: _reopen_session rank -1 2026-02-12T04:05:01.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.900+0000 7f6305d67640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T04:05:01.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.900+0000 7f6305d67640 10 monclient(hunting): picked mon.noname-a con 0x7f63001575d0 addr v1:10.20.193.91:6789/0 2026-02-12T04:05:01.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.900+0000 7f6305d67640 10 monclient(hunting): picked mon.noname-b con 0x7f6300163310 addr v1:10.20.193.98:6789/0 2026-02-12T04:05:01.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.900+0000 7f6305d67640 10 monclient(hunting): picked mon.noname-c con 0x7f63000560d0 addr v1:10.20.193.111:6789/0 2026-02-12T04:05:01.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.900+0000 7f6305d67640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63000b20b0 con 0x7f63001575d0 2026-02-12T04:05:01.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.900+0000 7f6305d67640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63000b2390 con 0x7f6300163310 2026-02-12T04:05:01.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.900+0000 7f6305d67640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63000b2670 con 0x7f63000560d0 2026-02-12T04:05:01.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.900+0000 7f6305d67640 10 monclient(hunting): _renew_subs 2026-02-12T04:05:01.905 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.900+0000 7f6305d67640 10 monclient(hunting): authenticate will time out at 1504.643499s 2026-02-12T04:05:01.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.900+0000 7f62feffd640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7f6300163310 0x7f63000559c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:38402/0 (socket says 10.20.193.91:38402) 2026-02-12T04:05:01.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.900+0000 7f62feffd640 1 -- 10.20.193.91:0/4187275622 learned_addr learned my addr 10.20.193.91:0/4187275622 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:05:01.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.902+0000 7f62fe7fc640 1 -- 10.20.193.91:0/4187275622 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4277994627 0 0) 0x7f63000b2390 con 0x7f6300163310 2026-02-12T04:05:01.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.902+0000 7f62fe7fc640 10 monclient(hunting): _negotiate 2026-02-12T04:05:01.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.902+0000 7f62fe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:01.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.902+0000 7f62fe7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:01.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.902+0000 7f62fe7fc640 10 monclient(hunting): my global_id is 27922 2026-02-12T04:05:01.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.902+0000 7f62fe7fc640 1 -- 10.20.193.91:0/4187275622 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62e4003610 con 0x7f6300163310 2026-02-12T04:05:01.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.902+0000 7f62fe7fc640 1 -- 10.20.193.91:0/4187275622 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3960656576 0 0) 0x7f63000b20b0 con 0x7f63001575d0 2026-02-12T04:05:01.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.902+0000 7f62fe7fc640 10 monclient(hunting): _negotiate 2026-02-12T04:05:01.906 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.902+0000 7f62fe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:01.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.902+0000 7f62fe7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:01.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.902+0000 7f62fe7fc640 10 monclient(hunting): my global_id is 30783 2026-02-12T04:05:01.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.902+0000 7f62fe7fc640 1 -- 10.20.193.91:0/4187275622 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63000b2390 con 0x7f63001575d0 2026-02-12T04:05:01.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.902+0000 7f62fe7fc640 1 -- 10.20.193.91:0/4187275622 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4288337974 0 0) 0x7f63000b2670 con 0x7f63000560d0 2026-02-12T04:05:01.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.902+0000 7f62fe7fc640 10 monclient(hunting): _negotiate 2026-02-12T04:05:01.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.902+0000 7f62fe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:01.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.902+0000 7f62fe7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:01.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.902+0000 7f62fe7fc640 10 monclient(hunting): my global_id is 27620 2026-02-12T04:05:01.907 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.902+0000 7f62fe7fc640 1 -- 10.20.193.91:0/4187275622 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63000b20b0 con 0x7f63000560d0 2026-02-12T04:05:01.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.903+0000 7f62fe7fc640 1 -- 10.20.193.91:0/4187275622 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4003823176 0 0) 0x7f62e4003610 con 0x7f6300163310 2026-02-12T04:05:01.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.903+0000 7f62fe7fc640 1 -- 10.20.193.91:0/4187275622 >> v1:10.20.193.111:6789/0 conn(0x7f63000560d0 legacy=0x7f63001c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:01.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.904+0000 7f62fe7fc640 1 -- 10.20.193.91:0/4187275622 >> v1:10.20.193.91:6789/0 conn(0x7f63001575d0 legacy=0x7f6300162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:01.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.904+0000 7f62fe7fc640 10 monclient: _finish_hunting 0 2026-02-12T04:05:01.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.904+0000 7f62fe7fc640 1 monclient: found mon.noname-b 2026-02-12T04:05:01.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.904+0000 7f62fe7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:05:01.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.904+0000 7f62fe7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T04:05:01.913 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.904+0000 7f62fe7fc640 1 -- 10.20.193.91:0/4187275622 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6300162400 con 0x7f6300163310 2026-02-12T04:05:01.914 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.904+0000 7f62fe7fc640 10 monclient: _finish_auth 0 2026-02-12T04:05:01.914 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.904+0000 7f62fe7fc640 10 monclient: _check_auth_tickets 2026-02-12T04:05:01.914 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.904+0000 7f62fe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:05:01.914 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.904+0000 7f6305d67640 5 monclient: authenticate success, global_id 27922 2026-02-12T04:05:01.914 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.904+0000 7f62fe7fc640 1 -- 10.20.193.91:0/4187275622 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f62f0002df0 con 0x7f6300163310 2026-02-12T04:05:01.914 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.904+0000 7f6305d67640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:05:01.914 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.904+0000 7f62fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:01.914 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.904+0000 7f62fe7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T04:05:01.914 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.904+0000 7f62fe7fc640 10 monclient: dump: 2026-02-12T04:05:01.914 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:01.914 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:01.914 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.915 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.915 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:01.915 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:01.915 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:01.915 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:01.915 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:01.915 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.904+0000 7f6305d67640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:05:01.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.904+0000 7f62fe7fc640 1 -- 10.20.193.91:0/4187275622 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f62f0002fc0 con 0x7f6300163310 2026-02-12T04:05:01.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.904+0000 7f62fe7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T04:05:01.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.904+0000 7f62fe7fc640 1 -- 10.20.193.91:0/4187275622 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f62f0003400 con 0x7f6300163310 2026-02-12T04:05:01.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.904+0000 7f6305d67640 10 monclient: get_monmap_and_config success 2026-02-12T04:05:01.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.904+0000 7f62fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:01.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.904+0000 7f6305d67640 4 set_mon_vals no callback set 2026-02-12T04:05:01.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.904+0000 7f62fe7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T04:05:01.916 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.904+0000 7f62fe7fc640 10 monclient: dump: 2026-02-12T04:05:01.916 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:01.916 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:01.916 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.916 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.916 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:01.916 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:01.917 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:01.917 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:01.917 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:01.917 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.905+0000 7f6305d67640 10 monclient: shutdown 2026-02-12T04:05:01.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.905+0000 7f6305d67640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:05:01.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.905+0000 7f6305d67640 1 -- 10.20.193.91:0/4187275622 >> v1:10.20.193.98:6789/0 conn(0x7f6300163310 legacy=0x7f63000559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:01.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.905+0000 7f6305d67640 1 -- 10.20.193.91:0/4187275622 shutdown_connections 2026-02-12T04:05:01.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.905+0000 7f6305d67640 1 -- 10.20.193.91:0/4187275622 >> 10.20.193.91:0/4187275622 conn(0x7f63000b6560 msgr2=0x7f63000b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:05:01.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.905+0000 7f6305d67640 1 -- 10.20.193.91:0/4187275622 shutdown_connections 2026-02-12T04:05:01.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.905+0000 7f6305d67640 1 -- 10.20.193.91:0/4187275622 wait complete. 2026-02-12T04:05:01.917 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.905+0000 7f6305d67640 10 monclient: build_initial_monmap 2026-02-12T04:05:01.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.905+0000 7f6305d67640 10 monclient: monmap: 2026-02-12T04:05:01.918 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:05:01.918 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:05:01.918 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:05:01.918 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:05:01.918 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:05:01.918 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:05:01.918 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:05:01.918 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:05:01.918 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:05:01.918 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.918 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.906+0000 7f6305d67640 1 librados: starting msgr at 2026-02-12T04:05:01.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.906+0000 7f6305d67640 1 librados: starting objecter 2026-02-12T04:05:01.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.906+0000 7f6305d67640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:05:01.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.906+0000 7f6305d67640 1 Processor -- start 2026-02-12T04:05:01.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.906+0000 7f6305d67640 1 -- start start 2026-02-12T04:05:01.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.906+0000 7f6305d67640 1 librados: setting wanted keys 2026-02-12T04:05:01.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.906+0000 7f6305d67640 1 librados: calling monclient init 2026-02-12T04:05:01.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.906+0000 7f6305d67640 10 monclient: init 2026-02-12T04:05:01.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.906+0000 7f6305d67640 10 monclient: _reopen_session rank -1 2026-02-12T04:05:01.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.906+0000 7f6305d67640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T04:05:01.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.906+0000 7f6305d67640 10 monclient(hunting): picked mon.noname-b con 0x7f63000560d0 addr v1:10.20.193.98:6789/0 2026-02-12T04:05:01.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.906+0000 7f6305d67640 10 monclient(hunting): picked mon.noname-c con 0x7f63001575d0 addr v1:10.20.193.111:6789/0 2026-02-12T04:05:01.919 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.906+0000 7f6305d67640 10 monclient(hunting): picked mon.noname-a con 0x7f6300163310 addr v1:10.20.193.91:6789/0 2026-02-12T04:05:01.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.906+0000 7f6305d67640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63000af170 con 0x7f6300163310 2026-02-12T04:05:01.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.906+0000 7f6305d67640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6300155770 con 0x7f63000560d0 2026-02-12T04:05:01.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.906+0000 7f6305d67640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6300057ca0 con 0x7f63001575d0 2026-02-12T04:05:01.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.906+0000 7f6305d67640 10 monclient(hunting): _renew_subs 2026-02-12T04:05:01.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.906+0000 7f6305d67640 10 monclient(hunting): authenticate will time out at 1504.649567s 2026-02-12T04:05:01.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.906+0000 7f62fffff640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f6300163310 0x7f6300153480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:40000/0 (socket says 10.20.193.91:40000) 2026-02-12T04:05:01.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.906+0000 7f62fffff640 1 -- 10.20.193.91:0/936035694 learned_addr learned my addr 10.20.193.91:0/936035694 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:05:01.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.906+0000 7f62dbfff640 10 client.?.objecter ms_handle_connect 0x7f6300163310 2026-02-12T04:05:01.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.906+0000 7f62dbfff640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:01.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.907+0000 7f62dbfff640 10 client.?.objecter ms_handle_connect 0x7f63001575d0 2026-02-12T04:05:01.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.907+0000 7f62dbfff640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:01.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.907+0000 7f62dbfff640 10 client.?.objecter ms_handle_connect 0x7f63000560d0 2026-02-12T04:05:01.920 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.907+0000 7f62dbfff640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:01.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.908+0000 7f62dbfff640 1 -- 10.20.193.91:0/936035694 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3128277411 0 0) 0x7f63000af170 con 0x7f6300163310 2026-02-12T04:05:01.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.908+0000 7f62dbfff640 10 monclient(hunting): _negotiate 2026-02-12T04:05:01.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.908+0000 7f62dbfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:01.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.908+0000 7f62dbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:01.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.908+0000 7f62dbfff640 10 monclient(hunting): my global_id is 30786 2026-02-12T04:05:01.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.908+0000 7f62dbfff640 1 -- 10.20.193.91:0/936035694 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62d0003610 con 0x7f6300163310 2026-02-12T04:05:01.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.908+0000 7f62dbfff640 1 -- 10.20.193.91:0/936035694 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3283346328 0 0) 0x7f6300057ca0 con 0x7f63001575d0 2026-02-12T04:05:01.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.908+0000 7f62dbfff640 10 monclient(hunting): _negotiate 2026-02-12T04:05:01.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.908+0000 7f62dbfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:01.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.908+0000 7f62dbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:01.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.908+0000 7f62dbfff640 10 monclient(hunting): my global_id is 27623 2026-02-12T04:05:01.921 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.908+0000 7f62dbfff640 1 -- 10.20.193.91:0/936035694 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63000af170 con 0x7f63001575d0 2026-02-12T04:05:01.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.908+0000 7f62dbfff640 1 -- 10.20.193.91:0/936035694 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1617877105 0 0) 0x7f6300155770 con 0x7f63000560d0 2026-02-12T04:05:01.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.908+0000 7f62dbfff640 10 monclient(hunting): _negotiate 2026-02-12T04:05:01.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.908+0000 7f62dbfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:01.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.908+0000 7f62dbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:01.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.908+0000 7f62dbfff640 10 monclient(hunting): my global_id is 27925 2026-02-12T04:05:01.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.908+0000 7f62dbfff640 1 -- 10.20.193.91:0/936035694 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6300057ca0 con 0x7f63000560d0 2026-02-12T04:05:01.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.910+0000 7f62dbfff640 1 -- 10.20.193.91:0/936035694 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2521776458 0 0) 0x7f63000af170 con 0x7f63001575d0 2026-02-12T04:05:01.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.910+0000 7f62dbfff640 1 -- 10.20.193.91:0/936035694 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6300155770 con 0x7f63001575d0 2026-02-12T04:05:01.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.910+0000 7f62dbfff640 1 -- 10.20.193.91:0/936035694 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f62f0003310 con 0x7f63001575d0 2026-02-12T04:05:01.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.910+0000 7f62dbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:01.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.910+0000 7f62dbfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T04:05:01.922 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.910+0000 7f62dbfff640 10 monclient(hunting): dump: 2026-02-12T04:05:01.923 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:01.923 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:01.923 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.923 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.923 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:01.923 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:01.923 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:01.923 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:01.923 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:01.923 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.910+0000 7f62dbfff640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:05:01.923 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.910+0000 7f62dbfff640 1 -- 10.20.193.91:0/936035694 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3866347040 0 0) 0x7f62d0003610 con 0x7f6300163310 2026-02-12T04:05:01.924 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.910+0000 7f62dbfff640 1 -- 10.20.193.91:0/936035694 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f63000af170 con 0x7f6300163310 2026-02-12T04:05:01.924 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.910+0000 7f62dbfff640 1 -- 10.20.193.91:0/936035694 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f62f4003470 con 0x7f6300163310 2026-02-12T04:05:01.924 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.910+0000 7f62dbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:01.924 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.910+0000 7f62dbfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T04:05:01.924 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.910+0000 7f62dbfff640 10 monclient(hunting): dump: 2026-02-12T04:05:01.924 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:01.924 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:01.924 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.924 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.924 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:01.924 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:01.924 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:01.924 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:01.925 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:01.925 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.911+0000 7f62dbfff640 1 -- 10.20.193.91:0/936035694 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2923764718 0 0) 0x7f6300057ca0 con 0x7f63000560d0 2026-02-12T04:05:01.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.911+0000 7f62dbfff640 1 -- 10.20.193.91:0/936035694 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f62d0003610 con 0x7f63000560d0 2026-02-12T04:05:01.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.911+0000 7f62dbfff640 1 -- 10.20.193.91:0/936035694 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f62ec0030b0 con 0x7f63000560d0 2026-02-12T04:05:01.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.911+0000 7f62dbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:01.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.911+0000 7f62dbfff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T04:05:01.925 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.911+0000 7f62dbfff640 10 monclient(hunting): dump: 2026-02-12T04:05:01.925 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:01.925 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:01.925 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.925 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.926 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:01.926 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:01.926 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:01.926 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:01.926 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:01.926 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.928 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.912+0000 7f62dbfff640 1 -- 10.20.193.91:0/936035694 <== mon.2 v1:10.20.193.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1735859132 0 0) 0x7f6300155770 con 0x7f63001575d0 2026-02-12T04:05:01.928 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.912+0000 7f62dbfff640 1 -- 10.20.193.91:0/936035694 >> v1:10.20.193.98:6789/0 conn(0x7f63000560d0 legacy=0x7f6300155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:01.929 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.912+0000 7f62dbfff640 1 -- 10.20.193.91:0/936035694 >> v1:10.20.193.91:6789/0 conn(0x7f6300163310 legacy=0x7f6300153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:01.929 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.912+0000 7f62dbfff640 10 monclient: _finish_hunting 0 2026-02-12T04:05:01.929 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.912+0000 7f62dbfff640 1 monclient: found mon.c 2026-02-12T04:05:01.929 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.912+0000 7f62dbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:05:01.929 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.912+0000 7f62dbfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:05:01.929 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.912+0000 7f62dbfff640 1 -- 10.20.193.91:0/936035694 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6300057f80 con 0x7f63001575d0 2026-02-12T04:05:01.929 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.912+0000 7f62dbfff640 10 monclient: _finish_auth 0 2026-02-12T04:05:01.929 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.912+0000 7f62dbfff640 10 monclient: _check_auth_tickets 2026-02-12T04:05:01.929 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.912+0000 7f62dbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:05:01.929 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.912+0000 7f6305d67640 5 monclient: authenticate success, global_id 27623 2026-02-12T04:05:01.929 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.912+0000 7f6305d67640 10 monclient: _renew_subs 2026-02-12T04:05:01.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.912+0000 7f6305d67640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:05:01.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.912+0000 7f6305d67640 1 -- 10.20.193.91:0/936035694 --> v1:10.20.193.111:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6300058260 con 0x7f63001575d0 2026-02-12T04:05:01.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.912+0000 7f6305d67640 10 client.27623.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:05:01.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.912+0000 7f6305d67640 10 monclient: _renew_subs 2026-02-12T04:05:01.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.912+0000 7f6305d67640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:05:01.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.912+0000 7f6305d67640 1 -- 10.20.193.91:0/936035694 --> v1:10.20.193.111:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f63000af430 con 0x7f63001575d0 2026-02-12T04:05:01.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.912+0000 7f6305d67640 1 librados: init done 2026-02-12T04:05:01.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.912+0000 7f6305d67640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T04:05:01.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.912+0000 7f6305d67640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:05:01.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.912+0000 7f6305d67640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:05:01.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.912+0000 7f6305d67640 1 -- 10.20.193.91:0/936035694 --> v1:10.20.193.111:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6300051de0 con 0x7f63001575d0 2026-02-12T04:05:01.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.918+0000 7f62dbfff640 1 -- 10.20.193.91:0/936035694 <== mon.2 v1:10.20.193.111:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f62f0002f70 con 0x7f63001575d0 2026-02-12T04:05:01.930 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.918+0000 7f62dbfff640 10 monclient: handle_config config(0 keys) 2026-02-12T04:05:01.931 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.918+0000 7f62dbfff640 1 -- 10.20.193.91:0/936035694 <== mon.2 v1:10.20.193.111:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f62f0004b80 con 0x7f63001575d0 2026-02-12T04:05:01.931 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.918+0000 7f62dbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:01.931 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.918+0000 7f62dbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T04:05:01.931 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.918+0000 7f62dbfff640 10 monclient: dump: 2026-02-12T04:05:01.931 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:01.931 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:01.931 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.931 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:01.931 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:01.931 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:01.931 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:01.931 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:01.931 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:01.932 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:01.932 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.918+0000 7f62fdffb640 4 set_mon_vals no callback set 2026-02-12T04:05:01.932 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.921+0000 7f62dbfff640 1 -- 10.20.193.91:0/936035694 <== mon.2 v1:10.20.193.111:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f62f001dec0 con 0x7f63001575d0 2026-02-12T04:05:01.932 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.921+0000 7f62ff7fe640 10 monclient: get_auth_request con 0x7f62d007a090 auth_method 0 2026-02-12T04:05:01.932 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.921+0000 7f62dbfff640 10 client.27623.objecter ms_handle_connect 0x7f62d007a090 2026-02-12T04:05:01.932 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.921+0000 7f62dbfff640 1 -- 10.20.193.91:0/936035694 <== mon.2 v1:10.20.193.111:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7f62f0095870 con 0x7f63001575d0 2026-02-12T04:05:01.932 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.921+0000 7f62dbfff640 10 client.27623.objecter ms_dispatch2 0x7f6300000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:05:01.932 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.921+0000 7f62dbfff640 3 client.27623.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:05:01.932 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.921+0000 7f62dbfff640 3 client.27623.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:05:01.932 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:01.921+0000 7f62dbfff640 20 client.27623.objecter dump_active .. 0 homeless 2026-02-12T04:05:02.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.021+0000 7f62dbfff640 1 -- 10.20.193.91:0/936035694 <== mon.2 v1:10.20.193.111:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f6300051de0 con 0x7f63001575d0 2026-02-12T04:05:02.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.021+0000 7f62dbfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:05:02.023 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.021+0000 7f62dbfff640 10 monclient: _finish_command 1 = system:0 2026-02-12T04:05:02.130 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.128+0000 7f6305d67640 1 -- 10.20.193.91:0/936035694 --> v1:10.20.193.91:6800/2929217192 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f630005a0b0 con 0x7f62d007a090 2026-02-12T04:05:02.130 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.128+0000 7f62dbfff640 1 -- 10.20.193.91:0/936035694 <== mgr.4113 v1:10.20.193.91:6800/2929217192 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (unknown 1239724482 0 0) 0x7f630005a0b0 con 0x7f62d007a090 2026-02-12T04:05:02.130 INFO:teuthology.orchestra.run.trial091.stderr:instructed osd(s) 7 to deep-scrub 2026-02-12T04:05:02.132 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.129+0000 7f6305d67640 10 librados: watch_flush enter 2026-02-12T04:05:02.132 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.129+0000 7f6305d67640 10 librados: watch_flush exit 2026-02-12T04:05:02.132 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.129+0000 7f6305d67640 20 client.27623.objecter shutdown clearing up homeless session... 2026-02-12T04:05:02.132 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.129+0000 7f6305d67640 10 client.27623.objecter successfully canceled tick 2026-02-12T04:05:02.132 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.129+0000 7f6305d67640 1 -- 10.20.193.91:0/936035694 >> v1:10.20.193.91:6800/2929217192 conn(0x7f62d007a090 legacy=0x7f62d009a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:02.132 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.129+0000 7f6305d67640 10 monclient: shutdown 2026-02-12T04:05:02.132 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.129+0000 7f6305d67640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:05:02.132 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.129+0000 7f6305d67640 1 -- 10.20.193.91:0/936035694 >> v1:10.20.193.111:6789/0 conn(0x7f63001575d0 legacy=0x7f63000af950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:02.132 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.129+0000 7f6305d67640 1 -- 10.20.193.91:0/936035694 shutdown_connections 2026-02-12T04:05:02.132 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.129+0000 7f6305d67640 1 -- 10.20.193.91:0/936035694 >> 10.20.193.91:0/936035694 conn(0x7f63000b6560 msgr2=0x7f6300056f80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:05:02.133 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.129+0000 7f6305d67640 1 -- 10.20.193.91:0/936035694 shutdown_connections 2026-02-12T04:05:02.133 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.129+0000 7f6305d67640 1 -- 10.20.193.91:0/936035694 wait complete. 2026-02-12T04:05:02.133 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.129+0000 7f6305d67640 1 librados: shutdown 2026-02-12T04:05:02.140 INFO:tasks.ceph:Scrubbing osd.11 2026-02-12T04:05:02.140 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 config set osd_debug_deep_scrub_sleep 0 2026-02-12T04:05:02.211 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.209+0000 7fdbcc449640 10 monclient: get_monmap_and_config 2026-02-12T04:05:02.211 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.209+0000 7fdbcc449640 10 monclient: build_initial_monmap 2026-02-12T04:05:02.211 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.209+0000 7fdbcc449640 10 monclient: monmap: 2026-02-12T04:05:02.212 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:05:02.212 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:02.212 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:05:02.210360+0000 2026-02-12T04:05:02.212 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:05:02.210360+0000 2026-02-12T04:05:02.212 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:05:02.212 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:02.212 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:05:02.212 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:05:02.212 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:05:02.212 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:02.215 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.210+0000 7fdbcc449640 1 Processor -- start 2026-02-12T04:05:02.215 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.210+0000 7fdbcc449640 1 -- start start 2026-02-12T04:05:02.215 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.210+0000 7fdbcc449640 10 monclient: init 2026-02-12T04:05:02.215 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.210+0000 7fdbcc449640 10 monclient: _reopen_session rank -1 2026-02-12T04:05:02.215 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.210+0000 7fdbcc449640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T04:05:02.215 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.210+0000 7fdbcc449640 10 monclient(hunting): picked mon.noname-b con 0x7fdbc4055c30 addr v1:10.20.193.98:6789/0 2026-02-12T04:05:02.215 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.210+0000 7fdbcc449640 10 monclient(hunting): picked mon.noname-c con 0x7fdbc4160f80 addr v1:10.20.193.111:6789/0 2026-02-12T04:05:02.215 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.210+0000 7fdbcc449640 10 monclient(hunting): picked mon.noname-a con 0x7fdbc4163230 addr v1:10.20.193.91:6789/0 2026-02-12T04:05:02.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.210+0000 7fdbcc449640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbc40b1fc0 con 0x7fdbc4163230 2026-02-12T04:05:02.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.210+0000 7fdbcc449640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbc40b22a0 con 0x7fdbc4055c30 2026-02-12T04:05:02.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.210+0000 7fdbcc449640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbc40b2580 con 0x7fdbc4160f80 2026-02-12T04:05:02.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.210+0000 7fdbcc449640 10 monclient(hunting): _renew_subs 2026-02-12T04:05:02.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.210+0000 7fdbcc449640 10 monclient(hunting): authenticate will time out at 1504.953812s 2026-02-12T04:05:02.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.211+0000 7fdbca1be640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7fdbc4055c30 0x7fdbc4162b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:38424/0 (socket says 10.20.193.91:38424) 2026-02-12T04:05:02.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.211+0000 7fdbca9bf640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7fdbc4163230 0x7fdbc41c57b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:40006/0 (socket says 10.20.193.91:40006) 2026-02-12T04:05:02.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.211+0000 7fdbca1be640 1 -- 10.20.193.91:0/2524843567 learned_addr learned my addr 10.20.193.91:0/2524843567 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:05:02.216 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.212+0000 7fdbc91bc640 1 -- 10.20.193.91:0/2524843567 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2943471768 0 0) 0x7fdbc40b2580 con 0x7fdbc4160f80 2026-02-12T04:05:02.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.212+0000 7fdbc91bc640 10 monclient(hunting): _negotiate 2026-02-12T04:05:02.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.212+0000 7fdbc91bc640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:02.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.212+0000 7fdbc91bc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:02.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.212+0000 7fdbc91bc640 10 monclient(hunting): my global_id is 27626 2026-02-12T04:05:02.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.212+0000 7fdbc91bc640 1 -- 10.20.193.91:0/2524843567 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbac003610 con 0x7fdbc4160f80 2026-02-12T04:05:02.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.212+0000 7fdbc91bc640 1 -- 10.20.193.91:0/2524843567 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 471485317 0 0) 0x7fdbc40b1fc0 con 0x7fdbc4163230 2026-02-12T04:05:02.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.212+0000 7fdbc91bc640 10 monclient(hunting): _negotiate 2026-02-12T04:05:02.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.212+0000 7fdbc91bc640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:02.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.212+0000 7fdbc91bc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:02.217 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.212+0000 7fdbc91bc640 10 monclient(hunting): my global_id is 30789 2026-02-12T04:05:02.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.212+0000 7fdbc91bc640 1 -- 10.20.193.91:0/2524843567 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbc40b2580 con 0x7fdbc4163230 2026-02-12T04:05:02.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.212+0000 7fdbc91bc640 1 -- 10.20.193.91:0/2524843567 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4180154821 0 0) 0x7fdbc40b22a0 con 0x7fdbc4055c30 2026-02-12T04:05:02.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.212+0000 7fdbc91bc640 10 monclient(hunting): _negotiate 2026-02-12T04:05:02.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.212+0000 7fdbc91bc640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:02.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.212+0000 7fdbc91bc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:02.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.212+0000 7fdbc91bc640 10 monclient(hunting): my global_id is 27928 2026-02-12T04:05:02.218 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.212+0000 7fdbc91bc640 1 -- 10.20.193.91:0/2524843567 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbc40b1fc0 con 0x7fdbc4055c30 2026-02-12T04:05:02.224 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.214+0000 7fdbc91bc640 1 -- 10.20.193.91:0/2524843567 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2745339844 0 0) 0x7fdbc40b1fc0 con 0x7fdbc4055c30 2026-02-12T04:05:02.225 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.214+0000 7fdbc91bc640 1 -- 10.20.193.91:0/2524843567 >> v1:10.20.193.111:6789/0 conn(0x7fdbc4160f80 legacy=0x7fdbc41572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:02.225 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.214+0000 7fdbc91bc640 1 -- 10.20.193.91:0/2524843567 >> v1:10.20.193.91:6789/0 conn(0x7fdbc4163230 legacy=0x7fdbc41c57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:02.225 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.214+0000 7fdbc91bc640 10 monclient: _finish_hunting 0 2026-02-12T04:05:02.225 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.214+0000 7fdbc91bc640 1 monclient: found mon.noname-b 2026-02-12T04:05:02.225 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.214+0000 7fdbc91bc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:05:02.225 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.214+0000 7fdbc91bc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T04:05:02.225 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.214+0000 7fdbc91bc640 1 -- 10.20.193.91:0/2524843567 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbc40b2860 con 0x7fdbc4055c30 2026-02-12T04:05:02.225 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.214+0000 7fdbc91bc640 10 monclient: _finish_auth 0 2026-02-12T04:05:02.225 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.214+0000 7fdbc91bc640 10 monclient: _check_auth_tickets 2026-02-12T04:05:02.225 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.214+0000 7fdbc91bc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:05:02.226 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.214+0000 7fdbc91bc640 1 -- 10.20.193.91:0/2524843567 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fdbb4002dd0 con 0x7fdbc4055c30 2026-02-12T04:05:02.226 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.214+0000 7fdbc91bc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:02.226 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.214+0000 7fdbc91bc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T04:05:02.226 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.214+0000 7fdbc91bc640 10 monclient: dump: 2026-02-12T04:05:02.226 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:02.226 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:02.226 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.226 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.226 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:02.226 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:02.226 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:02.226 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:02.226 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:02.227 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:02.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.214+0000 7fdbcc449640 5 monclient: authenticate success, global_id 27928 2026-02-12T04:05:02.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.214+0000 7fdbcc449640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:05:02.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.215+0000 7fdbc91bc640 1 -- 10.20.193.91:0/2524843567 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdbb4002f70 con 0x7fdbc4055c30 2026-02-12T04:05:02.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.215+0000 7fdbc91bc640 10 monclient: handle_config config(0 keys) 2026-02-12T04:05:02.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.215+0000 7fdbc91bc640 1 -- 10.20.193.91:0/2524843567 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fdbb4003370 con 0x7fdbc4055c30 2026-02-12T04:05:02.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.215+0000 7fdbc91bc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:02.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.215+0000 7fdbc91bc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T04:05:02.227 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.215+0000 7fdbc91bc640 10 monclient: dump: 2026-02-12T04:05:02.227 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:02.227 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:02.227 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.228 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.228 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:02.228 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:02.228 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:02.228 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:02.228 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:02.228 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:02.228 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.215+0000 7fdbcc449640 10 monclient: get_monmap_and_config success 2026-02-12T04:05:02.228 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.215+0000 7fdbcc449640 4 set_mon_vals no callback set 2026-02-12T04:05:02.228 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.215+0000 7fdbcc449640 10 monclient: shutdown 2026-02-12T04:05:02.228 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.215+0000 7fdbcc449640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:05:02.228 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.215+0000 7fdbcc449640 1 -- 10.20.193.91:0/2524843567 >> v1:10.20.193.98:6789/0 conn(0x7fdbc4055c30 legacy=0x7fdbc4162b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:02.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.215+0000 7fdbcc449640 1 -- 10.20.193.91:0/2524843567 shutdown_connections 2026-02-12T04:05:02.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.215+0000 7fdbcc449640 1 -- 10.20.193.91:0/2524843567 >> 10.20.193.91:0/2524843567 conn(0x7fdbc40b6560 msgr2=0x7fdbc40b6930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:05:02.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.215+0000 7fdbcc449640 1 -- 10.20.193.91:0/2524843567 shutdown_connections 2026-02-12T04:05:02.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.215+0000 7fdbcc449640 1 -- 10.20.193.91:0/2524843567 wait complete. 2026-02-12T04:05:02.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.216+0000 7fdbcc449640 10 monclient: build_initial_monmap 2026-02-12T04:05:02.229 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.216+0000 7fdbcc449640 10 monclient: monmap: 2026-02-12T04:05:02.229 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:05:02.229 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:05:02.229 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:05:02.229 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:05:02.229 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:05:02.229 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:05:02.229 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:05:02.230 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:05:02.230 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:05:02.230 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:02.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.216+0000 7fdbcc449640 1 librados: starting msgr at 2026-02-12T04:05:02.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.216+0000 7fdbcc449640 1 librados: starting objecter 2026-02-12T04:05:02.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.216+0000 7fdbcc449640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:05:02.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.216+0000 7fdbcc449640 1 Processor -- start 2026-02-12T04:05:02.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.216+0000 7fdbcc449640 1 -- start start 2026-02-12T04:05:02.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.216+0000 7fdbcc449640 1 librados: setting wanted keys 2026-02-12T04:05:02.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.216+0000 7fdbcc449640 1 librados: calling monclient init 2026-02-12T04:05:02.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.216+0000 7fdbcc449640 10 monclient: init 2026-02-12T04:05:02.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.216+0000 7fdbcc449640 10 monclient: _reopen_session rank -1 2026-02-12T04:05:02.230 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.216+0000 7fdbcc449640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T04:05:02.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.216+0000 7fdbcc449640 10 monclient(hunting): picked mon.noname-a con 0x7fdbc4055c30 addr v1:10.20.193.91:6789/0 2026-02-12T04:05:02.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.216+0000 7fdbcc449640 10 monclient(hunting): picked mon.noname-b con 0x7fdbc4160f80 addr v1:10.20.193.98:6789/0 2026-02-12T04:05:02.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.216+0000 7fdbcc449640 10 monclient(hunting): picked mon.noname-c con 0x7fdbc4163230 addr v1:10.20.193.111:6789/0 2026-02-12T04:05:02.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.216+0000 7fdbcc449640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbc4147040 con 0x7fdbc4055c30 2026-02-12T04:05:02.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.216+0000 7fdbcc449640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbc4057df0 con 0x7fdbc4160f80 2026-02-12T04:05:02.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.216+0000 7fdbcc449640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbc40580d0 con 0x7fdbc4163230 2026-02-12T04:05:02.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.216+0000 7fdbcc449640 10 monclient(hunting): _renew_subs 2026-02-12T04:05:02.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.216+0000 7fdbcc449640 10 monclient(hunting): authenticate will time out at 1504.959685s 2026-02-12T04:05:02.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.216+0000 7fdbca1be640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7fdbc4055c30 0x7fdbc4146930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:40014/0 (socket says 10.20.193.91:40014) 2026-02-12T04:05:02.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.216+0000 7fdbca1be640 1 -- 10.20.193.91:0/771175397 learned_addr learned my addr 10.20.193.91:0/771175397 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:05:02.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.217+0000 7fdbaaffd640 10 client.?.objecter ms_handle_connect 0x7fdbc4055c30 2026-02-12T04:05:02.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.217+0000 7fdbaaffd640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:02.231 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.217+0000 7fdbaaffd640 10 client.?.objecter ms_handle_connect 0x7fdbc4160f80 2026-02-12T04:05:02.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.217+0000 7fdbaaffd640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:02.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.217+0000 7fdbaaffd640 10 client.?.objecter ms_handle_connect 0x7fdbc4163230 2026-02-12T04:05:02.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.217+0000 7fdbaaffd640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:02.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.218+0000 7fdbaaffd640 1 -- 10.20.193.91:0/771175397 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2297018332 0 0) 0x7fdbc4057df0 con 0x7fdbc4160f80 2026-02-12T04:05:02.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.218+0000 7fdbaaffd640 10 monclient(hunting): _negotiate 2026-02-12T04:05:02.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.218+0000 7fdbaaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:02.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.218+0000 7fdbaaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:02.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.218+0000 7fdbaaffd640 10 monclient(hunting): my global_id is 27931 2026-02-12T04:05:02.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.218+0000 7fdbaaffd640 1 -- 10.20.193.91:0/771175397 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb94003610 con 0x7fdbc4160f80 2026-02-12T04:05:02.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.218+0000 7fdbaaffd640 1 -- 10.20.193.91:0/771175397 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2160852728 0 0) 0x7fdbc40580d0 con 0x7fdbc4163230 2026-02-12T04:05:02.232 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.218+0000 7fdbaaffd640 10 monclient(hunting): _negotiate 2026-02-12T04:05:02.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.218+0000 7fdbaaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:02.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.218+0000 7fdbaaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:02.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.218+0000 7fdbaaffd640 10 monclient(hunting): my global_id is 27629 2026-02-12T04:05:02.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.218+0000 7fdbaaffd640 1 -- 10.20.193.91:0/771175397 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbc4057df0 con 0x7fdbc4163230 2026-02-12T04:05:02.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.218+0000 7fdbaaffd640 1 -- 10.20.193.91:0/771175397 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3496363625 0 0) 0x7fdbc4147040 con 0x7fdbc4055c30 2026-02-12T04:05:02.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.218+0000 7fdbaaffd640 10 monclient(hunting): _negotiate 2026-02-12T04:05:02.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.218+0000 7fdbaaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:02.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.218+0000 7fdbaaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:02.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.218+0000 7fdbaaffd640 10 monclient(hunting): my global_id is 30792 2026-02-12T04:05:02.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.218+0000 7fdbaaffd640 1 -- 10.20.193.91:0/771175397 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbc40580d0 con 0x7fdbc4055c30 2026-02-12T04:05:02.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.220+0000 7fdbaaffd640 1 -- 10.20.193.91:0/771175397 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 626710828 0 0) 0x7fdbc4057df0 con 0x7fdbc4163230 2026-02-12T04:05:02.233 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.220+0000 7fdbaaffd640 1 -- 10.20.193.91:0/771175397 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdbc4147040 con 0x7fdbc4163230 2026-02-12T04:05:02.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.220+0000 7fdbaaffd640 1 -- 10.20.193.91:0/771175397 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fdbc0003340 con 0x7fdbc4163230 2026-02-12T04:05:02.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.220+0000 7fdbaaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:02.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.220+0000 7fdbaaffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T04:05:02.234 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.220+0000 7fdbaaffd640 10 monclient(hunting): dump: 2026-02-12T04:05:02.234 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:02.234 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:02.234 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.234 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.234 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:02.234 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:02.234 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:02.234 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:02.235 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:02.235 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:02.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.220+0000 7fdbaaffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:05:02.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.220+0000 7fdbaaffd640 1 -- 10.20.193.91:0/771175397 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1298526924 0 0) 0x7fdbc40580d0 con 0x7fdbc4055c30 2026-02-12T04:05:02.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.220+0000 7fdbaaffd640 1 -- 10.20.193.91:0/771175397 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdbc4057df0 con 0x7fdbc4055c30 2026-02-12T04:05:02.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.220+0000 7fdbaaffd640 1 -- 10.20.193.91:0/771175397 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fdbb40032c0 con 0x7fdbc4055c30 2026-02-12T04:05:02.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.220+0000 7fdbaaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:02.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.220+0000 7fdbaaffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T04:05:02.235 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.220+0000 7fdbaaffd640 10 monclient(hunting): dump: 2026-02-12T04:05:02.235 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:02.235 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:02.235 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.236 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.236 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:02.236 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:02.236 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:02.236 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:02.236 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:02.236 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:02.236 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.220+0000 7fdbaaffd640 1 -- 10.20.193.91:0/771175397 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2340791996 0 0) 0x7fdb94003610 con 0x7fdbc4160f80 2026-02-12T04:05:02.236 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.220+0000 7fdbaaffd640 1 -- 10.20.193.91:0/771175397 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdbc40580d0 con 0x7fdbc4160f80 2026-02-12T04:05:02.236 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.220+0000 7fdbaaffd640 1 -- 10.20.193.91:0/771175397 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fdbb8003020 con 0x7fdbc4160f80 2026-02-12T04:05:02.236 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.220+0000 7fdbaaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:02.236 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.220+0000 7fdbaaffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T04:05:02.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.220+0000 7fdbaaffd640 10 monclient(hunting): dump: 2026-02-12T04:05:02.237 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:02.237 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:02.237 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.237 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.237 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:02.237 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:02.237 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:02.237 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:02.237 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:02.237 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:02.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.222+0000 7fdbaaffd640 1 -- 10.20.193.91:0/771175397 <== mon.2 v1:10.20.193.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1861886424 0 0) 0x7fdbc4147040 con 0x7fdbc4163230 2026-02-12T04:05:02.237 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.222+0000 7fdbaaffd640 1 -- 10.20.193.91:0/771175397 >> v1:10.20.193.98:6789/0 conn(0x7fdbc4160f80 legacy=0x7fdbc4058e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:02.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.222+0000 7fdbaaffd640 1 -- 10.20.193.91:0/771175397 >> v1:10.20.193.91:6789/0 conn(0x7fdbc4055c30 legacy=0x7fdbc4146930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:02.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.222+0000 7fdbaaffd640 10 monclient: _finish_hunting 0 2026-02-12T04:05:02.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.222+0000 7fdbaaffd640 1 monclient: found mon.c 2026-02-12T04:05:02.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.222+0000 7fdbaaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:05:02.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.222+0000 7fdbaaffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:05:02.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.222+0000 7fdbaaffd640 1 -- 10.20.193.91:0/771175397 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbc40583b0 con 0x7fdbc4163230 2026-02-12T04:05:02.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.222+0000 7fdbaaffd640 10 monclient: _finish_auth 0 2026-02-12T04:05:02.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.222+0000 7fdbaaffd640 10 monclient: _check_auth_tickets 2026-02-12T04:05:02.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.222+0000 7fdbaaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:05:02.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.222+0000 7fdbcc449640 5 monclient: authenticate success, global_id 27629 2026-02-12T04:05:02.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.222+0000 7fdbcc449640 10 monclient: _renew_subs 2026-02-12T04:05:02.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.222+0000 7fdbcc449640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:05:02.238 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.222+0000 7fdbcc449640 1 -- 10.20.193.91:0/771175397 --> v1:10.20.193.111:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdbc4058690 con 0x7fdbc4163230 2026-02-12T04:05:02.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.222+0000 7fdbcc449640 10 client.27629.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:05:02.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.222+0000 7fdbcc449640 10 monclient: _renew_subs 2026-02-12T04:05:02.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.222+0000 7fdbcc449640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:05:02.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.222+0000 7fdbcc449640 1 -- 10.20.193.91:0/771175397 --> v1:10.20.193.111:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fdbc4147530 con 0x7fdbc4163230 2026-02-12T04:05:02.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.222+0000 7fdbcc449640 1 librados: init done 2026-02-12T04:05:02.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.222+0000 7fdbcc449640 10 client.27629.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:05:02.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.222+0000 7fdbcc449640 15 client.27629.objecter _session_command_op_assign -1 1 2026-02-12T04:05:02.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.222+0000 7fdbcc449640 20 client.27629.objecter _get_session osd=-1 returning homeless 2026-02-12T04:05:02.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.222+0000 7fdbcc449640 10 client.27629.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:05:02.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.222+0000 7fdbcc449640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:05:02.239 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.222+0000 7fdbcc449640 1 -- 10.20.193.91:0/771175397 --> v1:10.20.193.111:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fdbc415e850 con 0x7fdbc4163230 2026-02-12T04:05:02.241 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.230+0000 7fdbaaffd640 1 -- 10.20.193.91:0/771175397 <== mon.2 v1:10.20.193.111:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdbc415e850 con 0x7fdbc4163230 2026-02-12T04:05:02.242 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.230+0000 7fdbaaffd640 10 monclient: handle_config config(0 keys) 2026-02-12T04:05:02.242 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.230+0000 7fdbaaffd640 1 -- 10.20.193.91:0/771175397 <== mon.2 v1:10.20.193.111:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fdbc0004c50 con 0x7fdbc4163230 2026-02-12T04:05:02.242 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.230+0000 7fdbaaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:02.242 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.231+0000 7fdbaaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T04:05:02.242 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.230+0000 7fdbc89bb640 4 set_mon_vals no callback set 2026-02-12T04:05:02.242 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.231+0000 7fdbaaffd640 10 monclient: dump: 2026-02-12T04:05:02.242 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:02.242 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:02.242 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.242 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.243 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:02.243 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:02.243 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:02.243 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:02.243 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:02.243 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:02.243 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.231+0000 7fdbaaffd640 1 -- 10.20.193.91:0/771175397 <== mon.2 v1:10.20.193.111:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7fdbc001e130 con 0x7fdbc4163230 2026-02-12T04:05:02.243 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.232+0000 7fdbca1be640 10 monclient: get_auth_request con 0x7fdb9407a030 auth_method 0 2026-02-12T04:05:02.243 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.232+0000 7fdbaaffd640 10 client.27629.objecter ms_handle_connect 0x7fdb9407a030 2026-02-12T04:05:02.243 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.233+0000 7fdbaaffd640 1 -- 10.20.193.91:0/771175397 <== mon.2 v1:10.20.193.111:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7fdbc0095b40 con 0x7fdbc4163230 2026-02-12T04:05:02.243 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.233+0000 7fdbaaffd640 10 client.27629.objecter ms_dispatch2 0x7fdbc4000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:05:02.244 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.233+0000 7fdbaaffd640 3 client.27629.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:05:02.244 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.233+0000 7fdbaaffd640 3 client.27629.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:05:02.244 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.233+0000 7fdbaaffd640 10 client.27629.objecter checking command 1 2026-02-12T04:05:02.244 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.233+0000 7fdbaaffd640 20 client.27629.objecter _get_session s=0x7fdb940a4340 osd=11 3 2026-02-12T04:05:02.244 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.233+0000 7fdbaaffd640 20 client.27629.objecter put_session s=0x7fdb940a4340 osd=11 3 2026-02-12T04:05:02.244 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.233+0000 7fdbaaffd640 15 client.27629.objecter _session_command_op_remove -1 1 2026-02-12T04:05:02.244 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.233+0000 7fdbaaffd640 20 client.27629.objecter _get_session s=0x7fdb940a4340 osd=11 3 2026-02-12T04:05:02.244 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.233+0000 7fdbaaffd640 20 client.27629.objecter get_session s=0x7fdb940a4340 osd=11 3 2026-02-12T04:05:02.244 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.233+0000 7fdbaaffd640 15 client.27629.objecter _session_command_op_assign 11 1 2026-02-12T04:05:02.244 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.233+0000 7fdbaaffd640 20 client.27629.objecter put_session s=0x7fdb940a4340 osd=11 4 2026-02-12T04:05:02.244 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.233+0000 7fdbaaffd640 10 client.27629.objecter _send_command 1 2026-02-12T04:05:02.244 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.233+0000 7fdbaaffd640 1 -- 10.20.193.91:0/771175397 --> v1:10.20.193.154:6804/2902069275 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdb940c66f0 con 0x7fdb940a49f0 2026-02-12T04:05:02.244 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.233+0000 7fdbaaffd640 20 client.27629.objecter dump_active .. 0 homeless 2026-02-12T04:05:02.245 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.234+0000 7fdbc99bd640 10 monclient: get_auth_request con 0x7fdb940a49f0 auth_method 0 2026-02-12T04:05:02.245 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.235+0000 7fdbaaffd640 10 client.27629.objecter ms_handle_connect 0x7fdb940a49f0 2026-02-12T04:05:02.245 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.235+0000 7fdbaaffd640 1 -- 10.20.193.91:0/771175397 <== mon.2 v1:10.20.193.111:6789/0 9 ==== mon_get_version_reply(handle=1 version=344) ==== 24+0+0 (unknown 1403447244 0 0) 0x7fdbc005eb70 con 0x7fdbc4163230 2026-02-12T04:05:02.245 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.235+0000 7fdbaaffd640 10 monclient: handle_get_version_reply finishing 1 version 344 2026-02-12T04:05:02.246 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.244+0000 7fdbaaffd640 1 -- 10.20.193.91:0/771175397 <== osd.11 v1:10.20.193.154:6804/2902069275 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fdb940c66f0 con 0x7fdb940a49f0 2026-02-12T04:05:02.246 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.244+0000 7fdbaaffd640 10 client.27629.objecter ms_dispatch2 0x7fdbc4000b90 command_reply(tid 1: 0 ) 2026-02-12T04:05:02.246 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.244+0000 7fdbaaffd640 10 client.27629.objecter _finish_command 1 = system:0 2026-02-12T04:05:02.246 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.244+0000 7fdbaaffd640 20 client.27629.objecter put_session s=0x7fdb940a4340 osd=11 4 2026-02-12T04:05:02.246 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.244+0000 7fdbaaffd640 15 client.27629.objecter _session_command_op_remove 11 1 2026-02-12T04:05:02.253 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.251+0000 7fdbcc449640 10 client.27629.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-12T04:05:02.253 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.251+0000 7fdbcc449640 15 client.27629.objecter _session_command_op_assign -1 2 2026-02-12T04:05:02.254 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.251+0000 7fdbcc449640 20 client.27629.objecter _get_session s=0x7fdb940a4340 osd=11 3 2026-02-12T04:05:02.254 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.251+0000 7fdbcc449640 20 client.27629.objecter put_session s=0x7fdb940a4340 osd=11 3 2026-02-12T04:05:02.254 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.251+0000 7fdbcc449640 20 client.27629.objecter _get_session s=0x7fdb940a4340 osd=11 3 2026-02-12T04:05:02.254 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.251+0000 7fdbcc449640 15 client.27629.objecter _session_command_op_remove -1 2 2026-02-12T04:05:02.254 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.251+0000 7fdbcc449640 20 client.27629.objecter get_session s=0x7fdb940a4340 osd=11 3 2026-02-12T04:05:02.254 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.251+0000 7fdbcc449640 15 client.27629.objecter _session_command_op_assign 11 2 2026-02-12T04:05:02.254 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.251+0000 7fdbcc449640 20 client.27629.objecter put_session s=0x7fdb940a4340 osd=11 4 2026-02-12T04:05:02.254 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.251+0000 7fdbcc449640 10 client.27629.objecter _send_command 2 2026-02-12T04:05:02.254 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.251+0000 7fdbcc449640 1 -- 10.20.193.91:0/771175397 --> v1:10.20.193.154:6804/2902069275 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fdbc4057750 con 0x7fdb940a49f0 2026-02-12T04:05:02.261 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.259+0000 7fdbaaffd640 1 -- 10.20.193.91:0/771175397 <== osd.11 v1:10.20.193.154:6804/2902069275 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fdbc4057750 con 0x7fdb940a49f0 2026-02-12T04:05:02.261 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.259+0000 7fdbaaffd640 10 client.27629.objecter ms_dispatch2 0x7fdbc4000b90 command_reply(tid 2: 0 ) 2026-02-12T04:05:02.261 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.259+0000 7fdbaaffd640 10 client.27629.objecter _finish_command 2 = system:0 2026-02-12T04:05:02.261 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.259+0000 7fdbaaffd640 20 client.27629.objecter put_session s=0x7fdb940a4340 osd=11 4 2026-02-12T04:05:02.261 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.259+0000 7fdbaaffd640 15 client.27629.objecter _session_command_op_remove 11 2 2026-02-12T04:05:02.262 INFO:teuthology.orchestra.run.trial091.stdout:{ 2026-02-12T04:05:02.262 INFO:teuthology.orchestra.run.trial091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-12T04:05:02.262 INFO:teuthology.orchestra.run.trial091.stdout:} 2026-02-12T04:05:02.263 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.259+0000 7fdbcc449640 10 librados: watch_flush enter 2026-02-12T04:05:02.263 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.259+0000 7fdbcc449640 10 librados: watch_flush exit 2026-02-12T04:05:02.263 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.259+0000 7fdbcc449640 10 client.27629.objecter close_session for osd.11 2026-02-12T04:05:02.264 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.259+0000 7fdbcc449640 1 -- 10.20.193.91:0/771175397 >> v1:10.20.193.154:6804/2902069275 conn(0x7fdb940a49f0 legacy=0x7fdb940c4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:02.264 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.259+0000 7fdbcc449640 20 client.27629.objecter put_session s=0x7fdb940a4340 osd=11 1 2026-02-12T04:05:02.264 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.259+0000 7fdbcc449640 20 client.27629.objecter shutdown clearing up homeless session... 2026-02-12T04:05:02.264 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.259+0000 7fdbcc449640 10 client.27629.objecter successfully canceled tick 2026-02-12T04:05:02.264 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.259+0000 7fdbcc449640 1 -- 10.20.193.91:0/771175397 >> v1:10.20.193.91:6800/2929217192 conn(0x7fdb9407a030 legacy=0x7fdb9409a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:02.264 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.259+0000 7fdbcc449640 10 monclient: shutdown 2026-02-12T04:05:02.264 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.259+0000 7fdbcc449640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:05:02.264 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.259+0000 7fdbcc449640 1 -- 10.20.193.91:0/771175397 >> v1:10.20.193.111:6789/0 conn(0x7fdbc4163230 legacy=0x7fdbc405c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:02.264 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.259+0000 7fdbca9bf640 1 -- 10.20.193.91:0/771175397 reap_dead start 2026-02-12T04:05:02.264 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.259+0000 7fdbcc449640 1 -- 10.20.193.91:0/771175397 shutdown_connections 2026-02-12T04:05:02.264 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.259+0000 7fdbcc449640 1 -- 10.20.193.91:0/771175397 >> 10.20.193.91:0/771175397 conn(0x7fdbc40b6560 msgr2=0x7fdbc4156560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:05:02.264 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.259+0000 7fdbcc449640 1 -- 10.20.193.91:0/771175397 shutdown_connections 2026-02-12T04:05:02.265 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.259+0000 7fdbcc449640 1 -- 10.20.193.91:0/771175397 wait complete. 2026-02-12T04:05:02.265 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.259+0000 7fdbcc449640 1 librados: shutdown 2026-02-12T04:05:02.269 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 11 2026-02-12T04:05:02.338 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.336+0000 7f7480001640 10 monclient: get_monmap_and_config 2026-02-12T04:05:02.338 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.336+0000 7f7480001640 10 monclient: build_initial_monmap 2026-02-12T04:05:02.338 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.336+0000 7f7480001640 10 monclient: monmap: 2026-02-12T04:05:02.338 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:05:02.338 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:02.338 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:05:02.336933+0000 2026-02-12T04:05:02.339 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:05:02.336933+0000 2026-02-12T04:05:02.339 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:05:02.339 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:02.339 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:05:02.339 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:05:02.339 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:05:02.339 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:02.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.336+0000 7f7480001640 1 Processor -- start 2026-02-12T04:05:02.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.336+0000 7f7480001640 1 -- start start 2026-02-12T04:05:02.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.336+0000 7f7480001640 10 monclient: init 2026-02-12T04:05:02.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.337+0000 7f7480001640 10 monclient: _reopen_session rank -1 2026-02-12T04:05:02.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.337+0000 7f7480001640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T04:05:02.342 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.337+0000 7f7480001640 10 monclient(hunting): picked mon.noname-b con 0x7f74781599b0 addr v1:10.20.193.98:6789/0 2026-02-12T04:05:02.343 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.337+0000 7f7480001640 10 monclient(hunting): picked mon.noname-c con 0x7f747805d180 addr v1:10.20.193.111:6789/0 2026-02-12T04:05:02.343 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.337+0000 7f7480001640 10 monclient(hunting): picked mon.noname-a con 0x7f7478166580 addr v1:10.20.193.91:6789/0 2026-02-12T04:05:02.343 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.337+0000 7f7480001640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f747805c0e0 con 0x7f7478166580 2026-02-12T04:05:02.343 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.337+0000 7f7480001640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f747805c3c0 con 0x7f74781599b0 2026-02-12T04:05:02.343 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.337+0000 7f7480001640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f747805c6a0 con 0x7f747805d180 2026-02-12T04:05:02.343 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.337+0000 7f7480001640 10 monclient(hunting): _renew_subs 2026-02-12T04:05:02.343 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.337+0000 7f7480001640 10 monclient(hunting): authenticate will time out at 1505.080704s 2026-02-12T04:05:02.343 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.338+0000 7f747e577640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f7478166580 0x7f74781669a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:40020/0 (socket says 10.20.193.91:40020) 2026-02-12T04:05:02.343 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.338+0000 7f747e577640 1 -- 10.20.193.91:0/1802765849 learned_addr learned my addr 10.20.193.91:0/1802765849 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:05:02.343 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.338+0000 7f747dd76640 1 --1- 10.20.193.91:0/1802765849 >> v1:10.20.193.98:6789/0 conn(0x7f74781599b0 0x7f747805b730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:38436/0 (socket says 10.20.193.91:38436) 2026-02-12T04:05:02.343 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.339+0000 7f747cd74640 1 -- 10.20.193.91:0/1802765849 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3271656095 0 0) 0x7f747805c3c0 con 0x7f74781599b0 2026-02-12T04:05:02.344 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.339+0000 7f747cd74640 10 monclient(hunting): _negotiate 2026-02-12T04:05:02.344 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.339+0000 7f747cd74640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:02.344 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.339+0000 7f747cd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:02.344 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.339+0000 7f747cd74640 10 monclient(hunting): my global_id is 27934 2026-02-12T04:05:02.344 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.339+0000 7f747cd74640 1 -- 10.20.193.91:0/1802765849 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7460003610 con 0x7f74781599b0 2026-02-12T04:05:02.344 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.339+0000 7f747cd74640 1 -- 10.20.193.91:0/1802765849 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2444270513 0 0) 0x7f747805c6a0 con 0x7f747805d180 2026-02-12T04:05:02.344 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.339+0000 7f747cd74640 10 monclient(hunting): _negotiate 2026-02-12T04:05:02.344 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.339+0000 7f747cd74640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:02.344 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.339+0000 7f747cd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:02.344 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.339+0000 7f747cd74640 10 monclient(hunting): my global_id is 27632 2026-02-12T04:05:02.345 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.339+0000 7f747cd74640 1 -- 10.20.193.91:0/1802765849 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f747805c3c0 con 0x7f747805d180 2026-02-12T04:05:02.345 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.339+0000 7f747cd74640 1 -- 10.20.193.91:0/1802765849 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 362205067 0 0) 0x7f747805c0e0 con 0x7f7478166580 2026-02-12T04:05:02.345 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.339+0000 7f747cd74640 10 monclient(hunting): _negotiate 2026-02-12T04:05:02.345 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.339+0000 7f747cd74640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:02.345 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.339+0000 7f747cd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:02.345 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.339+0000 7f747cd74640 10 monclient(hunting): my global_id is 30795 2026-02-12T04:05:02.345 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.339+0000 7f747cd74640 1 -- 10.20.193.91:0/1802765849 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f747805c6a0 con 0x7f7478166580 2026-02-12T04:05:02.352 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.341+0000 7f747cd74640 1 -- 10.20.193.91:0/1802765849 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1192323788 0 0) 0x7f7460003610 con 0x7f74781599b0 2026-02-12T04:05:02.352 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.341+0000 7f747cd74640 1 -- 10.20.193.91:0/1802765849 >> v1:10.20.193.111:6789/0 conn(0x7f747805d180 legacy=0x7f747805d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:02.352 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.341+0000 7f747cd74640 1 -- 10.20.193.91:0/1802765849 >> v1:10.20.193.91:6789/0 conn(0x7f7478166580 legacy=0x7f74781669a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:02.352 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.341+0000 7f747cd74640 10 monclient: _finish_hunting 0 2026-02-12T04:05:02.352 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.341+0000 7f747cd74640 1 monclient: found mon.noname-b 2026-02-12T04:05:02.352 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.341+0000 7f747cd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:05:02.352 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.341+0000 7f747cd74640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T04:05:02.353 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.341+0000 7f747cd74640 1 -- 10.20.193.91:0/1802765849 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f747805c980 con 0x7f74781599b0 2026-02-12T04:05:02.353 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.341+0000 7f747cd74640 10 monclient: _finish_auth 0 2026-02-12T04:05:02.353 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.341+0000 7f747cd74640 10 monclient: _check_auth_tickets 2026-02-12T04:05:02.353 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.341+0000 7f747cd74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:05:02.353 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.341+0000 7f747cd74640 1 -- 10.20.193.91:0/1802765849 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f7468002df0 con 0x7f74781599b0 2026-02-12T04:05:02.353 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.341+0000 7f747cd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:02.353 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.341+0000 7f747cd74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T04:05:02.353 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.341+0000 7f747cd74640 10 monclient: dump: 2026-02-12T04:05:02.353 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:02.353 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:02.353 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.353 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.353 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:02.354 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:02.354 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:02.354 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:02.354 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:02.354 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:02.354 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.341+0000 7f7480001640 5 monclient: authenticate success, global_id 27934 2026-02-12T04:05:02.354 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.341+0000 7f7480001640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:05:02.354 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.342+0000 7f747cd74640 1 -- 10.20.193.91:0/1802765849 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7468002fc0 con 0x7f74781599b0 2026-02-12T04:05:02.354 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.342+0000 7f747cd74640 10 monclient: handle_config config(0 keys) 2026-02-12T04:05:02.354 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.342+0000 7f747cd74640 1 -- 10.20.193.91:0/1802765849 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f7468003400 con 0x7f74781599b0 2026-02-12T04:05:02.354 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.342+0000 7f747cd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:02.355 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.342+0000 7f747cd74640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T04:05:02.355 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.342+0000 7f747cd74640 10 monclient: dump: 2026-02-12T04:05:02.355 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:02.355 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:02.355 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.355 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.355 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:02.355 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:02.355 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:02.355 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:02.355 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:02.355 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:02.355 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.342+0000 7f7480001640 10 monclient: get_monmap_and_config success 2026-02-12T04:05:02.356 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.342+0000 7f7480001640 4 set_mon_vals no callback set 2026-02-12T04:05:02.356 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.342+0000 7f7480001640 10 monclient: shutdown 2026-02-12T04:05:02.356 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.342+0000 7f7480001640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:05:02.356 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.342+0000 7f7480001640 1 -- 10.20.193.91:0/1802765849 >> v1:10.20.193.98:6789/0 conn(0x7f74781599b0 legacy=0x7f747805b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:02.356 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.342+0000 7f7480001640 1 -- 10.20.193.91:0/1802765849 shutdown_connections 2026-02-12T04:05:02.356 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.342+0000 7f7480001640 1 -- 10.20.193.91:0/1802765849 >> 10.20.193.91:0/1802765849 conn(0x7f74780b6560 msgr2=0x7f74780b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:05:02.356 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.342+0000 7f7480001640 1 -- 10.20.193.91:0/1802765849 shutdown_connections 2026-02-12T04:05:02.356 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.342+0000 7f7480001640 1 -- 10.20.193.91:0/1802765849 wait complete. 2026-02-12T04:05:02.356 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.342+0000 7f7480001640 10 monclient: build_initial_monmap 2026-02-12T04:05:02.356 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.342+0000 7f7480001640 10 monclient: monmap: 2026-02-12T04:05:02.356 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:05:02.356 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:05:02.357 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:05:02.357 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:05:02.357 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:05:02.357 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:05:02.357 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:05:02.357 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:05:02.357 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:05:02.357 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:02.357 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.343+0000 7f7480001640 1 librados: starting msgr at 2026-02-12T04:05:02.357 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.343+0000 7f7480001640 1 librados: starting objecter 2026-02-12T04:05:02.357 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.343+0000 7f7480001640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:05:02.357 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.343+0000 7f7480001640 1 Processor -- start 2026-02-12T04:05:02.357 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.343+0000 7f7480001640 1 -- start start 2026-02-12T04:05:02.358 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.343+0000 7f7480001640 1 librados: setting wanted keys 2026-02-12T04:05:02.358 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.343+0000 7f7480001640 1 librados: calling monclient init 2026-02-12T04:05:02.358 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.343+0000 7f7480001640 10 monclient: init 2026-02-12T04:05:02.358 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.343+0000 7f7480001640 10 monclient: _reopen_session rank -1 2026-02-12T04:05:02.358 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.343+0000 7f7480001640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-12T04:05:02.358 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.343+0000 7f7480001640 10 monclient(hunting): picked mon.noname-b con 0x7f747805d180 addr v1:10.20.193.98:6789/0 2026-02-12T04:05:02.358 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.343+0000 7f7480001640 10 monclient(hunting): picked mon.noname-c con 0x7f74781599b0 addr v1:10.20.193.111:6789/0 2026-02-12T04:05:02.358 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.343+0000 7f7480001640 10 monclient(hunting): picked mon.noname-a con 0x7f7478166580 addr v1:10.20.193.91:6789/0 2026-02-12T04:05:02.358 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.343+0000 7f7480001640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7478112b30 con 0x7f7478166580 2026-02-12T04:05:02.358 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.343+0000 7f7480001640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74781661d0 con 0x7f747805d180 2026-02-12T04:05:02.358 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.343+0000 7f7480001640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7478112df0 con 0x7f74781599b0 2026-02-12T04:05:02.358 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.343+0000 7f7480001640 10 monclient(hunting): _renew_subs 2026-02-12T04:05:02.358 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.343+0000 7f7480001640 10 monclient(hunting): authenticate will time out at 1505.086719s 2026-02-12T04:05:02.359 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.343+0000 7f747e577640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f7478166580 0x7f747812ddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:40022/0 (socket says 10.20.193.91:40022) 2026-02-12T04:05:02.359 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.343+0000 7f747e577640 1 -- 10.20.193.91:0/1379147699 learned_addr learned my addr 10.20.193.91:0/1379147699 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:05:02.359 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.344+0000 7f74667fc640 10 client.?.objecter ms_handle_connect 0x7f747805d180 2026-02-12T04:05:02.359 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.344+0000 7f74667fc640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:02.359 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.344+0000 7f74667fc640 10 client.?.objecter ms_handle_connect 0x7f7478166580 2026-02-12T04:05:02.359 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.344+0000 7f74667fc640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:02.359 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.344+0000 7f74667fc640 10 client.?.objecter ms_handle_connect 0x7f74781599b0 2026-02-12T04:05:02.359 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.344+0000 7f74667fc640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:02.359 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.345+0000 7f74667fc640 1 -- 10.20.193.91:0/1379147699 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3645001098 0 0) 0x7f74781661d0 con 0x7f747805d180 2026-02-12T04:05:02.359 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.345+0000 7f74667fc640 10 monclient(hunting): _negotiate 2026-02-12T04:05:02.359 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.345+0000 7f74667fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:02.359 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.345+0000 7f74667fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:02.360 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.345+0000 7f74667fc640 10 monclient(hunting): my global_id is 27937 2026-02-12T04:05:02.360 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.345+0000 7f74667fc640 1 -- 10.20.193.91:0/1379147699 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7448003610 con 0x7f747805d180 2026-02-12T04:05:02.360 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.345+0000 7f74667fc640 1 -- 10.20.193.91:0/1379147699 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3778380147 0 0) 0x7f7478112df0 con 0x7f74781599b0 2026-02-12T04:05:02.360 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.345+0000 7f74667fc640 10 monclient(hunting): _negotiate 2026-02-12T04:05:02.360 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.345+0000 7f74667fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:02.360 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.345+0000 7f74667fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:02.360 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.345+0000 7f74667fc640 10 monclient(hunting): my global_id is 27635 2026-02-12T04:05:02.360 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.345+0000 7f74667fc640 1 -- 10.20.193.91:0/1379147699 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74781661d0 con 0x7f74781599b0 2026-02-12T04:05:02.360 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.345+0000 7f74667fc640 1 -- 10.20.193.91:0/1379147699 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 640944557 0 0) 0x7f7478112b30 con 0x7f7478166580 2026-02-12T04:05:02.360 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.345+0000 7f74667fc640 10 monclient(hunting): _negotiate 2026-02-12T04:05:02.360 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.345+0000 7f74667fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:02.361 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.345+0000 7f74667fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:02.361 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.345+0000 7f74667fc640 10 monclient(hunting): my global_id is 30798 2026-02-12T04:05:02.361 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.345+0000 7f74667fc640 1 -- 10.20.193.91:0/1379147699 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7478112df0 con 0x7f7478166580 2026-02-12T04:05:02.361 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.347+0000 7f74667fc640 1 -- 10.20.193.91:0/1379147699 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3185121063 0 0) 0x7f7448003610 con 0x7f747805d180 2026-02-12T04:05:02.361 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.347+0000 7f74667fc640 1 -- 10.20.193.91:0/1379147699 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7478112b30 con 0x7f747805d180 2026-02-12T04:05:02.361 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.347+0000 7f74667fc640 1 -- 10.20.193.91:0/1379147699 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f7468003310 con 0x7f747805d180 2026-02-12T04:05:02.361 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.347+0000 7f74667fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:02.361 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.347+0000 7f74667fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T04:05:02.361 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.347+0000 7f74667fc640 10 monclient(hunting): dump: 2026-02-12T04:05:02.361 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:02.361 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:02.361 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.361 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.362 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:02.362 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:02.362 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:02.362 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:02.362 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:02.362 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:02.362 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.347+0000 7f74667fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:05:02.362 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.347+0000 7f74667fc640 1 -- 10.20.193.91:0/1379147699 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2270054752 0 0) 0x7f74781661d0 con 0x7f74781599b0 2026-02-12T04:05:02.362 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.347+0000 7f74667fc640 1 -- 10.20.193.91:0/1379147699 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7448003610 con 0x7f74781599b0 2026-02-12T04:05:02.362 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.347+0000 7f74667fc640 1 -- 10.20.193.91:0/1379147699 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f746c0030b0 con 0x7f74781599b0 2026-02-12T04:05:02.362 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.347+0000 7f74667fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:02.362 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.347+0000 7f74667fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T04:05:02.363 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.347+0000 7f74667fc640 10 monclient(hunting): dump: 2026-02-12T04:05:02.363 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:02.363 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:02.363 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.363 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.363 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:02.363 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:02.363 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:02.363 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:02.363 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:02.363 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:02.363 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.348+0000 7f74667fc640 1 -- 10.20.193.91:0/1379147699 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 946982372 0 0) 0x7f7478112df0 con 0x7f7478166580 2026-02-12T04:05:02.363 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.348+0000 7f74667fc640 1 -- 10.20.193.91:0/1379147699 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f74781661d0 con 0x7f7478166580 2026-02-12T04:05:02.364 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.348+0000 7f74667fc640 1 -- 10.20.193.91:0/1379147699 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f7474003330 con 0x7f7478166580 2026-02-12T04:05:02.364 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.348+0000 7f74667fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:02.364 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.348+0000 7f74667fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T04:05:02.364 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.348+0000 7f74667fc640 10 monclient(hunting): dump: 2026-02-12T04:05:02.364 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:02.364 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:02.364 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.364 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.364 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:02.364 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:02.364 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:02.365 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:02.365 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:02.365 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:02.365 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.349+0000 7f74667fc640 1 -- 10.20.193.91:0/1379147699 <== mon.1 v1:10.20.193.98:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3702586662 0 0) 0x7f7478112b30 con 0x7f747805d180 2026-02-12T04:05:02.365 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.349+0000 7f74667fc640 1 -- 10.20.193.91:0/1379147699 >> v1:10.20.193.111:6789/0 conn(0x7f74781599b0 legacy=0x7f7478110340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:02.365 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.349+0000 7f74667fc640 1 -- 10.20.193.91:0/1379147699 >> v1:10.20.193.91:6789/0 conn(0x7f7478166580 legacy=0x7f747812ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:02.365 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.349+0000 7f74667fc640 10 monclient: _finish_hunting 0 2026-02-12T04:05:02.365 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.349+0000 7f74667fc640 1 monclient: found mon.b 2026-02-12T04:05:02.365 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.349+0000 7f74667fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:05:02.365 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.349+0000 7f74667fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:05:02.365 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.349+0000 7f74667fc640 1 -- 10.20.193.91:0/1379147699 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74781130d0 con 0x7f747805d180 2026-02-12T04:05:02.365 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.349+0000 7f74667fc640 10 monclient: _finish_auth 0 2026-02-12T04:05:02.366 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.349+0000 7f74667fc640 10 monclient: _check_auth_tickets 2026-02-12T04:05:02.366 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.349+0000 7f74667fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:05:02.366 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.349+0000 7f7480001640 5 monclient: authenticate success, global_id 27937 2026-02-12T04:05:02.366 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.349+0000 7f7480001640 10 monclient: _renew_subs 2026-02-12T04:05:02.366 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.349+0000 7f7480001640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:05:02.366 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.349+0000 7f7480001640 1 -- 10.20.193.91:0/1379147699 --> v1:10.20.193.98:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f74781133b0 con 0x7f747805d180 2026-02-12T04:05:02.366 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.349+0000 7f7480001640 10 client.27937.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:05:02.366 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.349+0000 7f7480001640 10 monclient: _renew_subs 2026-02-12T04:05:02.366 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.349+0000 7f7480001640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:05:02.366 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.349+0000 7f7480001640 1 -- 10.20.193.91:0/1379147699 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f747810fb40 con 0x7f747805d180 2026-02-12T04:05:02.366 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.349+0000 7f7480001640 1 librados: init done 2026-02-12T04:05:02.366 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.349+0000 7f7480001640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T04:05:02.366 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.349+0000 7f7480001640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:05:02.367 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.349+0000 7f7480001640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:05:02.367 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.349+0000 7f7480001640 1 -- 10.20.193.91:0/1379147699 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74781608b0 con 0x7f747805d180 2026-02-12T04:05:02.368 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.354+0000 7f74667fc640 1 -- 10.20.193.91:0/1379147699 <== mon.1 v1:10.20.193.98:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7468002fc0 con 0x7f747805d180 2026-02-12T04:05:02.368 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.354+0000 7f74667fc640 10 monclient: handle_config config(0 keys) 2026-02-12T04:05:02.368 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.354+0000 7f74667fc640 1 -- 10.20.193.91:0/1379147699 <== mon.1 v1:10.20.193.98:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f7468004b80 con 0x7f747805d180 2026-02-12T04:05:02.368 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.354+0000 7f74667fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:02.368 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.354+0000 7f74667fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T04:05:02.368 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.354+0000 7f74667fc640 10 monclient: dump: 2026-02-12T04:05:02.369 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:02.369 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:02.369 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.369 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.369 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:02.369 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:02.369 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:02.369 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:02.369 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:02.369 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:02.369 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.354+0000 7f7467fff640 4 set_mon_vals no callback set 2026-02-12T04:05:02.369 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.358+0000 7f74667fc640 1 -- 10.20.193.91:0/1379147699 <== mon.1 v1:10.20.193.98:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f746801dec0 con 0x7f747805d180 2026-02-12T04:05:02.370 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.358+0000 7f747d575640 10 monclient: get_auth_request con 0x7f7448079ff0 auth_method 0 2026-02-12T04:05:02.370 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.358+0000 7f74667fc640 10 client.27937.objecter ms_handle_connect 0x7f7448079ff0 2026-02-12T04:05:02.370 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.359+0000 7f74667fc640 1 -- 10.20.193.91:0/1379147699 <== mon.1 v1:10.20.193.98:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7f7468095970 con 0x7f747805d180 2026-02-12T04:05:02.370 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.359+0000 7f74667fc640 10 client.27937.objecter ms_dispatch2 0x7f7478000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:05:02.370 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.359+0000 7f74667fc640 3 client.27937.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:05:02.370 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.359+0000 7f74667fc640 3 client.27937.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:05:02.370 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.359+0000 7f74667fc640 20 client.27937.objecter dump_active .. 0 homeless 2026-02-12T04:05:02.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.447+0000 7f74667fc640 1 -- 10.20.193.91:0/1379147699 <== mon.1 v1:10.20.193.98:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f746805f2d0 con 0x7f747805d180 2026-02-12T04:05:02.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.447+0000 7f74667fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:05:02.449 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.447+0000 7f74667fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T04:05:02.560 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.558+0000 7f7480001640 1 -- 10.20.193.91:0/1379147699 --> v1:10.20.193.91:6800/2929217192 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "11", "target": ["mon-mgr", ""]}) -- 0x7f74781350b0 con 0x7f7448079ff0 2026-02-12T04:05:02.560 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.558+0000 7f74667fc640 1 -- 10.20.193.91:0/1379147699 <== mgr.4113 v1:10.20.193.91:6800/2929217192 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 11 to deep-scrub) ==== 42+0+0 (unknown 2412662492 0 0) 0x7f74781350b0 con 0x7f7448079ff0 2026-02-12T04:05:02.560 INFO:teuthology.orchestra.run.trial091.stderr:instructed osd(s) 11 to deep-scrub 2026-02-12T04:05:02.562 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.560+0000 7f7480001640 10 librados: watch_flush enter 2026-02-12T04:05:02.562 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.560+0000 7f7480001640 10 librados: watch_flush exit 2026-02-12T04:05:02.563 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.560+0000 7f7480001640 20 client.27937.objecter shutdown clearing up homeless session... 2026-02-12T04:05:02.563 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.560+0000 7f7480001640 10 client.27937.objecter successfully canceled tick 2026-02-12T04:05:02.563 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.560+0000 7f7480001640 1 -- 10.20.193.91:0/1379147699 >> v1:10.20.193.91:6800/2929217192 conn(0x7f7448079ff0 legacy=0x7f744809a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:02.563 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.560+0000 7f7480001640 10 monclient: shutdown 2026-02-12T04:05:02.563 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.560+0000 7f7480001640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:05:02.563 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.560+0000 7f7480001640 1 -- 10.20.193.91:0/1379147699 >> v1:10.20.193.98:6789/0 conn(0x7f747805d180 legacy=0x7f7478165ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:02.563 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.560+0000 7f7480001640 1 -- 10.20.193.91:0/1379147699 shutdown_connections 2026-02-12T04:05:02.563 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.560+0000 7f7480001640 1 -- 10.20.193.91:0/1379147699 >> 10.20.193.91:0/1379147699 conn(0x7f74780b6560 msgr2=0x7f747805b730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:05:02.563 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.560+0000 7f7480001640 1 -- 10.20.193.91:0/1379147699 shutdown_connections 2026-02-12T04:05:02.563 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.560+0000 7f7480001640 1 -- 10.20.193.91:0/1379147699 wait complete. 2026-02-12T04:05:02.564 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.560+0000 7f7480001640 1 librados: shutdown 2026-02-12T04:05:02.572 INFO:tasks.ceph:Scrubbing osd.15 2026-02-12T04:05:02.572 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.15 config set osd_debug_deep_scrub_sleep 0 2026-02-12T04:05:02.646 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.643+0000 7f8dc9696640 10 monclient: get_monmap_and_config 2026-02-12T04:05:02.646 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.643+0000 7f8dc9696640 10 monclient: build_initial_monmap 2026-02-12T04:05:02.646 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.644+0000 7f8dc9696640 10 monclient: monmap: 2026-02-12T04:05:02.646 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:05:02.646 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:02.646 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:05:02.644566+0000 2026-02-12T04:05:02.647 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:05:02.644566+0000 2026-02-12T04:05:02.647 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:05:02.647 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:02.647 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:05:02.647 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:05:02.647 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:05:02.647 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:02.647 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.644+0000 7f8dc9696640 1 Processor -- start 2026-02-12T04:05:02.647 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.644+0000 7f8dc9696640 1 -- start start 2026-02-12T04:05:02.647 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.644+0000 7f8dc9696640 10 monclient: init 2026-02-12T04:05:02.655 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.644+0000 7f8dc9696640 10 monclient: _reopen_session rank -1 2026-02-12T04:05:02.655 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.644+0000 7f8dc9696640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-12T04:05:02.655 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.644+0000 7f8dc9696640 10 monclient(hunting): picked mon.noname-c con 0x7f8dc4055c30 addr v1:10.20.193.111:6789/0 2026-02-12T04:05:02.655 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.644+0000 7f8dc9696640 10 monclient(hunting): picked mon.noname-a con 0x7f8dc4160f80 addr v1:10.20.193.91:6789/0 2026-02-12T04:05:02.655 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.644+0000 7f8dc9696640 10 monclient(hunting): picked mon.noname-b con 0x7f8dc4163230 addr v1:10.20.193.98:6789/0 2026-02-12T04:05:02.655 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.644+0000 7f8dc9696640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dc40b1fc0 con 0x7f8dc4160f80 2026-02-12T04:05:02.655 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.645+0000 7f8dc9696640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dc40b22a0 con 0x7f8dc4163230 2026-02-12T04:05:02.655 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.645+0000 7f8dc9696640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dc40b2580 con 0x7f8dc4055c30 2026-02-12T04:05:02.655 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.645+0000 7f8dc9696640 10 monclient(hunting): _renew_subs 2026-02-12T04:05:02.655 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.645+0000 7f8dc9696640 10 monclient(hunting): authenticate will time out at 1505.388008s 2026-02-12T04:05:02.656 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.645+0000 7f8dc27fc640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f8dc4160f80 0x7f8dc41572d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:40034/0 (socket says 10.20.193.91:40034) 2026-02-12T04:05:02.656 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.645+0000 7f8dc27fc640 1 -- 10.20.193.91:0/2804576160 learned_addr learned my addr 10.20.193.91:0/2804576160 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:05:02.656 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.646+0000 7f8dc1ffb640 1 -- 10.20.193.91:0/2804576160 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3272401071 0 0) 0x7f8dc40b1fc0 con 0x7f8dc4160f80 2026-02-12T04:05:02.656 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.646+0000 7f8dc1ffb640 10 monclient(hunting): _negotiate 2026-02-12T04:05:02.656 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.646+0000 7f8dc1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:02.656 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.646+0000 7f8dc1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:02.656 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.646+0000 7f8dc1ffb640 10 monclient(hunting): my global_id is 30801 2026-02-12T04:05:02.656 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.646+0000 7f8dc1ffb640 1 -- 10.20.193.91:0/2804576160 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8db0003610 con 0x7f8dc4160f80 2026-02-12T04:05:02.656 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.646+0000 7f8dc1ffb640 1 -- 10.20.193.91:0/2804576160 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3854821441 0 0) 0x7f8dc40b22a0 con 0x7f8dc4163230 2026-02-12T04:05:02.656 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.646+0000 7f8dc1ffb640 10 monclient(hunting): _negotiate 2026-02-12T04:05:02.656 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.646+0000 7f8dc1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:02.657 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.646+0000 7f8dc1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:02.657 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.646+0000 7f8dc1ffb640 10 monclient(hunting): my global_id is 27940 2026-02-12T04:05:02.657 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.646+0000 7f8dc1ffb640 1 -- 10.20.193.91:0/2804576160 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8dc40b1fc0 con 0x7f8dc4163230 2026-02-12T04:05:02.657 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.646+0000 7f8dc1ffb640 1 -- 10.20.193.91:0/2804576160 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3565199500 0 0) 0x7f8dc40b2580 con 0x7f8dc4055c30 2026-02-12T04:05:02.657 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.646+0000 7f8dc1ffb640 10 monclient(hunting): _negotiate 2026-02-12T04:05:02.657 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.646+0000 7f8dc1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:02.657 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.646+0000 7f8dc1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:02.657 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.646+0000 7f8dc1ffb640 10 monclient(hunting): my global_id is 27638 2026-02-12T04:05:02.657 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.646+0000 7f8dc1ffb640 1 -- 10.20.193.91:0/2804576160 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8dc40b22a0 con 0x7f8dc4055c30 2026-02-12T04:05:02.657 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.648+0000 7f8dc1ffb640 1 -- 10.20.193.91:0/2804576160 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2795969537 0 0) 0x7f8db0003610 con 0x7f8dc4160f80 2026-02-12T04:05:02.657 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.648+0000 7f8dc1ffb640 1 -- 10.20.193.91:0/2804576160 >> v1:10.20.193.111:6789/0 conn(0x7f8dc4055c30 legacy=0x7f8dc4162b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:02.657 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.648+0000 7f8dc1ffb640 1 -- 10.20.193.91:0/2804576160 >> v1:10.20.193.98:6789/0 conn(0x7f8dc4163230 legacy=0x7f8dc41c57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:02.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.648+0000 7f8dc1ffb640 10 monclient: _finish_hunting 0 2026-02-12T04:05:02.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.648+0000 7f8dc1ffb640 1 monclient: found mon.noname-a 2026-02-12T04:05:02.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.648+0000 7f8dc1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:05:02.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.648+0000 7f8dc1ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.91:6789/0 2026-02-12T04:05:02.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.648+0000 7f8dc1ffb640 1 -- 10.20.193.91:0/2804576160 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc40b2860 con 0x7f8dc4160f80 2026-02-12T04:05:02.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.648+0000 7f8dc1ffb640 10 monclient: _finish_auth 0 2026-02-12T04:05:02.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.648+0000 7f8dc1ffb640 10 monclient: _check_auth_tickets 2026-02-12T04:05:02.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.648+0000 7f8dc1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:05:02.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.648+0000 7f8dc1ffb640 1 -- 10.20.193.91:0/2804576160 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8dac002df0 con 0x7f8dc4160f80 2026-02-12T04:05:02.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.648+0000 7f8dc1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:02.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.648+0000 7f8dc1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T04:05:02.658 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.648+0000 7f8dc1ffb640 10 monclient: dump: 2026-02-12T04:05:02.659 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:02.659 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:02.659 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.659 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.659 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:02.659 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:02.659 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:02.659 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:02.659 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:02.659 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:02.659 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.648+0000 7f8dc9696640 5 monclient: authenticate success, global_id 30801 2026-02-12T04:05:02.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.648+0000 7f8dc9696640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:05:02.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.649+0000 7f8dc1ffb640 1 -- 10.20.193.91:0/2804576160 <== mon.0 v1:10.20.193.91:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8dac002fc0 con 0x7f8dc4160f80 2026-02-12T04:05:02.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.649+0000 7f8dc1ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T04:05:02.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.649+0000 7f8dc1ffb640 1 -- 10.20.193.91:0/2804576160 <== mon.0 v1:10.20.193.91:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8dac003400 con 0x7f8dc4160f80 2026-02-12T04:05:02.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.649+0000 7f8dc9696640 10 monclient: get_monmap_and_config success 2026-02-12T04:05:02.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.649+0000 7f8dc9696640 4 set_mon_vals no callback set 2026-02-12T04:05:02.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.649+0000 7f8dc1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:02.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.649+0000 7f8dc1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T04:05:02.660 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.649+0000 7f8dc1ffb640 10 monclient: dump: 2026-02-12T04:05:02.660 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:02.660 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:02.660 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.660 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.661 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:02.661 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:02.661 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:02.661 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:02.661 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:02.661 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:02.661 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.649+0000 7f8dc9696640 10 monclient: shutdown 2026-02-12T04:05:02.661 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.649+0000 7f8dc9696640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:05:02.661 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.649+0000 7f8dc9696640 1 -- 10.20.193.91:0/2804576160 >> v1:10.20.193.91:6789/0 conn(0x7f8dc4160f80 legacy=0x7f8dc41572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:02.661 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.649+0000 7f8dc9696640 1 -- 10.20.193.91:0/2804576160 shutdown_connections 2026-02-12T04:05:02.661 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.649+0000 7f8dc9696640 1 -- 10.20.193.91:0/2804576160 >> 10.20.193.91:0/2804576160 conn(0x7f8dc40b6560 msgr2=0x7f8dc40b6930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:05:02.661 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.649+0000 7f8dc9696640 1 -- 10.20.193.91:0/2804576160 shutdown_connections 2026-02-12T04:05:02.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.649+0000 7f8dc9696640 1 -- 10.20.193.91:0/2804576160 wait complete. 2026-02-12T04:05:02.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.650+0000 7f8dc9696640 10 monclient: build_initial_monmap 2026-02-12T04:05:02.662 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.650+0000 7f8dc9696640 10 monclient: monmap: 2026-02-12T04:05:02.662 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:05:02.662 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:05:02.662 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:05:02.662 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:05:02.662 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:05:02.662 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:05:02.662 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:05:02.662 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:05:02.662 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:05:02.663 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:02.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.650+0000 7f8dc9696640 1 librados: starting msgr at 2026-02-12T04:05:02.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.650+0000 7f8dc9696640 1 librados: starting objecter 2026-02-12T04:05:02.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.650+0000 7f8dc9696640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:05:02.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.650+0000 7f8dc9696640 1 Processor -- start 2026-02-12T04:05:02.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.650+0000 7f8dc9696640 1 -- start start 2026-02-12T04:05:02.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.650+0000 7f8dc9696640 1 librados: setting wanted keys 2026-02-12T04:05:02.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.650+0000 7f8dc9696640 1 librados: calling monclient init 2026-02-12T04:05:02.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.650+0000 7f8dc9696640 10 monclient: init 2026-02-12T04:05:02.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.650+0000 7f8dc9696640 10 monclient: _reopen_session rank -1 2026-02-12T04:05:02.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.650+0000 7f8dc9696640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T04:05:02.663 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.650+0000 7f8dc9696640 10 monclient(hunting): picked mon.noname-a con 0x7f8dc4055c30 addr v1:10.20.193.91:6789/0 2026-02-12T04:05:02.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.650+0000 7f8dc9696640 10 monclient(hunting): picked mon.noname-c con 0x7f8dc4160f80 addr v1:10.20.193.111:6789/0 2026-02-12T04:05:02.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.650+0000 7f8dc9696640 10 monclient(hunting): picked mon.noname-b con 0x7f8dc4163230 addr v1:10.20.193.98:6789/0 2026-02-12T04:05:02.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.650+0000 7f8dc9696640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dc405be70 con 0x7f8dc4055c30 2026-02-12T04:05:02.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.650+0000 7f8dc9696640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dc405c150 con 0x7f8dc4163230 2026-02-12T04:05:02.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.650+0000 7f8dc9696640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dc405c430 con 0x7f8dc4160f80 2026-02-12T04:05:02.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.650+0000 7f8dc9696640 10 monclient(hunting): _renew_subs 2026-02-12T04:05:02.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.650+0000 7f8dc9696640 10 monclient(hunting): authenticate will time out at 1505.393814s 2026-02-12T04:05:02.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.651+0000 7f8dc27fc640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f8dc4160f80 0x7f8dc415ef60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.91:56124/0 (socket says 10.20.193.91:56124) 2026-02-12T04:05:02.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.651+0000 7f8dc27fc640 1 -- 10.20.193.91:0/3668056274 learned_addr learned my addr 10.20.193.91:0/3668056274 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:05:02.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.651+0000 7f8da37fe640 10 client.?.objecter ms_handle_connect 0x7f8dc4160f80 2026-02-12T04:05:02.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.651+0000 7f8da37fe640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:02.664 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.651+0000 7f8da37fe640 10 client.?.objecter ms_handle_connect 0x7f8dc4163230 2026-02-12T04:05:02.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.651+0000 7f8da37fe640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:02.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.652+0000 7f8da37fe640 10 client.?.objecter ms_handle_connect 0x7f8dc4055c30 2026-02-12T04:05:02.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.652+0000 7f8da37fe640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:02.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.652+0000 7f8da37fe640 1 -- 10.20.193.91:0/3668056274 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1932857163 0 0) 0x7f8dc405c150 con 0x7f8dc4163230 2026-02-12T04:05:02.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.652+0000 7f8da37fe640 10 monclient(hunting): _negotiate 2026-02-12T04:05:02.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.652+0000 7f8da37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:02.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.652+0000 7f8da37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:02.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.652+0000 7f8da37fe640 10 monclient(hunting): my global_id is 27943 2026-02-12T04:05:02.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.652+0000 7f8da37fe640 1 -- 10.20.193.91:0/3668056274 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d90003610 con 0x7f8dc4163230 2026-02-12T04:05:02.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.652+0000 7f8da37fe640 1 -- 10.20.193.91:0/3668056274 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3215001479 0 0) 0x7f8dc405c430 con 0x7f8dc4160f80 2026-02-12T04:05:02.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.652+0000 7f8da37fe640 10 monclient(hunting): _negotiate 2026-02-12T04:05:02.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.652+0000 7f8da37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:02.665 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.652+0000 7f8da37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:02.666 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.652+0000 7f8da37fe640 10 monclient(hunting): my global_id is 27641 2026-02-12T04:05:02.666 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.652+0000 7f8da37fe640 1 -- 10.20.193.91:0/3668056274 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8dc405c150 con 0x7f8dc4160f80 2026-02-12T04:05:02.666 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.653+0000 7f8da37fe640 1 -- 10.20.193.91:0/3668056274 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1477323724 0 0) 0x7f8dc405be70 con 0x7f8dc4055c30 2026-02-12T04:05:02.666 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.653+0000 7f8da37fe640 10 monclient(hunting): _negotiate 2026-02-12T04:05:02.666 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.653+0000 7f8da37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:02.666 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.653+0000 7f8da37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:02.666 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.653+0000 7f8da37fe640 10 monclient(hunting): my global_id is 30804 2026-02-12T04:05:02.666 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.653+0000 7f8da37fe640 1 -- 10.20.193.91:0/3668056274 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8dc405c430 con 0x7f8dc4055c30 2026-02-12T04:05:02.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.655+0000 7f8da37fe640 1 -- 10.20.193.91:0/3668056274 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1426845391 0 0) 0x7f8dc405c150 con 0x7f8dc4160f80 2026-02-12T04:05:02.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.655+0000 7f8da37fe640 1 -- 10.20.193.91:0/3668056274 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8dc405be70 con 0x7f8dc4160f80 2026-02-12T04:05:02.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.655+0000 7f8da37fe640 1 -- 10.20.193.91:0/3668056274 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8dac003310 con 0x7f8dc4160f80 2026-02-12T04:05:02.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.655+0000 7f8da37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:02.670 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.655+0000 7f8da37fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T04:05:02.671 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.655+0000 7f8da37fe640 10 monclient(hunting): dump: 2026-02-12T04:05:02.671 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:02.671 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:02.671 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.671 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.671 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:02.671 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:02.671 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:02.671 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:02.671 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:02.671 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:02.671 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.655+0000 7f8da37fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:05:02.672 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.655+0000 7f8da37fe640 1 -- 10.20.193.91:0/3668056274 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3820361198 0 0) 0x7f8d90003610 con 0x7f8dc4163230 2026-02-12T04:05:02.672 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.655+0000 7f8da37fe640 1 -- 10.20.193.91:0/3668056274 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8dc405c150 con 0x7f8dc4163230 2026-02-12T04:05:02.672 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.655+0000 7f8da37fe640 1 -- 10.20.193.91:0/3668056274 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8db4003340 con 0x7f8dc4163230 2026-02-12T04:05:02.672 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.655+0000 7f8da37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:02.672 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.655+0000 7f8da37fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T04:05:02.672 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.655+0000 7f8da37fe640 10 monclient(hunting): dump: 2026-02-12T04:05:02.672 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:02.672 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:02.672 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.672 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.672 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:02.672 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:02.673 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:02.673 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:02.673 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:02.673 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:02.673 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.655+0000 7f8da37fe640 1 -- 10.20.193.91:0/3668056274 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 393364955 0 0) 0x7f8dc405c430 con 0x7f8dc4055c30 2026-02-12T04:05:02.673 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.655+0000 7f8da37fe640 1 -- 10.20.193.91:0/3668056274 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8d90003610 con 0x7f8dc4055c30 2026-02-12T04:05:02.673 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.655+0000 7f8da37fe640 1 -- 10.20.193.91:0/3668056274 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8db8003060 con 0x7f8dc4055c30 2026-02-12T04:05:02.673 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.655+0000 7f8da37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:02.673 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.655+0000 7f8da37fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T04:05:02.673 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.655+0000 7f8da37fe640 10 monclient(hunting): dump: 2026-02-12T04:05:02.673 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:02.673 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:02.674 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.674 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.674 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:02.674 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:02.674 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:02.674 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:02.674 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:02.674 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:02.674 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.656+0000 7f8da37fe640 1 -- 10.20.193.91:0/3668056274 <== mon.2 v1:10.20.193.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2686547652 0 0) 0x7f8dc405be70 con 0x7f8dc4160f80 2026-02-12T04:05:02.674 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.656+0000 7f8da37fe640 1 -- 10.20.193.91:0/3668056274 >> v1:10.20.193.98:6789/0 conn(0x7f8dc4163230 legacy=0x7f8dc4146cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:02.674 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.656+0000 7f8da37fe640 1 -- 10.20.193.91:0/3668056274 >> v1:10.20.193.91:6789/0 conn(0x7f8dc4055c30 legacy=0x7f8dc4143e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:02.674 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.656+0000 7f8da37fe640 10 monclient: _finish_hunting 0 2026-02-12T04:05:02.675 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.656+0000 7f8da37fe640 1 monclient: found mon.c 2026-02-12T04:05:02.675 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.656+0000 7f8da37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:05:02.675 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.656+0000 7f8da37fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:05:02.675 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.656+0000 7f8da37fe640 1 -- 10.20.193.91:0/3668056274 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc4143600 con 0x7f8dc4160f80 2026-02-12T04:05:02.675 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.656+0000 7f8da37fe640 10 monclient: _finish_auth 0 2026-02-12T04:05:02.675 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.656+0000 7f8da37fe640 10 monclient: _check_auth_tickets 2026-02-12T04:05:02.675 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.656+0000 7f8da37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:05:02.675 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.656+0000 7f8dc9696640 5 monclient: authenticate success, global_id 27641 2026-02-12T04:05:02.675 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.656+0000 7f8dc9696640 10 monclient: _renew_subs 2026-02-12T04:05:02.675 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.656+0000 7f8dc9696640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:05:02.675 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.656+0000 7f8dc9696640 1 -- 10.20.193.91:0/3668056274 --> v1:10.20.193.111:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8dc415e5a0 con 0x7f8dc4160f80 2026-02-12T04:05:02.675 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.656+0000 7f8dc9696640 10 client.27641.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:05:02.675 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.656+0000 7f8dc9696640 10 monclient: _renew_subs 2026-02-12T04:05:02.676 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.656+0000 7f8dc9696640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:05:02.676 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.656+0000 7f8dc9696640 1 -- 10.20.193.91:0/3668056274 --> v1:10.20.193.111:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8dc415f850 con 0x7f8dc4160f80 2026-02-12T04:05:02.676 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.656+0000 7f8dc9696640 1 librados: init done 2026-02-12T04:05:02.676 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.657+0000 7f8dc9696640 10 client.27641.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:05:02.676 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.657+0000 7f8dc9696640 15 client.27641.objecter _session_command_op_assign -1 1 2026-02-12T04:05:02.676 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.657+0000 7f8dc9696640 20 client.27641.objecter _get_session osd=-1 returning homeless 2026-02-12T04:05:02.676 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.657+0000 7f8dc9696640 10 client.27641.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:05:02.676 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.657+0000 7f8dc9696640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:05:02.676 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.657+0000 7f8dc9696640 1 -- 10.20.193.91:0/3668056274 --> v1:10.20.193.111:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f8dc40b0990 con 0x7f8dc4160f80 2026-02-12T04:05:02.676 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.665+0000 7f8da37fe640 1 -- 10.20.193.91:0/3668056274 <== mon.2 v1:10.20.193.111:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8dc40b0990 con 0x7f8dc4160f80 2026-02-12T04:05:02.676 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.665+0000 7f8da37fe640 10 monclient: handle_config config(0 keys) 2026-02-12T04:05:02.676 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.665+0000 7f8da37fe640 1 -- 10.20.193.91:0/3668056274 <== mon.2 v1:10.20.193.111:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f8dac002f70 con 0x7f8dc4160f80 2026-02-12T04:05:02.676 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.665+0000 7f8da37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:02.677 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.665+0000 7f8da37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T04:05:02.677 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.665+0000 7f8da37fe640 10 monclient: dump: 2026-02-12T04:05:02.677 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:02.677 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:02.677 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.677 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.677 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:02.677 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:02.677 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:02.677 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:02.677 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:02.677 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:02.677 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.665+0000 7f8dc17fa640 4 set_mon_vals no callback set 2026-02-12T04:05:02.678 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.666+0000 7f8da37fe640 1 -- 10.20.193.91:0/3668056274 <== mon.2 v1:10.20.193.111:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f8dac01dec0 con 0x7f8dc4160f80 2026-02-12T04:05:02.678 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.666+0000 7f8dc2ffd640 10 monclient: get_auth_request con 0x7f8d9007a110 auth_method 0 2026-02-12T04:05:02.678 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.666+0000 7f8da37fe640 10 client.27641.objecter ms_handle_connect 0x7f8d9007a110 2026-02-12T04:05:02.678 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.667+0000 7f8da37fe640 1 -- 10.20.193.91:0/3668056274 <== mon.2 v1:10.20.193.111:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7f8dac002f70 con 0x7f8dc4160f80 2026-02-12T04:05:02.678 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.667+0000 7f8da37fe640 10 client.27641.objecter ms_dispatch2 0x7f8dc4000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:05:02.678 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.667+0000 7f8da37fe640 3 client.27641.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:05:02.678 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.667+0000 7f8da37fe640 3 client.27641.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:05:02.678 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.667+0000 7f8da37fe640 10 client.27641.objecter checking command 1 2026-02-12T04:05:02.678 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.667+0000 7f8da37fe640 20 client.27641.objecter _get_session s=0x7f8d900a43c0 osd=15 3 2026-02-12T04:05:02.678 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.667+0000 7f8da37fe640 20 client.27641.objecter put_session s=0x7f8d900a43c0 osd=15 3 2026-02-12T04:05:02.678 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.667+0000 7f8da37fe640 15 client.27641.objecter _session_command_op_remove -1 1 2026-02-12T04:05:02.678 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.667+0000 7f8da37fe640 20 client.27641.objecter _get_session s=0x7f8d900a43c0 osd=15 3 2026-02-12T04:05:02.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.667+0000 7f8da37fe640 20 client.27641.objecter get_session s=0x7f8d900a43c0 osd=15 3 2026-02-12T04:05:02.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.667+0000 7f8da37fe640 15 client.27641.objecter _session_command_op_assign 15 1 2026-02-12T04:05:02.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.667+0000 7f8da37fe640 20 client.27641.objecter put_session s=0x7f8d900a43c0 osd=15 4 2026-02-12T04:05:02.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.667+0000 7f8da37fe640 10 client.27641.objecter _send_command 1 2026-02-12T04:05:02.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.667+0000 7f8da37fe640 1 -- 10.20.193.91:0/3668056274 --> v1:10.20.193.154:6809/2343771552 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8d900c66d0 con 0x7f8d900a4a70 2026-02-12T04:05:02.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.667+0000 7f8da37fe640 20 client.27641.objecter dump_active .. 0 homeless 2026-02-12T04:05:02.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.667+0000 7f8dc37fe640 10 monclient: get_auth_request con 0x7f8d900a4a70 auth_method 0 2026-02-12T04:05:02.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.667+0000 7f8da37fe640 1 -- 10.20.193.91:0/3668056274 <== mon.2 v1:10.20.193.111:6789/0 9 ==== mon_get_version_reply(handle=1 version=344) ==== 24+0+0 (unknown 1403447244 0 0) 0x7f8dac05e850 con 0x7f8dc4160f80 2026-02-12T04:05:02.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.667+0000 7f8da37fe640 10 monclient: handle_get_version_reply finishing 1 version 344 2026-02-12T04:05:02.679 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.668+0000 7f8da37fe640 10 client.27641.objecter ms_handle_connect 0x7f8d900a4a70 2026-02-12T04:05:02.680 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.679+0000 7f8da37fe640 1 -- 10.20.193.91:0/3668056274 <== osd.15 v1:10.20.193.154:6809/2343771552 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f8d900c66d0 con 0x7f8d900a4a70 2026-02-12T04:05:02.681 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.679+0000 7f8da37fe640 10 client.27641.objecter ms_dispatch2 0x7f8dc4000b90 command_reply(tid 1: 0 ) 2026-02-12T04:05:02.681 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.679+0000 7f8da37fe640 10 client.27641.objecter _finish_command 1 = system:0 2026-02-12T04:05:02.681 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.679+0000 7f8da37fe640 20 client.27641.objecter put_session s=0x7f8d900a43c0 osd=15 4 2026-02-12T04:05:02.681 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.679+0000 7f8da37fe640 15 client.27641.objecter _session_command_op_remove 15 1 2026-02-12T04:05:02.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.686+0000 7f8dc9696640 10 client.27641.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-12T04:05:02.688 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.686+0000 7f8dc9696640 15 client.27641.objecter _session_command_op_assign -1 2 2026-02-12T04:05:02.689 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.686+0000 7f8dc9696640 20 client.27641.objecter _get_session s=0x7f8d900a43c0 osd=15 3 2026-02-12T04:05:02.689 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.686+0000 7f8dc9696640 20 client.27641.objecter put_session s=0x7f8d900a43c0 osd=15 3 2026-02-12T04:05:02.689 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.686+0000 7f8dc9696640 20 client.27641.objecter _get_session s=0x7f8d900a43c0 osd=15 3 2026-02-12T04:05:02.689 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.686+0000 7f8dc9696640 15 client.27641.objecter _session_command_op_remove -1 2 2026-02-12T04:05:02.689 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.686+0000 7f8dc9696640 20 client.27641.objecter get_session s=0x7f8d900a43c0 osd=15 3 2026-02-12T04:05:02.689 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.686+0000 7f8dc9696640 15 client.27641.objecter _session_command_op_assign 15 2 2026-02-12T04:05:02.689 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.686+0000 7f8dc9696640 20 client.27641.objecter put_session s=0x7f8d900a43c0 osd=15 4 2026-02-12T04:05:02.689 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.686+0000 7f8dc9696640 10 client.27641.objecter _send_command 2 2026-02-12T04:05:02.689 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.686+0000 7f8dc9696640 1 -- 10.20.193.91:0/3668056274 --> v1:10.20.193.154:6809/2343771552 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8dc4157630 con 0x7f8d900a4a70 2026-02-12T04:05:02.696 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.695+0000 7f8da37fe640 1 -- 10.20.193.91:0/3668056274 <== osd.15 v1:10.20.193.154:6809/2343771552 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f8dc4157630 con 0x7f8d900a4a70 2026-02-12T04:05:02.697 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.695+0000 7f8da37fe640 10 client.27641.objecter ms_dispatch2 0x7f8dc4000b90 command_reply(tid 2: 0 ) 2026-02-12T04:05:02.697 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.695+0000 7f8da37fe640 10 client.27641.objecter _finish_command 2 = system:0 2026-02-12T04:05:02.697 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.695+0000 7f8da37fe640 20 client.27641.objecter put_session s=0x7f8d900a43c0 osd=15 4 2026-02-12T04:05:02.697 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.695+0000 7f8da37fe640 15 client.27641.objecter _session_command_op_remove 15 2 2026-02-12T04:05:02.697 INFO:teuthology.orchestra.run.trial091.stdout:{ 2026-02-12T04:05:02.697 INFO:teuthology.orchestra.run.trial091.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-12T04:05:02.698 INFO:teuthology.orchestra.run.trial091.stdout:} 2026-02-12T04:05:02.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.695+0000 7f8dc9696640 10 librados: watch_flush enter 2026-02-12T04:05:02.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.695+0000 7f8dc9696640 10 librados: watch_flush exit 2026-02-12T04:05:02.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.695+0000 7f8dc9696640 10 client.27641.objecter close_session for osd.15 2026-02-12T04:05:02.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.695+0000 7f8dc9696640 1 -- 10.20.193.91:0/3668056274 >> v1:10.20.193.154:6809/2343771552 conn(0x7f8d900a4a70 legacy=0x7f8d900c4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:02.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.695+0000 7f8dc9696640 20 client.27641.objecter put_session s=0x7f8d900a43c0 osd=15 1 2026-02-12T04:05:02.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.695+0000 7f8dc9696640 20 client.27641.objecter shutdown clearing up homeless session... 2026-02-12T04:05:02.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.695+0000 7f8dc9696640 10 client.27641.objecter successfully canceled tick 2026-02-12T04:05:02.699 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.695+0000 7f8dc9696640 1 -- 10.20.193.91:0/3668056274 >> v1:10.20.193.91:6800/2929217192 conn(0x7f8d9007a110 legacy=0x7f8d9009a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:02.700 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.695+0000 7f8dc9696640 10 monclient: shutdown 2026-02-12T04:05:02.700 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.695+0000 7f8dc9696640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:05:02.700 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.695+0000 7f8dc9696640 1 -- 10.20.193.91:0/3668056274 >> v1:10.20.193.111:6789/0 conn(0x7f8dc4160f80 legacy=0x7f8dc415ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:02.700 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.695+0000 7f8dc37fe640 1 -- 10.20.193.91:0/3668056274 reap_dead start 2026-02-12T04:05:02.700 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.695+0000 7f8dc9696640 1 -- 10.20.193.91:0/3668056274 shutdown_connections 2026-02-12T04:05:02.700 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.695+0000 7f8dc9696640 1 -- 10.20.193.91:0/3668056274 >> 10.20.193.91:0/3668056274 conn(0x7f8dc40b6560 msgr2=0x7f8dc41613b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:05:02.700 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.695+0000 7f8dc9696640 1 -- 10.20.193.91:0/3668056274 shutdown_connections 2026-02-12T04:05:02.700 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.695+0000 7f8dc9696640 1 -- 10.20.193.91:0/3668056274 wait complete. 2026-02-12T04:05:02.700 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.695+0000 7f8dc9696640 1 librados: shutdown 2026-02-12T04:05:02.704 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 15 2026-02-12T04:05:02.774 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.772+0000 7ff0ca04d640 10 monclient: get_monmap_and_config 2026-02-12T04:05:02.775 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.772+0000 7ff0ca04d640 10 monclient: build_initial_monmap 2026-02-12T04:05:02.775 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.772+0000 7ff0ca04d640 10 monclient: monmap: 2026-02-12T04:05:02.775 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:05:02.775 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:02.775 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:05:02.773426+0000 2026-02-12T04:05:02.775 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:05:02.773426+0000 2026-02-12T04:05:02.775 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:05:02.775 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:02.775 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:05:02.775 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:05:02.776 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:05:02.776 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:02.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.773+0000 7ff0ca04d640 1 Processor -- start 2026-02-12T04:05:02.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.773+0000 7ff0ca04d640 1 -- start start 2026-02-12T04:05:02.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.773+0000 7ff0ca04d640 10 monclient: init 2026-02-12T04:05:02.777 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.773+0000 7ff0ca04d640 10 monclient: _reopen_session rank -1 2026-02-12T04:05:02.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.773+0000 7ff0ca04d640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T04:05:02.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.773+0000 7ff0ca04d640 10 monclient(hunting): picked mon.noname-c con 0x7ff0c41575d0 addr v1:10.20.193.111:6789/0 2026-02-12T04:05:02.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.773+0000 7ff0ca04d640 10 monclient(hunting): picked mon.noname-b con 0x7ff0c4163310 addr v1:10.20.193.98:6789/0 2026-02-12T04:05:02.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.773+0000 7ff0ca04d640 10 monclient(hunting): picked mon.noname-a con 0x7ff0c40560d0 addr v1:10.20.193.91:6789/0 2026-02-12T04:05:02.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.773+0000 7ff0ca04d640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0c40b20b0 con 0x7ff0c40560d0 2026-02-12T04:05:02.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.773+0000 7ff0ca04d640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0c40b2390 con 0x7ff0c4163310 2026-02-12T04:05:02.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.773+0000 7ff0ca04d640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0c40b2670 con 0x7ff0c41575d0 2026-02-12T04:05:02.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.773+0000 7ff0ca04d640 10 monclient(hunting): _renew_subs 2026-02-12T04:05:02.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.773+0000 7ff0ca04d640 10 monclient(hunting): authenticate will time out at 1505.516918s 2026-02-12T04:05:02.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.774+0000 7ff0c3fff640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7ff0c40560d0 0x7ff0c41c56f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:40060/0 (socket says 10.20.193.91:40060) 2026-02-12T04:05:02.778 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.774+0000 7ff0c3fff640 1 -- 10.20.193.91:0/4164199011 learned_addr learned my addr 10.20.193.91:0/4164199011 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:05:02.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.776+0000 7ff0c27fc640 1 -- 10.20.193.91:0/4164199011 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2767765854 0 0) 0x7ff0c40b20b0 con 0x7ff0c40560d0 2026-02-12T04:05:02.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.776+0000 7ff0c27fc640 10 monclient(hunting): _negotiate 2026-02-12T04:05:02.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.776+0000 7ff0c27fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:02.779 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.776+0000 7ff0c27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:02.780 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.776+0000 7ff0c27fc640 10 monclient(hunting): my global_id is 30807 2026-02-12T04:05:02.780 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.776+0000 7ff0c27fc640 1 -- 10.20.193.91:0/4164199011 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0a8003610 con 0x7ff0c40560d0 2026-02-12T04:05:02.783 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.778+0000 7ff0c27fc640 1 -- 10.20.193.91:0/4164199011 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2281749245 0 0) 0x7ff0a8003610 con 0x7ff0c40560d0 2026-02-12T04:05:02.784 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.778+0000 7ff0c27fc640 1 -- 10.20.193.91:0/4164199011 >> v1:10.20.193.111:6789/0 conn(0x7ff0c41575d0 legacy=0x7ff0c4162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T04:05:02.784 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.778+0000 7ff0c27fc640 1 -- 10.20.193.91:0/4164199011 >> v1:10.20.193.98:6789/0 conn(0x7ff0c4163310 legacy=0x7ff0c40559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T04:05:02.784 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.778+0000 7ff0c27fc640 10 monclient: _finish_hunting 0 2026-02-12T04:05:02.784 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.778+0000 7ff0c27fc640 1 monclient: found mon.noname-a 2026-02-12T04:05:02.784 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.778+0000 7ff0c27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:05:02.784 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.778+0000 7ff0c27fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.91:6789/0 2026-02-12T04:05:02.784 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.778+0000 7ff0c27fc640 1 -- 10.20.193.91:0/4164199011 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0c4162400 con 0x7ff0c40560d0 2026-02-12T04:05:02.784 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.778+0000 7ff0c27fc640 10 monclient: _finish_auth 0 2026-02-12T04:05:02.784 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.778+0000 7ff0c27fc640 10 monclient: _check_auth_tickets 2026-02-12T04:05:02.784 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.778+0000 7ff0c27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:05:02.784 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.778+0000 7ff0c27fc640 1 -- 10.20.193.91:0/4164199011 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7ff0b8003170 con 0x7ff0c40560d0 2026-02-12T04:05:02.785 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.778+0000 7ff0c27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:02.785 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.778+0000 7ff0c27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T04:05:02.785 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.778+0000 7ff0c27fc640 10 monclient: dump: 2026-02-12T04:05:02.785 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:02.785 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:02.785 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.785 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.785 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:02.785 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:02.785 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:02.785 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:02.785 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:02.786 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:02.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.778+0000 7ff0ca04d640 5 monclient: authenticate success, global_id 30807 2026-02-12T04:05:02.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.778+0000 7ff0ca04d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:05:02.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.779+0000 7ff0c27fc640 1 -- 10.20.193.91:0/4164199011 <== mon.0 v1:10.20.193.91:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff0b8003380 con 0x7ff0c40560d0 2026-02-12T04:05:02.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.779+0000 7ff0c27fc640 10 monclient: handle_config config(0 keys) 2026-02-12T04:05:02.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.779+0000 7ff0c27fc640 1 -- 10.20.193.91:0/4164199011 <== mon.0 v1:10.20.193.91:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7ff0b80037c0 con 0x7ff0c40560d0 2026-02-12T04:05:02.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.779+0000 7ff0c27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:02.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.779+0000 7ff0c27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T04:05:02.786 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.779+0000 7ff0c27fc640 10 monclient: dump: 2026-02-12T04:05:02.786 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:02.786 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:02.786 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.787 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.787 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:02.787 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:02.787 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:02.787 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:02.787 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:02.787 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:02.787 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.779+0000 7ff0ca04d640 10 monclient: get_monmap_and_config success 2026-02-12T04:05:02.787 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.779+0000 7ff0ca04d640 4 set_mon_vals no callback set 2026-02-12T04:05:02.787 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.779+0000 7ff0ca04d640 10 monclient: shutdown 2026-02-12T04:05:02.787 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.779+0000 7ff0ca04d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:05:02.787 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.779+0000 7ff0ca04d640 1 -- 10.20.193.91:0/4164199011 >> v1:10.20.193.91:6789/0 conn(0x7ff0c40560d0 legacy=0x7ff0c41c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:02.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.779+0000 7ff0ca04d640 1 -- 10.20.193.91:0/4164199011 shutdown_connections 2026-02-12T04:05:02.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.779+0000 7ff0ca04d640 1 -- 10.20.193.91:0/4164199011 >> 10.20.193.91:0/4164199011 conn(0x7ff0c40b6560 msgr2=0x7ff0c40b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:05:02.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.779+0000 7ff0ca04d640 1 -- 10.20.193.91:0/4164199011 shutdown_connections 2026-02-12T04:05:02.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.779+0000 7ff0ca04d640 1 -- 10.20.193.91:0/4164199011 wait complete. 2026-02-12T04:05:02.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.779+0000 7ff0ca04d640 10 monclient: build_initial_monmap 2026-02-12T04:05:02.788 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.779+0000 7ff0ca04d640 10 monclient: monmap: 2026-02-12T04:05:02.788 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:05:02.788 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:05:02.788 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:05:02.788 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:05:02.788 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:05:02.788 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:05:02.789 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:05:02.789 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:05:02.789 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:05:02.789 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:02.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.780+0000 7ff0ca04d640 1 librados: starting msgr at 2026-02-12T04:05:02.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.780+0000 7ff0ca04d640 1 librados: starting objecter 2026-02-12T04:05:02.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.780+0000 7ff0ca04d640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:05:02.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.780+0000 7ff0ca04d640 1 Processor -- start 2026-02-12T04:05:02.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.780+0000 7ff0ca04d640 1 -- start start 2026-02-12T04:05:02.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.780+0000 7ff0ca04d640 1 librados: setting wanted keys 2026-02-12T04:05:02.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.780+0000 7ff0ca04d640 1 librados: calling monclient init 2026-02-12T04:05:02.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.780+0000 7ff0ca04d640 10 monclient: init 2026-02-12T04:05:02.789 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.780+0000 7ff0ca04d640 10 monclient: _reopen_session rank -1 2026-02-12T04:05:02.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.780+0000 7ff0ca04d640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T04:05:02.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.780+0000 7ff0ca04d640 10 monclient(hunting): picked mon.noname-a con 0x7ff0c40560d0 addr v1:10.20.193.91:6789/0 2026-02-12T04:05:02.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.780+0000 7ff0ca04d640 10 monclient(hunting): picked mon.noname-b con 0x7ff0c41575d0 addr v1:10.20.193.98:6789/0 2026-02-12T04:05:02.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.780+0000 7ff0ca04d640 10 monclient(hunting): picked mon.noname-c con 0x7ff0c4163310 addr v1:10.20.193.111:6789/0 2026-02-12T04:05:02.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.780+0000 7ff0ca04d640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0c405d520 con 0x7ff0c40560d0 2026-02-12T04:05:02.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.780+0000 7ff0ca04d640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0c41fc160 con 0x7ff0c41575d0 2026-02-12T04:05:02.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.780+0000 7ff0ca04d640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0c41fc440 con 0x7ff0c4163310 2026-02-12T04:05:02.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.780+0000 7ff0ca04d640 10 monclient(hunting): _renew_subs 2026-02-12T04:05:02.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.780+0000 7ff0ca04d640 10 monclient(hunting): authenticate will time out at 1505.523575s 2026-02-12T04:05:02.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.780+0000 7ff0c37fe640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7ff0c40560d0 0x7ff0c4151e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:40068/0 (socket says 10.20.193.91:40068) 2026-02-12T04:05:02.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.780+0000 7ff0c37fe640 1 -- 10.20.193.91:0/3278467851 learned_addr learned my addr 10.20.193.91:0/3278467851 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:05:02.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.780+0000 7ff09ffff640 10 client.?.objecter ms_handle_connect 0x7ff0c40560d0 2026-02-12T04:05:02.790 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.780+0000 7ff09ffff640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:02.791 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.781+0000 7ff09ffff640 1 -- 10.20.193.91:0/3278467851 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3939604868 0 0) 0x7ff0c405d520 con 0x7ff0c40560d0 2026-02-12T04:05:02.791 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.781+0000 7ff09ffff640 10 monclient(hunting): _negotiate 2026-02-12T04:05:02.791 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.781+0000 7ff09ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:02.791 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.781+0000 7ff09ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:02.791 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.781+0000 7ff09ffff640 10 monclient(hunting): my global_id is 30810 2026-02-12T04:05:02.791 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.781+0000 7ff09ffff640 1 -- 10.20.193.91:0/3278467851 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff094003610 con 0x7ff0c40560d0 2026-02-12T04:05:02.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.784+0000 7ff09ffff640 1 -- 10.20.193.91:0/3278467851 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2342830283 0 0) 0x7ff094003610 con 0x7ff0c40560d0 2026-02-12T04:05:02.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.784+0000 7ff09ffff640 1 -- 10.20.193.91:0/3278467851 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff0c405d520 con 0x7ff0c40560d0 2026-02-12T04:05:02.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.784+0000 7ff09ffff640 1 -- 10.20.193.91:0/3278467851 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7ff0b0002fd0 con 0x7ff0c40560d0 2026-02-12T04:05:02.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.784+0000 7ff09ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:02.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.784+0000 7ff09ffff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T04:05:02.793 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.784+0000 7ff09ffff640 10 monclient(hunting): dump: 2026-02-12T04:05:02.794 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:02.794 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:02.794 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.794 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.794 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:02.794 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:02.794 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:02.794 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:02.794 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:02.794 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:02.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.784+0000 7ff09ffff640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:05:02.794 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.785+0000 7ff09ffff640 1 -- 10.20.193.91:0/3278467851 <== mon.0 v1:10.20.193.91:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2359205415 0 0) 0x7ff0c405d520 con 0x7ff0c40560d0 2026-02-12T04:05:02.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.785+0000 7ff09ffff640 1 -- 10.20.193.91:0/3278467851 >> v1:10.20.193.111:6789/0 conn(0x7ff0c4163310 legacy=0x7ff0c4155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:02.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.785+0000 7ff09ffff640 1 -- 10.20.193.91:0/3278467851 >> v1:10.20.193.98:6789/0 conn(0x7ff0c41575d0 legacy=0x7ff0c41fcf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:02.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.785+0000 7ff09ffff640 10 monclient: _finish_hunting 0 2026-02-12T04:05:02.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.785+0000 7ff09ffff640 1 monclient: found mon.a 2026-02-12T04:05:02.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.785+0000 7ff09ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:05:02.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.785+0000 7ff09ffff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:05:02.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.785+0000 7ff09ffff640 1 -- 10.20.193.91:0/3278467851 --> v1:10.20.193.91:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0c41fc720 con 0x7ff0c40560d0 2026-02-12T04:05:02.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.785+0000 7ff09ffff640 10 monclient: _finish_auth 0 2026-02-12T04:05:02.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.785+0000 7ff09ffff640 10 monclient: _check_auth_tickets 2026-02-12T04:05:02.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.785+0000 7ff09ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:05:02.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.785+0000 7ff0ca04d640 5 monclient: authenticate success, global_id 30810 2026-02-12T04:05:02.795 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.785+0000 7ff0ca04d640 10 monclient: _renew_subs 2026-02-12T04:05:02.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.785+0000 7ff0ca04d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:05:02.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.785+0000 7ff0ca04d640 1 -- 10.20.193.91:0/3278467851 --> v1:10.20.193.91:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff0c405d0b0 con 0x7ff0c40560d0 2026-02-12T04:05:02.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.785+0000 7ff0ca04d640 10 client.30810.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:05:02.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.785+0000 7ff0ca04d640 10 monclient: _renew_subs 2026-02-12T04:05:02.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.785+0000 7ff0ca04d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:05:02.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.785+0000 7ff0ca04d640 1 -- 10.20.193.91:0/3278467851 --> v1:10.20.193.91:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff0c41fd810 con 0x7ff0c40560d0 2026-02-12T04:05:02.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.785+0000 7ff0ca04d640 1 librados: init done 2026-02-12T04:05:02.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.786+0000 7ff0ca04d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T04:05:02.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.786+0000 7ff0ca04d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:05:02.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.786+0000 7ff0ca04d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.91:6789/0 2026-02-12T04:05:02.796 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.786+0000 7ff0ca04d640 1 -- 10.20.193.91:0/3278467851 --> v1:10.20.193.91:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0c4152cd0 con 0x7ff0c40560d0 2026-02-12T04:05:02.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.879+0000 7ff09ffff640 1 -- 10.20.193.91:0/3278467851 <== mon.0 v1:10.20.193.91:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff0b00049f0 con 0x7ff0c40560d0 2026-02-12T04:05:02.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.879+0000 7ff09ffff640 10 monclient: handle_config config(0 keys) 2026-02-12T04:05:02.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.879+0000 7ff09ffff640 1 -- 10.20.193.91:0/3278467851 <== mon.0 v1:10.20.193.91:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7ff0b0004ba0 con 0x7ff0c40560d0 2026-02-12T04:05:02.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.879+0000 7ff09ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:02.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.879+0000 7ff09ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T04:05:02.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.879+0000 7ff0c1ffb640 4 set_mon_vals no callback set 2026-02-12T04:05:02.881 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.879+0000 7ff09ffff640 10 monclient: dump: 2026-02-12T04:05:02.881 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:02.882 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:02.882 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.882 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:02.882 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:02.882 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:02.882 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:02.882 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:02.882 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:02.882 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:02.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.879+0000 7ff09ffff640 1 -- 10.20.193.91:0/3278467851 <== mon.0 v1:10.20.193.91:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7ff0b001e080 con 0x7ff0c40560d0 2026-02-12T04:05:02.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.880+0000 7ff0c2ffd640 10 monclient: get_auth_request con 0x7ff094079ea0 auth_method 0 2026-02-12T04:05:02.883 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.880+0000 7ff09ffff640 10 client.30810.objecter ms_handle_connect 0x7ff094079ea0 2026-02-12T04:05:02.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.882+0000 7ff09ffff640 1 -- 10.20.193.91:0/3278467851 <== mon.0 v1:10.20.193.91:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7ff0b0095c50 con 0x7ff0c40560d0 2026-02-12T04:05:02.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.882+0000 7ff09ffff640 10 client.30810.objecter ms_dispatch2 0x7ff0c4000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:05:02.884 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.882+0000 7ff09ffff640 3 client.30810.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:05:02.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.882+0000 7ff09ffff640 3 client.30810.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:05:02.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.882+0000 7ff09ffff640 20 client.30810.objecter dump_active .. 0 homeless 2026-02-12T04:05:02.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.882+0000 7ff09ffff640 1 -- 10.20.193.91:0/3278467851 <== mon.0 v1:10.20.193.91:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7ff0b005f5b0 con 0x7ff0c40560d0 2026-02-12T04:05:02.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.882+0000 7ff09ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:05:02.885 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.882+0000 7ff09ffff640 10 monclient: _finish_command 1 = system:0 2026-02-12T04:05:02.994 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.992+0000 7ff0ca04d640 1 -- 10.20.193.91:0/3278467851 --> v1:10.20.193.91:6800/2929217192 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "15", "target": ["mon-mgr", ""]}) -- 0x7ff0c4152520 con 0x7ff094079ea0 2026-02-12T04:05:02.994 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.992+0000 7ff09ffff640 1 -- 10.20.193.91:0/3278467851 <== mgr.4113 v1:10.20.193.91:6800/2929217192 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 15 to deep-scrub) ==== 42+0+0 (unknown 337234985 0 0) 0x7ff0c4152520 con 0x7ff094079ea0 2026-02-12T04:05:02.994 INFO:teuthology.orchestra.run.trial091.stderr:instructed osd(s) 15 to deep-scrub 2026-02-12T04:05:02.995 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.993+0000 7ff0ca04d640 10 librados: watch_flush enter 2026-02-12T04:05:02.996 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.993+0000 7ff0ca04d640 10 librados: watch_flush exit 2026-02-12T04:05:02.996 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.993+0000 7ff0ca04d640 20 client.30810.objecter shutdown clearing up homeless session... 2026-02-12T04:05:02.996 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.993+0000 7ff0ca04d640 10 client.30810.objecter successfully canceled tick 2026-02-12T04:05:02.996 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.993+0000 7ff0ca04d640 1 -- 10.20.193.91:0/3278467851 >> v1:10.20.193.91:6800/2929217192 conn(0x7ff094079ea0 legacy=0x7ff09409a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:02.996 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.993+0000 7ff0ca04d640 10 monclient: shutdown 2026-02-12T04:05:02.996 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.993+0000 7ff0ca04d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:05:02.996 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.993+0000 7ff0ca04d640 1 -- 10.20.193.91:0/3278467851 >> v1:10.20.193.91:6789/0 conn(0x7ff0c40560d0 legacy=0x7ff0c4151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:02.996 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.993+0000 7ff0ca04d640 1 -- 10.20.193.91:0/3278467851 shutdown_connections 2026-02-12T04:05:02.996 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.993+0000 7ff0ca04d640 1 -- 10.20.193.91:0/3278467851 >> 10.20.193.91:0/3278467851 conn(0x7ff0c40b6560 msgr2=0x7ff0c41600e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:05:02.996 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.993+0000 7ff0ca04d640 1 -- 10.20.193.91:0/3278467851 shutdown_connections 2026-02-12T04:05:02.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.993+0000 7ff0ca04d640 1 -- 10.20.193.91:0/3278467851 wait complete. 2026-02-12T04:05:02.997 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:02.993+0000 7ff0ca04d640 1 librados: shutdown 2026-02-12T04:05:03.005 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T04:05:03.074 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.072+0000 7f5a0c608640 10 monclient: get_monmap_and_config 2026-02-12T04:05:03.074 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.072+0000 7f5a0c608640 10 monclient: build_initial_monmap 2026-02-12T04:05:03.074 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.072+0000 7f5a0c608640 10 monclient: monmap: 2026-02-12T04:05:03.074 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:05:03.074 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:03.074 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:05:03.072788+0000 2026-02-12T04:05:03.074 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:05:03.072788+0000 2026-02-12T04:05:03.074 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:05:03.075 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:03.075 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:05:03.075 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:05:03.075 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:05:03.075 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:03.077 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.072+0000 7f5a0c608640 1 Processor -- start 2026-02-12T04:05:03.077 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.072+0000 7f5a0c608640 1 -- start start 2026-02-12T04:05:03.077 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.072+0000 7f5a0c608640 10 monclient: init 2026-02-12T04:05:03.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.073+0000 7f5a0c608640 10 monclient: _reopen_session rank -1 2026-02-12T04:05:03.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.073+0000 7f5a0c608640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T04:05:03.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.073+0000 7f5a0c608640 10 monclient(hunting): picked mon.noname-a con 0x7f5a040afe70 addr v1:10.20.193.91:6789/0 2026-02-12T04:05:03.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.073+0000 7f5a0c608640 10 monclient(hunting): picked mon.noname-b con 0x7f5a0415f310 addr v1:10.20.193.98:6789/0 2026-02-12T04:05:03.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.073+0000 7f5a0c608640 10 monclient(hunting): picked mon.noname-c con 0x7f5a041639c0 addr v1:10.20.193.111:6789/0 2026-02-12T04:05:03.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.073+0000 7f5a0c608640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a04162bb0 con 0x7f5a040afe70 2026-02-12T04:05:03.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.073+0000 7f5a0c608640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a04162e90 con 0x7f5a0415f310 2026-02-12T04:05:03.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.073+0000 7f5a0c608640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a0415de40 con 0x7f5a041639c0 2026-02-12T04:05:03.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.073+0000 7f5a0c608640 10 monclient(hunting): _renew_subs 2026-02-12T04:05:03.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.073+0000 7f5a0c608640 10 monclient(hunting): authenticate will time out at 1505.816298s 2026-02-12T04:05:03.078 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.073+0000 7f5a0a37d640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f5a040afe70 0x7f5a0415ec00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:40072/0 (socket says 10.20.193.91:40072) 2026-02-12T04:05:03.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.073+0000 7f5a0a37d640 1 -- 10.20.193.91:0/798926532 learned_addr learned my addr 10.20.193.91:0/798926532 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:05:03.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.075+0000 7f5a0937b640 1 -- 10.20.193.91:0/798926532 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2680435611 0 0) 0x7f5a04162e90 con 0x7f5a0415f310 2026-02-12T04:05:03.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.075+0000 7f5a0937b640 10 monclient(hunting): _negotiate 2026-02-12T04:05:03.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.075+0000 7f5a0937b640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:03.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.075+0000 7f5a0937b640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:03.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.075+0000 7f5a0937b640 10 monclient(hunting): my global_id is 27946 2026-02-12T04:05:03.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.075+0000 7f5a0937b640 1 -- 10.20.193.91:0/798926532 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59ec003610 con 0x7f5a0415f310 2026-02-12T04:05:03.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.075+0000 7f5a0937b640 1 -- 10.20.193.91:0/798926532 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3179133281 0 0) 0x7f5a04162bb0 con 0x7f5a040afe70 2026-02-12T04:05:03.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.075+0000 7f5a0937b640 10 monclient(hunting): _negotiate 2026-02-12T04:05:03.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.075+0000 7f5a0937b640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:03.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.075+0000 7f5a0937b640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:03.079 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.075+0000 7f5a0937b640 10 monclient(hunting): my global_id is 30813 2026-02-12T04:05:03.080 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.075+0000 7f5a0937b640 1 -- 10.20.193.91:0/798926532 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a04162e90 con 0x7f5a040afe70 2026-02-12T04:05:03.080 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.075+0000 7f5a0937b640 1 -- 10.20.193.91:0/798926532 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1036327242 0 0) 0x7f5a0415de40 con 0x7f5a041639c0 2026-02-12T04:05:03.080 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.075+0000 7f5a0937b640 10 monclient(hunting): _negotiate 2026-02-12T04:05:03.080 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.075+0000 7f5a0937b640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:03.080 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.075+0000 7f5a0937b640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:03.080 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.075+0000 7f5a0937b640 10 monclient(hunting): my global_id is 27644 2026-02-12T04:05:03.080 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.075+0000 7f5a0937b640 1 -- 10.20.193.91:0/798926532 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a04162bb0 con 0x7f5a041639c0 2026-02-12T04:05:03.085 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.077+0000 7f5a0937b640 1 -- 10.20.193.91:0/798926532 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2266770386 0 0) 0x7f59ec003610 con 0x7f5a0415f310 2026-02-12T04:05:03.085 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.077+0000 7f5a0937b640 1 -- 10.20.193.91:0/798926532 >> v1:10.20.193.111:6789/0 conn(0x7f5a041639c0 legacy=0x7f5a04161b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:03.085 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.077+0000 7f5a0937b640 1 -- 10.20.193.91:0/798926532 >> v1:10.20.193.91:6789/0 conn(0x7f5a040afe70 legacy=0x7f5a0415ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:03.085 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.077+0000 7f5a0937b640 10 monclient: _finish_hunting 0 2026-02-12T04:05:03.085 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.077+0000 7f5a0937b640 1 monclient: found mon.noname-b 2026-02-12T04:05:03.085 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.077+0000 7f5a0937b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:05:03.085 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.077+0000 7f5a0937b640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T04:05:03.085 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.077+0000 7f5a0937b640 1 -- 10.20.193.91:0/798926532 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a0415e120 con 0x7f5a0415f310 2026-02-12T04:05:03.085 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.077+0000 7f5a0937b640 10 monclient: _finish_auth 0 2026-02-12T04:05:03.085 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.077+0000 7f5a0937b640 10 monclient: _check_auth_tickets 2026-02-12T04:05:03.086 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.077+0000 7f5a0937b640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:05:03.086 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.077+0000 7f5a0937b640 1 -- 10.20.193.91:0/798926532 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f59f8002df0 con 0x7f5a0415f310 2026-02-12T04:05:03.086 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.077+0000 7f5a0937b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:03.086 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.077+0000 7f5a0937b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T04:05:03.086 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.077+0000 7f5a0937b640 10 monclient: dump: 2026-02-12T04:05:03.086 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:03.086 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:03.086 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:03.086 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:03.086 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:03.086 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:03.086 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:03.087 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:03.087 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:03.087 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:03.087 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.077+0000 7f5a0c608640 5 monclient: authenticate success, global_id 27946 2026-02-12T04:05:03.087 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.077+0000 7f5a0c608640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:05:03.087 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.078+0000 7f5a0937b640 1 -- 10.20.193.91:0/798926532 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f59f8002f90 con 0x7f5a0415f310 2026-02-12T04:05:03.087 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.078+0000 7f5a0937b640 10 monclient: handle_config config(0 keys) 2026-02-12T04:05:03.087 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.078+0000 7f5a0937b640 1 -- 10.20.193.91:0/798926532 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f59f8003390 con 0x7f5a0415f310 2026-02-12T04:05:03.087 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.078+0000 7f5a0c608640 10 monclient: get_monmap_and_config success 2026-02-12T04:05:03.087 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.078+0000 7f5a0c608640 4 set_mon_vals no callback set 2026-02-12T04:05:03.087 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.078+0000 7f5a0937b640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:03.088 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.078+0000 7f5a0937b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T04:05:03.088 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.078+0000 7f5a0937b640 10 monclient: dump: 2026-02-12T04:05:03.088 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:03.088 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:03.088 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:03.088 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:03.088 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:03.088 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:03.088 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:03.088 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:03.088 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:03.088 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:03.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.078+0000 7f5a0c608640 10 monclient: shutdown 2026-02-12T04:05:03.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.078+0000 7f5a0c608640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:05:03.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.078+0000 7f5a0c608640 1 -- 10.20.193.91:0/798926532 >> v1:10.20.193.98:6789/0 conn(0x7f5a0415f310 legacy=0x7f5a041632b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:03.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.078+0000 7f5a0c608640 1 -- 10.20.193.91:0/798926532 shutdown_connections 2026-02-12T04:05:03.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.078+0000 7f5a0c608640 1 -- 10.20.193.91:0/798926532 >> 10.20.193.91:0/798926532 conn(0x7f5a040b6560 msgr2=0x7f5a040b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:05:03.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.078+0000 7f5a0c608640 1 -- 10.20.193.91:0/798926532 shutdown_connections 2026-02-12T04:05:03.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.078+0000 7f5a0c608640 1 -- 10.20.193.91:0/798926532 wait complete. 2026-02-12T04:05:03.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.078+0000 7f5a0c608640 10 monclient: build_initial_monmap 2026-02-12T04:05:03.089 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.078+0000 7f5a0c608640 10 monclient: monmap: 2026-02-12T04:05:03.089 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:05:03.089 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:05:03.089 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:05:03.089 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:05:03.090 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:05:03.090 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:05:03.090 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:05:03.090 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:05:03.090 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:05:03.090 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:03.090 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.079+0000 7f5a0c608640 1 librados: starting msgr at 2026-02-12T04:05:03.090 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.079+0000 7f5a0c608640 1 librados: starting objecter 2026-02-12T04:05:03.090 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.079+0000 7f5a0c608640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:05:03.090 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.079+0000 7f5a0c608640 1 Processor -- start 2026-02-12T04:05:03.090 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.079+0000 7f5a0c608640 1 -- start start 2026-02-12T04:05:03.090 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.079+0000 7f5a0c608640 1 librados: setting wanted keys 2026-02-12T04:05:03.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.079+0000 7f5a0c608640 1 librados: calling monclient init 2026-02-12T04:05:03.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.079+0000 7f5a0c608640 10 monclient: init 2026-02-12T04:05:03.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.079+0000 7f5a0c608640 10 monclient: _reopen_session rank -1 2026-02-12T04:05:03.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.079+0000 7f5a0c608640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-12T04:05:03.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.079+0000 7f5a0c608640 10 monclient(hunting): picked mon.noname-b con 0x7f5a040afe70 addr v1:10.20.193.98:6789/0 2026-02-12T04:05:03.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.079+0000 7f5a0c608640 10 monclient(hunting): picked mon.noname-a con 0x7f5a0415f310 addr v1:10.20.193.91:6789/0 2026-02-12T04:05:03.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.079+0000 7f5a0c608640 10 monclient(hunting): picked mon.noname-c con 0x7f5a041639c0 addr v1:10.20.193.111:6789/0 2026-02-12T04:05:03.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.079+0000 7f5a0c608640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a04147580 con 0x7f5a0415f310 2026-02-12T04:05:03.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.079+0000 7f5a0c608640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a04147860 con 0x7f5a040afe70 2026-02-12T04:05:03.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.079+0000 7f5a0c608640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a0413cc80 con 0x7f5a041639c0 2026-02-12T04:05:03.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.079+0000 7f5a0c608640 10 monclient(hunting): _renew_subs 2026-02-12T04:05:03.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.079+0000 7f5a0c608640 10 monclient(hunting): authenticate will time out at 1505.822500s 2026-02-12T04:05:03.091 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.079+0000 7f5a09b7c640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f5a0415f310 0x7f5a04120910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:40074/0 (socket says 10.20.193.91:40074) 2026-02-12T04:05:03.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.079+0000 7f5a09b7c640 1 -- 10.20.193.91:0/666497281 learned_addr learned my addr 10.20.193.91:0/666497281 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:05:03.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.080+0000 7f59eaffd640 10 client.?.objecter ms_handle_connect 0x7f5a041639c0 2026-02-12T04:05:03.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.080+0000 7f59eaffd640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:03.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.080+0000 7f59eaffd640 10 client.?.objecter ms_handle_connect 0x7f5a0415f310 2026-02-12T04:05:03.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.080+0000 7f59eaffd640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:03.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.080+0000 7f59eaffd640 10 client.?.objecter ms_handle_connect 0x7f5a040afe70 2026-02-12T04:05:03.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.080+0000 7f59eaffd640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:03.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.080+0000 7f59eaffd640 1 -- 10.20.193.91:0/666497281 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 592058926 0 0) 0x7f5a04147580 con 0x7f5a0415f310 2026-02-12T04:05:03.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.080+0000 7f59eaffd640 10 monclient(hunting): _negotiate 2026-02-12T04:05:03.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.080+0000 7f59eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:03.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.080+0000 7f59eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:03.092 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.080+0000 7f59eaffd640 10 monclient(hunting): my global_id is 30816 2026-02-12T04:05:03.093 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.080+0000 7f59eaffd640 1 -- 10.20.193.91:0/666497281 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59d4003610 con 0x7f5a0415f310 2026-02-12T04:05:03.093 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.081+0000 7f59eaffd640 1 -- 10.20.193.91:0/666497281 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 459173977 0 0) 0x7f5a0413cc80 con 0x7f5a041639c0 2026-02-12T04:05:03.093 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.081+0000 7f59eaffd640 10 monclient(hunting): _negotiate 2026-02-12T04:05:03.093 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.081+0000 7f59eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:03.093 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.081+0000 7f59eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:03.093 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.081+0000 7f59eaffd640 10 monclient(hunting): my global_id is 27647 2026-02-12T04:05:03.093 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.081+0000 7f59eaffd640 1 -- 10.20.193.91:0/666497281 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a04147580 con 0x7f5a041639c0 2026-02-12T04:05:03.093 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.081+0000 7f59eaffd640 1 -- 10.20.193.91:0/666497281 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 116925123 0 0) 0x7f5a04147860 con 0x7f5a040afe70 2026-02-12T04:05:03.093 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.081+0000 7f59eaffd640 10 monclient(hunting): _negotiate 2026-02-12T04:05:03.093 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.081+0000 7f59eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:03.093 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.081+0000 7f59eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:03.093 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.081+0000 7f59eaffd640 10 monclient(hunting): my global_id is 27949 2026-02-12T04:05:03.094 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.081+0000 7f59eaffd640 1 -- 10.20.193.91:0/666497281 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a0413cc80 con 0x7f5a040afe70 2026-02-12T04:05:03.097 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.083+0000 7f59eaffd640 1 -- 10.20.193.91:0/666497281 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2317476381 0 0) 0x7f59d4003610 con 0x7f5a0415f310 2026-02-12T04:05:03.098 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.083+0000 7f59eaffd640 1 -- 10.20.193.91:0/666497281 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5a04147860 con 0x7f5a0415f310 2026-02-12T04:05:03.098 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.083+0000 7f59eaffd640 1 -- 10.20.193.91:0/666497281 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f59f8003360 con 0x7f5a0415f310 2026-02-12T04:05:03.098 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.083+0000 7f59eaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:03.098 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.083+0000 7f59eaffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T04:05:03.098 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.083+0000 7f59eaffd640 10 monclient(hunting): dump: 2026-02-12T04:05:03.098 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:03.098 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:03.098 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:03.098 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:03.098 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:03.098 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:03.099 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:03.099 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:03.099 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:03.099 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:03.099 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.083+0000 7f59eaffd640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:05:03.099 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.083+0000 7f59eaffd640 1 -- 10.20.193.91:0/666497281 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2544208989 0 0) 0x7f5a04147580 con 0x7f5a041639c0 2026-02-12T04:05:03.099 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.084+0000 7f59eaffd640 1 -- 10.20.193.91:0/666497281 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f59d4003610 con 0x7f5a041639c0 2026-02-12T04:05:03.099 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.084+0000 7f59eaffd640 1 -- 10.20.193.91:0/666497281 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f5a00003410 con 0x7f5a041639c0 2026-02-12T04:05:03.099 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.084+0000 7f59eaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:03.099 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.084+0000 7f59eaffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T04:05:03.099 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.084+0000 7f59eaffd640 10 monclient(hunting): dump: 2026-02-12T04:05:03.099 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:03.100 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:03.100 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:03.100 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:03.100 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:03.100 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:03.100 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:03.100 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:03.100 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:03.100 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:03.100 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.084+0000 7f59eaffd640 1 -- 10.20.193.91:0/666497281 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 172476966 0 0) 0x7f5a0413cc80 con 0x7f5a040afe70 2026-02-12T04:05:03.100 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.084+0000 7f59eaffd640 1 -- 10.20.193.91:0/666497281 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5a04147580 con 0x7f5a040afe70 2026-02-12T04:05:03.100 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.084+0000 7f59eaffd640 1 -- 10.20.193.91:0/666497281 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f59f4002f50 con 0x7f5a040afe70 2026-02-12T04:05:03.101 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.084+0000 7f59eaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:03.101 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.084+0000 7f59eaffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T04:05:03.101 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.084+0000 7f59eaffd640 10 monclient(hunting): dump: 2026-02-12T04:05:03.101 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:03.101 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:03.101 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:03.101 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:03.101 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:03.101 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:03.101 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:03.101 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:03.101 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:03.101 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:03.102 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.085+0000 7f59eaffd640 1 -- 10.20.193.91:0/666497281 <== mon.2 v1:10.20.193.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 776319864 0 0) 0x7f59d4003610 con 0x7f5a041639c0 2026-02-12T04:05:03.102 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.085+0000 7f59eaffd640 1 -- 10.20.193.91:0/666497281 >> v1:10.20.193.98:6789/0 conn(0x7f5a040afe70 legacy=0x7f5a0405ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:03.102 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.085+0000 7f59eaffd640 1 -- 10.20.193.91:0/666497281 >> v1:10.20.193.91:6789/0 conn(0x7f5a0415f310 legacy=0x7f5a04120910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:03.102 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.085+0000 7f59eaffd640 10 monclient: _finish_hunting 0 2026-02-12T04:05:03.102 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.085+0000 7f59eaffd640 1 monclient: found mon.c 2026-02-12T04:05:03.102 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.085+0000 7f59eaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:05:03.102 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.085+0000 7f59eaffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:05:03.102 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.085+0000 7f59eaffd640 1 -- 10.20.193.91:0/666497281 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a0413cf60 con 0x7f5a041639c0 2026-02-12T04:05:03.102 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.085+0000 7f59eaffd640 10 monclient: _finish_auth 0 2026-02-12T04:05:03.102 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.085+0000 7f59eaffd640 10 monclient: _check_auth_tickets 2026-02-12T04:05:03.102 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.085+0000 7f59eaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:05:03.102 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.085+0000 7f5a0c608640 5 monclient: authenticate success, global_id 27647 2026-02-12T04:05:03.103 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.085+0000 7f5a0c608640 10 monclient: _renew_subs 2026-02-12T04:05:03.103 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.085+0000 7f5a0c608640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:05:03.103 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.085+0000 7f5a0c608640 1 -- 10.20.193.91:0/666497281 --> v1:10.20.193.111:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5a0413d240 con 0x7f5a041639c0 2026-02-12T04:05:03.103 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.085+0000 7f5a0c608640 10 client.27647.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:05:03.103 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.085+0000 7f5a0c608640 10 monclient: _renew_subs 2026-02-12T04:05:03.103 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.085+0000 7f5a0c608640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:05:03.103 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.085+0000 7f5a0c608640 1 -- 10.20.193.91:0/666497281 --> v1:10.20.193.111:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5a04121020 con 0x7f5a041639c0 2026-02-12T04:05:03.103 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.085+0000 7f5a0c608640 1 librados: init done 2026-02-12T04:05:03.103 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.086+0000 7f5a0c608640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T04:05:03.103 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.086+0000 7f5a0c608640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:05:03.103 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.086+0000 7f5a0c608640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:05:03.103 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.086+0000 7f5a0c608640 1 -- 10.20.193.91:0/666497281 --> v1:10.20.193.111:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a040528d0 con 0x7f5a041639c0 2026-02-12T04:05:03.103 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.092+0000 7f59eaffd640 1 -- 10.20.193.91:0/666497281 <== mon.2 v1:10.20.193.111:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5a00003a80 con 0x7f5a041639c0 2026-02-12T04:05:03.103 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.092+0000 7f59eaffd640 10 monclient: handle_config config(0 keys) 2026-02-12T04:05:03.104 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.092+0000 7f59eaffd640 1 -- 10.20.193.91:0/666497281 <== mon.2 v1:10.20.193.111:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f5a00003dd0 con 0x7f5a041639c0 2026-02-12T04:05:03.104 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.092+0000 7f59eaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:03.104 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.092+0000 7f59eaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T04:05:03.104 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.092+0000 7f59eaffd640 10 monclient: dump: 2026-02-12T04:05:03.104 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:03.104 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:03.104 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:03.104 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:03.104 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:03.104 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:03.104 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:03.104 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:03.104 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:03.105 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:03.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.092+0000 7f5a08b7a640 4 set_mon_vals no callback set 2026-02-12T04:05:03.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.094+0000 7f59eaffd640 1 -- 10.20.193.91:0/666497281 <== mon.2 v1:10.20.193.111:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f5a0001d110 con 0x7f5a041639c0 2026-02-12T04:05:03.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.095+0000 7f5a0a37d640 10 monclient: get_auth_request con 0x7f59d407a0e0 auth_method 0 2026-02-12T04:05:03.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.095+0000 7f59eaffd640 10 client.27647.objecter ms_handle_connect 0x7f59d407a0e0 2026-02-12T04:05:03.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.095+0000 7f59eaffd640 1 -- 10.20.193.91:0/666497281 <== mon.2 v1:10.20.193.111:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7f5a00094a90 con 0x7f5a041639c0 2026-02-12T04:05:03.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.095+0000 7f59eaffd640 10 client.27647.objecter ms_dispatch2 0x7f5a04000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:05:03.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.095+0000 7f59eaffd640 3 client.27647.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:05:03.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.095+0000 7f59eaffd640 3 client.27647.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:05:03.105 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.095+0000 7f59eaffd640 20 client.27647.objecter dump_active .. 0 homeless 2026-02-12T04:05:03.191 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.189+0000 7f59eaffd640 1 -- 10.20.193.91:0/666497281 <== mon.2 v1:10.20.193.111:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f5a0005e3f0 con 0x7f5a041639c0 2026-02-12T04:05:03.191 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.189+0000 7f59eaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:05:03.191 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.189+0000 7f59eaffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T04:05:03.304 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.303+0000 7f5a0c608640 1 -- 10.20.193.91:0/666497281 --> v1:10.20.193.91:6800/2929217192 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5a040b1140 con 0x7f59d407a0e0 2026-02-12T04:05:03.305 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.304+0000 7f59eaffd640 1 -- 10.20.193.91:0/666497281 <== mgr.4113 v1:10.20.193.91:6800/2929217192 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+125659 (unknown 2965378022 0 1604001374) 0x7f5a040b1140 con 0x7f59d407a0e0 2026-02-12T04:05:03.307 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T04:05:03.308 INFO:teuthology.orchestra.run.trial091.stderr:dumped all 2026-02-12T04:05:03.309 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.306+0000 7f5a0c608640 10 librados: watch_flush enter 2026-02-12T04:05:03.309 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.306+0000 7f5a0c608640 10 librados: watch_flush exit 2026-02-12T04:05:03.309 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.306+0000 7f5a0c608640 20 client.27647.objecter shutdown clearing up homeless session... 2026-02-12T04:05:03.309 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.306+0000 7f5a0c608640 10 client.27647.objecter successfully canceled tick 2026-02-12T04:05:03.310 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.306+0000 7f5a0c608640 1 -- 10.20.193.91:0/666497281 >> v1:10.20.193.91:6800/2929217192 conn(0x7f59d407a0e0 legacy=0x7f59d409a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:03.310 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.306+0000 7f5a0c608640 10 monclient: shutdown 2026-02-12T04:05:03.310 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.306+0000 7f5a0c608640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:05:03.310 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.306+0000 7f5a0c608640 1 -- 10.20.193.91:0/666497281 >> v1:10.20.193.111:6789/0 conn(0x7f5a041639c0 legacy=0x7f5a041469e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:03.310 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.306+0000 7f5a0c608640 1 -- 10.20.193.91:0/666497281 shutdown_connections 2026-02-12T04:05:03.310 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.306+0000 7f5a0c608640 1 -- 10.20.193.91:0/666497281 >> 10.20.193.91:0/666497281 conn(0x7f5a040b6560 msgr2=0x7f5a0415d900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:05:03.310 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.306+0000 7f5a0c608640 1 -- 10.20.193.91:0/666497281 shutdown_connections 2026-02-12T04:05:03.310 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.306+0000 7f5a0c608640 1 -- 10.20.193.91:0/666497281 wait complete. 2026-02-12T04:05:03.310 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:03.306+0000 7f5a0c608640 1 librados: shutdown 2026-02-12T04:05:03.316 INFO:teuthology.orchestra.run.trial091.stdout:{"pg_ready":true,"pg_map":{"version":541,"stamp":"2026-02-12T04:05:02.090064+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":56,"num_read_kb":47,"num_write":70,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":47,"ondisk_log_size":47,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":86,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":492568,"kb_used_data":61208,"kb_used_omap":24502,"kb_used_meta":406601,"kb_avail":1509456872,"statfs":{"total":1546188226560,"available":1545683836928,"internally_reserved":0,"allocated":62676992,"data_stored":70134512,"data_compressed":12830400,"data_compressed_allocated":23265280,"data_compressed_original":60084192,"omap_allocated":25090979,"internal_metadata":416359517},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":97,"apply_latency_ms":97,"commit_latency_ns":97000000,"apply_latency_ns":97000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.866220"},"pg_stats":[{"pgid":"10.1a","version":"0'0","reported_seq":632,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.433732+0000","last_change":"2026-02-12T03:59:14.506367+0000","last_active":"2026-02-12T04:04:53.433732+0000","last_peered":"2026-02-12T04:04:53.433732+0000","last_clean":"2026-02-12T04:04:53.433732+0000","last_became_active":"2026-02-12T03:59:14.484825+0000","last_became_peered":"2026-02-12T03:59:14.484825+0000","last_unstale":"2026-02-12T04:04:53.433732+0000","last_undegraded":"2026-02-12T04:04:53.433732+0000","last_fullsized":"2026-02-12T04:04:53.433732+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T13:39:56.222964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6],"acting":[11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":636,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.454208+0000","last_change":"2026-02-12T03:59:13.271129+0000","last_active":"2026-02-12T04:04:53.454208+0000","last_peered":"2026-02-12T04:04:53.454208+0000","last_clean":"2026-02-12T04:04:53.454208+0000","last_became_active":"2026-02-12T03:59:13.250886+0000","last_became_peered":"2026-02-12T03:59:13.250886+0000","last_unstale":"2026-02-12T04:04:53.454208+0000","last_undegraded":"2026-02-12T04:04:53.454208+0000","last_fullsized":"2026-02-12T04:04:53.454208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:56:54.392976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,0],"acting":[15,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":638,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:57.326948+0000","last_change":"2026-02-12T04:04:57.326948+0000","last_active":"2026-02-12T04:04:57.326948+0000","last_peered":"2026-02-12T04:04:57.326948+0000","last_clean":"2026-02-12T04:04:57.326948+0000","last_became_active":"2026-02-12T03:59:13.540079+0000","last_became_peered":"2026-02-12T03:59:13.540079+0000","last_unstale":"2026-02-12T04:04:57.326948+0000","last_undegraded":"2026-02-12T04:04:57.326948+0000","last_fullsized":"2026-02-12T04:04:57.326948+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:04:57.324857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:04:57.324857+0000","last_clean_scrub_stamp":"2026-02-12T04:04:57.324857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:16:43.845781+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,14],"acting":[4,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":632,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.319636+0000","last_change":"2026-02-12T03:59:13.067079+0000","last_active":"2026-02-12T04:04:53.319636+0000","last_peered":"2026-02-12T04:04:53.319636+0000","last_clean":"2026-02-12T04:04:53.319636+0000","last_became_active":"2026-02-12T03:59:13.054800+0000","last_became_peered":"2026-02-12T03:59:13.054800+0000","last_unstale":"2026-02-12T04:04:53.319636+0000","last_undegraded":"2026-02-12T04:04:53.319636+0000","last_fullsized":"2026-02-12T04:04:53.319636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T08:49:22.540651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":636,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.444146+0000","last_change":"2026-02-12T03:59:13.308993+0000","last_active":"2026-02-12T04:04:53.444146+0000","last_peered":"2026-02-12T04:04:53.444146+0000","last_clean":"2026-02-12T04:04:53.444146+0000","last_became_active":"2026-02-12T03:59:13.246053+0000","last_became_peered":"2026-02-12T03:59:13.246053+0000","last_unstale":"2026-02-12T04:04:53.444146+0000","last_undegraded":"2026-02-12T04:04:53.444146+0000","last_fullsized":"2026-02-12T04:04:53.444146+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T12:53:48.331317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,7],"acting":[15,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":632,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.347759+0000","last_change":"2026-02-12T03:59:13.329534+0000","last_active":"2026-02-12T04:04:53.347759+0000","last_peered":"2026-02-12T04:04:53.347759+0000","last_clean":"2026-02-12T04:04:53.347759+0000","last_became_active":"2026-02-12T03:59:13.325110+0000","last_became_peered":"2026-02-12T03:59:13.325110+0000","last_unstale":"2026-02-12T04:04:53.347759+0000","last_undegraded":"2026-02-12T04:04:53.347759+0000","last_fullsized":"2026-02-12T04:04:53.347759+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T13:01:51.962329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":631,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.448971+0000","last_change":"2026-02-12T03:59:13.470926+0000","last_active":"2026-02-12T04:04:53.448971+0000","last_peered":"2026-02-12T04:04:53.448971+0000","last_clean":"2026-02-12T04:04:53.448971+0000","last_became_active":"2026-02-12T03:59:13.466259+0000","last_became_peered":"2026-02-12T03:59:13.466259+0000","last_unstale":"2026-02-12T04:04:53.448971+0000","last_undegraded":"2026-02-12T04:04:53.448971+0000","last_fullsized":"2026-02-12T04:04:53.448971+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:30:59.565179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":631,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.458410+0000","last_change":"2026-02-12T03:59:13.501116+0000","last_active":"2026-02-12T04:04:53.458410+0000","last_peered":"2026-02-12T04:04:53.458410+0000","last_clean":"2026-02-12T04:04:53.458410+0000","last_became_active":"2026-02-12T03:59:13.497818+0000","last_became_peered":"2026-02-12T03:59:13.497818+0000","last_unstale":"2026-02-12T04:04:53.458410+0000","last_undegraded":"2026-02-12T04:04:53.458410+0000","last_fullsized":"2026-02-12T04:04:53.458410+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T07:00:27.016290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":632,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.367366+0000","last_change":"2026-02-12T03:59:13.134257+0000","last_active":"2026-02-12T04:04:53.367366+0000","last_peered":"2026-02-12T04:04:53.367366+0000","last_clean":"2026-02-12T04:04:53.367366+0000","last_became_active":"2026-02-12T03:59:13.116472+0000","last_became_peered":"2026-02-12T03:59:13.116472+0000","last_unstale":"2026-02-12T04:04:53.367366+0000","last_undegraded":"2026-02-12T04:04:53.367366+0000","last_fullsized":"2026-02-12T04:04:53.367366+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T10:34:46.392533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,3],"acting":[14,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":632,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.320753+0000","last_change":"2026-02-12T03:59:13.090778+0000","last_active":"2026-02-12T04:04:53.320753+0000","last_peered":"2026-02-12T04:04:53.320753+0000","last_clean":"2026-02-12T04:04:53.320753+0000","last_became_active":"2026-02-12T03:59:13.088475+0000","last_became_peered":"2026-02-12T03:59:13.088475+0000","last_unstale":"2026-02-12T04:04:53.320753+0000","last_undegraded":"2026-02-12T04:04:53.320753+0000","last_fullsized":"2026-02-12T04:04:53.320753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T04:11:16.331392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":632,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.426857+0000","last_change":"2026-02-12T03:59:14.956219+0000","last_active":"2026-02-12T04:04:53.426857+0000","last_peered":"2026-02-12T04:04:53.426857+0000","last_clean":"2026-02-12T04:04:53.426857+0000","last_became_active":"2026-02-12T03:59:14.947424+0000","last_became_peered":"2026-02-12T03:59:14.947424+0000","last_unstale":"2026-02-12T04:04:53.426857+0000","last_undegraded":"2026-02-12T04:04:53.426857+0000","last_fullsized":"2026-02-12T04:04:53.426857+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T11:01:54.553548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,11],"acting":[12,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"10.1","version":"33'11","reported_seq":660,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.431955+0000","last_change":"2026-02-12T03:59:13.848583+0000","last_active":"2026-02-12T04:04:53.431955+0000","last_peered":"2026-02-12T04:04:53.431955+0000","last_clean":"2026-02-12T04:04:53.431955+0000","last_became_active":"2026-02-12T03:59:13.846131+0000","last_became_peered":"2026-02-12T03:59:13.846131+0000","last_unstale":"2026-02-12T04:04:53.431955+0000","last_undegraded":"2026-02-12T04:04:53.431955+0000","last_fullsized":"2026-02-12T04:04:53.431955+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T04:28:11.002392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,7],"acting":[10,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"1.0","version":"24'32","reported_seq":691,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:54.443407+0000","last_change":"2026-02-12T03:58:33.836000+0000","last_active":"2026-02-12T04:04:54.443407+0000","last_peered":"2026-02-12T04:04:54.443407+0000","last_clean":"2026-02-12T04:04:54.443407+0000","last_became_active":"2026-02-12T03:58:33.819911+0000","last_became_peered":"2026-02-12T03:58:33.819911+0000","last_unstale":"2026-02-12T04:04:54.443407+0000","last_undegraded":"2026-02-12T04:04:54.443407+0000","last_fullsized":"2026-02-12T04:04:54.443407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:32.372907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:32.372907+0000","last_clean_scrub_stamp":"2026-02-12T03:58:32.372907+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T08:01:25.009200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,15],"acting":[2,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"26'1","reported_seq":653,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.441052+0000","last_change":"2026-02-12T03:58:44.065350+0000","last_active":"2026-02-12T04:04:53.441052+0000","last_peered":"2026-02-12T04:04:53.441052+0000","last_clean":"2026-02-12T04:04:53.441052+0000","last_became_active":"2026-02-12T03:58:42.128882+0000","last_became_peered":"2026-02-12T03:58:42.128882+0000","last_unstale":"2026-02-12T04:04:53.441052+0000","last_undegraded":"2026-02-12T04:04:53.441052+0000","last_fullsized":"2026-02-12T04:04:53.441052+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.058002405,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6],"acting":[8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":634,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.433841+0000","last_change":"2026-02-12T03:59:13.938696+0000","last_active":"2026-02-12T04:04:53.433841+0000","last_peered":"2026-02-12T04:04:53.433841+0000","last_clean":"2026-02-12T04:04:53.433841+0000","last_became_active":"2026-02-12T03:59:13.918494+0000","last_became_peered":"2026-02-12T03:59:13.918494+0000","last_unstale":"2026-02-12T04:04:53.433841+0000","last_undegraded":"2026-02-12T04:04:53.433841+0000","last_fullsized":"2026-02-12T04:04:53.433841+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T05:10:10.233810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":656,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:56.663872+0000","last_change":"2026-02-12T04:04:56.663872+0000","last_active":"2026-02-12T04:04:56.663872+0000","last_peered":"2026-02-12T04:04:56.663872+0000","last_clean":"2026-02-12T04:04:56.663872+0000","last_became_active":"2026-02-12T03:58:42.530615+0000","last_became_peered":"2026-02-12T03:58:42.530615+0000","last_unstale":"2026-02-12T04:04:56.663872+0000","last_undegraded":"2026-02-12T04:04:56.663872+0000","last_fullsized":"2026-02-12T04:04:56.663872+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:04:56.662073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:04:56.662073+0000","last_clean_scrub_stamp":"2026-02-12T04:04:56.662073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T08:16:37.169210+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0.030042276999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":632,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.318115+0000","last_change":"2026-02-12T03:59:12.994781+0000","last_active":"2026-02-12T04:04:53.318115+0000","last_peered":"2026-02-12T04:04:53.318115+0000","last_clean":"2026-02-12T04:04:53.318115+0000","last_became_active":"2026-02-12T03:59:12.992488+0000","last_became_peered":"2026-02-12T03:59:12.992488+0000","last_unstale":"2026-02-12T04:04:53.318115+0000","last_undegraded":"2026-02-12T04:04:53.318115+0000","last_fullsized":"2026-02-12T04:04:53.318115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:28:37.264382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,13],"acting":[7,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":653,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.296388+0000","last_change":"2026-02-12T03:58:44.019395+0000","last_active":"2026-02-12T04:04:53.296388+0000","last_peered":"2026-02-12T04:04:53.296388+0000","last_clean":"2026-02-12T04:04:53.296388+0000","last_became_active":"2026-02-12T03:58:42.143466+0000","last_became_peered":"2026-02-12T03:58:42.143466+0000","last_unstale":"2026-02-12T04:04:53.296388+0000","last_undegraded":"2026-02-12T04:04:53.296388+0000","last_fullsized":"2026-02-12T04:04:53.296388+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T08:05:12.033817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.030228985,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":630,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.429984+0000","last_change":"2026-02-12T03:59:13.213383+0000","last_active":"2026-02-12T04:04:53.429984+0000","last_peered":"2026-02-12T04:04:53.429984+0000","last_clean":"2026-02-12T04:04:53.429984+0000","last_became_active":"2026-02-12T03:59:13.207238+0000","last_became_peered":"2026-02-12T03:59:13.207238+0000","last_unstale":"2026-02-12T04:04:53.429984+0000","last_undegraded":"2026-02-12T04:04:53.429984+0000","last_fullsized":"2026-02-12T04:04:53.429984+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T06:27:24.872444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"344'3","reported_seq":663,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:57.729197+0000","last_change":"2026-02-12T04:04:57.728469+0000","last_active":"2026-02-12T04:04:57.729197+0000","last_peered":"2026-02-12T04:04:57.729197+0000","last_clean":"2026-02-12T04:04:57.729197+0000","last_became_active":"2026-02-12T03:58:42.443435+0000","last_became_peered":"2026-02-12T03:58:42.443435+0000","last_unstale":"2026-02-12T04:04:57.729197+0000","last_undegraded":"2026-02-12T04:04:57.729197+0000","last_fullsized":"2026-02-12T04:04:57.729197+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"344'3","last_scrub_stamp":"2026-02-12T04:04:57.727426+0000","last_deep_scrub":"344'3","last_deep_scrub_stamp":"2026-02-12T04:04:57.727426+0000","last_clean_scrub_stamp":"2026-02-12T04:04:57.727426+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:59:46.094093+0000","scrub_duration":82,"objects_trimmed":0,"snaptrim_duration":0.069533228000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":634,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:58.755794+0000","last_change":"2026-02-12T04:04:58.755794+0000","last_active":"2026-02-12T04:04:58.755794+0000","last_peered":"2026-02-12T04:04:58.755794+0000","last_clean":"2026-02-12T04:04:58.755794+0000","last_became_active":"2026-02-12T03:59:13.221176+0000","last_became_peered":"2026-02-12T03:59:13.221176+0000","last_unstale":"2026-02-12T04:04:58.755794+0000","last_undegraded":"2026-02-12T04:04:58.755794+0000","last_fullsized":"2026-02-12T04:04:58.755794+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:04:58.754081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:04:58.754081+0000","last_clean_scrub_stamp":"2026-02-12T04:04:58.754081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T08:28:45.746274+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11],"acting":[1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":646,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.448715+0000","last_change":"2026-02-12T03:58:44.390979+0000","last_active":"2026-02-12T04:04:53.448715+0000","last_peered":"2026-02-12T04:04:53.448715+0000","last_clean":"2026-02-12T04:04:53.448715+0000","last_became_active":"2026-02-12T03:58:42.128705+0000","last_became_peered":"2026-02-12T03:58:42.128705+0000","last_unstale":"2026-02-12T04:04:53.448715+0000","last_undegraded":"2026-02-12T04:04:53.448715+0000","last_fullsized":"2026-02-12T04:04:53.448715+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T04:06:44.956414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.043458169999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":630,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.433347+0000","last_change":"2026-02-12T03:59:13.662145+0000","last_active":"2026-02-12T04:04:53.433347+0000","last_peered":"2026-02-12T04:04:53.433347+0000","last_clean":"2026-02-12T04:04:53.433347+0000","last_became_active":"2026-02-12T03:59:13.639048+0000","last_became_peered":"2026-02-12T03:59:13.639048+0000","last_unstale":"2026-02-12T04:04:53.433347+0000","last_undegraded":"2026-02-12T04:04:53.433347+0000","last_fullsized":"2026-02-12T04:04:53.433347+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T14:17:15.031582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,14],"acting":[0,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":646,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.452808+0000","last_change":"2026-02-12T03:58:44.393932+0000","last_active":"2026-02-12T04:04:53.452808+0000","last_peered":"2026-02-12T04:04:53.452808+0000","last_clean":"2026-02-12T04:04:53.452808+0000","last_became_active":"2026-02-12T03:58:42.477478+0000","last_became_peered":"2026-02-12T03:58:42.477478+0000","last_unstale":"2026-02-12T04:04:53.452808+0000","last_undegraded":"2026-02-12T04:04:53.452808+0000","last_fullsized":"2026-02-12T04:04:53.452808+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:13:02.779200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.042443649,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":630,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.437660+0000","last_change":"2026-02-12T03:59:13.153999+0000","last_active":"2026-02-12T04:04:53.437660+0000","last_peered":"2026-02-12T04:04:53.437660+0000","last_clean":"2026-02-12T04:04:53.437660+0000","last_became_active":"2026-02-12T03:59:13.151732+0000","last_became_peered":"2026-02-12T03:59:13.151732+0000","last_unstale":"2026-02-12T04:04:53.437660+0000","last_undegraded":"2026-02-12T04:04:53.437660+0000","last_fullsized":"2026-02-12T04:04:53.437660+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T14:04:35.028100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":651,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.447570+0000","last_change":"2026-02-12T03:58:44.186869+0000","last_active":"2026-02-12T04:04:53.447570+0000","last_peered":"2026-02-12T04:04:53.447570+0000","last_clean":"2026-02-12T04:04:53.447570+0000","last_became_active":"2026-02-12T03:58:41.959956+0000","last_became_peered":"2026-02-12T03:58:41.959956+0000","last_unstale":"2026-02-12T04:04:53.447570+0000","last_undegraded":"2026-02-12T04:04:53.447570+0000","last_fullsized":"2026-02-12T04:04:53.447570+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T10:02:09.820740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.032971485000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,15],"acting":[10,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":630,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.438915+0000","last_change":"2026-02-12T03:59:13.349359+0000","last_active":"2026-02-12T04:04:53.438915+0000","last_peered":"2026-02-12T04:04:53.438915+0000","last_clean":"2026-02-12T04:04:53.438915+0000","last_became_active":"2026-02-12T03:59:13.347203+0000","last_became_peered":"2026-02-12T03:59:13.347203+0000","last_unstale":"2026-02-12T04:04:53.438915+0000","last_undegraded":"2026-02-12T04:04:53.438915+0000","last_fullsized":"2026-02-12T04:04:53.438915+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T05:50:59.198319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":651,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.466490+0000","last_change":"2026-02-12T03:58:44.073484+0000","last_active":"2026-02-12T04:04:53.466490+0000","last_peered":"2026-02-12T04:04:53.466490+0000","last_clean":"2026-02-12T04:04:53.466490+0000","last_became_active":"2026-02-12T03:58:42.327696+0000","last_became_peered":"2026-02-12T03:58:42.327696+0000","last_unstale":"2026-02-12T04:04:53.466490+0000","last_undegraded":"2026-02-12T04:04:53.466490+0000","last_fullsized":"2026-02-12T04:04:53.466490+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:58:40.736932+0000","last_clean_scrub_stamp":"2026-02-12T03:58:40.736932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T07:45:24.713381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.065547275000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,14],"acting":[8,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":632,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.390570+0000","last_change":"2026-02-12T03:59:14.920383+0000","last_active":"2026-02-12T04:04:53.390570+0000","last_peered":"2026-02-12T04:04:53.390570+0000","last_clean":"2026-02-12T04:04:53.390570+0000","last_became_active":"2026-02-12T03:59:14.917311+0000","last_became_peered":"2026-02-12T03:59:14.917311+0000","last_unstale":"2026-02-12T04:04:53.390570+0000","last_undegraded":"2026-02-12T04:04:53.390570+0000","last_fullsized":"2026-02-12T04:04:53.390570+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:47:34.135464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,2],"acting":[14,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":632,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.453565+0000","last_change":"2026-02-12T03:59:14.922629+0000","last_active":"2026-02-12T04:04:53.453565+0000","last_peered":"2026-02-12T04:04:53.453565+0000","last_clean":"2026-02-12T04:04:53.453565+0000","last_became_active":"2026-02-12T03:59:14.899726+0000","last_became_peered":"2026-02-12T03:59:14.899726+0000","last_unstale":"2026-02-12T04:04:53.453565+0000","last_undegraded":"2026-02-12T04:04:53.453565+0000","last_fullsized":"2026-02-12T04:04:53.453565+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T06:41:07.216123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":635,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.314527+0000","last_change":"2026-02-12T03:59:13.261070+0000","last_active":"2026-02-12T04:04:53.314527+0000","last_peered":"2026-02-12T04:04:53.314527+0000","last_clean":"2026-02-12T04:04:53.314527+0000","last_became_active":"2026-02-12T03:59:13.258353+0000","last_became_peered":"2026-02-12T03:59:13.258353+0000","last_unstale":"2026-02-12T04:04:53.314527+0000","last_undegraded":"2026-02-12T04:04:53.314527+0000","last_fullsized":"2026-02-12T04:04:53.314527+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T04:31:20.008810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":631,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.460305+0000","last_change":"2026-02-12T03:59:13.222666+0000","last_active":"2026-02-12T04:04:53.460305+0000","last_peered":"2026-02-12T04:04:53.460305+0000","last_clean":"2026-02-12T04:04:53.460305+0000","last_became_active":"2026-02-12T03:59:13.219996+0000","last_became_peered":"2026-02-12T03:59:13.219996+0000","last_unstale":"2026-02-12T04:04:53.460305+0000","last_undegraded":"2026-02-12T04:04:53.460305+0000","last_fullsized":"2026-02-12T04:04:53.460305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T14:24:56.118560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,8],"acting":[6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":633,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.436326+0000","last_change":"2026-02-12T03:59:14.179968+0000","last_active":"2026-02-12T04:04:53.436326+0000","last_peered":"2026-02-12T04:04:53.436326+0000","last_clean":"2026-02-12T04:04:53.436326+0000","last_became_active":"2026-02-12T03:59:14.177484+0000","last_became_peered":"2026-02-12T03:59:14.177484+0000","last_unstale":"2026-02-12T04:04:53.436326+0000","last_undegraded":"2026-02-12T04:04:53.436326+0000","last_fullsized":"2026-02-12T04:04:53.436326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T12:21:26.417548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,9],"acting":[13,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":633,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.302943+0000","last_change":"2026-02-12T03:59:13.723128+0000","last_active":"2026-02-12T04:04:53.302943+0000","last_peered":"2026-02-12T04:04:53.302943+0000","last_clean":"2026-02-12T04:04:53.302943+0000","last_became_active":"2026-02-12T03:59:13.720549+0000","last_became_peered":"2026-02-12T03:59:13.720549+0000","last_unstale":"2026-02-12T04:04:53.302943+0000","last_undegraded":"2026-02-12T04:04:53.302943+0000","last_fullsized":"2026-02-12T04:04:53.302943+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T04:30:20.689176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,15],"acting":[5,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":628,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:54.444437+0000","last_change":"2026-02-12T03:59:13.863936+0000","last_active":"2026-02-12T04:04:54.444437+0000","last_peered":"2026-02-12T04:04:54.444437+0000","last_clean":"2026-02-12T04:04:54.444437+0000","last_became_active":"2026-02-12T03:59:13.846922+0000","last_became_peered":"2026-02-12T03:59:13.846922+0000","last_unstale":"2026-02-12T04:04:54.444437+0000","last_undegraded":"2026-02-12T04:04:54.444437+0000","last_fullsized":"2026-02-12T04:04:54.444437+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:17:54.924916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":632,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.446442+0000","last_change":"2026-02-12T03:59:14.860387+0000","last_active":"2026-02-12T04:04:53.446442+0000","last_peered":"2026-02-12T04:04:53.446442+0000","last_clean":"2026-02-12T04:04:53.446442+0000","last_became_active":"2026-02-12T03:59:14.858194+0000","last_became_peered":"2026-02-12T03:59:14.858194+0000","last_unstale":"2026-02-12T04:04:53.446442+0000","last_undegraded":"2026-02-12T04:04:53.446442+0000","last_fullsized":"2026-02-12T04:04:53.446442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:17:18.432397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":632,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.432665+0000","last_change":"2026-02-12T03:59:14.314170+0000","last_active":"2026-02-12T04:04:53.432665+0000","last_peered":"2026-02-12T04:04:53.432665+0000","last_clean":"2026-02-12T04:04:53.432665+0000","last_became_active":"2026-02-12T03:59:14.311690+0000","last_became_peered":"2026-02-12T03:59:14.311690+0000","last_unstale":"2026-02-12T04:04:53.432665+0000","last_undegraded":"2026-02-12T04:04:53.432665+0000","last_fullsized":"2026-02-12T04:04:53.432665+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T11:08:54.179415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,13],"acting":[11,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":632,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.444003+0000","last_change":"2026-02-12T03:59:13.474307+0000","last_active":"2026-02-12T04:04:53.444003+0000","last_peered":"2026-02-12T04:04:53.444003+0000","last_clean":"2026-02-12T04:04:53.444003+0000","last_became_active":"2026-02-12T03:59:13.469019+0000","last_became_peered":"2026-02-12T03:59:13.469019+0000","last_unstale":"2026-02-12T04:04:53.444003+0000","last_undegraded":"2026-02-12T04:04:53.444003+0000","last_fullsized":"2026-02-12T04:04:53.444003+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:39:25.438275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,2],"acting":[12,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":628,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.449552+0000","last_change":"2026-02-12T03:59:13.092892+0000","last_active":"2026-02-12T04:04:53.449552+0000","last_peered":"2026-02-12T04:04:53.449552+0000","last_clean":"2026-02-12T04:04:53.449552+0000","last_became_active":"2026-02-12T03:59:13.075804+0000","last_became_peered":"2026-02-12T03:59:13.075804+0000","last_unstale":"2026-02-12T04:04:53.449552+0000","last_undegraded":"2026-02-12T04:04:53.449552+0000","last_fullsized":"2026-02-12T04:04:53.449552+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T05:40:29.002904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,13],"acting":[3,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":631,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.461065+0000","last_change":"2026-02-12T03:59:13.511621+0000","last_active":"2026-02-12T04:04:53.461065+0000","last_peered":"2026-02-12T04:04:53.461065+0000","last_clean":"2026-02-12T04:04:53.461065+0000","last_became_active":"2026-02-12T03:59:13.509387+0000","last_became_peered":"2026-02-12T03:59:13.509387+0000","last_unstale":"2026-02-12T04:04:53.461065+0000","last_undegraded":"2026-02-12T04:04:53.461065+0000","last_fullsized":"2026-02-12T04:04:53.461065+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:19:12.104502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":635,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:53.322424+0000","last_change":"2026-02-12T03:59:13.135837+0000","last_active":"2026-02-12T04:04:53.322424+0000","last_peered":"2026-02-12T04:04:53.322424+0000","last_clean":"2026-02-12T04:04:53.322424+0000","last_became_active":"2026-02-12T03:59:13.130685+0000","last_became_peered":"2026-02-12T03:59:13.130685+0000","last_unstale":"2026-02-12T04:04:53.322424+0000","last_undegraded":"2026-02-12T04:04:53.322424+0000","last_fullsized":"2026-02-12T04:04:53.322424+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T03:59:10.971958+0000","last_clean_scrub_stamp":"2026-02-12T03:59:10.971958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T05:20:55.632623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":918560,"data_compressed":2320,"data_compressed_allocated":65536,"data_compressed_original":917504,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":22,"seq":94489280592,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30784,"kb_used_data":3824,"kb_used_omap":3014,"kb_used_meta":23929,"kb_avail":94341056,"statfs":{"total":96636764160,"available":96605241344,"internally_reserved":0,"allocated":3915776,"data_stored":4326013,"data_compressed":801755,"data_compressed_allocated":1449984,"data_compressed_original":3697918,"omap_allocated":3087009,"internal_metadata":24503647},"hb_peers":[1,2,3,4,5,6,7,8,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280591,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30780,"kb_used_data":3820,"kb_used_omap":205,"kb_used_meta":26738,"kb_avail":94341060,"statfs":{"total":96636764160,"available":96605245440,"internally_reserved":0,"allocated":3911680,"data_stored":4325994,"data_compressed":801755,"data_compressed_allocated":1449984,"data_compressed_original":3697918,"omap_allocated":210542,"internal_metadata":27380114},"hb_peers":[0,2,3,4,5,6,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280593,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30816,"kb_used_data":3856,"kb_used_omap":212,"kb_used_meta":26731,"kb_avail":94341024,"statfs":{"total":96636764160,"available":96605208576,"internally_reserved":0,"allocated":3948544,"data_stored":4785274,"data_compressed":802915,"data_compressed_allocated":1482752,"data_compressed_original":4156670,"omap_allocated":217936,"internal_metadata":27372720},"hb_peers":[0,1,2,4,5,6,7,8,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313295,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30780,"kb_used_data":3820,"kb_used_omap":3018,"kb_used_meta":23925,"kb_avail":94341060,"statfs":{"total":96636764160,"available":96605245440,"internally_reserved":0,"allocated":3911680,"data_stored":4325994,"data_compressed":801755,"data_compressed_allocated":1449984,"data_compressed_original":3697918,"omap_allocated":3091108,"internal_metadata":24499548},"hb_peers":[1,2,3,4,5,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313295,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30780,"kb_used_data":3820,"kb_used_omap":3017,"kb_used_meta":23926,"kb_avail":94341060,"statfs":{"total":96636764160,"available":96605245440,"internally_reserved":0,"allocated":3911680,"data_stored":4325994,"data_compressed":801755,"data_compressed_allocated":1449984,"data_compressed_original":3697918,"omap_allocated":3089978,"internal_metadata":24500678},"hb_peers":[0,1,3,4,5,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":21,"seq":90194313296,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30780,"kb_used_data":3820,"kb_used_omap":3019,"kb_used_meta":23924,"kb_avail":94341060,"statfs":{"total":96636764160,"available":96605245440,"internally_reserved":0,"allocated":3911680,"data_stored":4325994,"data_compressed":801755,"data_compressed_allocated":1449984,"data_compressed_original":3697918,"omap_allocated":3091937,"internal_metadata":24498719},"hb_peers":[0,1,3,4,5,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313296,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30816,"kb_used_data":3856,"kb_used_omap":208,"kb_used_meta":26735,"kb_avail":94341024,"statfs":{"total":96636764160,"available":96605208576,"internally_reserved":0,"allocated":3948544,"data_stored":4785274,"data_compressed":802915,"data_compressed_allocated":1482752,"data_compressed_original":4156670,"omap_allocated":213892,"internal_metadata":27376764},"hb_peers":[1,3,4,5,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313295,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30780,"kb_used_data":3820,"kb_used_omap":1740,"kb_used_meta":25203,"kb_avail":94341060,"statfs":{"total":96636764160,"available":96605245440,"internally_reserved":0,"allocated":3911680,"data_stored":4325994,"data_compressed":801755,"data_compressed_allocated":1449984,"data_compressed_original":3697918,"omap_allocated":1782034,"internal_metadata":25808622},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313296,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30780,"kb_used_data":3820,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94341060,"statfs":{"total":96636764160,"available":96605245440,"internally_reserved":0,"allocated":3911680,"data_stored":4325994,"data_compressed":801755,"data_compressed_allocated":1449984,"data_compressed_original":3697918,"omap_allocated":214817,"internal_metadata":27375839},"hb_peers":[0,1,3,4,6,7,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313295,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30784,"kb_used_data":3824,"kb_used_omap":210,"kb_used_meta":26733,"kb_avail":94341056,"statfs":{"total":96636764160,"available":96605241344,"internally_reserved":0,"allocated":3915776,"data_stored":4326013,"data_compressed":801755,"data_compressed_allocated":1449984,"data_compressed_original":3697918,"omap_allocated":215240,"internal_metadata":27375416},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313297,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30780,"kb_used_data":3820,"kb_used_omap":175,"kb_used_meta":26768,"kb_avail":94341060,"statfs":{"total":96636764160,"available":96605245440,"internally_reserved":0,"allocated":3911680,"data_stored":4325994,"data_compressed":801755,"data_compressed_allocated":1449984,"data_compressed_original":3697918,"omap_allocated":179988,"internal_metadata":27410668},"hb_peers":[0,1,3,5,6,7,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":10,"up_from":21,"seq":90194313296,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30784,"kb_used_data":3824,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94341056,"statfs":{"total":96636764160,"available":96605241344,"internally_reserved":0,"allocated":3915776,"data_stored":4325999,"data_compressed":801755,"data_compressed_allocated":1449984,"data_compressed_original":3697918,"omap_allocated":214733,"internal_metadata":27375923},"hb_peers":[0,1,2,3,4,5,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313297,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30780,"kb_used_data":3820,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94341060,"statfs":{"total":96636764160,"available":96605245440,"internally_reserved":0,"allocated":3911680,"data_stored":4325994,"data_compressed":801755,"data_compressed_allocated":1449984,"data_compressed_original":3697918,"omap_allocated":214322,"internal_metadata":27376334},"hb_peers":[0,2,3,5,6,7,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":14,"up_from":21,"seq":90194313296,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30780,"kb_used_data":3820,"kb_used_omap":3018,"kb_used_meta":23925,"kb_avail":94341060,"statfs":{"total":96636764160,"available":96605245440,"internally_reserved":0,"allocated":3911680,"data_stored":4325994,"data_compressed":801755,"data_compressed_allocated":1449984,"data_compressed_original":3697918,"omap_allocated":3090725,"internal_metadata":24499931},"hb_peers":[0,2,3,4,5,6,7,8,9,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280593,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30780,"kb_used_data":3820,"kb_used_omap":3012,"kb_used_meta":23931,"kb_avail":94341060,"statfs":{"total":96636764160,"available":96605245440,"internally_reserved":0,"allocated":3911680,"data_stored":4325994,"data_compressed":801755,"data_compressed_allocated":1449984,"data_compressed_original":3697918,"omap_allocated":3085203,"internal_metadata":24505453},"hb_peers":[1,2,4,5,6,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280593,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30784,"kb_used_data":3824,"kb_used_omap":3019,"kb_used_meta":23924,"kb_avail":94341056,"statfs":{"total":96636764160,"available":96605241344,"internally_reserved":0,"allocated":3915776,"data_stored":4325999,"data_compressed":801755,"data_compressed_allocated":1449984,"data_compressed_original":3697918,"omap_allocated":3091515,"internal_metadata":24499141},"hb_peers":[0,3,4,5,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":459280,"data_compressed":1160,"data_compressed_allocated":32768,"data_compressed_original":458752,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":459280,"data_compressed":1160,"data_compressed_allocated":32768,"data_compressed_original":458752,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T04:05:03.323 INFO:tasks.ceph:pgid 10.1a last_scrub_stamp 2026-02-12T03:59:10.971958+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=3, tm_min=59, tm_sec=10, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=4, tm_min=4, tm_sec=55, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T04:05:03.324 INFO:tasks.ceph:pgid 10.1b last_scrub_stamp 2026-02-12T03:59:10.971958+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=3, tm_min=59, tm_sec=10, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=4, tm_min=4, tm_sec=55, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T04:05:03.324 INFO:tasks.ceph:pgid 10.19 last_scrub_stamp 2026-02-12T03:59:10.971958+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=3, tm_min=59, tm_sec=10, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=4, tm_min=4, tm_sec=55, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T04:05:03.324 INFO:tasks.ceph:pgid 10.6 last_scrub_stamp 2026-02-12T03:59:10.971958+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=3, tm_min=59, tm_sec=10, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=4, tm_min=4, tm_sec=55, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T04:05:03.324 INFO:tasks.ceph:pgid 10.7 last_scrub_stamp 2026-02-12T03:59:10.971958+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=3, tm_min=59, tm_sec=10, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=4, tm_min=4, tm_sec=55, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T04:05:03.324 INFO:tasks.ceph:pgid 10.4 last_scrub_stamp 2026-02-12T03:59:10.971958+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=3, tm_min=59, tm_sec=10, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=4, tm_min=4, tm_sec=55, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T04:05:03.325 INFO:tasks.ceph:pgid 10.5 last_scrub_stamp 2026-02-12T03:59:10.971958+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=3, tm_min=59, tm_sec=10, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=4, tm_min=4, tm_sec=55, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T04:05:03.325 INFO:tasks.ceph:pgid 10.2 last_scrub_stamp 2026-02-12T03:59:10.971958+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=3, tm_min=59, tm_sec=10, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=4, tm_min=4, tm_sec=55, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T04:05:03.325 INFO:tasks.ceph:pgid 10.3 last_scrub_stamp 2026-02-12T03:59:10.971958+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=3, tm_min=59, tm_sec=10, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=4, tm_min=4, tm_sec=55, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T04:05:03.325 INFO:tasks.ceph:pgid 10.0 last_scrub_stamp 2026-02-12T03:59:10.971958+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=3, tm_min=59, tm_sec=10, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=4, tm_min=4, tm_sec=55, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T04:05:03.325 INFO:tasks.ceph:pgid 10.1 last_scrub_stamp 2026-02-12T03:59:10.971958+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=3, tm_min=59, tm_sec=10, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=4, tm_min=4, tm_sec=55, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T04:05:03.325 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-12T03:58:32.372907+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=3, tm_min=58, tm_sec=32, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=4, tm_min=4, tm_sec=55, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T04:05:03.325 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2026-02-12T03:58:40.736932+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=3, tm_min=58, tm_sec=40, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=4, tm_min=4, tm_sec=55, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T04:05:03.326 INFO:tasks.ceph:pgid 10.b last_scrub_stamp 2026-02-12T03:59:10.971958+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=3, tm_min=59, tm_sec=10, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=4, tm_min=4, tm_sec=55, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T04:05:03.326 INFO:tasks.ceph:pgid 10.8 last_scrub_stamp 2026-02-12T03:59:10.971958+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=3, tm_min=59, tm_sec=10, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=4, tm_min=4, tm_sec=55, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T04:05:03.326 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2026-02-12T03:58:40.736932+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=3, tm_min=58, tm_sec=40, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=4, tm_min=4, tm_sec=55, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T04:05:03.326 INFO:tasks.ceph:pgid 10.9 last_scrub_stamp 2026-02-12T03:59:10.971958+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=3, tm_min=59, tm_sec=10, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=4, tm_min=4, tm_sec=55, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T04:05:03.326 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2026-02-12T03:58:40.736932+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=3, tm_min=58, tm_sec=40, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=4, tm_min=4, tm_sec=55, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T04:05:03.326 INFO:tasks.ceph:pgid 10.c last_scrub_stamp 2026-02-12T03:59:10.971958+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=3, tm_min=59, tm_sec=10, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=4, tm_min=4, tm_sec=55, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T04:05:03.326 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2026-02-12T03:58:40.736932+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=3, tm_min=58, tm_sec=40, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=4, tm_min=4, tm_sec=55, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T04:05:03.327 INFO:tasks.ceph:pgid 10.d last_scrub_stamp 2026-02-12T03:59:10.971958+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=3, tm_min=59, tm_sec=10, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=4, tm_min=4, tm_sec=55, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T04:05:03.327 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2026-02-12T03:58:40.736932+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=3, tm_min=58, tm_sec=40, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=4, tm_min=4, tm_sec=55, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T04:05:03.327 INFO:tasks.ceph:pgid 10.e last_scrub_stamp 2026-02-12T03:59:10.971958+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=3, tm_min=59, tm_sec=10, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=4, tm_min=4, tm_sec=55, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T04:05:03.327 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2026-02-12T03:58:40.736932+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=3, tm_min=58, tm_sec=40, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=4, tm_min=4, tm_sec=55, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T04:05:03.327 INFO:tasks.ceph:pgid 10.f last_scrub_stamp 2026-02-12T03:59:10.971958+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=3, tm_min=59, tm_sec=10, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=4, tm_min=4, tm_sec=55, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T04:05:03.327 INFO:tasks.ceph:pgid 10.1d last_scrub_stamp 2026-02-12T03:59:10.971958+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=3, tm_min=59, tm_sec=10, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=4, tm_min=4, tm_sec=55, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T04:05:03.327 INFO:tasks.ceph:pgid 10.1c last_scrub_stamp 2026-02-12T03:59:10.971958+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=3, tm_min=59, tm_sec=10, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=4, tm_min=4, tm_sec=55, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T04:05:03.328 INFO:tasks.ceph:pgid 10.1f last_scrub_stamp 2026-02-12T03:59:10.971958+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=3, tm_min=59, tm_sec=10, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=4, tm_min=4, tm_sec=55, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T04:05:03.328 INFO:tasks.ceph:pgid 10.1e last_scrub_stamp 2026-02-12T03:59:10.971958+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=3, tm_min=59, tm_sec=10, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=4, tm_min=4, tm_sec=55, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T04:05:03.328 INFO:tasks.ceph:pgid 10.11 last_scrub_stamp 2026-02-12T03:59:10.971958+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=3, tm_min=59, tm_sec=10, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=4, tm_min=4, tm_sec=55, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T04:05:03.328 INFO:tasks.ceph:pgid 10.10 last_scrub_stamp 2026-02-12T03:59:10.971958+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=3, tm_min=59, tm_sec=10, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=4, tm_min=4, tm_sec=55, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T04:05:03.328 INFO:tasks.ceph:pgid 10.13 last_scrub_stamp 2026-02-12T03:59:10.971958+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=3, tm_min=59, tm_sec=10, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=4, tm_min=4, tm_sec=55, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T04:05:03.328 INFO:tasks.ceph:pgid 10.12 last_scrub_stamp 2026-02-12T03:59:10.971958+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=3, tm_min=59, tm_sec=10, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=4, tm_min=4, tm_sec=55, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T04:05:03.328 INFO:tasks.ceph:pgid 10.15 last_scrub_stamp 2026-02-12T03:59:10.971958+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=3, tm_min=59, tm_sec=10, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=4, tm_min=4, tm_sec=55, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T04:05:03.328 INFO:tasks.ceph:pgid 10.14 last_scrub_stamp 2026-02-12T03:59:10.971958+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=3, tm_min=59, tm_sec=10, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=4, tm_min=4, tm_sec=55, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T04:05:03.329 INFO:tasks.ceph:pgid 10.17 last_scrub_stamp 2026-02-12T03:59:10.971958+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=3, tm_min=59, tm_sec=10, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=4, tm_min=4, tm_sec=55, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T04:05:03.329 INFO:tasks.ceph:pgid 10.16 last_scrub_stamp 2026-02-12T03:59:10.971958+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=3, tm_min=59, tm_sec=10, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=4, tm_min=4, tm_sec=55, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T04:05:03.329 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-12T04:05:14.181 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:07:35.065 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:05:14.183 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:07:35.067 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:05:14.194 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:07:35.079 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:05:14.209 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:07:35.089 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:05:14.212 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:07:35.092 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:05:14.212 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:07:35.059 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:05:14.213 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:07:35.060 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:05:14.221 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:07:35.102 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:05:14.224 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:07:35.071 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:05:23.330 DEBUG:teuthology.orchestra.run.trial091:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T04:05:23.398 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.395+0000 7f4c764c0640 10 monclient: get_monmap_and_config 2026-02-12T04:05:23.398 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.395+0000 7f4c764c0640 10 monclient: build_initial_monmap 2026-02-12T04:05:23.398 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.395+0000 7f4c764c0640 10 monclient: monmap: 2026-02-12T04:05:23.398 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:05:23.398 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:23.399 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:05:23.397071+0000 2026-02-12T04:05:23.399 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:05:23.397071+0000 2026-02-12T04:05:23.399 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:05:23.399 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:23.399 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:05:23.399 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:05:23.399 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:05:23.399 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:23.401 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.395+0000 7f4c764c0640 1 Processor -- start 2026-02-12T04:05:23.401 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.395+0000 7f4c764c0640 1 -- start start 2026-02-12T04:05:23.402 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.395+0000 7f4c764c0640 10 monclient: init 2026-02-12T04:05:23.402 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.396+0000 7f4c764c0640 10 monclient: _reopen_session rank -1 2026-02-12T04:05:23.402 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.396+0000 7f4c764c0640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T04:05:23.402 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.396+0000 7f4c764c0640 10 monclient(hunting): picked mon.noname-a con 0x7f4c701575d0 addr v1:10.20.193.91:6789/0 2026-02-12T04:05:23.402 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.396+0000 7f4c764c0640 10 monclient(hunting): picked mon.noname-c con 0x7f4c70163310 addr v1:10.20.193.111:6789/0 2026-02-12T04:05:23.402 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.396+0000 7f4c764c0640 10 monclient(hunting): picked mon.noname-b con 0x7f4c700560d0 addr v1:10.20.193.98:6789/0 2026-02-12T04:05:23.402 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.396+0000 7f4c764c0640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c700b20b0 con 0x7f4c701575d0 2026-02-12T04:05:23.402 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.396+0000 7f4c764c0640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c700b2390 con 0x7f4c700560d0 2026-02-12T04:05:23.402 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.396+0000 7f4c764c0640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c700b2670 con 0x7f4c70163310 2026-02-12T04:05:23.402 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.396+0000 7f4c764c0640 10 monclient(hunting): _renew_subs 2026-02-12T04:05:23.402 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.396+0000 7f4c764c0640 10 monclient(hunting): authenticate will time out at 1526.140514s 2026-02-12T04:05:23.403 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.396+0000 7f4c6ffff640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f4c701575d0 0x7f4c70162c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:37958/0 (socket says 10.20.193.91:37958) 2026-02-12T04:05:23.403 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.396+0000 7f4c6ffff640 1 -- 10.20.193.91:0/771248003 learned_addr learned my addr 10.20.193.91:0/771248003 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:05:23.403 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.398+0000 7f4c6effd640 1 -- 10.20.193.91:0/771248003 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 216150121 0 0) 0x7f4c700b20b0 con 0x7f4c701575d0 2026-02-12T04:05:23.403 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.398+0000 7f4c6effd640 10 monclient(hunting): _negotiate 2026-02-12T04:05:23.403 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.398+0000 7f4c6effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:23.403 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.398+0000 7f4c6effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:23.403 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.398+0000 7f4c6effd640 10 monclient(hunting): my global_id is 30819 2026-02-12T04:05:23.403 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.398+0000 7f4c6effd640 1 -- 10.20.193.91:0/771248003 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c54003610 con 0x7f4c701575d0 2026-02-12T04:05:23.403 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.398+0000 7f4c6effd640 1 -- 10.20.193.91:0/771248003 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 113671423 0 0) 0x7f4c700b2390 con 0x7f4c700560d0 2026-02-12T04:05:23.403 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.398+0000 7f4c6effd640 10 monclient(hunting): _negotiate 2026-02-12T04:05:23.403 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.398+0000 7f4c6effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:23.403 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.398+0000 7f4c6effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:23.404 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.398+0000 7f4c6effd640 10 monclient(hunting): my global_id is 27952 2026-02-12T04:05:23.404 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.398+0000 7f4c6effd640 1 -- 10.20.193.91:0/771248003 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c700b20b0 con 0x7f4c700560d0 2026-02-12T04:05:23.404 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.398+0000 7f4c6effd640 1 -- 10.20.193.91:0/771248003 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2821060440 0 0) 0x7f4c700b2670 con 0x7f4c70163310 2026-02-12T04:05:23.404 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.398+0000 7f4c6effd640 10 monclient(hunting): _negotiate 2026-02-12T04:05:23.404 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.398+0000 7f4c6effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:23.404 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.398+0000 7f4c6effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:23.404 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.398+0000 7f4c6effd640 10 monclient(hunting): my global_id is 27650 2026-02-12T04:05:23.404 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.398+0000 7f4c6effd640 1 -- 10.20.193.91:0/771248003 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c700b2390 con 0x7f4c70163310 2026-02-12T04:05:23.409 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.400+0000 7f4c6effd640 1 -- 10.20.193.91:0/771248003 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1925432406 0 0) 0x7f4c700b20b0 con 0x7f4c700560d0 2026-02-12T04:05:23.410 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.400+0000 7f4c6effd640 1 -- 10.20.193.91:0/771248003 >> v1:10.20.193.111:6789/0 conn(0x7f4c70163310 legacy=0x7f4c700559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:23.410 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.400+0000 7f4c6effd640 1 -- 10.20.193.91:0/771248003 >> v1:10.20.193.91:6789/0 conn(0x7f4c701575d0 legacy=0x7f4c70162c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:23.410 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.400+0000 7f4c6effd640 10 monclient: _finish_hunting 0 2026-02-12T04:05:23.410 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.400+0000 7f4c6effd640 1 monclient: found mon.noname-b 2026-02-12T04:05:23.410 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.400+0000 7f4c6effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:05:23.410 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.400+0000 7f4c6effd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T04:05:23.410 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.400+0000 7f4c6effd640 1 -- 10.20.193.91:0/771248003 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c70162400 con 0x7f4c700560d0 2026-02-12T04:05:23.410 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.400+0000 7f4c6effd640 10 monclient: _finish_auth 0 2026-02-12T04:05:23.410 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.400+0000 7f4c6effd640 10 monclient: _check_auth_tickets 2026-02-12T04:05:23.410 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.400+0000 7f4c6effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:05:23.410 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.400+0000 7f4c6effd640 1 -- 10.20.193.91:0/771248003 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f4c64003170 con 0x7f4c700560d0 2026-02-12T04:05:23.410 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.400+0000 7f4c6effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:23.411 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.400+0000 7f4c6effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T04:05:23.411 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.400+0000 7f4c6effd640 10 monclient: dump: 2026-02-12T04:05:23.411 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:23.411 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:23.411 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:23.411 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:23.411 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:23.411 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:23.411 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:23.411 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:23.411 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:23.411 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:23.412 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.400+0000 7f4c764c0640 5 monclient: authenticate success, global_id 27952 2026-02-12T04:05:23.412 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.400+0000 7f4c764c0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:05:23.412 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.401+0000 7f4c6effd640 1 -- 10.20.193.91:0/771248003 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4c64003340 con 0x7f4c700560d0 2026-02-12T04:05:23.412 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.401+0000 7f4c6effd640 10 monclient: handle_config config(0 keys) 2026-02-12T04:05:23.412 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.401+0000 7f4c6effd640 1 -- 10.20.193.91:0/771248003 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f4c64003780 con 0x7f4c700560d0 2026-02-12T04:05:23.412 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.401+0000 7f4c6effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:23.412 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.401+0000 7f4c6effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T04:05:23.412 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.401+0000 7f4c6effd640 10 monclient: dump: 2026-02-12T04:05:23.412 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:23.412 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:23.412 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:23.412 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:23.413 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:23.413 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:23.413 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:23.413 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:23.413 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:23.413 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:23.413 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.401+0000 7f4c764c0640 10 monclient: get_monmap_and_config success 2026-02-12T04:05:23.413 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.401+0000 7f4c764c0640 4 set_mon_vals no callback set 2026-02-12T04:05:23.413 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.401+0000 7f4c764c0640 10 monclient: shutdown 2026-02-12T04:05:23.413 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.401+0000 7f4c764c0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:05:23.413 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.401+0000 7f4c764c0640 1 -- 10.20.193.91:0/771248003 >> v1:10.20.193.98:6789/0 conn(0x7f4c700560d0 legacy=0x7f4c701c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:23.413 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.401+0000 7f4c764c0640 1 -- 10.20.193.91:0/771248003 shutdown_connections 2026-02-12T04:05:23.414 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.401+0000 7f4c764c0640 1 -- 10.20.193.91:0/771248003 >> 10.20.193.91:0/771248003 conn(0x7f4c700b6560 msgr2=0x7f4c700b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:05:23.414 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.401+0000 7f4c764c0640 1 -- 10.20.193.91:0/771248003 shutdown_connections 2026-02-12T04:05:23.414 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.401+0000 7f4c764c0640 1 -- 10.20.193.91:0/771248003 wait complete. 2026-02-12T04:05:23.414 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.401+0000 7f4c764c0640 10 monclient: build_initial_monmap 2026-02-12T04:05:23.414 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.401+0000 7f4c764c0640 10 monclient: monmap: 2026-02-12T04:05:23.414 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:05:23.414 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:05:23.414 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:05:23.414 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:05:23.414 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:05:23.414 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:05:23.414 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:05:23.414 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:05:23.415 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:05:23.415 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:23.415 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.401+0000 7f4c764c0640 1 librados: starting msgr at 2026-02-12T04:05:23.415 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.401+0000 7f4c764c0640 1 librados: starting objecter 2026-02-12T04:05:23.415 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.401+0000 7f4c764c0640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:05:23.415 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.402+0000 7f4c764c0640 1 Processor -- start 2026-02-12T04:05:23.415 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.402+0000 7f4c764c0640 1 -- start start 2026-02-12T04:05:23.415 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.402+0000 7f4c764c0640 1 librados: setting wanted keys 2026-02-12T04:05:23.415 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.402+0000 7f4c764c0640 1 librados: calling monclient init 2026-02-12T04:05:23.415 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.402+0000 7f4c764c0640 10 monclient: init 2026-02-12T04:05:23.415 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.402+0000 7f4c764c0640 10 monclient: _reopen_session rank -1 2026-02-12T04:05:23.415 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.402+0000 7f4c764c0640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-12T04:05:23.415 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.402+0000 7f4c764c0640 10 monclient(hunting): picked mon.noname-a con 0x7f4c700560d0 addr v1:10.20.193.91:6789/0 2026-02-12T04:05:23.415 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.402+0000 7f4c764c0640 10 monclient(hunting): picked mon.noname-b con 0x7f4c701575d0 addr v1:10.20.193.98:6789/0 2026-02-12T04:05:23.416 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.402+0000 7f4c764c0640 10 monclient(hunting): picked mon.noname-c con 0x7f4c70163310 addr v1:10.20.193.111:6789/0 2026-02-12T04:05:23.416 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.402+0000 7f4c764c0640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c7011d510 con 0x7f4c700560d0 2026-02-12T04:05:23.416 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.402+0000 7f4c764c0640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c7005d230 con 0x7f4c701575d0 2026-02-12T04:05:23.416 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.402+0000 7f4c764c0640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c7005d510 con 0x7f4c70163310 2026-02-12T04:05:23.416 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.402+0000 7f4c764c0640 10 monclient(hunting): _renew_subs 2026-02-12T04:05:23.416 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.402+0000 7f4c764c0640 10 monclient(hunting): authenticate will time out at 1526.146435s 2026-02-12T04:05:23.416 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.402+0000 7f4c6ffff640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7f4c700560d0 0x7f4c70160330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:37972/0 (socket says 10.20.193.91:37972) 2026-02-12T04:05:23.416 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.402+0000 7f4c6ffff640 1 -- 10.20.193.91:0/570068919 learned_addr learned my addr 10.20.193.91:0/570068919 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:05:23.416 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.402+0000 7f4c6cff9640 10 client.?.objecter ms_handle_connect 0x7f4c700560d0 2026-02-12T04:05:23.416 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.402+0000 7f4c6cff9640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:23.416 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.402+0000 7f4c6cff9640 10 client.?.objecter ms_handle_connect 0x7f4c701575d0 2026-02-12T04:05:23.416 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.402+0000 7f4c6cff9640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:23.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.403+0000 7f4c6cff9640 10 client.?.objecter ms_handle_connect 0x7f4c70163310 2026-02-12T04:05:23.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.403+0000 7f4c6cff9640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:23.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.403+0000 7f4c6cff9640 1 -- 10.20.193.91:0/570068919 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2815536169 0 0) 0x7f4c7011d510 con 0x7f4c700560d0 2026-02-12T04:05:23.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.403+0000 7f4c6cff9640 10 monclient(hunting): _negotiate 2026-02-12T04:05:23.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.403+0000 7f4c6cff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:23.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.403+0000 7f4c6cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:23.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.403+0000 7f4c6cff9640 10 monclient(hunting): my global_id is 30822 2026-02-12T04:05:23.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.403+0000 7f4c6cff9640 1 -- 10.20.193.91:0/570068919 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c40003610 con 0x7f4c700560d0 2026-02-12T04:05:23.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.404+0000 7f4c6cff9640 1 -- 10.20.193.91:0/570068919 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3775412082 0 0) 0x7f4c7005d230 con 0x7f4c701575d0 2026-02-12T04:05:23.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.404+0000 7f4c6cff9640 10 monclient(hunting): _negotiate 2026-02-12T04:05:23.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.404+0000 7f4c6cff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:23.417 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.404+0000 7f4c6cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:23.418 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.404+0000 7f4c6cff9640 10 monclient(hunting): my global_id is 27955 2026-02-12T04:05:23.418 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.404+0000 7f4c6cff9640 1 -- 10.20.193.91:0/570068919 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c7011d510 con 0x7f4c701575d0 2026-02-12T04:05:23.418 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.404+0000 7f4c6cff9640 1 -- 10.20.193.91:0/570068919 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2032264862 0 0) 0x7f4c7005d510 con 0x7f4c70163310 2026-02-12T04:05:23.418 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.404+0000 7f4c6cff9640 10 monclient(hunting): _negotiate 2026-02-12T04:05:23.418 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.404+0000 7f4c6cff9640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:23.418 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.404+0000 7f4c6cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:23.418 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.404+0000 7f4c6cff9640 10 monclient(hunting): my global_id is 27653 2026-02-12T04:05:23.418 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.404+0000 7f4c6cff9640 1 -- 10.20.193.91:0/570068919 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c7005d230 con 0x7f4c70163310 2026-02-12T04:05:23.418 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.406+0000 7f4c6cff9640 1 -- 10.20.193.91:0/570068919 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 975770669 0 0) 0x7f4c7005d230 con 0x7f4c70163310 2026-02-12T04:05:23.418 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.406+0000 7f4c6cff9640 1 -- 10.20.193.91:0/570068919 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4c7005d510 con 0x7f4c70163310 2026-02-12T04:05:23.418 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.406+0000 7f4c6cff9640 1 -- 10.20.193.91:0/570068919 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f4c64003690 con 0x7f4c70163310 2026-02-12T04:05:23.418 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.406+0000 7f4c6cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:23.418 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.406+0000 7f4c6cff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T04:05:23.418 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.406+0000 7f4c6cff9640 10 monclient(hunting): dump: 2026-02-12T04:05:23.419 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:23.419 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:23.419 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:23.419 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:23.419 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:23.419 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:23.419 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:23.419 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:23.419 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:23.419 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:23.419 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.406+0000 7f4c6cff9640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:05:23.419 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.406+0000 7f4c6cff9640 1 -- 10.20.193.91:0/570068919 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1625932155 0 0) 0x7f4c40003610 con 0x7f4c700560d0 2026-02-12T04:05:23.419 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.406+0000 7f4c6cff9640 1 -- 10.20.193.91:0/570068919 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4c7005d230 con 0x7f4c700560d0 2026-02-12T04:05:23.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.406+0000 7f4c6cff9640 1 -- 10.20.193.91:0/570068919 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f4c5c0030b0 con 0x7f4c700560d0 2026-02-12T04:05:23.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.406+0000 7f4c6cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:23.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.406+0000 7f4c6cff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T04:05:23.420 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.406+0000 7f4c6cff9640 10 monclient(hunting): dump: 2026-02-12T04:05:23.420 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:23.420 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:23.420 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:23.420 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:23.420 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:23.420 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:23.420 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:23.420 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:23.421 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:23.421 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:23.421 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.406+0000 7f4c6cff9640 1 -- 10.20.193.91:0/570068919 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1125041695 0 0) 0x7f4c7011d510 con 0x7f4c701575d0 2026-02-12T04:05:23.421 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.406+0000 7f4c6cff9640 1 -- 10.20.193.91:0/570068919 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4c40003610 con 0x7f4c701575d0 2026-02-12T04:05:23.421 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.406+0000 7f4c6cff9640 1 -- 10.20.193.91:0/570068919 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f4c60002fb0 con 0x7f4c701575d0 2026-02-12T04:05:23.421 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.406+0000 7f4c6cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:23.421 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.406+0000 7f4c6cff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-12T04:05:23.421 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.406+0000 7f4c6cff9640 10 monclient(hunting): dump: 2026-02-12T04:05:23.421 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:23.421 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:23.421 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:23.421 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:23.421 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:23.422 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:23.422 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:23.422 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:23.422 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:23.422 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:23.424 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.408+0000 7f4c6cff9640 1 -- 10.20.193.91:0/570068919 <== mon.2 v1:10.20.193.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2791885071 0 0) 0x7f4c7005d510 con 0x7f4c70163310 2026-02-12T04:05:23.424 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.408+0000 7f4c6cff9640 1 -- 10.20.193.91:0/570068919 >> v1:10.20.193.98:6789/0 conn(0x7f4c701575d0 legacy=0x7f4c700b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:23.425 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.408+0000 7f4c6cff9640 1 -- 10.20.193.91:0/570068919 >> v1:10.20.193.91:6789/0 conn(0x7f4c700560d0 legacy=0x7f4c70160330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:23.425 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.408+0000 7f4c6cff9640 10 monclient: _finish_hunting 0 2026-02-12T04:05:23.425 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.408+0000 7f4c6cff9640 1 monclient: found mon.c 2026-02-12T04:05:23.425 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.408+0000 7f4c6cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:05:23.425 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.408+0000 7f4c6cff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:05:23.425 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.408+0000 7f4c6cff9640 1 -- 10.20.193.91:0/570068919 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c70142d90 con 0x7f4c70163310 2026-02-12T04:05:23.425 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.408+0000 7f4c6cff9640 10 monclient: _finish_auth 0 2026-02-12T04:05:23.425 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.408+0000 7f4c6cff9640 10 monclient: _check_auth_tickets 2026-02-12T04:05:23.425 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.408+0000 7f4c6cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:05:23.425 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.408+0000 7f4c764c0640 5 monclient: authenticate success, global_id 27653 2026-02-12T04:05:23.425 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.408+0000 7f4c764c0640 10 monclient: _renew_subs 2026-02-12T04:05:23.425 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.408+0000 7f4c764c0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:05:23.425 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.408+0000 7f4c764c0640 1 -- 10.20.193.91:0/570068919 --> v1:10.20.193.111:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4c70143070 con 0x7f4c70163310 2026-02-12T04:05:23.426 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.408+0000 7f4c764c0640 10 client.27653.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:05:23.426 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.408+0000 7f4c764c0640 10 monclient: _renew_subs 2026-02-12T04:05:23.426 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.408+0000 7f4c764c0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:05:23.426 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.408+0000 7f4c764c0640 1 -- 10.20.193.91:0/570068919 --> v1:10.20.193.111:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4c70143870 con 0x7f4c70163310 2026-02-12T04:05:23.426 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.408+0000 7f4c764c0640 1 librados: init done 2026-02-12T04:05:23.426 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.408+0000 7f4c764c0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T04:05:23.426 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.408+0000 7f4c764c0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:05:23.426 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.408+0000 7f4c764c0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.111:6789/0 2026-02-12T04:05:23.426 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.408+0000 7f4c764c0640 1 -- 10.20.193.91:0/570068919 --> v1:10.20.193.111:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c70143b50 con 0x7f4c70163310 2026-02-12T04:05:23.426 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.416+0000 7f4c6cff9640 1 -- 10.20.193.91:0/570068919 <== mon.2 v1:10.20.193.111:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4c640032f0 con 0x7f4c70163310 2026-02-12T04:05:23.426 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.416+0000 7f4c6cff9640 10 monclient: handle_config config(0 keys) 2026-02-12T04:05:23.426 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.416+0000 7f4c6cff9640 1 -- 10.20.193.91:0/570068919 <== mon.2 v1:10.20.193.111:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7f4c64003e80 con 0x7f4c70163310 2026-02-12T04:05:23.427 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.416+0000 7f4c6cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:23.427 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.416+0000 7f4c6cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T04:05:23.427 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.416+0000 7f4c6cff9640 10 monclient: dump: 2026-02-12T04:05:23.427 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:23.427 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:23.427 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:23.427 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:23.427 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:23.427 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:23.427 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:23.427 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:23.427 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:23.427 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:23.428 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.416+0000 7f4c6e7fc640 4 set_mon_vals no callback set 2026-02-12T04:05:23.428 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.417+0000 7f4c6cff9640 1 -- 10.20.193.91:0/570068919 <== mon.2 v1:10.20.193.111:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7f4c6401d360 con 0x7f4c70163310 2026-02-12T04:05:23.428 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.418+0000 7f4c6ffff640 10 monclient: get_auth_request con 0x7f4c4007a090 auth_method 0 2026-02-12T04:05:23.428 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.418+0000 7f4c6cff9640 10 client.27653.objecter ms_handle_connect 0x7f4c4007a090 2026-02-12T04:05:23.428 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.418+0000 7f4c6cff9640 1 -- 10.20.193.91:0/570068919 <== mon.2 v1:10.20.193.111:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7f4c64094a90 con 0x7f4c70163310 2026-02-12T04:05:23.428 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.418+0000 7f4c6cff9640 10 client.27653.objecter ms_dispatch2 0x7f4c70000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:05:23.428 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.418+0000 7f4c6cff9640 3 client.27653.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:05:23.428 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.418+0000 7f4c6cff9640 3 client.27653.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:05:23.428 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.418+0000 7f4c6cff9640 20 client.27653.objecter dump_active .. 0 homeless 2026-02-12T04:05:23.509 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.507+0000 7f4c6cff9640 1 -- 10.20.193.91:0/570068919 <== mon.2 v1:10.20.193.111:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7f4c6405e3f0 con 0x7f4c70163310 2026-02-12T04:05:23.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.507+0000 7f4c6cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:05:23.510 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.507+0000 7f4c6cff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T04:05:23.616 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.614+0000 7f4c764c0640 1 -- 10.20.193.91:0/570068919 --> v1:10.20.193.91:6800/2929217192 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4c7005cfe0 con 0x7f4c4007a090 2026-02-12T04:05:23.617 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.615+0000 7f4c6cff9640 1 -- 10.20.193.91:0/570068919 <== mgr.4113 v1:10.20.193.91:6800/2929217192 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+125563 (unknown 2965378022 0 604013836) 0x7f4c7005cfe0 con 0x7f4c4007a090 2026-02-12T04:05:23.619 INFO:teuthology.orchestra.run.trial091.stdout: 2026-02-12T04:05:23.620 INFO:teuthology.orchestra.run.trial091.stderr:dumped all 2026-02-12T04:05:23.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.616+0000 7f4c764c0640 10 librados: watch_flush enter 2026-02-12T04:05:23.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.616+0000 7f4c764c0640 10 librados: watch_flush exit 2026-02-12T04:05:23.621 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.616+0000 7f4c764c0640 20 client.27653.objecter shutdown clearing up homeless session... 2026-02-12T04:05:23.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.616+0000 7f4c764c0640 10 client.27653.objecter successfully canceled tick 2026-02-12T04:05:23.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.616+0000 7f4c764c0640 1 -- 10.20.193.91:0/570068919 >> v1:10.20.193.91:6800/2929217192 conn(0x7f4c4007a090 legacy=0x7f4c4009a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:23.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.616+0000 7f4c764c0640 10 monclient: shutdown 2026-02-12T04:05:23.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.616+0000 7f4c764c0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:05:23.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.616+0000 7f4c764c0640 1 -- 10.20.193.91:0/570068919 >> v1:10.20.193.111:6789/0 conn(0x7f4c70163310 legacy=0x7f4c7011ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:23.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.616+0000 7f4c764c0640 1 -- 10.20.193.91:0/570068919 shutdown_connections 2026-02-12T04:05:23.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.616+0000 7f4c764c0640 1 -- 10.20.193.91:0/570068919 >> 10.20.193.91:0/570068919 conn(0x7f4c700b6560 msgr2=0x7f4c700559c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:05:23.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.616+0000 7f4c764c0640 1 -- 10.20.193.91:0/570068919 shutdown_connections 2026-02-12T04:05:23.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.617+0000 7f4c764c0640 1 -- 10.20.193.91:0/570068919 wait complete. 2026-02-12T04:05:23.622 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.617+0000 7f4c764c0640 1 librados: shutdown 2026-02-12T04:05:23.628 INFO:teuthology.orchestra.run.trial091.stdout:{"pg_ready":true,"pg_map":{"version":551,"stamp":"2026-02-12T04:05:22.093076+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":56,"num_read_kb":47,"num_write":70,"num_write_kb":597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":16,"num_per_pool_osds":16,"num_per_pool_omap_osds":16,"kb":1509949440,"kb_used":492568,"kb_used_data":61208,"kb_used_omap":24502,"kb_used_meta":406601,"kb_avail":1509456872,"statfs":{"total":1546188226560,"available":1545683836928,"internally_reserved":0,"allocated":62676992,"data_stored":70134512,"data_compressed":12830400,"data_compressed_allocated":23265280,"data_compressed_original":60084192,"omap_allocated":25090979,"internal_metadata":416359517},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001803"},"pg_stats":[{"pgid":"10.1a","version":"0'0","reported_seq":640,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:05:04.209541+0000","last_change":"2026-02-12T04:05:04.209541+0000","last_active":"2026-02-12T04:05:04.209541+0000","last_peered":"2026-02-12T04:05:04.209541+0000","last_clean":"2026-02-12T04:05:04.209541+0000","last_became_active":"2026-02-12T03:59:14.484825+0000","last_became_peered":"2026-02-12T03:59:14.484825+0000","last_unstale":"2026-02-12T04:05:04.209541+0000","last_undegraded":"2026-02-12T04:05:04.209541+0000","last_fullsized":"2026-02-12T04:05:04.209541+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:05:04.208647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:05:04.208647+0000","last_clean_scrub_stamp":"2026-02-12T04:05:04.208647+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T07:08:05.005499+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6],"acting":[11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":644,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:05:04.607017+0000","last_change":"2026-02-12T04:05:04.607017+0000","last_active":"2026-02-12T04:05:04.607017+0000","last_peered":"2026-02-12T04:05:04.607017+0000","last_clean":"2026-02-12T04:05:04.607017+0000","last_became_active":"2026-02-12T03:59:13.250886+0000","last_became_peered":"2026-02-12T03:59:13.250886+0000","last_unstale":"2026-02-12T04:05:04.607017+0000","last_undegraded":"2026-02-12T04:05:04.607017+0000","last_fullsized":"2026-02-12T04:05:04.607017+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:05:04.606169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:05:04.606169+0000","last_clean_scrub_stamp":"2026-02-12T04:05:04.606169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T07:59:57.672100+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,0],"acting":[15,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":638,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:57.326948+0000","last_change":"2026-02-12T04:04:57.326948+0000","last_active":"2026-02-12T04:04:57.326948+0000","last_peered":"2026-02-12T04:04:57.326948+0000","last_clean":"2026-02-12T04:04:57.326948+0000","last_became_active":"2026-02-12T03:59:13.540079+0000","last_became_peered":"2026-02-12T03:59:13.540079+0000","last_unstale":"2026-02-12T04:04:57.326948+0000","last_undegraded":"2026-02-12T04:04:57.326948+0000","last_fullsized":"2026-02-12T04:04:57.326948+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:04:57.324857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:04:57.324857+0000","last_clean_scrub_stamp":"2026-02-12T04:04:57.324857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:16:43.845781+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,14],"acting":[4,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":640,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:05:05.703143+0000","last_change":"2026-02-12T04:05:05.703143+0000","last_active":"2026-02-12T04:05:05.703143+0000","last_peered":"2026-02-12T04:05:05.703143+0000","last_clean":"2026-02-12T04:05:05.703143+0000","last_became_active":"2026-02-12T03:59:13.054800+0000","last_became_peered":"2026-02-12T03:59:13.054800+0000","last_unstale":"2026-02-12T04:05:05.703143+0000","last_undegraded":"2026-02-12T04:05:05.703143+0000","last_fullsized":"2026-02-12T04:05:05.703143+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:05:05.701338+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:05:05.701338+0000","last_clean_scrub_stamp":"2026-02-12T04:05:05.701338+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T12:46:11.379644+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":644,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:05:03.720917+0000","last_change":"2026-02-12T04:05:03.720917+0000","last_active":"2026-02-12T04:05:03.720917+0000","last_peered":"2026-02-12T04:05:03.720917+0000","last_clean":"2026-02-12T04:05:03.720917+0000","last_became_active":"2026-02-12T03:59:13.246053+0000","last_became_peered":"2026-02-12T03:59:13.246053+0000","last_unstale":"2026-02-12T04:05:03.720917+0000","last_undegraded":"2026-02-12T04:05:03.720917+0000","last_fullsized":"2026-02-12T04:05:03.720917+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:05:03.716142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:05:03.716142+0000","last_clean_scrub_stamp":"2026-02-12T04:05:03.716142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T06:55:37.146700+0000","scrub_duration":90,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[15,7],"acting":[15,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":15,"acting_primary":15,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":640,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:05:04.651157+0000","last_change":"2026-02-12T04:05:04.651157+0000","last_active":"2026-02-12T04:05:04.651157+0000","last_peered":"2026-02-12T04:05:04.651157+0000","last_clean":"2026-02-12T04:05:04.651157+0000","last_became_active":"2026-02-12T03:59:13.325110+0000","last_became_peered":"2026-02-12T03:59:13.325110+0000","last_unstale":"2026-02-12T04:05:04.651157+0000","last_undegraded":"2026-02-12T04:05:04.651157+0000","last_fullsized":"2026-02-12T04:05:04.651157+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:05:04.650303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:05:04.650303+0000","last_clean_scrub_stamp":"2026-02-12T04:05:04.650303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T11:02:53.615124+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":639,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:05:00.631328+0000","last_change":"2026-02-12T04:05:00.631328+0000","last_active":"2026-02-12T04:05:00.631328+0000","last_peered":"2026-02-12T04:05:00.631328+0000","last_clean":"2026-02-12T04:05:00.631328+0000","last_became_active":"2026-02-12T03:59:13.466259+0000","last_became_peered":"2026-02-12T03:59:13.466259+0000","last_unstale":"2026-02-12T04:05:00.631328+0000","last_undegraded":"2026-02-12T04:05:00.631328+0000","last_fullsized":"2026-02-12T04:05:00.631328+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:05:00.626744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:05:00.626744+0000","last_clean_scrub_stamp":"2026-02-12T04:05:00.626744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T07:48:46.783920+0000","scrub_duration":92,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9],"acting":[6,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":639,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:05:01.499145+0000","last_change":"2026-02-12T04:05:01.499145+0000","last_active":"2026-02-12T04:05:01.499145+0000","last_peered":"2026-02-12T04:05:01.499145+0000","last_clean":"2026-02-12T04:05:01.499145+0000","last_became_active":"2026-02-12T03:59:13.497818+0000","last_became_peered":"2026-02-12T03:59:13.497818+0000","last_unstale":"2026-02-12T04:05:01.499145+0000","last_undegraded":"2026-02-12T04:05:01.499145+0000","last_fullsized":"2026-02-12T04:05:01.499145+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:05:01.498362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:05:01.498362+0000","last_clean_scrub_stamp":"2026-02-12T04:05:01.498362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T04:11:53.791882+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":640,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:05:02.135955+0000","last_change":"2026-02-12T04:05:02.135955+0000","last_active":"2026-02-12T04:05:02.135955+0000","last_peered":"2026-02-12T04:05:02.135955+0000","last_clean":"2026-02-12T04:05:02.135955+0000","last_became_active":"2026-02-12T03:59:13.116472+0000","last_became_peered":"2026-02-12T03:59:13.116472+0000","last_unstale":"2026-02-12T04:05:02.135955+0000","last_undegraded":"2026-02-12T04:05:02.135955+0000","last_fullsized":"2026-02-12T04:05:02.135955+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:05:02.134362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:05:02.134362+0000","last_clean_scrub_stamp":"2026-02-12T04:05:02.134362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T07:04:20.194261+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,3],"acting":[14,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":640,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:05:02.791683+0000","last_change":"2026-02-12T04:05:02.791683+0000","last_active":"2026-02-12T04:05:02.791683+0000","last_peered":"2026-02-12T04:05:02.791683+0000","last_clean":"2026-02-12T04:05:02.791683+0000","last_became_active":"2026-02-12T03:59:13.088475+0000","last_became_peered":"2026-02-12T03:59:13.088475+0000","last_unstale":"2026-02-12T04:05:02.791683+0000","last_undegraded":"2026-02-12T04:05:02.791683+0000","last_fullsized":"2026-02-12T04:05:02.791683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:05:02.786788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:05:02.786788+0000","last_clean_scrub_stamp":"2026-02-12T04:05:02.786788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T04:16:20.799848+0000","scrub_duration":89,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9],"acting":[7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":641,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:58.532414+0000","last_change":"2026-02-12T04:04:58.531579+0000","last_active":"2026-02-12T04:04:58.532414+0000","last_peered":"2026-02-12T04:04:58.532414+0000","last_clean":"2026-02-12T04:04:58.532414+0000","last_became_active":"2026-02-12T03:59:14.947424+0000","last_became_peered":"2026-02-12T03:59:14.947424+0000","last_unstale":"2026-02-12T04:04:58.532414+0000","last_undegraded":"2026-02-12T04:04:58.532414+0000","last_fullsized":"2026-02-12T04:04:58.532414+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:04:58.526184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:04:58.526184+0000","last_clean_scrub_stamp":"2026-02-12T04:04:58.526184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T07:22:21.611097+0000","scrub_duration":97,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,11],"acting":[12,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"10.1","version":"344'12","reported_seq":669,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:05:02.302261+0000","last_change":"2026-02-12T04:05:02.302261+0000","last_active":"2026-02-12T04:05:02.302261+0000","last_peered":"2026-02-12T04:05:02.302261+0000","last_clean":"2026-02-12T04:05:02.302261+0000","last_became_active":"2026-02-12T03:59:13.846131+0000","last_became_peered":"2026-02-12T03:59:13.846131+0000","last_unstale":"2026-02-12T04:05:02.302261+0000","last_undegraded":"2026-02-12T04:05:02.302261+0000","last_fullsized":"2026-02-12T04:05:02.302261+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"344'12","last_scrub_stamp":"2026-02-12T04:05:02.301515+0000","last_deep_scrub":"344'12","last_deep_scrub_stamp":"2026-02-12T04:05:02.301515+0000","last_clean_scrub_stamp":"2026-02-12T04:05:02.301515+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:23:10.013733+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,7],"acting":[10,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"1.0","version":"344'34","reported_seq":701,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:05:00.538974+0000","last_change":"2026-02-12T04:05:00.538974+0000","last_active":"2026-02-12T04:05:00.538974+0000","last_peered":"2026-02-12T04:05:00.538974+0000","last_clean":"2026-02-12T04:05:00.538974+0000","last_became_active":"2026-02-12T03:58:33.819911+0000","last_became_peered":"2026-02-12T03:58:33.819911+0000","last_unstale":"2026-02-12T04:05:00.538974+0000","last_undegraded":"2026-02-12T04:05:00.538974+0000","last_fullsized":"2026-02-12T04:05:00.538974+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"344'34","last_scrub_stamp":"2026-02-12T04:05:00.537125+0000","last_deep_scrub":"344'34","last_deep_scrub_stamp":"2026-02-12T04:05:00.537125+0000","last_clean_scrub_stamp":"2026-02-12T04:05:00.537125+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T10:46:03.522550+0000","scrub_duration":53,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,15],"acting":[2,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"344'2","reported_seq":662,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:58.673919+0000","last_change":"2026-02-12T04:04:58.673919+0000","last_active":"2026-02-12T04:04:58.673919+0000","last_peered":"2026-02-12T04:04:58.673919+0000","last_clean":"2026-02-12T04:04:58.673919+0000","last_became_active":"2026-02-12T03:58:42.128882+0000","last_became_peered":"2026-02-12T03:58:42.128882+0000","last_unstale":"2026-02-12T04:04:58.673919+0000","last_undegraded":"2026-02-12T04:04:58.673919+0000","last_fullsized":"2026-02-12T04:04:58.673919+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"344'2","last_scrub_stamp":"2026-02-12T04:04:58.672160+0000","last_deep_scrub":"344'2","last_deep_scrub_stamp":"2026-02-12T04:04:58.672160+0000","last_clean_scrub_stamp":"2026-02-12T04:04:58.672160+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T13:50:22.719038+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0.058002405,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,6],"acting":[8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":642,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:05:03.255298+0000","last_change":"2026-02-12T04:05:03.255298+0000","last_active":"2026-02-12T04:05:03.255298+0000","last_peered":"2026-02-12T04:05:03.255298+0000","last_clean":"2026-02-12T04:05:03.255298+0000","last_became_active":"2026-02-12T03:59:13.918494+0000","last_became_peered":"2026-02-12T03:59:13.918494+0000","last_unstale":"2026-02-12T04:05:03.255298+0000","last_undegraded":"2026-02-12T04:05:03.255298+0000","last_fullsized":"2026-02-12T04:05:03.255298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:05:03.253483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:05:03.253483+0000","last_clean_scrub_stamp":"2026-02-12T04:05:03.253483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T07:23:01.807647+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":656,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:56.663872+0000","last_change":"2026-02-12T04:04:56.663872+0000","last_active":"2026-02-12T04:04:56.663872+0000","last_peered":"2026-02-12T04:04:56.663872+0000","last_clean":"2026-02-12T04:04:56.663872+0000","last_became_active":"2026-02-12T03:58:42.530615+0000","last_became_peered":"2026-02-12T03:58:42.530615+0000","last_unstale":"2026-02-12T04:04:56.663872+0000","last_undegraded":"2026-02-12T04:04:56.663872+0000","last_fullsized":"2026-02-12T04:04:56.663872+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:04:56.662073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:04:56.662073+0000","last_clean_scrub_stamp":"2026-02-12T04:04:56.662073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T08:16:37.169210+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0.030042276999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11],"acting":[0,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":640,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:05:03.668478+0000","last_change":"2026-02-12T04:05:03.668478+0000","last_active":"2026-02-12T04:05:03.668478+0000","last_peered":"2026-02-12T04:05:03.668478+0000","last_clean":"2026-02-12T04:05:03.668478+0000","last_became_active":"2026-02-12T03:59:12.992488+0000","last_became_peered":"2026-02-12T03:59:12.992488+0000","last_unstale":"2026-02-12T04:05:03.668478+0000","last_undegraded":"2026-02-12T04:05:03.668478+0000","last_fullsized":"2026-02-12T04:05:03.668478+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:05:03.666583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:05:03.666583+0000","last_clean_scrub_stamp":"2026-02-12T04:05:03.666583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:19:16.898982+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,13],"acting":[7,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":661,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:59.441733+0000","last_change":"2026-02-12T04:04:59.441733+0000","last_active":"2026-02-12T04:04:59.441733+0000","last_peered":"2026-02-12T04:04:59.441733+0000","last_clean":"2026-02-12T04:04:59.441733+0000","last_became_active":"2026-02-12T03:58:42.143466+0000","last_became_peered":"2026-02-12T03:58:42.143466+0000","last_unstale":"2026-02-12T04:04:59.441733+0000","last_undegraded":"2026-02-12T04:04:59.441733+0000","last_fullsized":"2026-02-12T04:04:59.441733+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:04:59.436514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:04:59.436514+0000","last_clean_scrub_stamp":"2026-02-12T04:04:59.436514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T07:59:32.274773+0000","scrub_duration":122,"objects_trimmed":0,"snaptrim_duration":0.030228985,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":638,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:57.663067+0000","last_change":"2026-02-12T04:04:57.663067+0000","last_active":"2026-02-12T04:04:57.663067+0000","last_peered":"2026-02-12T04:04:57.663067+0000","last_clean":"2026-02-12T04:04:57.663067+0000","last_became_active":"2026-02-12T03:59:13.207238+0000","last_became_peered":"2026-02-12T03:59:13.207238+0000","last_unstale":"2026-02-12T04:04:57.663067+0000","last_undegraded":"2026-02-12T04:04:57.663067+0000","last_fullsized":"2026-02-12T04:04:57.663067+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:04:57.660987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:04:57.660987+0000","last_clean_scrub_stamp":"2026-02-12T04:04:57.660987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T14:25:58.584105+0000","scrub_duration":37,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"344'3","reported_seq":663,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:57.729197+0000","last_change":"2026-02-12T04:04:57.728469+0000","last_active":"2026-02-12T04:04:57.729197+0000","last_peered":"2026-02-12T04:04:57.729197+0000","last_clean":"2026-02-12T04:04:57.729197+0000","last_became_active":"2026-02-12T03:58:42.443435+0000","last_became_peered":"2026-02-12T03:58:42.443435+0000","last_unstale":"2026-02-12T04:04:57.729197+0000","last_undegraded":"2026-02-12T04:04:57.729197+0000","last_fullsized":"2026-02-12T04:04:57.729197+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"344'3","last_scrub_stamp":"2026-02-12T04:04:57.727426+0000","last_deep_scrub":"344'3","last_deep_scrub_stamp":"2026-02-12T04:04:57.727426+0000","last_clean_scrub_stamp":"2026-02-12T04:04:57.727426+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:59:46.094093+0000","scrub_duration":82,"objects_trimmed":0,"snaptrim_duration":0.069533228000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11],"acting":[8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":634,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:58.755794+0000","last_change":"2026-02-12T04:04:58.755794+0000","last_active":"2026-02-12T04:04:58.755794+0000","last_peered":"2026-02-12T04:04:58.755794+0000","last_clean":"2026-02-12T04:04:58.755794+0000","last_became_active":"2026-02-12T03:59:13.221176+0000","last_became_peered":"2026-02-12T03:59:13.221176+0000","last_unstale":"2026-02-12T04:04:58.755794+0000","last_undegraded":"2026-02-12T04:04:58.755794+0000","last_fullsized":"2026-02-12T04:04:58.755794+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:04:58.754081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:04:58.754081+0000","last_clean_scrub_stamp":"2026-02-12T04:04:58.754081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T08:28:45.746274+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11],"acting":[1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":654,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:05:01.878423+0000","last_change":"2026-02-12T04:05:01.878423+0000","last_active":"2026-02-12T04:05:01.878423+0000","last_peered":"2026-02-12T04:05:01.878423+0000","last_clean":"2026-02-12T04:05:01.878423+0000","last_became_active":"2026-02-12T03:58:42.128705+0000","last_became_peered":"2026-02-12T03:58:42.128705+0000","last_unstale":"2026-02-12T04:05:01.878423+0000","last_undegraded":"2026-02-12T04:05:01.878423+0000","last_fullsized":"2026-02-12T04:05:01.878423+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:05:01.876615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:05:01.876615+0000","last_clean_scrub_stamp":"2026-02-12T04:05:01.876615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T07:40:12.569840+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0.043458169999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":638,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:58.683241+0000","last_change":"2026-02-12T04:04:58.683241+0000","last_active":"2026-02-12T04:04:58.683241+0000","last_peered":"2026-02-12T04:04:58.683241+0000","last_clean":"2026-02-12T04:04:58.683241+0000","last_became_active":"2026-02-12T03:59:13.639048+0000","last_became_peered":"2026-02-12T03:59:13.639048+0000","last_unstale":"2026-02-12T04:04:58.683241+0000","last_undegraded":"2026-02-12T04:04:58.683241+0000","last_fullsized":"2026-02-12T04:04:58.683241+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:04:58.681415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:04:58.681415+0000","last_clean_scrub_stamp":"2026-02-12T04:04:58.681415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T06:24:56.704184+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,14],"acting":[0,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":654,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:05:02.846781+0000","last_change":"2026-02-12T04:05:02.846781+0000","last_active":"2026-02-12T04:05:02.846781+0000","last_peered":"2026-02-12T04:05:02.846781+0000","last_clean":"2026-02-12T04:05:02.846781+0000","last_became_active":"2026-02-12T03:58:42.477478+0000","last_became_peered":"2026-02-12T03:58:42.477478+0000","last_unstale":"2026-02-12T04:05:02.846781+0000","last_undegraded":"2026-02-12T04:05:02.846781+0000","last_fullsized":"2026-02-12T04:05:02.846781+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:05:02.844965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:05:02.844965+0000","last_clean_scrub_stamp":"2026-02-12T04:05:02.844965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T06:44:55.618949+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0.042443649,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":638,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:59.648224+0000","last_change":"2026-02-12T04:04:59.648224+0000","last_active":"2026-02-12T04:04:59.648224+0000","last_peered":"2026-02-12T04:04:59.648224+0000","last_clean":"2026-02-12T04:04:59.648224+0000","last_became_active":"2026-02-12T03:59:13.151732+0000","last_became_peered":"2026-02-12T03:59:13.151732+0000","last_unstale":"2026-02-12T04:04:59.648224+0000","last_undegraded":"2026-02-12T04:04:59.648224+0000","last_fullsized":"2026-02-12T04:04:59.648224+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:04:59.646125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:04:59.646125+0000","last_clean_scrub_stamp":"2026-02-12T04:04:59.646125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T05:57:42.459054+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":660,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:05:01.278880+0000","last_change":"2026-02-12T04:05:01.278132+0000","last_active":"2026-02-12T04:05:01.278880+0000","last_peered":"2026-02-12T04:05:01.278880+0000","last_clean":"2026-02-12T04:05:01.278880+0000","last_became_active":"2026-02-12T03:58:41.959956+0000","last_became_peered":"2026-02-12T03:58:41.959956+0000","last_unstale":"2026-02-12T04:05:01.278880+0000","last_undegraded":"2026-02-12T04:05:01.278880+0000","last_fullsized":"2026-02-12T04:05:01.278880+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:05:01.277237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:05:01.277237+0000","last_clean_scrub_stamp":"2026-02-12T04:05:01.277237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T05:50:13.618177+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0.032971485000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,15],"acting":[10,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":638,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:05:00.617318+0000","last_change":"2026-02-12T04:05:00.617318+0000","last_active":"2026-02-12T04:05:00.617318+0000","last_peered":"2026-02-12T04:05:00.617318+0000","last_clean":"2026-02-12T04:05:00.617318+0000","last_became_active":"2026-02-12T03:59:13.347203+0000","last_became_peered":"2026-02-12T03:59:13.347203+0000","last_unstale":"2026-02-12T04:05:00.617318+0000","last_undegraded":"2026-02-12T04:05:00.617318+0000","last_fullsized":"2026-02-12T04:05:00.617318+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:05:00.615518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:05:00.615518+0000","last_clean_scrub_stamp":"2026-02-12T04:05:00.615518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T12:13:32.126349+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8],"acting":[0,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":660,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:59.607428+0000","last_change":"2026-02-12T04:04:59.606765+0000","last_active":"2026-02-12T04:04:59.607428+0000","last_peered":"2026-02-12T04:04:59.607428+0000","last_clean":"2026-02-12T04:04:59.607428+0000","last_became_active":"2026-02-12T03:58:42.327696+0000","last_became_peered":"2026-02-12T03:58:42.327696+0000","last_unstale":"2026-02-12T04:04:59.607428+0000","last_undegraded":"2026-02-12T04:04:59.607428+0000","last_fullsized":"2026-02-12T04:04:59.607428+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:04:59.605018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:04:59.605018+0000","last_clean_scrub_stamp":"2026-02-12T04:04:59.605018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T12:31:43.025819+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0.065547275000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,14],"acting":[8,14],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":640,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:05:03.123197+0000","last_change":"2026-02-12T04:05:03.123197+0000","last_active":"2026-02-12T04:05:03.123197+0000","last_peered":"2026-02-12T04:05:03.123197+0000","last_clean":"2026-02-12T04:05:03.123197+0000","last_became_active":"2026-02-12T03:59:14.917311+0000","last_became_peered":"2026-02-12T03:59:14.917311+0000","last_unstale":"2026-02-12T04:05:03.123197+0000","last_undegraded":"2026-02-12T04:05:03.123197+0000","last_fullsized":"2026-02-12T04:05:03.123197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:05:03.121661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:05:03.121661+0000","last_clean_scrub_stamp":"2026-02-12T04:05:03.121661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:14:29.540005+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[14,2],"acting":[14,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":14,"acting_primary":14,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":640,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:05:06.185293+0000","last_change":"2026-02-12T04:05:06.185293+0000","last_active":"2026-02-12T04:05:06.185293+0000","last_peered":"2026-02-12T04:05:06.185293+0000","last_clean":"2026-02-12T04:05:06.185293+0000","last_became_active":"2026-02-12T03:59:14.899726+0000","last_became_peered":"2026-02-12T03:59:14.899726+0000","last_unstale":"2026-02-12T04:05:06.185293+0000","last_undegraded":"2026-02-12T04:05:06.185293+0000","last_fullsized":"2026-02-12T04:05:06.185293+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:05:06.183050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:05:06.183050+0000","last_clean_scrub_stamp":"2026-02-12T04:05:06.183050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T07:53:27.966191+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1],"acting":[11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":643,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:05:01.322754+0000","last_change":"2026-02-12T04:05:01.322754+0000","last_active":"2026-02-12T04:05:01.322754+0000","last_peered":"2026-02-12T04:05:01.322754+0000","last_clean":"2026-02-12T04:05:01.322754+0000","last_became_active":"2026-02-12T03:59:13.258353+0000","last_became_peered":"2026-02-12T03:59:13.258353+0000","last_unstale":"2026-02-12T04:05:01.322754+0000","last_undegraded":"2026-02-12T04:05:01.322754+0000","last_fullsized":"2026-02-12T04:05:01.322754+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:05:01.320922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:05:01.320922+0000","last_clean_scrub_stamp":"2026-02-12T04:05:01.320922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T11:25:40.060571+0000","scrub_duration":38,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3],"acting":[9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":639,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:05:03.565165+0000","last_change":"2026-02-12T04:05:03.565165+0000","last_active":"2026-02-12T04:05:03.565165+0000","last_peered":"2026-02-12T04:05:03.565165+0000","last_clean":"2026-02-12T04:05:03.565165+0000","last_became_active":"2026-02-12T03:59:13.219996+0000","last_became_peered":"2026-02-12T03:59:13.219996+0000","last_unstale":"2026-02-12T04:05:03.565165+0000","last_undegraded":"2026-02-12T04:05:03.565165+0000","last_fullsized":"2026-02-12T04:05:03.565165+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:05:03.563368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:05:03.563368+0000","last_clean_scrub_stamp":"2026-02-12T04:05:03.563368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T08:37:01.978907+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,8],"acting":[6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":642,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:05:00.500970+0000","last_change":"2026-02-12T04:05:00.500295+0000","last_active":"2026-02-12T04:05:00.500970+0000","last_peered":"2026-02-12T04:05:00.500970+0000","last_clean":"2026-02-12T04:05:00.500970+0000","last_became_active":"2026-02-12T03:59:14.177484+0000","last_became_peered":"2026-02-12T03:59:14.177484+0000","last_unstale":"2026-02-12T04:05:00.500970+0000","last_undegraded":"2026-02-12T04:05:00.500970+0000","last_fullsized":"2026-02-12T04:05:00.500970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:05:00.498437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:05:00.498437+0000","last_clean_scrub_stamp":"2026-02-12T04:05:00.498437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T08:51:45.985890+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[13,9],"acting":[13,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":13,"acting_primary":13,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":641,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:59.542511+0000","last_change":"2026-02-12T04:04:59.542511+0000","last_active":"2026-02-12T04:04:59.542511+0000","last_peered":"2026-02-12T04:04:59.542511+0000","last_clean":"2026-02-12T04:04:59.542511+0000","last_became_active":"2026-02-12T03:59:13.720549+0000","last_became_peered":"2026-02-12T03:59:13.720549+0000","last_unstale":"2026-02-12T04:04:59.542511+0000","last_undegraded":"2026-02-12T04:04:59.542511+0000","last_fullsized":"2026-02-12T04:04:59.542511+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:04:59.536672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:04:59.536672+0000","last_clean_scrub_stamp":"2026-02-12T04:04:59.536672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T14:38:44.899479+0000","scrub_duration":97,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,15],"acting":[5,15],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":636,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:05:01.491893+0000","last_change":"2026-02-12T04:05:01.491893+0000","last_active":"2026-02-12T04:05:01.491893+0000","last_peered":"2026-02-12T04:05:01.491893+0000","last_clean":"2026-02-12T04:05:01.491893+0000","last_became_active":"2026-02-12T03:59:13.846922+0000","last_became_peered":"2026-02-12T03:59:13.846922+0000","last_unstale":"2026-02-12T04:05:01.491893+0000","last_undegraded":"2026-02-12T04:05:01.491893+0000","last_fullsized":"2026-02-12T04:05:01.491893+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:05:01.489799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:05:01.489799+0000","last_clean_scrub_stamp":"2026-02-12T04:05:01.489799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T13:51:53.900813+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":640,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:05:05.231704+0000","last_change":"2026-02-12T04:05:05.231704+0000","last_active":"2026-02-12T04:05:05.231704+0000","last_peered":"2026-02-12T04:05:05.231704+0000","last_clean":"2026-02-12T04:05:05.231704+0000","last_became_active":"2026-02-12T03:59:14.858194+0000","last_became_peered":"2026-02-12T03:59:14.858194+0000","last_unstale":"2026-02-12T04:05:05.231704+0000","last_undegraded":"2026-02-12T04:05:05.231704+0000","last_fullsized":"2026-02-12T04:05:05.231704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:05:05.229877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:05:05.229877+0000","last_clean_scrub_stamp":"2026-02-12T04:05:05.229877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T06:52:03.608009+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2],"acting":[11,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":640,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:05:03.342814+0000","last_change":"2026-02-12T04:05:03.342814+0000","last_active":"2026-02-12T04:05:03.342814+0000","last_peered":"2026-02-12T04:05:03.342814+0000","last_clean":"2026-02-12T04:05:03.342814+0000","last_became_active":"2026-02-12T03:59:14.311690+0000","last_became_peered":"2026-02-12T03:59:14.311690+0000","last_unstale":"2026-02-12T04:05:03.342814+0000","last_undegraded":"2026-02-12T04:05:03.342814+0000","last_fullsized":"2026-02-12T04:05:03.342814+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:05:03.337916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:05:03.337916+0000","last_clean_scrub_stamp":"2026-02-12T04:05:03.337916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T08:31:31.889362+0000","scrub_duration":119,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,13],"acting":[11,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":640,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:04:59.435654+0000","last_change":"2026-02-12T04:04:59.435654+0000","last_active":"2026-02-12T04:04:59.435654+0000","last_peered":"2026-02-12T04:04:59.435654+0000","last_clean":"2026-02-12T04:04:59.435654+0000","last_became_active":"2026-02-12T03:59:13.469019+0000","last_became_peered":"2026-02-12T03:59:13.469019+0000","last_unstale":"2026-02-12T04:04:59.435654+0000","last_undegraded":"2026-02-12T04:04:59.435654+0000","last_fullsized":"2026-02-12T04:04:59.435654+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:04:59.433786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:04:59.433786+0000","last_clean_scrub_stamp":"2026-02-12T04:04:59.433786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T15:28:52.961529+0000","scrub_duration":40,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[12,2],"acting":[12,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":12,"acting_primary":12,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":636,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:05:03.800445+0000","last_change":"2026-02-12T04:05:03.800445+0000","last_active":"2026-02-12T04:05:03.800445+0000","last_peered":"2026-02-12T04:05:03.800445+0000","last_clean":"2026-02-12T04:05:03.800445+0000","last_became_active":"2026-02-12T03:59:13.075804+0000","last_became_peered":"2026-02-12T03:59:13.075804+0000","last_unstale":"2026-02-12T04:05:03.800445+0000","last_undegraded":"2026-02-12T04:05:03.800445+0000","last_fullsized":"2026-02-12T04:05:03.800445+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:05:03.798598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:05:03.798598+0000","last_clean_scrub_stamp":"2026-02-12T04:05:03.798598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T06:54:46.153291+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,13],"acting":[3,13],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":639,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:05:02.514856+0000","last_change":"2026-02-12T04:05:02.514856+0000","last_active":"2026-02-12T04:05:02.514856+0000","last_peered":"2026-02-12T04:05:02.514856+0000","last_clean":"2026-02-12T04:05:02.514856+0000","last_became_active":"2026-02-12T03:59:13.509387+0000","last_became_peered":"2026-02-12T03:59:13.509387+0000","last_unstale":"2026-02-12T04:05:02.514856+0000","last_undegraded":"2026-02-12T04:05:02.514856+0000","last_fullsized":"2026-02-12T04:05:02.514856+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:05:02.513244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:05:02.513244+0000","last_clean_scrub_stamp":"2026-02-12T04:05:02.513244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T09:37:11.214392+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,11],"acting":[6,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":643,"reported_epoch":344,"state":"active+clean","last_fresh":"2026-02-12T04:05:00.344249+0000","last_change":"2026-02-12T04:05:00.344249+0000","last_active":"2026-02-12T04:05:00.344249+0000","last_peered":"2026-02-12T04:05:00.344249+0000","last_clean":"2026-02-12T04:05:00.344249+0000","last_became_active":"2026-02-12T03:59:13.130685+0000","last_became_peered":"2026-02-12T03:59:13.130685+0000","last_unstale":"2026-02-12T04:05:00.344249+0000","last_undegraded":"2026-02-12T04:05:00.344249+0000","last_fullsized":"2026-02-12T04:05:00.344249+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T04:05:00.342331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T04:05:00.342331+0000","last_clean_scrub_stamp":"2026-02-12T04:05:00.342331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T08:40:46.675785+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1],"acting":[9,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":16},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":11},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":37,"num_write":57,"num_write_kb":584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":918560,"data_compressed":2320,"data_compressed_allocated":65536,"data_compressed_original":917504,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":11,"up_from":22,"seq":94489280596,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30784,"kb_used_data":3824,"kb_used_omap":3014,"kb_used_meta":23929,"kb_avail":94341056,"statfs":{"total":96636764160,"available":96605241344,"internally_reserved":0,"allocated":3915776,"data_stored":4326013,"data_compressed":801755,"data_compressed_allocated":1449984,"data_compressed_original":3697918,"omap_allocated":3087009,"internal_metadata":24503647},"hb_peers":[1,2,3,4,5,6,7,8,10,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":22,"seq":94489280595,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30780,"kb_used_data":3820,"kb_used_omap":205,"kb_used_meta":26738,"kb_avail":94341060,"statfs":{"total":96636764160,"available":96605245440,"internally_reserved":0,"allocated":3911680,"data_stored":4325994,"data_compressed":801755,"data_compressed_allocated":1449984,"data_compressed_original":3697918,"omap_allocated":210542,"internal_metadata":27380114},"hb_peers":[0,2,3,4,5,6,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":15,"up_from":22,"seq":94489280597,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30816,"kb_used_data":3856,"kb_used_omap":212,"kb_used_meta":26731,"kb_avail":94341024,"statfs":{"total":96636764160,"available":96605208576,"internally_reserved":0,"allocated":3948544,"data_stored":4785274,"data_compressed":802915,"data_compressed_allocated":1482752,"data_compressed_original":4156670,"omap_allocated":217936,"internal_metadata":27372720},"hb_peers":[0,1,2,4,5,6,7,8,10,11,12,13,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":21,"seq":90194313299,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30780,"kb_used_data":3820,"kb_used_omap":3018,"kb_used_meta":23925,"kb_avail":94341060,"statfs":{"total":96636764160,"available":96605245440,"internally_reserved":0,"allocated":3911680,"data_stored":4325994,"data_compressed":801755,"data_compressed_allocated":1449984,"data_compressed_original":3697918,"omap_allocated":3091108,"internal_metadata":24499548},"hb_peers":[1,2,3,4,5,6,7,8,9,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":13,"up_from":21,"seq":90194313299,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30780,"kb_used_data":3820,"kb_used_omap":3017,"kb_used_meta":23926,"kb_avail":94341060,"statfs":{"total":96636764160,"available":96605245440,"internally_reserved":0,"allocated":3911680,"data_stored":4325994,"data_compressed":801755,"data_compressed_allocated":1449984,"data_compressed_original":3697918,"omap_allocated":3089978,"internal_metadata":24500678},"hb_peers":[0,1,3,4,5,7,8,9,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":21,"seq":90194313300,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30780,"kb_used_data":3820,"kb_used_omap":3019,"kb_used_meta":23924,"kb_avail":94341060,"statfs":{"total":96636764160,"available":96605245440,"internally_reserved":0,"allocated":3911680,"data_stored":4325994,"data_compressed":801755,"data_compressed_allocated":1449984,"data_compressed_original":3697918,"omap_allocated":3091937,"internal_metadata":24498719},"hb_peers":[0,1,3,4,5,7,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":21,"seq":90194313300,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30816,"kb_used_data":3856,"kb_used_omap":208,"kb_used_meta":26735,"kb_avail":94341024,"statfs":{"total":96636764160,"available":96605208576,"internally_reserved":0,"allocated":3948544,"data_stored":4785274,"data_compressed":802915,"data_compressed_allocated":1482752,"data_compressed_original":4156670,"omap_allocated":213892,"internal_metadata":27376764},"hb_peers":[1,3,4,5,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":21,"seq":90194313299,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30780,"kb_used_data":3820,"kb_used_omap":1740,"kb_used_meta":25203,"kb_avail":94341060,"statfs":{"total":96636764160,"available":96605245440,"internally_reserved":0,"allocated":3911680,"data_stored":4325994,"data_compressed":801755,"data_compressed_allocated":1449984,"data_compressed_original":3697918,"omap_allocated":1782034,"internal_metadata":25808622},"hb_peers":[0,1,2,3,5,6,7,8,9,10,11,12,14],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":21,"seq":90194313300,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30780,"kb_used_data":3820,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94341060,"statfs":{"total":96636764160,"available":96605245440,"internally_reserved":0,"allocated":3911680,"data_stored":4325994,"data_compressed":801755,"data_compressed_allocated":1449984,"data_compressed_original":3697918,"omap_allocated":214817,"internal_metadata":27375839},"hb_peers":[0,1,3,4,6,7,8,9,10,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":21,"seq":90194313299,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30784,"kb_used_data":3824,"kb_used_omap":210,"kb_used_meta":26733,"kb_avail":94341056,"statfs":{"total":96636764160,"available":96605241344,"internally_reserved":0,"allocated":3915776,"data_stored":4326013,"data_compressed":801755,"data_compressed_allocated":1449984,"data_compressed_original":3697918,"omap_allocated":215240,"internal_metadata":27375416},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11,12,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":21,"seq":90194313301,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30780,"kb_used_data":3820,"kb_used_omap":175,"kb_used_meta":26768,"kb_avail":94341060,"statfs":{"total":96636764160,"available":96605245440,"internally_reserved":0,"allocated":3911680,"data_stored":4325994,"data_compressed":801755,"data_compressed_allocated":1449984,"data_compressed_original":3697918,"omap_allocated":179988,"internal_metadata":27410668},"hb_peers":[0,1,3,5,6,7,8,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":21,"seq":90194313300,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30784,"kb_used_data":3824,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94341056,"statfs":{"total":96636764160,"available":96605241344,"internally_reserved":0,"allocated":3915776,"data_stored":4325999,"data_compressed":801755,"data_compressed_allocated":1449984,"data_compressed_original":3697918,"omap_allocated":214733,"internal_metadata":27375923},"hb_peers":[0,1,2,3,4,5,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":12,"up_from":21,"seq":90194313301,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30780,"kb_used_data":3820,"kb_used_omap":209,"kb_used_meta":26734,"kb_avail":94341060,"statfs":{"total":96636764160,"available":96605245440,"internally_reserved":0,"allocated":3911680,"data_stored":4325994,"data_compressed":801755,"data_compressed_allocated":1449984,"data_compressed_original":3697918,"omap_allocated":214322,"internal_metadata":27376334},"hb_peers":[0,2,3,5,6,7,8,9,10,11,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":14,"up_from":21,"seq":90194313300,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30780,"kb_used_data":3820,"kb_used_omap":3018,"kb_used_meta":23925,"kb_avail":94341060,"statfs":{"total":96636764160,"available":96605245440,"internally_reserved":0,"allocated":3911680,"data_stored":4325994,"data_compressed":801755,"data_compressed_allocated":1449984,"data_compressed_original":3697918,"omap_allocated":3090725,"internal_metadata":24499931},"hb_peers":[0,2,3,4,5,6,7,8,9,10,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":22,"seq":94489280597,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30780,"kb_used_data":3820,"kb_used_omap":3012,"kb_used_meta":23931,"kb_avail":94341060,"statfs":{"total":96636764160,"available":96605245440,"internally_reserved":0,"allocated":3911680,"data_stored":4325994,"data_compressed":801755,"data_compressed_allocated":1449984,"data_compressed_original":3697918,"omap_allocated":3085203,"internal_metadata":24505453},"hb_peers":[1,2,4,5,6,7,8,9,11,12,13,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":22,"seq":94489280597,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":30784,"kb_used_data":3824,"kb_used_omap":3019,"kb_used_meta":23924,"kb_avail":94341056,"statfs":{"total":96636764160,"available":96605241344,"internally_reserved":0,"allocated":3915776,"data_stored":4325999,"data_compressed":801755,"data_compressed_allocated":1449984,"data_compressed_original":3697918,"omap_allocated":3091515,"internal_metadata":24499141},"hb_peers":[0,3,4,5,6,8,9,10,11,12,13,14,15],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":459280,"data_compressed":1160,"data_compressed_allocated":32768,"data_compressed_original":458752,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":459280,"data_compressed":1160,"data_compressed_allocated":32768,"data_compressed_original":458752,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":12,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":13,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":14,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":15,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T04:05:23.633 DEBUG:teuthology.orchestra.run.trial091:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-12T04:05:23.700 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.698+0000 7fcbc5e6f640 10 monclient: get_monmap_and_config 2026-02-12T04:05:23.701 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.698+0000 7fcbc5e6f640 10 monclient: build_initial_monmap 2026-02-12T04:05:23.701 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.698+0000 7fcbc5e6f640 10 monclient: monmap: 2026-02-12T04:05:23.701 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:05:23.701 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:23.701 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T04:05:23.699620+0000 2026-02-12T04:05:23.701 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T04:05:23.699620+0000 2026-02-12T04:05:23.701 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:05:23.701 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:23.701 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:05:23.701 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:05:23.702 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:05:23.702 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:23.703 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.698+0000 7fcbc5e6f640 1 Processor -- start 2026-02-12T04:05:23.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.698+0000 7fcbc5e6f640 1 -- start start 2026-02-12T04:05:23.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.698+0000 7fcbc5e6f640 10 monclient: init 2026-02-12T04:05:23.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.698+0000 7fcbc5e6f640 10 monclient: _reopen_session rank -1 2026-02-12T04:05:23.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.699+0000 7fcbc5e6f640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-12T04:05:23.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.699+0000 7fcbc5e6f640 10 monclient(hunting): picked mon.noname-c con 0x7fcbc015e1c0 addr v1:10.20.193.111:6789/0 2026-02-12T04:05:23.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.699+0000 7fcbc5e6f640 10 monclient(hunting): picked mon.noname-b con 0x7fcbc0058750 addr v1:10.20.193.98:6789/0 2026-02-12T04:05:23.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.699+0000 7fcbc5e6f640 10 monclient(hunting): picked mon.noname-a con 0x7fcbc00560d0 addr v1:10.20.193.91:6789/0 2026-02-12T04:05:23.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.699+0000 7fcbc5e6f640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbc00b1ec0 con 0x7fcbc00560d0 2026-02-12T04:05:23.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.699+0000 7fcbc5e6f640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbc00566d0 con 0x7fcbc0058750 2026-02-12T04:05:23.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.699+0000 7fcbc5e6f640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbc00569b0 con 0x7fcbc015e1c0 2026-02-12T04:05:23.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.699+0000 7fcbc5e6f640 10 monclient(hunting): _renew_subs 2026-02-12T04:05:23.704 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.699+0000 7fcbc5e6f640 10 monclient(hunting): authenticate will time out at 1526.443061s 2026-02-12T04:05:23.705 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.699+0000 7fcbbffff640 1 --1- >> v1:10.20.193.91:6789/0 conn(0x7fcbc00560d0 0x7fcbc01c5810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.91:6789/0 says I am v1:10.20.193.91:37986/0 (socket says 10.20.193.91:37986) 2026-02-12T04:05:23.705 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.699+0000 7fcbbffff640 1 -- 10.20.193.91:0/192343491 learned_addr learned my addr 10.20.193.91:0/192343491 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:05:23.705 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.700+0000 7fcbbe7fc640 1 -- 10.20.193.91:0/192343491 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2705304621 0 0) 0x7fcbc00566d0 con 0x7fcbc0058750 2026-02-12T04:05:23.705 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.700+0000 7fcbbe7fc640 10 monclient(hunting): _negotiate 2026-02-12T04:05:23.705 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.700+0000 7fcbbe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:23.705 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.700+0000 7fcbbe7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:23.705 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.700+0000 7fcbbe7fc640 10 monclient(hunting): my global_id is 27958 2026-02-12T04:05:23.705 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.700+0000 7fcbbe7fc640 1 -- 10.20.193.91:0/192343491 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcba4003610 con 0x7fcbc0058750 2026-02-12T04:05:23.705 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.700+0000 7fcbbe7fc640 1 -- 10.20.193.91:0/192343491 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 264906653 0 0) 0x7fcbc00b1ec0 con 0x7fcbc00560d0 2026-02-12T04:05:23.705 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.700+0000 7fcbbe7fc640 10 monclient(hunting): _negotiate 2026-02-12T04:05:23.705 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.700+0000 7fcbbe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:23.705 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.700+0000 7fcbbe7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:23.706 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.700+0000 7fcbbe7fc640 10 monclient(hunting): my global_id is 30825 2026-02-12T04:05:23.706 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.700+0000 7fcbbe7fc640 1 -- 10.20.193.91:0/192343491 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbc00566d0 con 0x7fcbc00560d0 2026-02-12T04:05:23.710 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.701+0000 7fcbbe7fc640 1 -- 10.20.193.91:0/192343491 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3246117396 0 0) 0x7fcbc00569b0 con 0x7fcbc015e1c0 2026-02-12T04:05:23.710 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.701+0000 7fcbbe7fc640 10 monclient(hunting): _negotiate 2026-02-12T04:05:23.710 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.701+0000 7fcbbe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:23.710 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.701+0000 7fcbbe7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:23.710 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.701+0000 7fcbbe7fc640 10 monclient(hunting): my global_id is 27656 2026-02-12T04:05:23.710 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.701+0000 7fcbbe7fc640 1 -- 10.20.193.91:0/192343491 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbc00b1ec0 con 0x7fcbc015e1c0 2026-02-12T04:05:23.710 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.702+0000 7fcbbe7fc640 1 -- 10.20.193.91:0/192343491 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 414934043 0 0) 0x7fcba4003610 con 0x7fcbc0058750 2026-02-12T04:05:23.711 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.702+0000 7fcbbe7fc640 1 -- 10.20.193.91:0/192343491 >> v1:10.20.193.111:6789/0 conn(0x7fcbc015e1c0 legacy=0x7fcbc0057770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:23.711 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.702+0000 7fcbbe7fc640 1 -- 10.20.193.91:0/192343491 >> v1:10.20.193.91:6789/0 conn(0x7fcbc00560d0 legacy=0x7fcbc01c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:23.711 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.702+0000 7fcbbe7fc640 10 monclient: _finish_hunting 0 2026-02-12T04:05:23.711 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.702+0000 7fcbbe7fc640 1 monclient: found mon.noname-b 2026-02-12T04:05:23.711 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.702+0000 7fcbbe7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:05:23.711 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.702+0000 7fcbbe7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.98:6789/0 2026-02-12T04:05:23.711 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.702+0000 7fcbbe7fc640 1 -- 10.20.193.91:0/192343491 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbc0056c90 con 0x7fcbc0058750 2026-02-12T04:05:23.711 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.702+0000 7fcbbe7fc640 10 monclient: _finish_auth 0 2026-02-12T04:05:23.711 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.702+0000 7fcbbe7fc640 10 monclient: _check_auth_tickets 2026-02-12T04:05:23.711 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.702+0000 7fcbbe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:05:23.711 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.702+0000 7fcbbe7fc640 1 -- 10.20.193.91:0/192343491 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fcbb0002df0 con 0x7fcbc0058750 2026-02-12T04:05:23.711 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.702+0000 7fcbbe7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:23.712 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.702+0000 7fcbbe7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T04:05:23.712 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.702+0000 7fcbbe7fc640 10 monclient: dump: 2026-02-12T04:05:23.712 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:23.712 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:23.712 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:23.712 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:23.712 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:23.712 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:23.712 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:23.712 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:23.712 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:23.713 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:23.713 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.702+0000 7fcbc5e6f640 5 monclient: authenticate success, global_id 27958 2026-02-12T04:05:23.713 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.702+0000 7fcbc5e6f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T04:05:23.713 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.703+0000 7fcbbe7fc640 1 -- 10.20.193.91:0/192343491 <== mon.1 v1:10.20.193.98:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcbb0002fc0 con 0x7fcbc0058750 2026-02-12T04:05:23.713 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.703+0000 7fcbbe7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T04:05:23.713 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.703+0000 7fcbbe7fc640 1 -- 10.20.193.91:0/192343491 <== mon.1 v1:10.20.193.98:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fcbb0003400 con 0x7fcbc0058750 2026-02-12T04:05:23.713 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.703+0000 7fcbc5e6f640 10 monclient: get_monmap_and_config success 2026-02-12T04:05:23.713 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.703+0000 7fcbbe7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:23.713 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.703+0000 7fcbc5e6f640 4 set_mon_vals no callback set 2026-02-12T04:05:23.713 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.703+0000 7fcbbe7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T04:05:23.713 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.703+0000 7fcbbe7fc640 10 monclient: dump: 2026-02-12T04:05:23.713 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:23.714 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:23.714 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:23.714 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:23.714 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:23.714 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:23.714 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:23.714 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:23.714 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:23.714 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:23.714 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.703+0000 7fcbc5e6f640 10 monclient: shutdown 2026-02-12T04:05:23.714 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.703+0000 7fcbc5e6f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:05:23.714 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.703+0000 7fcbc5e6f640 1 -- 10.20.193.91:0/192343491 >> v1:10.20.193.98:6789/0 conn(0x7fcbc0058750 legacy=0x7fcbc00559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:23.715 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.703+0000 7fcbc5e6f640 1 -- 10.20.193.91:0/192343491 shutdown_connections 2026-02-12T04:05:23.715 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.703+0000 7fcbc5e6f640 1 -- 10.20.193.91:0/192343491 >> 10.20.193.91:0/192343491 conn(0x7fcbc00b6530 msgr2=0x7fcbc00b6930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:05:23.715 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.703+0000 7fcbc5e6f640 1 -- 10.20.193.91:0/192343491 shutdown_connections 2026-02-12T04:05:23.715 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.703+0000 7fcbc5e6f640 1 -- 10.20.193.91:0/192343491 wait complete. 2026-02-12T04:05:23.715 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.704+0000 7fcbc5e6f640 10 monclient: build_initial_monmap 2026-02-12T04:05:23.715 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.704+0000 7fcbc5e6f640 10 monclient: monmap: 2026-02-12T04:05:23.715 INFO:teuthology.orchestra.run.trial091.stderr:epoch 0 2026-02-12T04:05:23.715 INFO:teuthology.orchestra.run.trial091.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T04:05:23.715 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 0.000000 2026-02-12T04:05:23.715 INFO:teuthology.orchestra.run.trial091.stderr:created 0.000000 2026-02-12T04:05:23.715 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 0 (unknown) 2026-02-12T04:05:23.715 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 1 2026-02-12T04:05:23.715 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.noname-a 2026-02-12T04:05:23.716 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.noname-b 2026-02-12T04:05:23.716 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.noname-c 2026-02-12T04:05:23.716 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:23.716 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.704+0000 7fcbc5e6f640 1 librados: starting msgr at 2026-02-12T04:05:23.716 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.704+0000 7fcbc5e6f640 1 librados: starting objecter 2026-02-12T04:05:23.716 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.704+0000 7fcbc5e6f640 20 client.?.objecter Objecter: read policy: balance 2026-02-12T04:05:23.716 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.704+0000 7fcbc5e6f640 1 Processor -- start 2026-02-12T04:05:23.716 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.704+0000 7fcbc5e6f640 1 -- start start 2026-02-12T04:05:23.716 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.704+0000 7fcbc5e6f640 1 librados: setting wanted keys 2026-02-12T04:05:23.716 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.704+0000 7fcbc5e6f640 1 librados: calling monclient init 2026-02-12T04:05:23.716 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.704+0000 7fcbc5e6f640 10 monclient: init 2026-02-12T04:05:23.716 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.704+0000 7fcbc5e6f640 10 monclient: _reopen_session rank -1 2026-02-12T04:05:23.717 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.704+0000 7fcbc5e6f640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-12T04:05:23.717 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.704+0000 7fcbc5e6f640 10 monclient(hunting): picked mon.noname-a con 0x7fcbc00560d0 addr v1:10.20.193.91:6789/0 2026-02-12T04:05:23.717 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.704+0000 7fcbc5e6f640 10 monclient(hunting): picked mon.noname-c con 0x7fcbc0058750 addr v1:10.20.193.111:6789/0 2026-02-12T04:05:23.717 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.704+0000 7fcbc5e6f640 10 monclient(hunting): picked mon.noname-b con 0x7fcbc015e1c0 addr v1:10.20.193.98:6789/0 2026-02-12T04:05:23.717 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.704+0000 7fcbc5e6f640 1 -- --> v1:10.20.193.91:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbc01629c0 con 0x7fcbc00560d0 2026-02-12T04:05:23.717 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.704+0000 7fcbc5e6f640 1 -- --> v1:10.20.193.98:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbc0162ca0 con 0x7fcbc015e1c0 2026-02-12T04:05:23.717 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.704+0000 7fcbc5e6f640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbc0162f80 con 0x7fcbc0058750 2026-02-12T04:05:23.717 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.704+0000 7fcbc5e6f640 10 monclient(hunting): _renew_subs 2026-02-12T04:05:23.717 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.704+0000 7fcbc5e6f640 10 monclient(hunting): authenticate will time out at 1526.448685s 2026-02-12T04:05:23.717 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.704+0000 7fcbbffff640 1 --1- >> v1:10.20.193.98:6789/0 conn(0x7fcbc015e1c0 0x7fcbc015bd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.98:6789/0 says I am v1:10.20.193.91:51680/0 (socket says 10.20.193.91:51680) 2026-02-12T04:05:23.717 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.704+0000 7fcbbffff640 1 -- 10.20.193.91:0/4199491344 learned_addr learned my addr 10.20.193.91:0/4199491344 (peer_addr_for_me v1:10.20.193.91:0/0) 2026-02-12T04:05:23.717 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.705+0000 7fcb9bfff640 10 client.?.objecter ms_handle_connect 0x7fcbc0058750 2026-02-12T04:05:23.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.705+0000 7fcb9bfff640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:23.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.705+0000 7fcb9bfff640 10 client.?.objecter ms_handle_connect 0x7fcbc015e1c0 2026-02-12T04:05:23.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.705+0000 7fcb9bfff640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:23.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.706+0000 7fcb9bfff640 10 client.?.objecter ms_handle_connect 0x7fcbc00560d0 2026-02-12T04:05:23.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.706+0000 7fcb9bfff640 10 client.?.objecter resend_mon_ops 2026-02-12T04:05:23.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.706+0000 7fcb9bfff640 1 -- 10.20.193.91:0/4199491344 <== mon.2 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2501564972 0 0) 0x7fcbc0162f80 con 0x7fcbc0058750 2026-02-12T04:05:23.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.706+0000 7fcb9bfff640 10 monclient(hunting): _negotiate 2026-02-12T04:05:23.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.706+0000 7fcb9bfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:23.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.706+0000 7fcb9bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:23.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.706+0000 7fcb9bfff640 10 monclient(hunting): my global_id is 27659 2026-02-12T04:05:23.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.706+0000 7fcb9bfff640 1 -- 10.20.193.91:0/4199491344 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb90003610 con 0x7fcbc0058750 2026-02-12T04:05:23.718 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.706+0000 7fcb9bfff640 1 -- 10.20.193.91:0/4199491344 <== mon.1 v1:10.20.193.98:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4030439458 0 0) 0x7fcbc0162ca0 con 0x7fcbc015e1c0 2026-02-12T04:05:23.719 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.706+0000 7fcb9bfff640 10 monclient(hunting): _negotiate 2026-02-12T04:05:23.719 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.706+0000 7fcb9bfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:23.719 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.706+0000 7fcb9bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:23.719 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.706+0000 7fcb9bfff640 10 monclient(hunting): my global_id is 27961 2026-02-12T04:05:23.719 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.706+0000 7fcb9bfff640 1 -- 10.20.193.91:0/4199491344 --> v1:10.20.193.98:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbc0162f80 con 0x7fcbc015e1c0 2026-02-12T04:05:23.719 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.707+0000 7fcb9bfff640 1 -- 10.20.193.91:0/4199491344 <== mon.0 v1:10.20.193.91:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1830622306 0 0) 0x7fcbc01629c0 con 0x7fcbc00560d0 2026-02-12T04:05:23.719 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.707+0000 7fcb9bfff640 10 monclient(hunting): _negotiate 2026-02-12T04:05:23.719 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.707+0000 7fcb9bfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T04:05:23.719 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.707+0000 7fcb9bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T04:05:23.719 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.707+0000 7fcb9bfff640 10 monclient(hunting): my global_id is 30828 2026-02-12T04:05:23.719 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.707+0000 7fcb9bfff640 1 -- 10.20.193.91:0/4199491344 --> v1:10.20.193.91:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbc0162ca0 con 0x7fcbc00560d0 2026-02-12T04:05:23.722 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.708+0000 7fcb9bfff640 1 -- 10.20.193.91:0/4199491344 <== mon.1 v1:10.20.193.98:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 118836566 0 0) 0x7fcbc0162f80 con 0x7fcbc015e1c0 2026-02-12T04:05:23.723 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.708+0000 7fcb9bfff640 1 -- 10.20.193.91:0/4199491344 --> v1:10.20.193.98:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcbc01629c0 con 0x7fcbc015e1c0 2026-02-12T04:05:23.723 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.708+0000 7fcb9bfff640 1 -- 10.20.193.91:0/4199491344 <== mon.1 v1:10.20.193.98:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fcbb40032f0 con 0x7fcbc015e1c0 2026-02-12T04:05:23.723 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.708+0000 7fcb9bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:23.723 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.708+0000 7fcb9bfff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T04:05:23.723 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.708+0000 7fcb9bfff640 10 monclient(hunting): dump: 2026-02-12T04:05:23.723 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:23.723 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:23.723 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:23.723 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:23.723 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:23.724 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:23.724 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:23.724 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:23.724 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:23.724 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:23.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.708+0000 7fcb9bfff640 10 monclient(hunting): _finish_auth 0 2026-02-12T04:05:23.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.709+0000 7fcb9bfff640 1 -- 10.20.193.91:0/4199491344 <== mon.2 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1724512105 0 0) 0x7fcb90003610 con 0x7fcbc0058750 2026-02-12T04:05:23.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.709+0000 7fcb9bfff640 1 -- 10.20.193.91:0/4199491344 --> v1:10.20.193.111:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcbc0162f80 con 0x7fcbc0058750 2026-02-12T04:05:23.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.709+0000 7fcb9bfff640 1 -- 10.20.193.91:0/4199491344 <== mon.2 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fcbb0003310 con 0x7fcbc0058750 2026-02-12T04:05:23.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.709+0000 7fcb9bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:23.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.709+0000 7fcb9bfff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-12T04:05:23.724 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.709+0000 7fcb9bfff640 10 monclient(hunting): dump: 2026-02-12T04:05:23.725 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:23.725 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:23.725 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:23.725 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:23.725 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:23.725 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:23.725 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:23.725 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:23.725 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:23.725 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:23.725 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.709+0000 7fcb9bfff640 1 -- 10.20.193.91:0/4199491344 <== mon.0 v1:10.20.193.91:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 29360551 0 0) 0x7fcbc0162ca0 con 0x7fcbc00560d0 2026-02-12T04:05:23.725 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.709+0000 7fcb9bfff640 1 -- 10.20.193.91:0/4199491344 --> v1:10.20.193.91:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcb90003610 con 0x7fcbc00560d0 2026-02-12T04:05:23.726 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.709+0000 7fcb9bfff640 1 -- 10.20.193.91:0/4199491344 <== mon.0 v1:10.20.193.91:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fcbac003060 con 0x7fcbc00560d0 2026-02-12T04:05:23.726 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.709+0000 7fcb9bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-12T04:05:23.726 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.709+0000 7fcb9bfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-12T04:05:23.726 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.709+0000 7fcb9bfff640 10 monclient(hunting): dump: 2026-02-12T04:05:23.726 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:23.726 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:23.726 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:23.726 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:23.726 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:23.726 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:23.726 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:23.726 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:23.726 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:23.727 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:23.727 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.710+0000 7fcb9bfff640 1 -- 10.20.193.91:0/4199491344 <== mon.1 v1:10.20.193.98:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4242627865 0 0) 0x7fcbc01629c0 con 0x7fcbc015e1c0 2026-02-12T04:05:23.727 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.710+0000 7fcb9bfff640 1 -- 10.20.193.91:0/4199491344 >> v1:10.20.193.111:6789/0 conn(0x7fcbc0058750 legacy=0x7fcbc015a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:23.727 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.710+0000 7fcb9bfff640 1 -- 10.20.193.91:0/4199491344 >> v1:10.20.193.91:6789/0 conn(0x7fcbc00560d0 legacy=0x7fcbc0140430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:23.727 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.710+0000 7fcb9bfff640 10 monclient: _finish_hunting 0 2026-02-12T04:05:23.727 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.710+0000 7fcb9bfff640 1 monclient: found mon.b 2026-02-12T04:05:23.727 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.710+0000 7fcb9bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T04:05:23.727 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.710+0000 7fcb9bfff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:05:23.727 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.710+0000 7fcb9bfff640 1 -- 10.20.193.91:0/4199491344 --> v1:10.20.193.98:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbc0163260 con 0x7fcbc015e1c0 2026-02-12T04:05:23.727 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.710+0000 7fcb9bfff640 10 monclient: _finish_auth 0 2026-02-12T04:05:23.727 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.710+0000 7fcb9bfff640 10 monclient: _check_auth_tickets 2026-02-12T04:05:23.727 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.710+0000 7fcb9bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T04:05:23.728 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.710+0000 7fcbc5e6f640 5 monclient: authenticate success, global_id 27961 2026-02-12T04:05:23.728 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.710+0000 7fcbc5e6f640 10 monclient: _renew_subs 2026-02-12T04:05:23.728 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.710+0000 7fcbc5e6f640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:05:23.728 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.710+0000 7fcbc5e6f640 1 -- 10.20.193.91:0/4199491344 --> v1:10.20.193.98:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcbc0163540 con 0x7fcbc015e1c0 2026-02-12T04:05:23.728 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.710+0000 7fcbc5e6f640 10 client.27961.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-12T04:05:23.728 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.710+0000 7fcbc5e6f640 10 monclient: _renew_subs 2026-02-12T04:05:23.728 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.710+0000 7fcbc5e6f640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:05:23.728 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.710+0000 7fcbc5e6f640 1 -- 10.20.193.91:0/4199491344 --> v1:10.20.193.98:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fcbc015ac90 con 0x7fcbc015e1c0 2026-02-12T04:05:23.728 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.710+0000 7fcbc5e6f640 1 librados: init done 2026-02-12T04:05:23.728 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.710+0000 7fcbc5e6f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T04:05:23.728 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.710+0000 7fcbc5e6f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:05:23.728 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.710+0000 7fcbc5e6f640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:05:23.728 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.710+0000 7fcbc5e6f640 1 -- 10.20.193.91:0/4199491344 --> v1:10.20.193.98:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbc0053250 con 0x7fcbc015e1c0 2026-02-12T04:05:23.729 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.718+0000 7fcb9bfff640 1 -- 10.20.193.91:0/4199491344 <== mon.1 v1:10.20.193.98:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcbb4004c50 con 0x7fcbc015e1c0 2026-02-12T04:05:23.729 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.718+0000 7fcb9bfff640 10 monclient: handle_config config(0 keys) 2026-02-12T04:05:23.729 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.718+0000 7fcb9bfff640 1 -- 10.20.193.91:0/4199491344 <== mon.1 v1:10.20.193.98:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 2513467566 0 0) 0x7fcbb4004fa0 con 0x7fcbc015e1c0 2026-02-12T04:05:23.729 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.718+0000 7fcb9bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T04:05:23.729 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.718+0000 7fcb9bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T04:05:23.729 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.718+0000 7fcb9bfff640 10 monclient: dump: 2026-02-12T04:05:23.729 INFO:teuthology.orchestra.run.trial091.stderr:epoch 1 2026-02-12T04:05:23.729 INFO:teuthology.orchestra.run.trial091.stderr:fsid 1e356fcf-3d61-462e-a451-82f8dd01e1f3 2026-02-12T04:05:23.729 INFO:teuthology.orchestra.run.trial091.stderr:last_changed 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:23.729 INFO:teuthology.orchestra.run.trial091.stderr:created 2026-02-12T03:57:12.286436+0000 2026-02-12T04:05:23.729 INFO:teuthology.orchestra.run.trial091.stderr:min_mon_release 20 (tentacle) 2026-02-12T04:05:23.729 INFO:teuthology.orchestra.run.trial091.stderr:election_strategy: 3 2026-02-12T04:05:23.729 INFO:teuthology.orchestra.run.trial091.stderr:0: v1:10.20.193.91:6789/0 mon.a 2026-02-12T04:05:23.730 INFO:teuthology.orchestra.run.trial091.stderr:1: v1:10.20.193.98:6789/0 mon.b 2026-02-12T04:05:23.730 INFO:teuthology.orchestra.run.trial091.stderr:2: v1:10.20.193.111:6789/0 mon.c 2026-02-12T04:05:23.730 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:05:23.730 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.718+0000 7fcbbdffb640 4 set_mon_vals no callback set 2026-02-12T04:05:23.730 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.718+0000 7fcb9bfff640 1 -- 10.20.193.91:0/4199491344 <== mon.1 v1:10.20.193.98:6789/0 7 ==== mgrmap(e 5) ==== 103224+0+0 (unknown 2621633197 0 0) 0x7fcbb401e480 con 0x7fcbc015e1c0 2026-02-12T04:05:23.730 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.719+0000 7fcbbf7fe640 10 monclient: get_auth_request con 0x7fcb9007a020 auth_method 0 2026-02-12T04:05:23.730 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.719+0000 7fcb9bfff640 10 client.27961.objecter ms_handle_connect 0x7fcb9007a020 2026-02-12T04:05:23.730 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.719+0000 7fcb9bfff640 1 -- 10.20.193.91:0/4199491344 <== mon.1 v1:10.20.193.98:6789/0 8 ==== osd_map(344..344 src has 1..344) ==== 8955+0+0 (unknown 963914884 0 0) 0x7fcbb4095d50 con 0x7fcbc015e1c0 2026-02-12T04:05:23.730 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.719+0000 7fcb9bfff640 10 client.27961.objecter ms_dispatch2 0x7fcbc0000b90 osd_map(344..344 src has 1..344) 2026-02-12T04:05:23.730 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.719+0000 7fcb9bfff640 3 client.27961.objecter handle_osd_map got epochs [344,344] > 0 2026-02-12T04:05:23.730 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.719+0000 7fcb9bfff640 3 client.27961.objecter handle_osd_map decoding full epoch 344 2026-02-12T04:05:23.730 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.719+0000 7fcb9bfff640 20 client.27961.objecter dump_active .. 0 homeless 2026-02-12T04:05:23.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.806+0000 7fcb9bfff640 1 -- 10.20.193.91:0/4199491344 <== mon.1 v1:10.20.193.98:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+232485 (unknown 1092875540 0 743202903) 0x7fcbc0053250 con 0x7fcbc015e1c0 2026-02-12T04:05:23.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.806+0000 7fcb9bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T04:05:23.808 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.806+0000 7fcb9bfff640 10 monclient: _finish_command 1 = system:0 2026-02-12T04:05:23.914 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.911+0000 7fcbc5e6f640 10 start_mon_command cmd=[{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-12T04:05:23.914 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.911+0000 7fcbc5e6f640 10 monclient: _send_command 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-12T04:05:23.914 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.911+0000 7fcbc5e6f640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.98:6789/0 2026-02-12T04:05:23.915 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:23.911+0000 7fcbc5e6f640 1 -- 10.20.193.91:0/4199491344 --> v1:10.20.193.98:6789/0 -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fcbc00b0b20 con 0x7fcbc015e1c0 2026-02-12T04:05:24.005 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:24.003+0000 7fcb9bfff640 1 -- 10.20.193.91:0/4199491344 <== mon.1 v1:10.20.193.98:6789/0 10 ==== config(1 keys) ==== 35+0+0 (unknown 2555425225 0 0) 0x7fcbb405f6b0 con 0x7fcbc015e1c0 2026-02-12T04:05:24.006 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:24.003+0000 7fcb9bfff640 10 monclient: handle_config config(1 keys) 2026-02-12T04:05:24.006 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:24.003+0000 7fcbbdffb640 4 set_mon_vals no callback set 2026-02-12T04:05:24.006 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:24.003+0000 7fcbbdffb640 10 set_mon_vals mon_health_to_clog = false 2026-02-12T04:05:24.009 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:24.006+0000 7fcb9bfff640 1 -- 10.20.193.91:0/4199491344 <== mon.1 v1:10.20.193.98:6789/0 11 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v2)=0 v2) ==== 123+0+0 (unknown 691139944 0 0) 0x7fcbb405efb0 con 0x7fcbc015e1c0 2026-02-12T04:05:24.009 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:24.006+0000 7fcb9bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-12T04:05:24.009 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:24.006+0000 7fcb9bfff640 10 monclient: _finish_command 2 = system:0 2026-02-12T04:05:24.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:24.009+0000 7fcbc5e6f640 10 librados: watch_flush enter 2026-02-12T04:05:24.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:24.009+0000 7fcbc5e6f640 10 librados: watch_flush exit 2026-02-12T04:05:24.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:24.009+0000 7fcbc5e6f640 20 client.27961.objecter shutdown clearing up homeless session... 2026-02-12T04:05:24.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:24.009+0000 7fcbc5e6f640 10 client.27961.objecter successfully canceled tick 2026-02-12T04:05:24.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:24.009+0000 7fcbc5e6f640 1 -- 10.20.193.91:0/4199491344 >> v1:10.20.193.91:6800/2929217192 conn(0x7fcb9007a020 legacy=0x7fcb9009a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:24.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:24.009+0000 7fcbc5e6f640 10 monclient: shutdown 2026-02-12T04:05:24.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:24.009+0000 7fcbc5e6f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T04:05:24.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:24.009+0000 7fcbc5e6f640 1 -- 10.20.193.91:0/4199491344 >> v1:10.20.193.98:6789/0 conn(0x7fcbc015e1c0 legacy=0x7fcbc015bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T04:05:24.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:24.009+0000 7fcbc5e6f640 1 -- 10.20.193.91:0/4199491344 shutdown_connections 2026-02-12T04:05:24.013 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:24.009+0000 7fcbc5e6f640 1 -- 10.20.193.91:0/4199491344 >> 10.20.193.91:0/4199491344 conn(0x7fcbc00b6530 msgr2=0x7fcbc015ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T04:05:24.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:24.009+0000 7fcbc5e6f640 1 -- 10.20.193.91:0/4199491344 shutdown_connections 2026-02-12T04:05:24.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:24.009+0000 7fcbc5e6f640 1 -- 10.20.193.91:0/4199491344 wait complete. 2026-02-12T04:05:24.014 INFO:teuthology.orchestra.run.trial091.stderr:2026-02-12T04:05:24.009+0000 7fcbc5e6f640 1 librados: shutdown 2026-02-12T04:05:24.021 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-12T04:05:24.022 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-12T04:05:24.022 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-12T04:05:24.022 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-12T04:05:24.028 INFO:tasks.ceph.osd.0.trial091.stderr:2026-02-12T04:05:24.021+0000 c761640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 0 (PID: 27164) UID: 0 2026-02-12T04:05:24.028 INFO:tasks.ceph.osd.0.trial091.stderr:2026-02-12T04:05:24.022+0000 c761640 -1 osd.0 344 *** Got signal Terminated *** 2026-02-12T04:05:30.123 INFO:tasks.ceph.osd.0:Stopped 2026-02-12T04:05:30.123 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2026-02-12T04:05:30.124 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-12T04:05:30.131 INFO:tasks.ceph.osd.4.trial091.stderr:2026-02-12T04:05:30.123+0000 c761640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 4 (PID: 27238) UID: 0 2026-02-12T04:05:30.131 INFO:tasks.ceph.osd.4.trial091.stderr:2026-02-12T04:05:30.124+0000 c761640 -1 osd.4 346 *** Got signal Terminated *** 2026-02-12T04:05:31.720 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2026-02-12T04:05:34.209 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:07:55.093 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:05:34.210 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:07:55.095 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:05:34.227 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:07:55.112 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:05:34.237 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:07:55.117 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:05:34.239 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:07:55.086 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:05:34.240 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:07:55.120 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:05:34.243 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:07:55.089 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:05:34.251 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:07:55.131 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:05:34.253 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:07:55.099 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:05:36.226 INFO:tasks.ceph.osd.4:Stopped 2026-02-12T04:05:36.226 DEBUG:tasks.ceph.osd.8:waiting for process to exit 2026-02-12T04:05:36.226 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-12T04:05:36.234 INFO:tasks.ceph.osd.8.trial091.stderr:2026-02-12T04:05:36.227+0000 c761640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.8.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 8 (PID: 27241) UID: 0 2026-02-12T04:05:36.234 INFO:tasks.ceph.osd.8.trial091.stderr:2026-02-12T04:05:36.228+0000 c761640 -1 osd.8 348 *** Got signal Terminated *** 2026-02-12T04:05:38.636 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2026-02-12T04:05:42.328 INFO:tasks.ceph.osd.8:Stopped 2026-02-12T04:05:42.329 DEBUG:tasks.ceph.osd.12:waiting for process to exit 2026-02-12T04:05:42.329 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-12T04:05:42.336 INFO:tasks.ceph.osd.12.trial091.stderr:2026-02-12T04:05:42.330+0000 c761640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.12.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 12 (PID: 27243) UID: 0 2026-02-12T04:05:42.336 INFO:tasks.ceph.osd.12.trial091.stderr:2026-02-12T04:05:42.331+0000 c761640 -1 osd.12 350 *** Got signal Terminated *** 2026-02-12T04:05:45.348 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.12 is failed for ~0s 2026-02-12T04:05:48.431 INFO:tasks.ceph.osd.12:Stopped 2026-02-12T04:05:48.431 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-12T04:05:48.431 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-12T04:05:48.439 INFO:tasks.ceph.osd.1.trial098.stderr:2026-02-12T04:05:48.433+0000 c761640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 1 (PID: 26550) UID: 0 2026-02-12T04:05:48.440 INFO:tasks.ceph.osd.1.trial098.stderr:2026-02-12T04:05:48.434+0000 c761640 -1 osd.1 352 *** Got signal Terminated *** 2026-02-12T04:05:51.959 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2026-02-12T04:05:51.959 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.12 has been restored 2026-02-12T04:05:54.241 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:08:15.125 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:05:54.244 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:08:15.128 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:05:54.256 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:08:15.140 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:05:54.270 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:08:15.150 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:05:54.271 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:08:15.117 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:05:54.272 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:08:15.152 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:05:54.272 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:08:15.119 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:05:54.284 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:08:15.164 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:05:54.286 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:08:15.132 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:05:54.534 INFO:tasks.ceph.osd.1:Stopped 2026-02-12T04:05:54.534 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2026-02-12T04:05:54.535 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-12T04:05:54.541 INFO:tasks.ceph.osd.5.trial098.stderr:2026-02-12T04:05:54.535+0000 c761640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 5 (PID: 26551) UID: 0 2026-02-12T04:05:54.542 INFO:tasks.ceph.osd.5.trial098.stderr:2026-02-12T04:05:54.536+0000 c761640 -1 osd.5 354 *** Got signal Terminated *** 2026-02-12T04:05:58.472 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2026-02-12T04:05:58.472 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2026-02-12T04:06:00.636 INFO:tasks.ceph.osd.5:Stopped 2026-02-12T04:06:00.637 DEBUG:tasks.ceph.osd.9:waiting for process to exit 2026-02-12T04:06:00.637 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-12T04:06:00.643 INFO:tasks.ceph.osd.9.trial098.stderr:2026-02-12T04:06:00.637+0000 c761640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.9.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 9 (PID: 26555) UID: 0 2026-02-12T04:06:00.643 INFO:tasks.ceph.osd.9.trial098.stderr:2026-02-12T04:06:00.638+0000 c761640 -1 osd.9 356 *** Got signal Terminated *** 2026-02-12T04:06:04.885 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.9 is failed for ~0s 2026-02-12T04:06:04.885 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2026-02-12T04:06:06.739 INFO:tasks.ceph.osd.9:Stopped 2026-02-12T04:06:06.740 DEBUG:tasks.ceph.osd.13:waiting for process to exit 2026-02-12T04:06:06.740 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-12T04:06:06.747 INFO:tasks.ceph.osd.13.trial098.stderr:2026-02-12T04:06:06.740+0000 c761640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.13.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 13 (PID: 26557) UID: 0 2026-02-12T04:06:06.747 INFO:tasks.ceph.osd.13.trial098.stderr:2026-02-12T04:06:06.741+0000 c761640 -1 osd.13 358 *** Got signal Terminated *** 2026-02-12T04:06:11.194 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.13 is failed for ~0s 2026-02-12T04:06:11.194 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.9 has been restored 2026-02-12T04:06:12.842 INFO:tasks.ceph.osd.13:Stopped 2026-02-12T04:06:12.842 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-12T04:06:12.842 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-12T04:06:12.850 INFO:tasks.ceph.osd.2.trial111.stderr:2026-02-12T04:06:12.844+0000 c761640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 2 (PID: 26481) UID: 0 2026-02-12T04:06:12.850 INFO:tasks.ceph.osd.2.trial111.stderr:2026-02-12T04:06:12.845+0000 c761640 -1 osd.2 360 *** Got signal Terminated *** 2026-02-12T04:06:14.336 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:08:35.220 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:06:14.338 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:08:35.222 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:06:14.349 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:08:35.234 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:06:14.362 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:08:35.242 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:06:14.362 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:08:35.242 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:06:14.366 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:08:35.212 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:06:14.368 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:08:35.214 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:06:14.374 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:08:35.254 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:06:14.382 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:08:35.228 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:06:17.406 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2026-02-12T04:06:17.407 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.13 has been restored 2026-02-12T04:06:18.944 INFO:tasks.ceph.osd.2:Stopped 2026-02-12T04:06:18.945 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2026-02-12T04:06:18.945 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-12T04:06:18.952 INFO:tasks.ceph.osd.6.trial111.stderr:2026-02-12T04:06:18.945+0000 c761640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 6 (PID: 26484) UID: 0 2026-02-12T04:06:18.952 INFO:tasks.ceph.osd.6.trial111.stderr:2026-02-12T04:06:18.946+0000 c761640 -1 osd.6 362 *** Got signal Terminated *** 2026-02-12T04:06:23.517 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2026-02-12T04:06:23.517 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2026-02-12T04:06:25.046 INFO:tasks.ceph.osd.6:Stopped 2026-02-12T04:06:25.046 DEBUG:tasks.ceph.osd.10:waiting for process to exit 2026-02-12T04:06:25.046 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-12T04:06:25.053 INFO:tasks.ceph.osd.10.trial111.stderr:2026-02-12T04:06:25.047+0000 c761640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.10.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 10 (PID: 26486) UID: 0 2026-02-12T04:06:25.054 INFO:tasks.ceph.osd.10.trial111.stderr:2026-02-12T04:06:25.047+0000 c761640 -1 osd.10 366 *** Got signal Terminated *** 2026-02-12T04:06:29.526 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.10 is failed for ~0s 2026-02-12T04:06:29.526 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2026-02-12T04:06:31.149 INFO:tasks.ceph.osd.10:Stopped 2026-02-12T04:06:31.149 DEBUG:tasks.ceph.osd.14:waiting for process to exit 2026-02-12T04:06:31.149 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-12T04:06:31.156 INFO:tasks.ceph.osd.14.trial111.stderr:2026-02-12T04:06:31.149+0000 c761640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.14.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 14 (PID: 26489) UID: 0 2026-02-12T04:06:31.156 INFO:tasks.ceph.osd.14.trial111.stderr:2026-02-12T04:06:31.150+0000 c761640 -1 osd.14 368 *** Got signal Terminated *** 2026-02-12T04:06:34.341 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:08:55.225 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:06:34.342 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:08:55.226 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:06:34.354 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:08:55.238 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:06:34.365 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:08:55.245 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:06:34.367 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:08:55.247 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:06:34.367 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:08:55.214 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:06:34.368 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:08:55.215 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:06:34.379 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:08:55.260 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:06:34.380 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:08:55.227 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:06:35.436 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.14 is failed for ~0s 2026-02-12T04:06:35.436 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.10 has been restored 2026-02-12T04:06:37.251 INFO:tasks.ceph.osd.14:Stopped 2026-02-12T04:06:37.252 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-12T04:06:37.252 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-12T04:06:37.271 INFO:tasks.ceph.osd.3.trial154.stderr:2026-02-12T04:06:37.264+0000 c761640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 3 (PID: 26161) UID: 0 2026-02-12T04:06:37.272 INFO:tasks.ceph.osd.3.trial154.stderr:2026-02-12T04:06:37.264+0000 c761640 -1 osd.3 370 *** Got signal Terminated *** 2026-02-12T04:06:41.243 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2026-02-12T04:06:41.244 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.14 has been restored 2026-02-12T04:06:43.354 INFO:tasks.ceph.osd.3:Stopped 2026-02-12T04:06:43.354 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2026-02-12T04:06:43.354 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-12T04:06:43.361 INFO:tasks.ceph.osd.7.trial154.stderr:2026-02-12T04:06:43.355+0000 c761640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 7 (PID: 26162) UID: 0 2026-02-12T04:06:43.362 INFO:tasks.ceph.osd.7.trial154.stderr:2026-02-12T04:06:43.356+0000 c761640 -1 osd.7 370 *** Got signal Terminated *** 2026-02-12T04:06:46.951 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2026-02-12T04:06:46.951 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2026-02-12T04:06:49.456 INFO:tasks.ceph.osd.7:Stopped 2026-02-12T04:06:49.456 DEBUG:tasks.ceph.osd.11:waiting for process to exit 2026-02-12T04:06:49.456 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-12T04:06:49.463 INFO:tasks.ceph.osd.11.trial154.stderr:2026-02-12T04:06:49.457+0000 c761640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.11.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 11 (PID: 26167) UID: 0 2026-02-12T04:06:49.463 INFO:tasks.ceph.osd.11.trial154.stderr:2026-02-12T04:06:49.457+0000 c761640 -1 osd.11 370 *** Got signal Terminated *** 2026-02-12T04:06:52.657 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2026-02-12T04:06:54.373 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:09:15.257 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:06:54.374 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:09:15.258 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:06:54.382 INFO:tasks.ceph.mon.a.trial091.stderr:==00:00:09:15.266 26771== Warning: unimplemented fcntl command: 1036 2026-02-12T04:06:54.397 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:09:15.277 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:06:54.399 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:09:15.279 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:06:54.399 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:09:15.245 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:06:54.400 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:09:15.246 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:06:54.406 INFO:tasks.ceph.mon.b.trial098.stderr:==00:00:09:15.286 26314== Warning: unimplemented fcntl command: 1036 2026-02-12T04:06:54.407 INFO:tasks.ceph.mon.c.trial111.stderr:==00:00:09:15.254 26248== Warning: unimplemented fcntl command: 1036 2026-02-12T04:06:55.557 INFO:tasks.ceph.osd.11:Stopped 2026-02-12T04:06:55.558 DEBUG:tasks.ceph.osd.15:waiting for process to exit 2026-02-12T04:06:55.558 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-12T04:06:55.565 INFO:tasks.ceph.osd.15.trial154.stderr:2026-02-12T04:06:55.559+0000 c761640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/osd.15.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 15 (PID: 26168) UID: 0 2026-02-12T04:06:55.565 INFO:tasks.ceph.osd.15.trial154.stderr:2026-02-12T04:06:55.559+0000 c761640 -1 osd.15 370 *** Got signal Terminated *** 2026-02-12T04:06:58.161 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.15 is failed for ~0s 2026-02-12T04:07:01.660 INFO:tasks.ceph.osd.15:Stopped 2026-02-12T04:07:01.660 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-12T04:07:01.661 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2026-02-12T04:07:01.661 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-12T04:07:01.662 INFO:tasks.ceph.mgr.y.trial091.stderr:2026-02-12T04:07:01.660+0000 7f0b6c148640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-mgr -f --cluster ceph -i y (PID: 26819) UID: 0 2026-02-12T04:07:01.662 INFO:tasks.ceph.mgr.y.trial091.stderr:2026-02-12T04:07:01.660+0000 7f0b6c148640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2026-02-12T04:07:01.697 INFO:tasks.ceph.mgr.y:Stopped 2026-02-12T04:07:01.697 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-12T04:07:01.697 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-12T04:07:01.730 INFO:tasks.ceph.mgr.x:Stopped 2026-02-12T04:07:01.730 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-12T04:07:01.730 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-12T04:07:01.730 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-12T04:07:01.745 INFO:tasks.ceph.mon.a.trial091.stderr:2026-02-12T04:07:01.738+0000 add1640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 26769) UID: 0 2026-02-12T04:07:01.746 INFO:tasks.ceph.mon.a.trial091.stderr:2026-02-12T04:07:01.738+0000 add1640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-12T04:07:03.364 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2026-02-12T04:07:03.364 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.15 has been restored 2026-02-12T04:07:07.831 INFO:tasks.ceph.mon.a:Stopped 2026-02-12T04:07:07.831 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-12T04:07:07.831 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-12T04:07:07.839 INFO:tasks.ceph.mon.b.trial098.stderr:2026-02-12T04:07:07.831+0000 add1640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 26312) UID: 0 2026-02-12T04:07:07.840 INFO:tasks.ceph.mon.b.trial098.stderr:2026-02-12T04:07:07.832+0000 add1640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2026-02-12T04:07:08.466 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2026-02-12T04:07:08.466 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2026-02-12T04:07:13.569 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~5s 2026-02-12T04:07:13.933 INFO:tasks.ceph.mon.b:Stopped 2026-02-12T04:07:13.933 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-12T04:07:13.933 INFO:teuthology.orchestra.run:waiting for 1200 2026-02-12T04:07:13.941 INFO:tasks.ceph.mon.c.trial111.stderr:2026-02-12T04:07:13.934+0000 add1640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 26246) UID: 0 2026-02-12T04:07:13.942 INFO:tasks.ceph.mon.c.trial111.stderr:2026-02-12T04:07:13.935+0000 add1640 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2026-02-12T04:07:18.569 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2026-02-12T04:07:18.570 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2026-02-12T04:07:20.035 INFO:tasks.ceph.mon.c:Stopped 2026-02-12T04:07:20.036 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-12T04:07:20.036 DEBUG:teuthology.orchestra.run.trial091:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'reached quota' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(OBJECT_MISPLACED\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(PG_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v 'OSD bench result' | egrep -v OSD_DOWN | head -n 1 2026-02-12T04:07:20.067 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial091.front.sepia.ceph.com 2026-02-12T04:07:20.067 DEBUG:teuthology.orchestra.run.trial091:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-12T04:07:20.143 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@trial091.front.sepia.ceph.com 2026-02-12T04:07:20.143 DEBUG:teuthology.orchestra.run.trial091:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2026-02-12T04:07:20.214 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-8 on ubuntu@trial091.front.sepia.ceph.com 2026-02-12T04:07:20.215 DEBUG:teuthology.orchestra.run.trial091:> sync && sudo umount -f /var/lib/ceph/osd/ceph-8 2026-02-12T04:07:20.283 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-12 on ubuntu@trial091.front.sepia.ceph.com 2026-02-12T04:07:20.283 DEBUG:teuthology.orchestra.run.trial091:> sync && sudo umount -f /var/lib/ceph/osd/ceph-12 2026-02-12T04:07:20.359 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial098.front.sepia.ceph.com 2026-02-12T04:07:20.359 DEBUG:teuthology.orchestra.run.trial098:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-12T04:07:20.392 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@trial098.front.sepia.ceph.com 2026-02-12T04:07:20.392 DEBUG:teuthology.orchestra.run.trial098:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2026-02-12T04:07:20.466 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-9 on ubuntu@trial098.front.sepia.ceph.com 2026-02-12T04:07:20.466 DEBUG:teuthology.orchestra.run.trial098:> sync && sudo umount -f /var/lib/ceph/osd/ceph-9 2026-02-12T04:07:20.534 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-13 on ubuntu@trial098.front.sepia.ceph.com 2026-02-12T04:07:20.535 DEBUG:teuthology.orchestra.run.trial098:> sync && sudo umount -f /var/lib/ceph/osd/ceph-13 2026-02-12T04:07:20.603 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial111.front.sepia.ceph.com 2026-02-12T04:07:20.604 DEBUG:teuthology.orchestra.run.trial111:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-12T04:07:20.639 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@trial111.front.sepia.ceph.com 2026-02-12T04:07:20.639 DEBUG:teuthology.orchestra.run.trial111:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2026-02-12T04:07:20.711 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-10 on ubuntu@trial111.front.sepia.ceph.com 2026-02-12T04:07:20.712 DEBUG:teuthology.orchestra.run.trial111:> sync && sudo umount -f /var/lib/ceph/osd/ceph-10 2026-02-12T04:07:20.784 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-14 on ubuntu@trial111.front.sepia.ceph.com 2026-02-12T04:07:20.784 DEBUG:teuthology.orchestra.run.trial111:> sync && sudo umount -f /var/lib/ceph/osd/ceph-14 2026-02-12T04:07:20.854 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial154.front.sepia.ceph.com 2026-02-12T04:07:20.855 DEBUG:teuthology.orchestra.run.trial154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-12T04:07:20.893 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@trial154.front.sepia.ceph.com 2026-02-12T04:07:20.893 DEBUG:teuthology.orchestra.run.trial154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2026-02-12T04:07:20.981 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-11 on ubuntu@trial154.front.sepia.ceph.com 2026-02-12T04:07:20.981 DEBUG:teuthology.orchestra.run.trial154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-11 2026-02-12T04:07:21.014 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-15 on ubuntu@trial154.front.sepia.ceph.com 2026-02-12T04:07:21.015 DEBUG:teuthology.orchestra.run.trial154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-15 2026-02-12T04:07:21.090 INFO:tasks.ceph:Archiving mon data... 2026-02-12T04:07:21.091 DEBUG:teuthology.misc:Transferring archived files from trial091:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/yuriw-2026-02-11_20:27:55-rados-wip-yuri3-testing-2026-02-09-1550-tentacle-distro-default-trial/45766/data/mon.a.tgz 2026-02-12T04:07:21.091 DEBUG:teuthology.orchestra.run.trial091:> mktemp 2026-02-12T04:07:21.109 INFO:teuthology.orchestra.run.trial091.stdout:/tmp/tmp.G2afgahjiv 2026-02-12T04:07:21.110 DEBUG:teuthology.orchestra.run.trial091:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.G2afgahjiv 2026-02-12T04:07:21.284 DEBUG:teuthology.orchestra.run.trial091:> sudo chmod 0666 /tmp/tmp.G2afgahjiv 2026-02-12T04:07:21.365 DEBUG:teuthology.orchestra.remote:trial091:/tmp/tmp.G2afgahjiv is 876KB 2026-02-12T04:07:21.469 DEBUG:teuthology.orchestra.run.trial091:> rm -fr /tmp/tmp.G2afgahjiv 2026-02-12T04:07:21.486 DEBUG:teuthology.misc:Transferring archived files from trial098:/var/lib/ceph/mon/ceph-b to /home/teuthworker/mnt/teuthology/yuriw-2026-02-11_20:27:55-rados-wip-yuri3-testing-2026-02-09-1550-tentacle-distro-default-trial/45766/data/mon.b.tgz 2026-02-12T04:07:21.487 DEBUG:teuthology.orchestra.run.trial098:> mktemp 2026-02-12T04:07:21.505 INFO:teuthology.orchestra.run.trial098.stdout:/tmp/tmp.0f46xGgQMQ 2026-02-12T04:07:21.505 DEBUG:teuthology.orchestra.run.trial098:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.0f46xGgQMQ 2026-02-12T04:07:21.681 DEBUG:teuthology.orchestra.run.trial098:> sudo chmod 0666 /tmp/tmp.0f46xGgQMQ 2026-02-12T04:07:21.763 DEBUG:teuthology.orchestra.remote:trial098:/tmp/tmp.0f46xGgQMQ is 877KB 2026-02-12T04:07:21.864 DEBUG:teuthology.orchestra.run.trial098:> rm -fr /tmp/tmp.0f46xGgQMQ 2026-02-12T04:07:21.881 DEBUG:teuthology.misc:Transferring archived files from trial111:/var/lib/ceph/mon/ceph-c to /home/teuthworker/mnt/teuthology/yuriw-2026-02-11_20:27:55-rados-wip-yuri3-testing-2026-02-09-1550-tentacle-distro-default-trial/45766/data/mon.c.tgz 2026-02-12T04:07:21.882 DEBUG:teuthology.orchestra.run.trial111:> mktemp 2026-02-12T04:07:21.899 INFO:teuthology.orchestra.run.trial111.stdout:/tmp/tmp.fWsQYMjz0J 2026-02-12T04:07:21.900 DEBUG:teuthology.orchestra.run.trial111:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.fWsQYMjz0J 2026-02-12T04:07:22.074 DEBUG:teuthology.orchestra.run.trial111:> sudo chmod 0666 /tmp/tmp.fWsQYMjz0J 2026-02-12T04:07:22.159 DEBUG:teuthology.orchestra.remote:trial111:/tmp/tmp.fWsQYMjz0J is 877KB 2026-02-12T04:07:22.259 DEBUG:teuthology.orchestra.run.trial111:> rm -fr /tmp/tmp.fWsQYMjz0J 2026-02-12T04:07:22.276 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-12T04:07:22.277 DEBUG:teuthology.orchestra.run.trial091:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-12T04:07:22.280 DEBUG:teuthology.orchestra.run.trial098:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-12T04:07:22.283 DEBUG:teuthology.orchestra.run.trial111:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-12T04:07:22.319 DEBUG:teuthology.orchestra.run.trial154:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-12T04:07:22.419 ERROR:teuthology.util.scanner:Opening and ending tag mismatch: still_reachable line 85 and leak_summary, line 92, column 16 (, line 92) 2026-02-12T04:07:22.602 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-12T04:07:22.677 ERROR:teuthology.util.scanner:Opening and ending tag mismatch: still_reachable line 85 and leak_summary, line 92, column 16 (, line 92) 2026-02-12T04:07:22.858 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-12T04:07:22.933 ERROR:teuthology.util.scanner:Opening and ending tag mismatch: still_reachable line 85 and leak_summary, line 92, column 16 (, line 92) 2026-02-12T04:07:23.114 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-12T04:07:23.326 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-12T04:07:23.326 INFO:tasks.ceph:Archiving crash dumps... 2026-02-12T04:07:23.329 DEBUG:teuthology.misc:Transferring archived files from trial091:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-11_20:27:55-rados-wip-yuri3-testing-2026-02-09-1550-tentacle-distro-default-trial/45766/remote/trial091/crash 2026-02-12T04:07:23.330 DEBUG:teuthology.orchestra.run.trial091:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-12T04:07:23.356 DEBUG:teuthology.misc:Transferring archived files from trial098:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-11_20:27:55-rados-wip-yuri3-testing-2026-02-09-1550-tentacle-distro-default-trial/45766/remote/trial098/crash 2026-02-12T04:07:23.358 DEBUG:teuthology.orchestra.run.trial098:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-12T04:07:23.384 DEBUG:teuthology.misc:Transferring archived files from trial111:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-11_20:27:55-rados-wip-yuri3-testing-2026-02-09-1550-tentacle-distro-default-trial/45766/remote/trial111/crash 2026-02-12T04:07:23.386 DEBUG:teuthology.orchestra.run.trial111:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-12T04:07:23.412 DEBUG:teuthology.misc:Transferring archived files from trial154:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-11_20:27:55-rados-wip-yuri3-testing-2026-02-09-1550-tentacle-distro-default-trial/45766/remote/trial154/crash 2026-02-12T04:07:23.414 DEBUG:teuthology.orchestra.run.trial154:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-12T04:07:23.441 INFO:tasks.ceph:Compressing logs... 2026-02-12T04:07:23.441 DEBUG:teuthology.orchestra.run.trial091:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T04:07:23.444 DEBUG:teuthology.orchestra.run.trial098:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T04:07:23.447 DEBUG:teuthology.orchestra.run.trial111:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T04:07:23.458 DEBUG:teuthology.orchestra.run.trial154:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T04:07:23.466 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32915.log 2026-02-12T04:07:23.481 INFO:teuthology.orchestra.run.trial098.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2026-02-12T04:07:23.481 INFO:teuthology.orchestra.run.trial098.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.5.log 2026-02-12T04:07:23.481 INFO:teuthology.orchestra.run.trial098.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.13.log 2026-02-12T04:07:23.481 INFO:teuthology.orchestra.run.trial098.stderr:/var/log/ceph/valgrind/osd.5.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.1.log 2026-02-12T04:07:23.481 INFO:teuthology.orchestra.run.trial098.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.5.log.gz 2026-02-12T04:07:23.481 INFO:teuthology.orchestra.run.trial098.stderr:/var/log/ceph/valgrind/osd.13.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.9.log 2026-02-12T04:07:23.482 INFO:teuthology.orchestra.run.trial098.stderr: 65.5% -- replaced with /var/log/ceph/valgrind/osd.13.log.gz 2026-02-12T04:07:23.482 INFO:teuthology.orchestra.run.trial098.stderr:/var/log/ceph/valgrind/osd.1.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2026-02-12T04:07:23.482 INFO:teuthology.orchestra.run.trial098.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.1.log.gz 2026-02-12T04:07:23.482 INFO:teuthology.orchestra.run.trial098.stderr:gzip/var/log/ceph/valgrind/osd.9.log: -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-12T04:07:23.482 INFO:teuthology.orchestra.run.trial098.stderr: 65.6% -- replaced with /var/log/ceph/valgrind/osd.9.log.gz 2026-02-12T04:07:23.482 INFO:teuthology.orchestra.run.trial098.stderr:/var/log/ceph/valgrind/mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2026-02-12T04:07:23.482 INFO:teuthology.orchestra.run.trial098.stderr: 65.6% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2026-02-12T04:07:23.482 INFO:teuthology.orchestra.run.trial098.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.13.log 2026-02-12T04:07:23.482 INFO:teuthology.orchestra.run.trial098.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-12T04:07:23.482 INFO:teuthology.orchestra.run.trial098.stderr:/var/log/ceph/ceph-osd.13.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-12T04:07:23.482 INFO:teuthology.orchestra.run.trial098.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.9.log 2026-02-12T04:07:23.483 INFO:teuthology.orchestra.run.trial098.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-osd.9.log: 91.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-12T04:07:23.483 INFO:teuthology.orchestra.run.trial098.stderr: 87.0% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-12T04:07:23.490 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-12T04:07:23.490 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2026-02-12T04:07:23.490 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.2.log 2026-02-12T04:07:23.490 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/osd.6.log 2026-02-12T04:07:23.491 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/valgrind/osd.2.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.14.log 2026-02-12T04:07:23.491 INFO:teuthology.orchestra.run.trial111.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.2.log.gz 2026-02-12T04:07:23.491 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/valgrind/osd.6.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.10.log 2026-02-12T04:07:23.491 INFO:teuthology.orchestra.run.trial111.stderr: 66.1% -- replaced with /var/log/ceph/valgrind/osd.6.log.gz 2026-02-12T04:07:23.491 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/valgrind/osd.14.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2026-02-12T04:07:23.491 INFO:teuthology.orchestra.run.trial111.stderr: 65.6% -- replaced with /var/log/ceph/valgrind/osd.14.log.gz 2026-02-12T04:07:23.491 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.10.log 2026-02-12T04:07:23.491 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/valgrind/osd.10.log: 65.6% -- replaced with /var/log/ceph/valgrind/osd.10.log.gz 2026-02-12T04:07:23.491 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/valgrind/mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.14.log 2026-02-12T04:07:23.491 INFO:teuthology.orchestra.run.trial111.stderr: 65.5% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2026-02-12T04:07:23.491 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-12T04:07:23.491 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-osd.14.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2026-02-12T04:07:23.492 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose --/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph.log 2026-02-12T04:07:23.492 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph.log: 87.0% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-12T04:07:23.492 INFO:teuthology.orchestra.run.trial111.stderr: 91.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-12T04:07:23.510 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-12T04:07:23.510 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.32915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34825.log 2026-02-12T04:07:23.510 INFO:teuthology.orchestra.run.trial091.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.32915.log.gz 2026-02-12T04:07:23.510 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32434.log 2026-02-12T04:07:23.510 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.34825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32429.log 2026-02-12T04:07:23.510 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.32434.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-12T04:07:23.510 INFO:teuthology.orchestra.run.trial091.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34825.log.gz 2026-02-12T04:07:23.510 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.32429.log: gzip -5 --verbose 87.0% -- -- replaced with /var/log/ceph/ceph-client.admin.32434.log.gz /var/log/ceph/ceph-client.admin.31621.log 2026-02-12T04:07:23.510 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:07:23.510 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-osd.0.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.32429.log.gz 2026-02-12T04:07:23.510 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29112.log 2026-02-12T04:07:23.510 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31646.log 2026-02-12T04:07:23.510 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.31621.log: /var/log/ceph/ceph-client.admin.29112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32992.log 2026-02-12T04:07:23.511 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.31646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34286.log 2026-02-12T04:07:23.511 INFO:teuthology.orchestra.run.trial091.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31621.log.gz 2026-02-12T04:07:23.511 INFO:teuthology.orchestra.run.trial091.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.29112.log.gz 2026-02-12T04:07:23.511 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.32992.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2026-02-12T04:07:23.511 INFO:teuthology.orchestra.run.trial091.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31646.log.gz 2026-02-12T04:07:23.511 INFO:teuthology.orchestra.run.trial091.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.32992.log.gz 2026-02-12T04:07:23.511 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.34286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33403.log 2026-02-12T04:07:23.511 INFO:teuthology.orchestra.run.trial091.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34286.log.gz 2026-02-12T04:07:23.511 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34139.log 2026-02-12T04:07:23.511 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32985.log 2026-02-12T04:07:23.511 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.33403.log: /var/log/ceph/ceph-client.admin.34139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32421.log 2026-02-12T04:07:23.511 INFO:teuthology.orchestra.run.trial091.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.33403.log.gz 2026-02-12T04:07:23.511 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.32985.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34139.log.gz 2026-02-12T04:07:23.511 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33600.log 2026-02-12T04:07:23.511 INFO:teuthology.orchestra.run.trial091.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.32985.log.gz 2026-02-12T04:07:23.511 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32423.log 2026-02-12T04:07:23.511 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.32421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31651.log 2026-02-12T04:07:23.511 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.33600.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.32421.log.gz 2026-02-12T04:07:23.511 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.32423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31612.log 2026-02-12T04:07:23.511 INFO:teuthology.orchestra.run.trial091.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.33600.log.gz 2026-02-12T04:07:23.512 INFO:teuthology.orchestra.run.trial091.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.32423.log.gz 2026-02-12T04:07:23.512 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.31651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34776.log 2026-02-12T04:07:23.512 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.31612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34482.log 2026-02-12T04:07:23.512 INFO:teuthology.orchestra.run.trial091.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.31651.log.gz 2026-02-12T04:07:23.512 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.34776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32433.log 2026-02-12T04:07:23.512 INFO:teuthology.orchestra.run.trial091.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.31612.log.gz 2026-02-12T04:07:23.512 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.34482.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34776.log.gz 2026-02-12T04:07:23.512 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33181.log 2026-02-12T04:07:23.512 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31051.log 2026-02-12T04:07:23.512 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.32433.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34482.log.gz 2026-02-12T04:07:23.512 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.33181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33649.log 2026-02-12T04:07:23.512 INFO:teuthology.orchestra.run.trial091.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.32433.log.gz 2026-02-12T04:07:23.512 INFO:teuthology.orchestra.run.trial091.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.33181.log.gz 2026-02-12T04:07:23.512 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.31051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34041.log 2026-02-12T04:07:23.512 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.33649.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.31051.log.gz 2026-02-12T04:07:23.512 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27274.log 2026-02-12T04:07:23.512 INFO:teuthology.orchestra.run.trial091.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.33649.log.gz 2026-02-12T04:07:23.512 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34629.log 2026-02-12T04:07:23.512 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.34041.log: /var/log/ceph/ceph-client.admin.27274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32815.log 2026-02-12T04:07:23.512 INFO:teuthology.orchestra.run.trial091.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34041.log.gz 2026-02-12T04:07:23.512 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.34629.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.27274.log.gz 2026-02-12T04:07:23.513 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31638.log 2026-02-12T04:07:23.513 INFO:teuthology.orchestra.run.trial091.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34629.log.gz 2026-02-12T04:07:23.513 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.32815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31616.log 2026-02-12T04:07:23.513 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.31638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32435.log 2026-02-12T04:07:23.513 INFO:teuthology.orchestra.run.trial091.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32815.log.gz 2026-02-12T04:07:23.513 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.31616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35021.log 2026-02-12T04:07:23.513 INFO:teuthology.orchestra.run.trial091.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.31638.log.gz 2026-02-12T04:07:23.513 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.32435.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.31616.log.gz 2026-02-12T04:07:23.513 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34580.log 2026-02-12T04:07:23.513 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.35021.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.32435.log.gz 2026-02-12T04:07:23.513 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34384.log 2026-02-12T04:07:23.513 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.34580.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35021.log.gz 2026-02-12T04:07:23.513 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30893.log 2026-02-12T04:07:23.513 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32410.log 2026-02-12T04:07:23.513 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.34384.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34580.log.gz 2026-02-12T04:07:23.513 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.30893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33894.log 2026-02-12T04:07:23.513 INFO:teuthology.orchestra.run.trial091.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34384.log.gz 2026-02-12T04:07:23.513 INFO:teuthology.orchestra.run.trial091.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.30893.log.gz 2026-02-12T04:07:23.513 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34972.log 2026-02-12T04:07:23.513 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.32410.log: /var/log/ceph/ceph-client.admin.33894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33747.log 2026-02-12T04:07:23.513 INFO:teuthology.orchestra.run.trial091.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.32410.log.gz 2026-02-12T04:07:23.514 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.34972.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33894.log.gz 2026-02-12T04:07:23.514 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26928.log 2026-02-12T04:07:23.514 INFO:teuthology.orchestra.run.trial091.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34972.log.gz 2026-02-12T04:07:23.514 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.33747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27297.log 2026-02-12T04:07:23.514 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.26928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26822.log 2026-02-12T04:07:23.514 INFO:teuthology.orchestra.run.trial091.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33747.log.gz 2026-02-12T04:07:23.514 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.27297.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.26928.log.gz 2026-02-12T04:07:23.514 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31628.log 2026-02-12T04:07:23.514 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.26822.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.27297.log.gz 2026-02-12T04:07:23.514 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33287.log 2026-02-12T04:07:23.514 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33845.log 2026-02-12T04:07:23.514 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.31628.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.26822.log.gz 2026-02-12T04:07:23.514 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.33287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35168.log 2026-02-12T04:07:23.514 INFO:teuthology.orchestra.run.trial091.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.31628.log.gz 2026-02-12T04:07:23.514 INFO:teuthology.orchestra.run.trial091.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.33287.log.gz 2026-02-12T04:07:23.514 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.33845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31652.log 2026-02-12T04:07:23.514 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.35168.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.0.log 2026-02-12T04:07:23.514 INFO:teuthology.orchestra.run.trial091.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.33845.log.gz 2026-02-12T04:07:23.514 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.31652.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.12.log 2026-02-12T04:07:23.514 INFO:teuthology.orchestra.run.trial091.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35168.log.gz 2026-02-12T04:07:23.514 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/valgrind/osd.0.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.8.log 2026-02-12T04:07:23.514 INFO:teuthology.orchestra.run.trial091.stderr: 66.1% -- replaced with /var/log/ceph/valgrind/osd.0.log.gz 2026-02-12T04:07:23.515 INFO:teuthology.orchestra.run.trial091.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.31652.log.gz 2026-02-12T04:07:23.515 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/valgrind/osd.12.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2026-02-12T04:07:23.515 INFO:teuthology.orchestra.run.trial091.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.12.log.gz 2026-02-12T04:07:23.515 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/valgrind/osd.8.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.4.log 2026-02-12T04:07:23.515 INFO:teuthology.orchestra.run.trial091.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.8.log.gz 2026-02-12T04:07:23.515 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/valgrind/mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33796.log 2026-02-12T04:07:23.515 INFO:teuthology.orchestra.run.trial091.stderr: 65.4% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2026-02-12T04:07:23.515 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/valgrind/osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31642.log 2026-02-12T04:07:23.515 INFO:teuthology.orchestra.run.trial091.stderr: 65.7% -- replaced with /var/log/ceph/valgrind/osd.4.log.gz 2026-02-12T04:07:23.515 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.33796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35414.log 2026-02-12T04:07:23.515 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.31642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34727.log 2026-02-12T04:07:23.515 INFO:teuthology.orchestra.run.trial091.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33796.log.gz 2026-02-12T04:07:23.515 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.35414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34433.log 2026-02-12T04:07:23.515 INFO:teuthology.orchestra.run.trial091.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.31642.log.gz 2026-02-12T04:07:23.515 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31609.log 2026-02-12T04:07:23.515 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.34727.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35414.log.gz 2026-02-12T04:07:23.515 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31636.log 2026-02-12T04:07:23.515 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.34433.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34727.log.gz 2026-02-12T04:07:23.515 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.31609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32397.log 2026-02-12T04:07:23.515 INFO:teuthology.orchestra.run.trial091.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34433.log.gz 2026-02-12T04:07:23.515 INFO:teuthology.orchestra.run.trial091.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.31609.log.gz 2026-02-12T04:07:23.515 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.31636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33452.log 2026-02-12T04:07:23.516 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32416.log 2026-02-12T04:07:23.516 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.32397.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.31636.log.gz 2026-02-12T04:07:23.516 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.33452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32844.log 2026-02-12T04:07:23.516 INFO:teuthology.orchestra.run.trial091.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.32397.log.gz 2026-02-12T04:07:23.516 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31149.log 2026-02-12T04:07:23.516 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.32416.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.33452.log.gz 2026-02-12T04:07:23.516 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.32844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32436.log 2026-02-12T04:07:23.516 INFO:teuthology.orchestra.run.trial091.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.32416.log.gz 2026-02-12T04:07:23.516 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.31149.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.12.log 2026-02-12T04:07:23.516 INFO:teuthology.orchestra.run.trial091.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.32844.log.gz 2026-02-12T04:07:23.516 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.32436.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.31149.log.gz 2026-02-12T04:07:23.516 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33992.log 2026-02-12T04:07:23.516 INFO:teuthology.orchestra.run.trial091.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.32436.log.gz 2026-02-12T04:07:23.516 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-osd.12.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30963.log 2026-02-12T04:07:23.516 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.33992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33142.log 2026-02-12T04:07:23.516 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.30963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35217.log 2026-02-12T04:07:23.516 INFO:teuthology.orchestra.run.trial091.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33992.log.gz 2026-02-12T04:07:23.516 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.33142.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30963.log.gz 2026-02-12T04:07:23.516 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35070.log 2026-02-12T04:07:23.516 INFO:teuthology.orchestra.run.trial091.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.33142.log.gz 2026-02-12T04:07:23.516 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.35217.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2026-02-12T04:07:23.516 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.35070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31650.log 2026-02-12T04:07:23.517 INFO:teuthology.orchestra.run.trial091.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35217.log.gz 2026-02-12T04:07:23.517 INFO:teuthology.orchestra.run.trial091.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35070.log.gz 2026-02-12T04:07:23.517 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31607.log 2026-02-12T04:07:23.517 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31631.log 2026-02-12T04:07:23.517 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.31650.log: /var/log/ceph/ceph-client.admin.31607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33067.log 2026-02-12T04:07:23.517 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.31631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32408.log 2026-02-12T04:07:23.517 INFO:teuthology.orchestra.run.trial091.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.31650.log.gz 2026-02-12T04:07:23.517 INFO:teuthology.orchestra.run.trial091.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.31607.log.gz 2026-02-12T04:07:23.517 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.33067.log: gzip 87.1% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.31631.log.gz -- 2026-02-12T04:07:23.517 INFO:teuthology.orchestra.run.trial091.stderr: /var/log/ceph/ceph-client.admin.34188.log 2026-02-12T04:07:23.517 INFO:teuthology.orchestra.run.trial091.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.33067.log.gz 2026-02-12T04:07:23.517 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.32408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35119.log 2026-02-12T04:07:23.517 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.34188.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.32408.log.gz 2026-02-12T04:07:23.517 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32402.log 2026-02-12T04:07:23.517 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.35119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32420.log 2026-02-12T04:07:23.517 INFO:teuthology.orchestra.run.trial091.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34188.log.gz 2026-02-12T04:07:23.517 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.32402.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.35119.log.gz 2026-02-12T04:07:23.517 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-12T04:07:23.517 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.32420.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.32402.log.gz 2026-02-12T04:07:23.517 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32430.log 2026-02-12T04:07:23.517 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33943.log 2026-02-12T04:07:23.517 INFO:teuthology.orchestra.run.trial091.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.32420.log.gz 2026-02-12T04:07:23.517 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.32430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34531.log 2026-02-12T04:07:23.518 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.33943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34237.log 2026-02-12T04:07:23.518 INFO:teuthology.orchestra.run.trial091.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.32430.log.gz 2026-02-12T04:07:23.518 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.34531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34335.log 2026-02-12T04:07:23.518 INFO:teuthology.orchestra.run.trial091.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.33943.log.gz 2026-02-12T04:07:23.518 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.34237.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.34531.log.gz 2026-02-12T04:07:23.518 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32404.log 2026-02-12T04:07:23.518 INFO:teuthology.orchestra.run.trial091.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.34237.log.gz 2026-02-12T04:07:23.518 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.34335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33294.log 2026-02-12T04:07:23.518 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.32404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31100.log 2026-02-12T04:07:23.518 INFO:teuthology.orchestra.run.trial091.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34335.log.gz 2026-02-12T04:07:23.518 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.33294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34678.log 2026-02-12T04:07:23.518 INFO:teuthology.orchestra.run.trial091.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.32404.log.gz 2026-02-12T04:07:23.518 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.31100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32401.log 2026-02-12T04:07:23.518 INFO:teuthology.orchestra.run.trial091.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.33294.log.gz 2026-02-12T04:07:23.518 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.34678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27343.log 2026-02-12T04:07:23.518 INFO:teuthology.orchestra.run.trial091.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31100.log.gz 2026-02-12T04:07:23.518 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.32401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34090.log 2026-02-12T04:07:23.518 INFO:teuthology.orchestra.run.trial091.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34678.log.gz 2026-02-12T04:07:23.518 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.27343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31198.log 2026-02-12T04:07:23.518 INFO:teuthology.orchestra.run.trial091.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.32401.log.gz 2026-02-12T04:07:23.518 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.34090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35461.log 2026-02-12T04:07:23.518 INFO:teuthology.orchestra.run.trial091.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.27343.log.gz 2026-02-12T04:07:23.518 INFO:teuthology.orchestra.run.trial091.stderr: 91.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-12T04:07:23.519 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.31198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32916.log 2026-02-12T04:07:23.519 INFO:teuthology.orchestra.run.trial091.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34090.log.gz 2026-02-12T04:07:23.519 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.35461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35364.log 2026-02-12T04:07:23.519 INFO:teuthology.orchestra.run.trial091.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31198.log.gz 2026-02-12T04:07:23.519 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.32916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33295.log 2026-02-12T04:07:23.519 INFO:teuthology.orchestra.run.trial091.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35461.log.gz 2026-02-12T04:07:23.519 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.35364.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.32916.log.gz 2026-02-12T04:07:23.519 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31644.log 2026-02-12T04:07:23.519 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.33295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33501.log 2026-02-12T04:07:23.519 INFO:teuthology.orchestra.run.trial091.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.35364.log.gz 2026-02-12T04:07:23.519 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.31644.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.33295.log.gz 2026-02-12T04:07:23.519 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20473.log 2026-02-12T04:07:23.519 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.33501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35315.log 2026-02-12T04:07:23.519 INFO:teuthology.orchestra.run.trial091.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.31644.log.gz 2026-02-12T04:07:23.519 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph.tmp-client.admin.20473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30986.log 2026-02-12T04:07:23.519 INFO:teuthology.orchestra.run.trial091.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33501.log.gz 2026-02-12T04:07:23.519 INFO:teuthology.orchestra.run.trial091.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20473.log.gz 2026-02-12T04:07:23.519 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.35315.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-12T04:07:23.519 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.30986.log: gzip 85.4% -- replaced with /var/log/ceph/ceph-client.admin.35315.log.gz -5 2026-02-12T04:07:23.519 INFO:teuthology.orchestra.run.trial091.stderr: --verbose -- /var/log/ceph/ceph-osd.8.log 2026-02-12T04:07:23.519 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35266.log 2026-02-12T04:07:23.519 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34923.log 2026-02-12T04:07:23.519 INFO:teuthology.orchestra.run.trial091.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.30986.log.gz 2026-02-12T04:07:23.519 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.35266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31639.log 2026-02-12T04:07:23.520 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.34923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30816.log 2026-02-12T04:07:23.520 INFO:teuthology.orchestra.run.trial091.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35266.log.gz 2026-02-12T04:07:23.520 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.31639.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.34923.log.gz 2026-02-12T04:07:23.520 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33698.log 2026-02-12T04:07:23.520 INFO:teuthology.orchestra.run.trial091.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.31639.log.gz 2026-02-12T04:07:23.520 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34874.log 2026-02-12T04:07:23.520 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.30816.log: /var/log/ceph/ceph-client.admin.33698.log: 87.0% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-12T04:07:23.520 INFO:teuthology.orchestra.run.trial091.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.30816.log.gz 2026-02-12T04:07:23.520 INFO:teuthology.orchestra.run.trial091.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.33698.log.gz 2026-02-12T04:07:23.520 INFO:teuthology.orchestra.run.trial091.stderr:/var/log/ceph/ceph-client.admin.34874.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34874.log.gz 2026-02-12T04:07:23.528 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25432.log 2026-02-12T04:07:23.528 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30723.log 2026-02-12T04:07:23.528 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.25432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30631.log 2026-02-12T04:07:23.528 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.30723.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.25432.log.gz 2026-02-12T04:07:23.528 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39333.log 2026-02-12T04:07:23.528 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.30631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30621.log 2026-02-12T04:07:23.528 INFO:teuthology.orchestra.run.trial154.stderr:gzip/var/log/ceph/ceph-client.admin.39333.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.30870.log 2026-02-12T04:07:23.528 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.30621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30912.log 2026-02-12T04:07:23.528 INFO:teuthology.orchestra.run.trial154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.30723.log.gz 2026-02-12T04:07:23.528 INFO:teuthology.orchestra.run.trial154.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.30621.log.gz 2026-02-12T04:07:23.528 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.30870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25621.log 2026-02-12T04:07:23.528 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.30912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30059.log 2026-02-12T04:07:23.528 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.25621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29879.log 2026-02-12T04:07:23.528 INFO:teuthology.orchestra.run.trial154.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.25621.log.gz 2026-02-12T04:07:23.528 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.30059.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.39333.log.gz 2026-02-12T04:07:23.529 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25950.log 2026-02-12T04:07:23.529 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.29879.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-12T04:07:23.529 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.25950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29958.log 2026-02-12T04:07:23.529 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-osd.3.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.30870.log.gz 2026-02-12T04:07:23.529 INFO:teuthology.orchestra.run.trial154.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.25950.log.gz 2026-02-12T04:07:23.529 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30407.log 2026-02-12T04:07:23.529 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.29958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30614.log 2026-02-12T04:07:23.529 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.30407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30669.log 2026-02-12T04:07:23.529 INFO:teuthology.orchestra.run.trial154.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.30631.log.gz 2026-02-12T04:07:23.529 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.30614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30087.log 2026-02-12T04:07:23.529 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.30669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30387.log 2026-02-12T04:07:23.529 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.30087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32161.log 2026-02-12T04:07:23.529 INFO:teuthology.orchestra.run.trial154.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.30669.log.gz 2026-02-12T04:07:23.529 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.30387.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.30407.log.gz 2026-02-12T04:07:23.529 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30682.log 2026-02-12T04:07:23.529 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.32161.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.29958.log.gz 2026-02-12T04:07:23.529 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30652.log 2026-02-12T04:07:23.529 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.30682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29939.log 2026-02-12T04:07:23.529 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.30652.log: 89.8% 87.4% -- replaced with /var/log/ceph/ceph-client.admin.30614.log.gz 2026-02-12T04:07:23.529 INFO:teuthology.orchestra.run.trial154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30682.log.gz 2026-02-12T04:07:23.529 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25374.log 2026-02-12T04:07:23.529 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.29939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26044.log 2026-02-12T04:07:23.529 INFO:teuthology.orchestra.run.trial154.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.30652.log.gz 2026-02-12T04:07:23.529 INFO:teuthology.orchestra.run.trial154.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.30912.log.gz 2026-02-12T04:07:23.529 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.25374.log: gzip -5 --verbose 90.1% -- /var/log/ceph/ceph-osd.7.log -- replaced with /var/log/ceph/ceph-client.admin.32161.log.gz 2026-02-12T04:07:23.529 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T04:07:23.529 INFO:teuthology.orchestra.run.trial154.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.25374.log.gz 2026-02-12T04:07:23.529 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30677.log 2026-02-12T04:07:23.529 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.26044.log: /var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34641.log 2026-02-12T04:07:23.530 INFO:teuthology.orchestra.run.trial154.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.26044.log.gz 2026-02-12T04:07:23.530 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.30677.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.7.log 2026-02-12T04:07:23.530 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.34641.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.11.log 2026-02-12T04:07:23.530 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/valgrind/osd.7.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.15.log 2026-02-12T04:07:23.530 INFO:teuthology.orchestra.run.trial154.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.7.log.gz 2026-02-12T04:07:23.530 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/valgrind/osd.11.log: gzip -5 --verbose -- /var/log/ceph/valgrind/osd.3.log 2026-02-12T04:07:23.530 INFO:teuthology.orchestra.run.trial154.stderr: 65.9% -- replaced with /var/log/ceph/valgrind/osd.11.log.gz 2026-02-12T04:07:23.530 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/valgrind/osd.15.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32293.log 2026-02-12T04:07:23.530 INFO:teuthology.orchestra.run.trial154.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.30387.log.gz 2026-02-12T04:07:23.530 INFO:teuthology.orchestra.run.trial154.stderr: 65.9% -- replaced with /var/log/ceph/valgrind/osd.15.log.gz 2026-02-12T04:07:23.530 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/valgrind/osd.3.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.34641.log.gz 2026-02-12T04:07:23.530 INFO:teuthology.orchestra.run.trial154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.30677.log.gz 2026-02-12T04:07:23.530 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30129.log 2026-02-12T04:07:23.530 INFO:teuthology.orchestra.run.trial154.stderr: 66.0% -- replaced with /var/log/ceph/valgrind/osd.3.log.gz 2026-02-12T04:07:23.530 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.32293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25762.log 2026-02-12T04:07:23.530 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.30129.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.11.log 2026-02-12T04:07:23.530 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.25762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34642.log 2026-02-12T04:07:23.530 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-osd.11.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.25762.log.gz 2026-02-12T04:07:23.530 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25668.log 2026-02-12T04:07:23.530 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.34642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30852.log 2026-02-12T04:07:23.530 INFO:teuthology.orchestra.run.trial154.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.32293.log.gz 2026-02-12T04:07:23.530 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.25668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30331.log 2026-02-12T04:07:23.530 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.30852.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.25668.log.gz 2026-02-12T04:07:23.530 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30457.log 2026-02-12T04:07:23.530 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.30331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32163.log 2026-02-12T04:07:23.530 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.30457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39334.log 2026-02-12T04:07:23.530 INFO:teuthology.orchestra.run.trial154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.34642.log.gz 2026-02-12T04:07:23.530 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.32163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25526.log 2026-02-12T04:07:23.530 INFO:teuthology.orchestra.run.trial154.stderr:gzip/var/log/ceph/ceph-client.admin.39334.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39337.log 2026-02-12T04:07:23.530 INFO:teuthology.orchestra.run.trial154.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.30129.log.gz 2026-02-12T04:07:23.530 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.25526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30261.log 2026-02-12T04:07:23.531 INFO:teuthology.orchestra.run.trial154.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.25526.log.gz 2026-02-12T04:07:23.531 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.39337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30481.log 2026-02-12T04:07:23.531 INFO:teuthology.orchestra.run.trial154.stderr:gzip/var/log/ceph/ceph-client.admin.30261.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.30766.log 2026-02-12T04:07:23.531 INFO:teuthology.orchestra.run.trial154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.39334.log.gz 2026-02-12T04:07:23.531 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.30481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30922.log 2026-02-12T04:07:23.531 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.30766.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.32163.log.gz 2026-02-12T04:07:23.531 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32291.log 2026-02-12T04:07:23.531 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.30922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25715.log 2026-02-12T04:07:23.531 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.32291.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.29939.log.gz 2026-02-12T04:07:23.531 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29979.log 2026-02-12T04:07:23.531 INFO:teuthology.orchestra.run.trial154.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.30331.log.gz 2026-02-12T04:07:23.531 INFO:teuthology.orchestra.run.trial154.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.39337.log.gz 2026-02-12T04:07:23.531 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.25715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32162.log 2026-02-12T04:07:23.531 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.29979.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.25715.log.gz 2026-02-12T04:07:23.531 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25479.log 2026-02-12T04:07:23.531 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.32162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25809.log 2026-02-12T04:07:23.531 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.25479.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.32291.log.gz 2026-02-12T04:07:23.531 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29918.log 2026-02-12T04:07:23.531 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.25809.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.25479.log.gz 2026-02-12T04:07:23.531 INFO:teuthology.orchestra.run.trial154.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.30852.log.gz 2026-02-12T04:07:23.531 INFO:teuthology.orchestra.run.trial154.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.25809.log.gz 2026-02-12T04:07:23.531 INFO:teuthology.orchestra.run.trial154.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.30261.log.gz 2026-02-12T04:07:23.531 INFO:teuthology.orchestra.run.trial154.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.32162.log.gz 2026-02-12T04:07:23.531 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30616.log 2026-02-12T04:07:23.531 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.29918.log: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.30481.log.gz 2026-02-12T04:07:23.531 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30800.log 2026-02-12T04:07:23.531 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.30616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25327.log 2026-02-12T04:07:23.531 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.30800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30026.log 2026-02-12T04:07:23.531 INFO:teuthology.orchestra.run.trial154.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.29879.log.gz 2026-02-12T04:07:23.531 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.25327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25574.log 2026-02-12T04:07:23.531 INFO:teuthology.orchestra.run.trial154.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.25327.log.gz 2026-02-12T04:07:23.531 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30253.log 2026-02-12T04:07:23.532 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.30026.log: /var/log/ceph/ceph-client.admin.25574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32294.log 2026-02-12T04:07:23.532 INFO:teuthology.orchestra.run.trial154.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.30616.log.gz 2026-02-12T04:07:23.532 INFO:teuthology.orchestra.run.trial154.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.25574.log.gz 2026-02-12T04:07:23.532 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.30253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30146.log 2026-02-12T04:07:23.532 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.32294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25997.log 2026-02-12T04:07:23.534 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43665.log 2026-02-12T04:07:23.534 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.30146.log: /var/log/ceph/ceph-client.admin.25997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39335.log 2026-02-12T04:07:23.534 INFO:teuthology.orchestra.run.trial154.stderr: 87.1% 90.9% -- replaced with /var/log/ceph/ceph-client.admin.25997.log.gz 2026-02-12T04:07:23.534 INFO:teuthology.orchestra.run.trial154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29918.log.gz 2026-02-12T04:07:23.534 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.43665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30523.log 2026-02-12T04:07:23.534 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.39335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30664.log 2026-02-12T04:07:23.534 INFO:teuthology.orchestra.run.trial154.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.30026.log.gz 2026-02-12T04:07:23.534 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.30523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30702.log 2026-02-12T04:07:23.534 INFO:teuthology.orchestra.run.trial154.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.30253.log.gz 2026-02-12T04:07:23.534 INFO:teuthology.orchestra.run.trial154.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.30523.log.gz 2026-02-12T04:07:23.534 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.30664.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.32294.log.gz 2026-02-12T04:07:23.535 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-12T04:07:23.535 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.30702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43666.log 2026-02-12T04:07:23.535 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29898.log 2026-02-12T04:07:23.535 INFO:teuthology.orchestra.run.trial154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.43665.log.gz 2026-02-12T04:07:23.535 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.43666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32295.log 2026-02-12T04:07:23.535 INFO:teuthology.orchestra.run.trial154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.39335.log.gz 2026-02-12T04:07:23.535 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.29898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30878.log 2026-02-12T04:07:23.535 INFO:teuthology.orchestra.run.trial154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.30664.log.gz 2026-02-12T04:07:23.535 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.32295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43667.log 2026-02-12T04:07:23.535 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30000.log 2026-02-12T04:07:23.535 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.30878.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.32295.log.gz 2026-02-12T04:07:23.535 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.43667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25856.log 2026-02-12T04:07:23.535 INFO:teuthology.orchestra.run.trial154.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.43666.log.gz 2026-02-12T04:07:23.535 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.30000.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.30146.log.gz 2026-02-12T04:07:23.535 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30361.log 2026-02-12T04:07:23.535 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.25856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34640.log 2026-02-12T04:07:23.535 INFO:teuthology.orchestra.run.trial154.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.25856.log.gz 2026-02-12T04:07:23.535 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.30361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30189.log 2026-02-12T04:07:23.535 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.34640.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.43667.log.gz 2026-02-12T04:07:23.535 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30168.log 2026-02-12T04:07:23.535 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.30189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25903.log 2026-02-12T04:07:23.535 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32292.log 2026-02-12T04:07:23.535 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.30168.log: /var/log/ceph/ceph-client.admin.25903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30280.log 2026-02-12T04:07:23.535 INFO:teuthology.orchestra.run.trial154.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.25903.log.gz 2026-02-12T04:07:23.535 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.32292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39336.log 2026-02-12T04:07:23.536 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.30280.log: 90.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30917.log 2026-02-12T04:07:23.536 INFO:teuthology.orchestra.run.trial154.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.32292.log.gz 2026-02-12T04:07:23.536 INFO:teuthology.orchestra.run.trial154.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30000.log.gz 2026-02-12T04:07:23.536 INFO:teuthology.orchestra.run.trial154.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.34640.log.gz 2026-02-12T04:07:23.536 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.39336.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.15.log 2026-02-12T04:07:23.536 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-client.admin.30917.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.30189.log.gz 2026-02-12T04:07:23.536 INFO:teuthology.orchestra.run.trial154.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-12T04:07:23.536 INFO:teuthology.orchestra.run.trial154.stderr:/var/log/ceph/ceph-osd.15.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.30702.log.gz 2026-02-12T04:07:23.536 INFO:teuthology.orchestra.run.trial154.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.30361.log.gz 2026-02-12T04:07:23.537 INFO:teuthology.orchestra.run.trial091.stderr: 89.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2026-02-12T04:07:23.537 INFO:teuthology.orchestra.run.trial154.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.39336.log.gz 2026-02-12T04:07:23.538 INFO:teuthology.orchestra.run.trial154.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.30917.log.gz 2026-02-12T04:07:23.538 INFO:teuthology.orchestra.run.trial154.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.30766.log.gz 2026-02-12T04:07:23.538 INFO:teuthology.orchestra.run.trial154.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.30168.log.gz 2026-02-12T04:07:23.539 INFO:teuthology.orchestra.run.trial154.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.30280.log.gz 2026-02-12T04:07:23.539 INFO:teuthology.orchestra.run.trial154.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.30800.log.gz 2026-02-12T04:07:23.540 INFO:teuthology.orchestra.run.trial154.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.30878.log.gz 2026-02-12T04:07:23.543 INFO:teuthology.orchestra.run.trial154.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.30457.log.gz 2026-02-12T04:07:23.545 INFO:teuthology.orchestra.run.trial154.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.30922.log.gz 2026-02-12T04:07:23.552 INFO:teuthology.orchestra.run.trial154.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.29979.log.gz 2026-02-12T04:07:23.558 INFO:teuthology.orchestra.run.trial154.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.30087.log.gz 2026-02-12T04:07:23.563 INFO:teuthology.orchestra.run.trial154.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.29898.log.gz 2026-02-12T04:07:23.570 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2026-02-12T04:07:23.986 INFO:teuthology.orchestra.run.trial154.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.30059.log.gz 2026-02-12T04:07:24.091 INFO:teuthology.orchestra.run.trial098.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2026-02-12T04:07:24.135 INFO:teuthology.orchestra.run.trial111.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2026-02-12T04:07:24.195 INFO:teuthology.orchestra.run.trial098.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2026-02-12T04:07:24.195 INFO:teuthology.orchestra.run.trial098.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-12T04:07:24.208 INFO:teuthology.orchestra.run.trial098.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.9.log.gz 2026-02-12T04:07:24.210 INFO:teuthology.orchestra.run.trial091.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.8.log.gz 2026-02-12T04:07:24.239 INFO:teuthology.orchestra.run.trial111.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-12T04:07:24.249 INFO:teuthology.orchestra.run.trial098.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.13.log.gz 2026-02-12T04:07:24.251 INFO:teuthology.orchestra.run.trial098.stderr: 2026-02-12T04:07:24.251 INFO:teuthology.orchestra.run.trial098.stderr:real 0m0.791s 2026-02-12T04:07:24.252 INFO:teuthology.orchestra.run.trial098.stderr:user 0m3.442s 2026-02-12T04:07:24.252 INFO:teuthology.orchestra.run.trial098.stderr:sys 0m0.166s 2026-02-12T04:07:24.254 INFO:teuthology.orchestra.run.trial091.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2026-02-12T04:07:24.254 INFO:teuthology.orchestra.run.trial111.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2026-02-12T04:07:24.266 INFO:teuthology.orchestra.run.trial091.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.12.log.gz 2026-02-12T04:07:24.276 INFO:teuthology.orchestra.run.trial091.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-12T04:07:24.285 INFO:teuthology.orchestra.run.trial154.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-12T04:07:24.306 INFO:teuthology.orchestra.run.trial111.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.14.log.gz 2026-02-12T04:07:24.324 INFO:teuthology.orchestra.run.trial154.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.15.log.gz 2026-02-12T04:07:24.329 INFO:teuthology.orchestra.run.trial154.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2026-02-12T04:07:24.367 INFO:teuthology.orchestra.run.trial111.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.10.log.gz 2026-02-12T04:07:24.369 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T04:07:24.369 INFO:teuthology.orchestra.run.trial111.stderr:real 0m0.896s 2026-02-12T04:07:24.369 INFO:teuthology.orchestra.run.trial111.stderr:user 0m3.721s 2026-02-12T04:07:24.369 INFO:teuthology.orchestra.run.trial111.stderr:sys 0m0.192s 2026-02-12T04:07:24.375 INFO:teuthology.orchestra.run.trial154.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.11.log.gz 2026-02-12T04:07:24.377 INFO:teuthology.orchestra.run.trial154.stderr: 2026-02-12T04:07:24.378 INFO:teuthology.orchestra.run.trial154.stderr:real 0m0.875s 2026-02-12T04:07:24.378 INFO:teuthology.orchestra.run.trial154.stderr:user 0m3.835s 2026-02-12T04:07:24.378 INFO:teuthology.orchestra.run.trial154.stderr:sys 0m0.247s 2026-02-12T04:07:24.507 INFO:teuthology.orchestra.run.trial091.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-12T04:07:24.508 INFO:teuthology.orchestra.run.trial091.stderr: 2026-02-12T04:07:24.508 INFO:teuthology.orchestra.run.trial091.stderr:real 0m1.051s 2026-02-12T04:07:24.508 INFO:teuthology.orchestra.run.trial091.stderr:user 0m4.031s 2026-02-12T04:07:24.508 INFO:teuthology.orchestra.run.trial091.stderr:sys 0m0.256s 2026-02-12T04:07:24.510 INFO:tasks.ceph:Archiving logs... 2026-02-12T04:07:24.510 DEBUG:teuthology.misc:Transferring archived files from trial091:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-11_20:27:55-rados-wip-yuri3-testing-2026-02-09-1550-tentacle-distro-default-trial/45766/remote/trial091/log 2026-02-12T04:07:24.511 DEBUG:teuthology.orchestra.run.trial091:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-12T04:07:25.030 DEBUG:teuthology.misc:Transferring archived files from trial098:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-11_20:27:55-rados-wip-yuri3-testing-2026-02-09-1550-tentacle-distro-default-trial/45766/remote/trial098/log 2026-02-12T04:07:25.030 DEBUG:teuthology.orchestra.run.trial098:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-12T04:07:25.351 DEBUG:teuthology.misc:Transferring archived files from trial111:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-11_20:27:55-rados-wip-yuri3-testing-2026-02-09-1550-tentacle-distro-default-trial/45766/remote/trial111/log 2026-02-12T04:07:25.353 DEBUG:teuthology.orchestra.run.trial111:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-12T04:07:25.685 DEBUG:teuthology.misc:Transferring archived files from trial154:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-11_20:27:55-rados-wip-yuri3-testing-2026-02-09-1550-tentacle-distro-default-trial/45766/remote/trial154/log 2026-02-12T04:07:25.686 DEBUG:teuthology.orchestra.run.trial154:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-12T04:07:26.051 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-12T04:07:26.068 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-12T04:07:26.068 DEBUG:teuthology.orchestra.run.trial091:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-12T04:07:26.070 DEBUG:teuthology.orchestra.run.trial098:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-12T04:07:26.072 DEBUG:teuthology.orchestra.run.trial111:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-12T04:07:26.073 DEBUG:teuthology.orchestra.run.trial154:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-12T04:07:26.329 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-12T04:07:26.364 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-12T04:07:26.364 DEBUG:teuthology.orchestra.run.trial091:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T04:07:26.365 DEBUG:teuthology.orchestra.run.trial098:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T04:07:26.367 DEBUG:teuthology.orchestra.run.trial111:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T04:07:26.369 DEBUG:teuthology.orchestra.run.trial154:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T04:07:26.380 INFO:teuthology.orchestra.run.trial091.stderr:bash: line 1: ntpq: command not found 2026-02-12T04:07:26.381 INFO:teuthology.orchestra.run.trial098.stderr:bash: line 1: ntpq: command not found 2026-02-12T04:07:26.383 INFO:teuthology.orchestra.run.trial111.stderr:bash: line 1: ntpq: command not found 2026-02-12T04:07:26.385 INFO:teuthology.orchestra.run.trial154.stderr:bash: line 1: ntpq: command not found 2026-02-12T04:07:26.400 INFO:teuthology.orchestra.run.trial111.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T04:07:26.400 INFO:teuthology.orchestra.run.trial111.stdout:=============================================================================== 2026-02-12T04:07:26.400 INFO:teuthology.orchestra.run.trial111.stdout:^- kjsl-fmt2-net.fmt2.kjsl.> 2 6 377 119 +300us[ +300us] +/- 34ms 2026-02-12T04:07:26.400 INFO:teuthology.orchestra.run.trial111.stdout:^* pool-96-231-54-40.washdc> 1 7 275 120 +349us[ +298us] +/- 6376us 2026-02-12T04:07:26.400 INFO:teuthology.orchestra.run.trial111.stdout:^+ 107-172-222-7-host.coloc> 2 6 377 53 -1029us[-1029us] +/- 14ms 2026-02-12T04:07:26.400 INFO:teuthology.orchestra.run.trial111.stdout:^- 66.42.71.197.vultruserco> 3 6 377 51 -1791us[-1791us] +/- 44ms 2026-02-12T04:07:26.400 INFO:teuthology.orchestra.run.trial098.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T04:07:26.400 INFO:teuthology.orchestra.run.trial098.stdout:=============================================================================== 2026-02-12T04:07:26.400 INFO:teuthology.orchestra.run.trial098.stdout:^- kjsl-fmt2-net.fmt2.kjsl.> 2 7 377 119 +1185us[+1279us] +/- 35ms 2026-02-12T04:07:26.401 INFO:teuthology.orchestra.run.trial098.stdout:^* pool-96-231-54-40.washdc> 1 7 377 118 +832us[ +925us] +/- 6532us 2026-02-12T04:07:26.401 INFO:teuthology.orchestra.run.trial098.stdout:^+ 107-172-222-7-host.coloc> 2 6 377 54 -1027us[-1027us] +/- 14ms 2026-02-12T04:07:26.401 INFO:teuthology.orchestra.run.trial098.stdout:^- 66.42.71.197.vultruserco> 3 7 377 117 -1929us[-1929us] +/- 44ms 2026-02-12T04:07:26.401 INFO:teuthology.orchestra.run.trial091.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T04:07:26.401 INFO:teuthology.orchestra.run.trial091.stdout:=============================================================================== 2026-02-12T04:07:26.401 INFO:teuthology.orchestra.run.trial091.stdout:^- kjsl-fmt2-net.fmt2.kjsl.> 2 6 377 55 +76us[ +96us] +/- 34ms 2026-02-12T04:07:26.401 INFO:teuthology.orchestra.run.trial091.stdout:^* pool-96-231-54-40.washdc> 1 7 377 54 -402us[ -382us] +/- 7362us 2026-02-12T04:07:26.401 INFO:teuthology.orchestra.run.trial091.stdout:^+ 107-172-222-7-host.coloc> 2 6 377 56 -1163us[-1143us] +/- 14ms 2026-02-12T04:07:26.401 INFO:teuthology.orchestra.run.trial091.stdout:^- 66.42.71.197.vultruserco> 3 7 377 186 -1955us[-1952us] +/- 44ms 2026-02-12T04:07:26.402 INFO:teuthology.orchestra.run.trial154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T04:07:26.402 INFO:teuthology.orchestra.run.trial154.stdout:=============================================================================== 2026-02-12T04:07:26.402 INFO:teuthology.orchestra.run.trial154.stdout:^- kjsl-fmt2-net.fmt2.kjsl.> 2 6 377 56 +429us[ +429us] +/- 34ms 2026-02-12T04:07:26.402 INFO:teuthology.orchestra.run.trial154.stdout:^* pool-96-231-54-40.washdc> 1 7 377 121 +901us[ +964us] +/- 6483us 2026-02-12T04:07:26.402 INFO:teuthology.orchestra.run.trial154.stdout:^+ 107-172-222-7-host.coloc> 2 6 377 54 -875us[ -875us] +/- 14ms 2026-02-12T04:07:26.402 INFO:teuthology.orchestra.run.trial154.stdout:^- 66.42.71.197.vultruserco> 3 6 377 55 -1699us[-1699us] +/- 44ms 2026-02-12T04:07:26.403 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-12T04:07:26.417 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-12T04:07:26.417 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-12T04:07:26.433 DEBUG:teuthology.orchestra.run.trial091:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-12T04:07:26.487 DEBUG:teuthology.orchestra.run.trial098:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-12T04:07:26.530 DEBUG:teuthology.orchestra.run.trial111:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-12T04:07:26.573 DEBUG:teuthology.orchestra.run.trial154:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-12T04:07:26.615 DEBUG:teuthology.orchestra.run.trial091:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-12T04:07:26.642 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T04:07:26.642 DEBUG:teuthology.orchestra.run.trial098:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-12T04:07:26.669 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T04:07:26.670 DEBUG:teuthology.orchestra.run.trial111:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-12T04:07:26.696 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T04:07:26.697 DEBUG:teuthology.orchestra.run.trial154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-12T04:07:26.722 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T04:07:26.723 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-12T04:07:26.738 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-12T04:07:26.754 INFO:teuthology.task.internal:Duration was 1304.037049 seconds 2026-02-12T04:07:26.754 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-12T04:07:26.769 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-12T04:07:26.769 DEBUG:teuthology.orchestra.run.trial091:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-12T04:07:26.772 DEBUG:teuthology.orchestra.run.trial098:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-12T04:07:26.775 DEBUG:teuthology.orchestra.run.trial111:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-12T04:07:26.778 DEBUG:teuthology.orchestra.run.trial154:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-12T04:07:26.807 INFO:teuthology.orchestra.run.trial091.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T04:07:26.810 INFO:teuthology.orchestra.run.trial098.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T04:07:26.813 INFO:teuthology.orchestra.run.trial111.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T04:07:26.815 INFO:teuthology.orchestra.run.trial154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T04:07:27.317 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-12T04:07:27.318 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial091.front.sepia.ceph.com 2026-02-12T04:07:27.318 DEBUG:teuthology.orchestra.run.trial091:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-12T04:07:27.376 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial098.front.sepia.ceph.com 2026-02-12T04:07:27.377 DEBUG:teuthology.orchestra.run.trial098:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-12T04:07:27.397 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial111.front.sepia.ceph.com 2026-02-12T04:07:27.398 DEBUG:teuthology.orchestra.run.trial111:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-12T04:07:27.418 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial154.front.sepia.ceph.com 2026-02-12T04:07:27.419 DEBUG:teuthology.orchestra.run.trial154:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-12T04:07:27.439 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-12T04:07:27.439 DEBUG:teuthology.orchestra.run.trial091:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T04:07:27.442 DEBUG:teuthology.orchestra.run.trial098:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T04:07:27.445 DEBUG:teuthology.orchestra.run.trial111:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T04:07:27.460 DEBUG:teuthology.orchestra.run.trial154:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T04:07:27.521 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-12T04:07:27.522 DEBUG:teuthology.orchestra.run.trial091:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T04:07:27.524 DEBUG:teuthology.orchestra.run.trial098:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T04:07:27.527 DEBUG:teuthology.orchestra.run.trial111:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T04:07:27.542 DEBUG:teuthology.orchestra.run.trial154:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T04:07:27.545 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T04:07:27.546 INFO:teuthology.orchestra.run.trial091.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T04:07:27.547 INFO:teuthology.orchestra.run.trial091.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T04:07:27.547 INFO:teuthology.orchestra.run.trial091.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-12T04:07:27.547 INFO:teuthology.orchestra.run.trial091.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-12T04:07:27.549 INFO:teuthology.orchestra.run.trial098.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T04:07:27.550 INFO:teuthology.orchestra.run.trial098.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T04:07:27.550 INFO:teuthology.orchestra.run.trial098.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-12T04:07:27.550 INFO:teuthology.orchestra.run.trial098.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T04:07:27.550 INFO:teuthology.orchestra.run.trial098.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-12T04:07:27.551 INFO:teuthology.orchestra.run.trial091.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 89.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-12T04:07:27.553 INFO:teuthology.orchestra.run.trial098.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 88.2% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-12T04:07:27.563 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T04:07:27.565 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T04:07:27.565 INFO:teuthology.orchestra.run.trial111.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-12T04:07:27.565 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T04:07:27.566 INFO:teuthology.orchestra.run.trial111.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-12T04:07:27.568 INFO:teuthology.orchestra.run.trial111.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 88.4% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-12T04:07:27.585 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T04:07:27.586 INFO:teuthology.orchestra.run.trial154.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T04:07:27.586 INFO:teuthology.orchestra.run.trial154.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T04:07:27.586 INFO:teuthology.orchestra.run.trial154.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-12T04:07:27.587 INFO:teuthology.orchestra.run.trial154.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-12T04:07:27.590 INFO:teuthology.orchestra.run.trial154.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 88.2% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-12T04:07:27.592 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-12T04:07:27.609 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-12T04:07:27.609 DEBUG:teuthology.orchestra.run.trial091:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-12T04:07:27.633 DEBUG:teuthology.orchestra.run.trial098:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-12T04:07:27.659 DEBUG:teuthology.orchestra.run.trial111:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-12T04:07:27.684 DEBUG:teuthology.orchestra.run.trial154:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-12T04:07:27.710 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-12T04:07:27.727 DEBUG:teuthology.orchestra.run.trial091:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-12T04:07:27.730 DEBUG:teuthology.orchestra.run.trial098:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-12T04:07:27.733 DEBUG:teuthology.orchestra.run.trial111:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-12T04:07:27.735 DEBUG:teuthology.orchestra.run.trial154:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-12T04:07:27.753 INFO:teuthology.orchestra.run.trial091.stdout:kernel.core_pattern = core 2026-02-12T04:07:27.755 INFO:teuthology.orchestra.run.trial098.stdout:kernel.core_pattern = core 2026-02-12T04:07:27.757 INFO:teuthology.orchestra.run.trial111.stdout:kernel.core_pattern = core 2026-02-12T04:07:27.774 INFO:teuthology.orchestra.run.trial154.stdout:kernel.core_pattern = core 2026-02-12T04:07:27.788 DEBUG:teuthology.orchestra.run.trial091:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-12T04:07:27.825 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T04:07:27.826 DEBUG:teuthology.orchestra.run.trial098:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-12T04:07:27.841 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T04:07:27.842 DEBUG:teuthology.orchestra.run.trial111:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-12T04:07:27.859 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T04:07:27.859 DEBUG:teuthology.orchestra.run.trial154:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-12T04:07:27.876 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T04:07:27.877 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-12T04:07:27.893 INFO:teuthology.task.internal:Transferring archived files... 2026-02-12T04:07:27.894 DEBUG:teuthology.misc:Transferring archived files from trial091:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-11_20:27:55-rados-wip-yuri3-testing-2026-02-09-1550-tentacle-distro-default-trial/45766/remote/trial091 2026-02-12T04:07:27.894 DEBUG:teuthology.orchestra.run.trial091:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-12T04:07:27.928 DEBUG:teuthology.misc:Transferring archived files from trial098:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-11_20:27:55-rados-wip-yuri3-testing-2026-02-09-1550-tentacle-distro-default-trial/45766/remote/trial098 2026-02-12T04:07:27.928 DEBUG:teuthology.orchestra.run.trial098:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-12T04:07:27.961 DEBUG:teuthology.misc:Transferring archived files from trial111:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-11_20:27:55-rados-wip-yuri3-testing-2026-02-09-1550-tentacle-distro-default-trial/45766/remote/trial111 2026-02-12T04:07:27.962 DEBUG:teuthology.orchestra.run.trial111:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-12T04:07:27.996 DEBUG:teuthology.misc:Transferring archived files from trial154:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-11_20:27:55-rados-wip-yuri3-testing-2026-02-09-1550-tentacle-distro-default-trial/45766/remote/trial154 2026-02-12T04:07:27.996 DEBUG:teuthology.orchestra.run.trial154:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-12T04:07:28.046 INFO:teuthology.task.internal:Removing archive directory... 2026-02-12T04:07:28.046 DEBUG:teuthology.orchestra.run.trial091:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-12T04:07:28.049 DEBUG:teuthology.orchestra.run.trial098:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-12T04:07:28.052 DEBUG:teuthology.orchestra.run.trial111:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-12T04:07:28.055 DEBUG:teuthology.orchestra.run.trial154:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-12T04:07:28.080 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-12T04:07:28.101 INFO:teuthology.task.internal:Not uploading archives. 2026-02-12T04:07:28.101 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-12T04:07:28.117 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-12T04:07:28.118 DEBUG:teuthology.orchestra.run.trial091:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-12T04:07:28.120 DEBUG:teuthology.orchestra.run.trial098:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-12T04:07:28.123 DEBUG:teuthology.orchestra.run.trial111:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-12T04:07:28.125 DEBUG:teuthology.orchestra.run.trial154:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-12T04:07:28.134 INFO:teuthology.orchestra.run.trial091.stdout: 786525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 12 04:07 /home/ubuntu/cephtest 2026-02-12T04:07:28.136 INFO:teuthology.orchestra.run.trial098.stdout: 786525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 12 04:07 /home/ubuntu/cephtest 2026-02-12T04:07:28.140 INFO:teuthology.orchestra.run.trial111.stdout: 786461 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 12 04:07 /home/ubuntu/cephtest 2026-02-12T04:07:28.142 INFO:teuthology.orchestra.run.trial154.stdout: 786525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 12 04:07 /home/ubuntu/cephtest 2026-02-12T04:07:28.143 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-12T04:07:28.160 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-12T04:07:28.199 INFO:teuthology.run:Summary data: description: rados/verify/{centos_latest ceph clusters/fixed-4 d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/{bluestore/{alloc$/{btree} base mem$/{normal-2} onode-segment$/{512K} write$/{v2/{compr$/{yes$/{zstd}} v2}}}} rados read-affinity/balance tasks/rados_api_tests validater/valgrind} duration: 1304.0370490550995 flavor: default owner: scheduled_yuriw@soko04.front.sepia.ceph.com success: true 2026-02-12T04:07:28.199 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T04:07:28.327 INFO:teuthology.run:pass